Skip to content

derricksobrien/course-apache-airflow-programming-developing-configuring-

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 

Repository files navigation

Apache Airflow Programming: Developing, Configuring, and Automating Workflows

Vendor: Cloud Contraptions
Format: Live instructor-led
Duration: 28 hours

Overview

Learning Outcomes

  • Course details available on vendor site

Modules

  • What is Apache Airflow?
    • Distributed Task Automation
    • Compared to Cron Jobs
    • Compared to Celery
    • Scalability and Reliability
    • Directed Acyclic Graphs (DAGs)
    • Workflows as Code
    • Workflows as Code (no programming)
    • Anatomy of a DAG
    • Directed Acyclic Graphs
    • Operators
    • Tasks
    • Variables
    • XComs
    • Providers
    • Connections
    • Explore how DAG parts connect to the UI
    • DAG Serialization
    • Listeners
    • Schedulers
    • Pools
    • Installation and Configuration
    • Python Virtual Environment
    • Install Airflow
    • Airflow Constraints File
    • Standalone Mode
    • Run the Webserver and Scheduler Independently
    • SQLite vs PostgreSQL
    • Configure with PostgreSQL
    • Airflow and Kubernetes (with Minikube)
    • Airflow and AWS Elastic Kubernetes Service (EKS)
    • Airflow Helm Chart
    • Hands-On Kubernetes (K8s)
    • Containerization and Orchestration
    • Kubectl
    • Helm
    • Nodes
    • Namespaces
    • Pods, Containers, and Services
    • Connect to the Internet (EKS)
    • Keda Autoscaler
    • Pod Logs
    • SSH into Pods/Containers
    • Live Upgrading Airflow
    • Airflow Configuration
    • Airflow Configuration File Location
    • Airflow Executor Configuration
    • Airflow Log Levels
    • Helm Chart Configuration
    • Learn How to Configure Airflow and K8s Pods
    • Local Executor
    • Celery Executor
    • K8s Pod Executor
    • Airflow Custom Image
    • Airflow Container Image
    • Why Create a Custom Image?
    • Create a Custom Image
    • Install Software with Apt
    • Install Software with PyPi
    • Install Providers and Custom Software
    • Use the Custom Container Image
    • Monitoring
    • Logging
    • Log File Structure
    • Log Levels
    • Review Task Logs in the Web UI
    • External Log Storage
    • Metrics Configuration
    • Monitor with Grafana
    • Notifications
    • Download
    • Word Version
    • PDF Version
    • Reseller Version
    • We specialize in delivering computer programming training and consulting services with an emphasis on using the latest in AI technology. We are customer-friendly and employ AI best practices and teach these practices to companies around the world.
    • Learn More
    • Services
    • Courses
    • Academy
    • Contact Info
    • +1 434-945-9416
    • help@cloudcontraptions.com
    • 3378 South Amherst Hwy
    • Unit 21
    • Monroe, VA 24574
    • © 2026 Cloud Contraptions LLC. All Rights Reserved.
    • About |Contact |Privacy
    • This website uses cookies to improve your experience and analyze site traffic. By clicking "Accept", you consent to our use of cookies.
    • Accept
    • Decline

Target Audience

  • Practical experience with Python.
  • Familiarity with Containerization and Container Orchestration.
  • Basic Linux command line skills.
  • Executive Summary
  • Over three days, this course immerses participants in Apache Airflow's architecture and configuration, guiding them through setting up environments, choosing executors, and developing robust DAGs with Python. Through hands-on exercises—ranging from dynamic task mapping and templating to cloud integrations and custom plugin development—attendees will master best practices for automating, monitoring, and optimizing production-ready workflows.

Prerequisites

None specified

Source

View original course page

Source Host: www.cloudcontraptions.com


Generated on 2026-04-16 03:35:54

About

Apache Airflow Programming: Developing, Configuring, and Automating Workflows - Cloud Contraptions Course

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors