Published 3/2023
Created by Sourabh Sahu
MP4 | Video: h264, 1280×720 | Audio: AAC, 44.1 KHz, 2 Ch
Genre: eLearning | Language: English | Duration: 13 Lectures ( 12h 28m ) | Size: 7.1 GB
A Comprehensive Guide to Apache Airflow: Learn Workflow Management from Beginner to Expert
What you’ll learn
Learn Orchestration and Workflow Management
How to create Data Pipelines
Cloud Integrations and Data Migration
End to End Data Pipeline with real use case
Requirements
Basic Python Knowledge
Description
Apache Airflow is an open-source platform used for workflow automation, scheduling, and orchestration of complex data pipelines. As data volumes and complexity continue to grow, the need for efficient and scalable data processing and management is critical. In this comprehensive course, you will learn how to master Apache Airflow, starting from the basics and progressing to advanced concepts.The course is designed for data engineers, data scientists, python developers, software engineers, and anyone interested in learning how to automate and manage data workflows. You will learn how to use Apache Airflow to build and manage data pipelines, schedule, and trigger tasks, monitor and troubleshoot workflows, and integrate with various data sources and services.The course will cover the following topics:Introduction to Apache Airflow and workflow managementIntroduction to Docker and Docker CommandsInstallation and configuration of Apache AirflowBuilding and managing workflows with Apache AirflowScheduling and triggering tasks in Apache AirflowOperators in Apache AirflowFetching data from Web APIs or HTTPFile Sensors in Apache AirflowConnecting with Azure or AWSUsing AWS S3 Bucket and Azure Blob Storage to store and retrieve dataCreating custom operators and sensorsHandling dependencies and task retriesMonitoring and troubleshooting workflowsIntegrating with data sources and servicesScaling and optimizing Apache Airflow for large-scale data processing using Celery ExecutorsSecuring Dags Connections using Fernet KeysThroughout the course, you will work on practical exercises and projects to apply the concepts you learn. By the end of the course, you will have a strong understanding of Apache Airflow and the skills to build and manage complex data workflows.
Password/解压密码www.tbtos.com
转载请注明：0daytown » Master Airflow: Beginner to Advance with Project