Wrap Up

Start course
Overview
Difficulty
Intermediate
Duration
15m
Students
64
Ratings
5/5
starstarstarstarstar
Description

This course delves into Amazon-managed workflows for Apache Airflow (MWAA). This is a great service for anyone already using Apache Airflow, and wanting to find a better way to deal with setting up the service, scheduling, and managing their workflow.

Learning Objectives

  • Understand how Amazon-managed workflows for Apache Airflow is implemented within AWS
  • Learn about DAGs (Directed Acyclic Graphs), which Apache Airflow uses to run your workflows
  • Understand the key components required to set up your own Managed Airflow environment

Intended Audience

This is a great service for anyone already using Apache Airflow, and wanting to find a better way to deal with setting up the service, scheduling, and managing their workflow.

Prerequisites

To get the most out of this course, you should have a decent understanding of cloud computing and cloud architectures, specifically with Amazon Web Services. You should also have some background knowledge about Apache Airflow, however, that is not a hard requirement. Basic knowledge of ELT pipelines and state machines would also be beneficial.

Transcript

If you have been running and managing apache workflows yourself, you will understand how troublesome and difficult it can be to keep everything maintained and up to date. Just getting apache workflows set up alone can be a cause of trouble for some people. 

If you are looking for a way to have the administrative burdens of apache workflows removed from your plate, and you just want to focus on creating the best workflows for your systems MWAA might be just right for you. 

Amazon has done a great job of integrating the open-source workflow management system in the AWS ecosystem - and have promised to support and work with the community to keep it alive and well.

Something to keep in mind however is that there might be a cheaper option available through the use of AWS step functions, but it offers slightly different ways of navigating workflows and systems.

Well, that's all I have for this lecture - My name is Will Meadows and I'd like to thank you for spending your time here learning about Managed Workflows for Apache Airflow.  If you have any feedback, positive or negative, please contact us at support@cloudacademy.com, your feedback is greatly appreciated, thank you!

About the Author

William Meadows is a passionately curious human currently living in the Bay Area in California. His career has included working with lasers, teaching teenagers how to code, and creating classes about cloud technology that are taught all over the world. His dedication to completing goals and helping others is what brings meaning to his life. In his free time, he enjoys reading Reddit, playing video games, and writing books.