Serverless Streaming ETL using Amazon Managed Service for Apache Flink
In this lesson, I will show you how the Amazon Managed Service for Apache Flink, formerly known as Amazon Kinesis Data Analytics, can be used to perform serverless ETL of your streaming data.
Learning Objectives
- A greater understanding of how the Amazon Managed Service for Apache Flink allows you to build and run streaming data processing applications in AWS
- Learn about the types of APIs and connectors you can use within your Flink applications
- Learn how AWS-provided blueprints can help you quickly get started when using the Amazon Managed Service for Apache Flink, to create end-to-end stream processing applications and Studio notebooks
Intended Audience
- Data engineers who want to process and analyze streaming data in AWS using Apache Flink
- Anyone who may be preparing to take an AWS certification exam such as the AWS Certified Data Engineer - Associate
Prerequisites
- You should have a basic understanding of AWS, as well as data engineering concepts such as streaming data and ETL
- It may also be useful to have some experience with Amazon Kinesis Data Streams and Amazon Managed Streaming for Apache Kafka, or MSK, both of which can interact with the Amazon Managed Service for Apache Flink
- To learn more about these services, check out our existing lessons here:
Danny has over 20 years of IT experience as a software developer, cloud engineer, and technical trainer. After attending a conference on cloud computing in 2009, he knew he wanted to build his career around what was still a very new, emerging technology at the time — and share this transformational knowledge with others. He has spoken to IT professional audiences at local, regional, and national user groups and conferences. He has delivered in-person classroom and virtual training, interactive webinars, and authored video training courses covering many different technologies, including Amazon Web Services. He currently has nine active AWS certifications, including certifications at the Professional and Specialty level.