hands-on lab

Exporting Amazon CloudWatch Logs to Amazon S3 Using Kinesis

Beginner
1h
188
4.5/5
Get guided in a real environmentPractice with a step-by-step scenario in a real, provisioned environment.
Learn and validateUse validations to check your solutions every step of the way.
See resultsTrack your knowledge and monitor your progress.
Lab description

Amazon Kinesis Data Firehose is a streaming Extract, Transform, and Load (ETL) service from AWS. It's fully-managed, and once configured it scales to match your data throughput with no on-going administration.

Combining Amazon Kinesis Data Firehose with Amazon CloudWatch Logs and Amazon S3 allows you to build a solution that is capable of centralizing logs across many AWS accounts.

This can have the following benefits for your organization:

  • Make long term data management easier
  • Help to secure your data
  • Help to meet regulatory or compliance requirements

In this lab, you will create a Kinesis Data Firehose Delivery Stream and use it to centralize logs from Amazon CloudWatch.

Learning Objectives

Upon completion of this beginner level lab, you will be able to:

  • Create a Firehose Delivery Stream
  • Subscribe a CloudWatch log group to your delivery stream
  • Modify an Amazon S3 bucket to it more secure

Intended Audience

  • Candidates for the AWS Certified DevOps Engineer - Professional certification
  • DevOps Engineers
  • Cloud Architects
  • Data Engineers
  • Software Engineers

Prerequisites

Familiarity with the following will be beneficial but is not required:

  • Kinesis Data Firehose
  • Amazon CloudWatch Logs
  • Amazon Simple Storage Service (S3)

The following content can be used to fulfill the prerequisite:

Environment before
Environment after
About the author
Avatar
Andrew Burchill
Labs Developer
Students
65,999
Labs
162
Courses
2
Learning paths
4

Andrew is a Labs Developer with previous experience in the Internet Service Provider, Audio Streaming, and CryptoCurrency industries. He has also been a DevOps Engineer and enjoys working with CI/CD and Kubernetes.

He holds multiple AWS certifications including Solutions Architect Associate and Professional.

Covered topics
Lab steps
Logging In to the Amazon Web Services Console
Creating a Amazon Kinesis Firehose Delivery Stream
Sending CloudWatch Logs to Your Delivery Stream
Securing Your Centralized Logs