image
hands-on labExporting Amazon CloudWatch Logs to Amazon S3 Using Kinesis
Beginner
1h
140
4.3/5
Get guided in a real environmentPractice with a step-by-step scenario in a real, provisioned environment.
Learn and validateUse validations to check your solutions every step of the way.
See resultsTrack your knowledge and monitor your progress.
Lab steps
Logging In to the Amazon Web Services Console
Creating a Amazon Kinesis Firehose Delivery Stream
Sending CloudWatch Logs to Your Delivery Stream
Securing Your Centralized Logs
Lab description

Amazon Kinesis Data Firehose is a streaming Extract, Transform, and Load (ETL) service from AWS. It's fully-managed, and once configured it scales to match your data throughput with no on-going administration.

Combining Amazon Kinesis Data Firehose with Amazon CloudWatch Logs and Amazon S3 allows you to build a solution that is capable of centralizing logs across many AWS accounts.

This can have the following benefits for your organization:

  • Make long term data management easier
  • Help to secure your data
  • Help to meet regulatory or compliance requirements

In this lab, you will create a Kinesis Data Firehose Delivery Stream and use it to centralize logs from Amazon CloudWatch.

Learning Objectives

Upon completion of this beginner level lab, you will be able to:

  • Create a Firehose Delivery Stream
  • Subscribe a CloudWatch log group to your delivery stream
  • Modify an Amazon S3 bucket to it more secure

Intended Audience

  • Candidates for the AWS Certified DevOps Engineer - Professional certification
  • DevOps Engineers
  • Cloud Architects
  • Data Engineers
  • Software Engineers

Prerequisites

Familiarity with the following will be beneficial but is not required:

  • Kinesis Data Firehose
  • Amazon CloudWatch Logs
  • Amazon Simple Storage Service (S3)

The following content can be used to fulfill the prerequisite:

Environment before
environment before preview
Environment after
environment after preview
About the author
Avatar
Andrew Burchill
Labs Developer
Students
57422
Labs
143
Courses
2
Learning Paths
3

Andrew is a Labs Developer with previous experience in the Internet Service Provider, Audio Streaming, and CryptoCurrency industries. He has also been a DevOps Engineer and enjoys working with CI/CD and Kubernetes.

He holds multiple AWS certifications including Solutions Architect Associate and Professional.

Covered topics