hands-on lab

Evaluating Generative AI Models Using Amazon Bedrock

Up to 1h
Get guided in a real environmentPractice with a step-by-step scenario in a real, provisioned environment.
Learn and validateUse validations to check your solutions every step of the way.
See resultsTrack your knowledge and monitor your progress.


Amazon Bedrock is an offering from AWS that enables you to use Generative AI models as a service. When using Bedrock, you don't have to worry about the technical complexity of training, hosting, and scaling models. Instead, you can focus on integrating the models into your applications and workflows.

Learning how to use Amazon Bedrock's model evaluation feature is beneficial to anyone looking to gain confidence in the quality of the models they choose to use.

In this hands-on lab, you will configure an Amazon S3 bucket for use with Amazon Bedrock and run a model evaluation job to compare the performance of a Generative AI model.

Learning objectives

Upon completion of this beginner-level lab, you will be able to:

  • Add a CORS configuration to an Amazon S3 bucket
  • Create an Amazon Bedrock model evaluation job
  • Run an Amazon Bedrock model evaluation job and interpret the results

Intended audience

  • Anyone looking to make use of Generative AI models in the public AWS cloud
  • Cloud Architects
  • Data Engineers
  • DevOps Engineers
  • Machine Learning Engineers
  • Software Engineers


Familiarity with the following will be beneficial but is not required:

  • Amazon S3
  • Amazon Bedrock

The following content can be used to fulfill the prerequisites:

Environment before

Environment after

About the author

Learning paths

Andrew is a Labs Developer with previous experience in the Internet Service Provider, Audio Streaming, and CryptoCurrency industries. He has also been a DevOps Engineer and enjoys working with CI/CD and Kubernetes.

He holds multiple AWS certifications including Solutions Architect Associate and Professional.

Covered topics

Lab steps

Logging In to the Amazon Web Services Console
Configuring an Amazon S3 Bucket
Running a Model Evaluation Job