CloudAcademy

Getting Started with Amazon Elastic MapReduce

The hands-on lab is part of this learning path

Big Data – Specialty Certification Preparation for AWS

course-steps 14 lab-steps 5 quiz-steps 3

Lab Steps

keyboard_tab
lock
Logging in to the Amazon Web Services Console
lock
Creating an S3 Bucket for EMR
lock
Creating an EMR Cluster
lock
Adding a Step to your running Cluster
lock
Viewing the EMR Cluster and Step Results
lock
Terminating and Cloning a Cluster
lock
Adding a new Step for a Cloned EMR Cluster to Process

Ready for the real environment experience?

DifficultyIntermediate
Duration1h 30m
Students226

Description

Get started with Amazon Elastic MapReduce (EMR) and learn the fundamentals of EMR

Lab Overview

Amazon Elastic MapReduce (Amazon EMR) makes it easy to process vast amounts of data in a variety of applications, including log analysis, web indexing, data warehousing, machine learning, financial analysis, scientific simulation, and bioinformatics. Amazon EMR uses Hadoop, an open source framework, to distribute raw data and processing across a resizable cluster of Amazon EC2 instances.

Hadoop uses a distributed processing architecture called MapReduce in which a task is mapped to a set of servers for processing. The results of the computation performed by those servers is then reduced down to a single output set. 

A high level view of the EMR workflow is as follows:

  1. Load the input dataset
  2. Execute a Map-Reduce job
  3. Store the job results in HDFS
  4. View the job results from HDFS

The focus of this lab is configuring and launching an EMR cluster. You will be provided with sample input data sets and sample applications to process the data sets. Treating the application and data set as a "black box" will lift unneeded complexities and free you up to concentrate on the configuration component. Note that Amazon EMR does a massive amount of heavy lifting for you. In addition to providing security, reliability, monitoring, scalability, integration with other Amazon services and the potential for cost savings, Amazon tackles the deployment as well. For example, Amazon will configure the instances in your cluster with all the necessary software and versions of the software to process the tasks you submit.

Lab Objectives

Upon completion of this lab you will be able to:

  • Explain the key features and benefits of Amazon EMR
  • Configure and launch a cluster in two different launch modes
  • Submit tasks for your cluster to process
  • Check the status of your cluster and the tasks it processes
  • Terminate, clone, reconfigure and launch a cluster
  • Clone a job for your cluster to process
  • View logs and results

Lab Prerequisites

You should be familiar with:

  • Amazon Management Console
  • Amazon Simple Storage Service (S3)
  • Amazon Elastic Compute Cloud (EC2)
  • Big Data concepts

Lab Environment

After completing the lab instructions the environment should look similar to:

About the Author

Students14926
Labs14

Greg has been a consistent high performer for pioneering technologies in the wireless web industries with an illustrious career that is a testament to his breadth of knowledge. Dabbling with MS Azure, at Cloud Academy, Greg really thrives on evangelizing the benefits of Amazon Web Services. A dedicated and passionate professional who learns new and emerging technologies quickly, Greg always ensures the highest quality and caliber of everything he produces.