Submitting a U-SQL Job to Azure Data Lake Analytics

Beginner

9 students completed the lab in ~24m

Total available time: 40m

Be the first to rate this lab!

Lab Overview

Big data and analytics in Azure can help you gain insights into your data and deliver better experiences. This Lab demonstrates using two of Azure's big data services:

  1. Azure Data Lake Store for storing massive amounts of structured, semi-structured, and unstructured data, and
  2. Azure Data Lake Analytics for massively parallel analysis of data stored in Data Lake Store.

You will use Data Lake Analytics' U-SQL big data query language to transform website search logs stored in a Data Lake Store and discover which searches take longer than a threshold to complete.

Lab Objectives

Upon completion of this Lab you will be able to:

  • Store data in Azure Data Lake Stores
  • Submit jobs to Azure Data Lake Analytics
  • Understand the trade-off between cost and performance in Azure Data Lake Analytics
  • Explain basic U-SQL queries

Lab Prerequisites

You should be familiar with:

Lab Environment

Before completing the Lab instructions, the environment will look as follows:

After completing the Lab instructions, the environment should look similar to:

Follow these steps to learn by building helpful cloud resources

Logging into the Microsoft Azure portal

Begin the Lab by logging into the Microsoft Azure portal

Uploading a File to an Azure Data Lake Store

Upload a search log data file to an Data Lake Store

Submitting a U-SQL Job to Azure Data Lake Analytics

Submit a U-SQL job to Azure Data Lake Analytics to identify slow queries

Inspecting the Results of the Data Lake Analytics Job

Inspect the result and monitoring information of the Data Lake Analytics job