hands-on lab

Monitor Azure Data Factory using Azure Monitor

Intermediate
1h
1,217
3.9/5
Get guided in a real environmentPractice with a step-by-step scenario in a real, provisioned environment.
Learn and validateUse validations to check your solutions every step of the way.
See resultsTrack your knowledge and monitor your progress.
Lab description

Azure Data Factory (ADF) is a cloud-based ETL and data integration service that allows you to create data-driven workloads for orchestrating the data movement and transforming data at scale. The capabilities of ADF include the data transformation with intelligent intent-driven mapping that automates the copy activities and allows you to prepare and construct the ETL process pipeline code-free.

In this hands-on lab, you will provision a monitoring solution for the ADF resource using Azure Log Analytics and Log solution.

Learning Objectives

Upon completion of this intermediate-level lab, you will be able to:

  • Create Azure Log Analytics workspace
  • Configure Diagnostic settings for Azure Data Factory
  • Create and review a Log Solution for the Azure Data Factory
  • Setup Monitor Alerts for Azure Data Factory

Intended Audience

  • Candidates for Data Engineer Exam (DP-203)
  • Cloud Architects
  • Data Engineers/Analysts
  • DevOps Engineers
  • Software Engineers

Prerequisites

Familiarity with the following will be beneficial but is not required:

  • Azure Data Factory
  • Azure Monitor
  • Azure Log Analytics

The following course and labs can be used to fulfill the prerequisite:

Updates

December 11th, 2023 - Updated the instructions and screenshots to reflect the latest UI

July 31st, 2023 - Updated the instructions and screenshots to reflect the latest UI

September 12th, 2022 - Updated the instructions and screenshots to reflect the latest UI

Environment before
Environment after
About the author
Avatar
Parveen Singh
Cloud Lab Developer
Students
14,291
Labs
95
Courses
1
Learning paths
3

Parveen is an Azure advocate with previous experience in the professional consulting services industries. He specializes in infrastructure and DevOps with a wide range of knowledge in security and access management. He is also an Azure Certified - DevOps Engineer Expert, Security Engineer, Developer Associate, Administrator Associate, CompTIA Certified - Network+, Security+, and AWS Cloud Practitioner.
Parveen enjoys writing about cloud technologies and sharing the knowledge with the community to help students upskill in the cloud.

Covered topics
Lab steps
Logging in to the Microsoft Azure Portal
Publishing Pipeline Triggers in Azure Data Factory
Creating Azure Log Analytics Workspace
Configuring Diagnostic Settings for Azure Data Factory
Reviewing Logs for Azure Data Factory using Data Factory Dashboard
Configuring Alerts for Data Factory Failures