Designing Data Flows in Azure
Data Flow Basics
Designing a Data Flow Solution
The course is part of this learning path
This Designing Data Flows in Azure course will enable you to implement the best practices for data flows in your own team. Starting from the basics, you will learn how data flows work from beginning to end. Though we do recommend an idea of what data flows are and how they are used, this course contains some demonstration lectures to really make sure you have got to grips with the concept. By better understanding the key components available in Azure to design and deploy efficient data flows, you will be allowing your organization to reap the benefits.
This course is made up of 19 comprehensive lectures including an overview, demonstrations, and a conclusion.
- Review the features, concepts, and requirements that are necessary for designing data flows
- Learn the basic principles of data flows and common data flow scenarios
- Understand how to implement data flows within Microsoft Azure
- IT professionals who are interested in obtaining an Azure certification
- Those looking to implement data flows within their organizations
- A basic understanding of data flows and their uses
Related Training Content
For more training content related to this course, visit our dedicated MS Azure Content Training Library.
To create an Azure Data Lake Storage Gen2-enabled storage account, you're going to need a resource group that's going to act as the logical container for your storage account or any of your other Azure resources. I've already created a resource group called AzureCourse here. To take advantage of Data Lake Storage Gen2 features, we're going to need to create a storage account as a StorageV2 type. Essentially, it's a general-purpose V2 storage account. When we name our storage account, we need to make sure that the name is between three and 24 characters, and it's gotta be unique across the entire Azure landscape. So as you can see here, I'm in my resource group that I provisioned earlier, and what we're going to do is deploy our Azure Data Lake Storage Gen2-enabled storage account within this resource group. To create our new Data Lake Gen2-enabled storage account, we simply click Add up here at the top to create a new resource, and then, we search for storage accounts. After selecting the Storage account option in the list of results, we have to deploy an actual storage account. Don't be tempted to select the Data Lake option because as you can see here, this Data Lake option is for Gen1.
We're deploying a Gen2-enabled storage account, so we'll go ahead and click to deploy a storage account. After selecting the Storage account option, we can simply go ahead and click Create to begin the deployment of the storage account. We need to select the Subscription and Resource group that we're going to deploy our new storage account to. In this demonstration, we're going to deploy to our Pay-As-You-Go subscription, and in our AzureCourse resource group that we deployed earlier. I'm going to give my storage account a unique name here. Again, this needs to be unique across the entire Azure landscape, and for this demonstration, I'm going to deploy to the West US 2 location. When deploying our storage account, that's going to be Data Lake Storage Gen2-enabled, we can leave Performance, Account kind, Replication, and Access tier options at their default values. We just want to ensure that we have the right subscription selected, and then, we can click Next: Advanced. We can leave the values under Security and Virtual Networks set to their default options, but in the Data Lake Storage Gen2 Preview section, we need to turn on Hierarchical namespace by setting it to Enabled. After doing so, we simply click Review and create to create the new storage account. When it completes, the new Data Lake Storage Gen2-enabled storage account is now provisioned.
About the Author
Tom is a 25+ year veteran of the IT industry, having worked in environments as large as 40k seats and as small as 50 seats. Throughout the course of a long an interesting career, he has built an in-depth skillset that spans numerous IT disciplines. Tom has designed and architected small, large, and global IT solutions.
In addition to the Cloud Platform and Infrastructure MCSE certification, Tom also carries several other Microsoft certifications. His ability to see things from a strategic perspective allows Tom to architect solutions that closely align with business needs.
In his spare time, Tom enjoys camping, fishing, and playing poker.