Moving Blobs Between Storage Containers

play-arrow
Start course
Overview
DifficultyIntermediate
Duration31m
Students83
Ratings
5/5
star star star star star

Description

Microsoft Azure Storage Accounts are cloud-based data storage repositories for a variety of data types, including blobs, queues, tables, and files. Managing the data in these accounts is often the responsibility of the application developer who uses this data. This course focuses on blob storage and the tools and methods developers can use to manage blobs in Azure Storage Accounts.

The course begins with a brief review of Azure Storage Accounts and then drills down into the details of blobs storage services, highlighting the different kinds of blobs.

The course then focuses on moving blobs between storage containers within a storage account and moving blobs between different storage accounts, using the AZCopy tool, using PowerShell, and programmatically using C#.NET. Next, the course dives into blob properties and metadata and how to set and retrieve this information using the Azure Portal, PowerShell, and programmatically in C#.NET. The course then moves into blob leasing, what it is used for, and how to obtain and manage blob leases using the Azure CLI, the REST API, and C#.NET. The last topic in this course covers data archiving and retention by levering Storage Tiers, the new Lifecycle Management feature in the Azure Portal, and using the immutable storage policies feature.

Learning Objectives

  • Moving items in blob storage between storage containers 
  • Moving items in blob storage between storage accounts
  • Setting and retrieving blob properties and metadata
  • Implementing blob leasing
  • Implementing data archiving and retention

Intended Audience

  • Azure developers who design and build cloud-based applications and services
  • People preparing for Microsoft’s Azure AZ-203 exam

Prerequisites

You’ll need to have a basic understanding of Azure, have some experience developing scalable solutions, and be skilled in at least one cloud-supported programming language.

Transcript

As part of the ongoing management of Blob storage, it may be necessary to copy, or even move data, between different containers within the same Blob storage service. To facilitate the copying of data in Azure storage you can use the AZCopy tool. The AZCopy tool (https://docs.microsoft.com/azure/storage/common/storage-use-azcopy), a free download from the Microsoft website, is a command-line tool for copying data in Azure, Blob, table, or file storage between storage containers, as well as between storage accounts. The current version of the tool, version 10, can be downloaded on any supportive Windows, Linux, or Mac OS system. 

The moving of blobs between containers is not natively supported in Azure, so to effectively move blobs between containers the blobs must be copied to the destination container, and then deleted from the source container. This can be done on the Azure portal or using PowerShell's Remove-AzureStorageBlob.cmdlet. 

It is possible to effectively move blobs between containers programmatically using the Microsoft Azure storage data movement library. This library contains methods that can be added to a C# project that can copy data between containers as well as delete the blobs after the copy process has completed. To learn more about the Microsoft Azure storage data movement library refer to this URL (https://docs.microsoft.com/azure/storage/common/storage-use-data-movement-library).

About the Author

Students1109
Courses3

Jeff is a technical trainer and developer residing in Arizona, USA. He has been a Microsoft Certified Trainer for the past 18 years, providing in-house development and training on Microsoft server operating systems, PowerShell, SQL Server and Azure.  When he’s not developing and delivering courses on Azure, he’s photographing galaxies, nebulae and star formations from his computer-automated observatory in Chino Valley, Arizona using a 14” Schmidt Cassegrain telescope.