Dealing With Schema Changes in a Data Service

Developed with
Calculated Systems

Lab Steps

lock
Signing In to the Google Cloud Console
lock
Opening the Lab's Jupyter Notebook in Google Cloud

Ready for the real environment experience?

DifficultyIntermediate
Time Limit1h
Students2
Ratings
5/5
starstarstarstarstar

Description

Databases are extraordinarily powerful in managing sets of data, but what do we do when management wants to add/remove/modify something that code does? This lab is aimed at students with a moderate understanding of data engineering, and Python who want to understand how to update schemas to handle new features. We will walk through the changing requirements of a bug tracking application and how to handle them.

Learning Objectives

Upon completion of this lab you will be able to:

  • Evolve MySQL tables to handle schema changes
  • Learn how to update data models to meet changing requirements

Intended Audience

This lab is intended for:

  • Data engineers
  • Anyone needing to perform a schema migration on a relational database

Prerequisites

You should possess:

  • A moderate understanding of Python
  • A basic understanding of data engineering concepts

About the Author

Students378
Labs14
Courses2

Calculated Systems was founded by experts in Hadoop, Google Cloud and AWS. Calculated Systems enables code-free capture, mapping and transformation of data in the cloud based on Apache NiFi, an open source project originally developed within the NSA. Calculated Systems accelerates time to market for new innovations while maintaining data integrity.  With cloud automation tools, deep industry expertise, and experience productionalizing workloads development cycles are cut down to a fraction of their normal time. The ability to quickly develop large scale data ingestion and processing  decreases the risk companies face in long development cycles. Calculated Systems is one of the industry leaders in Big Data transformation and education of these complex technologies.

Covered Topics