1. Home
  2. Training Library
  3. Big Data
  4. Courses
  5. What is a Data Engineer, What Skills Do You Need, and is the Data Engineer Role Right For You?

Key Traits of a Data Engineer

play-arrow
Start course
Overview
DifficultyBeginner
Duration16m
Students61
Ratings
5/5
starstarstarstarstar

Description

Is becoming a data engineer the right move for you? This Introduction to the Data Engineer Role course walks you through the ins and outs of being a data engineer: the tasks and responsibilities of the role, the skills necessary to carry them out, and the personality traits best suited to working as a data engineer. You will also learn the differences between data engineers and both data scientists and database administrators. All of this should help you get a clear idea of what a career in data engineering looks like and if it's the right one for you!

Learning Objectives

  • Understand what a data engineer does
  • Learn the differences between a data engineer and a data scientist and database administrator
  • Understand the skills and character traits that make a successful data engineer

Intended Audience

Anyone who is thinking of embarking on a career as a data engineer, whether they're fresh out of school and thinking about their future, or they already have years of experience under their belt but want a career change.

Prerequisites

None! This course is open to everyone.

Transcript

What are the key traits of a data engineer? Well, data engineers in my view are practical people, right? Hands-on, they're critical thinkers, data engineers connect the dots and see the big picture to evaluate how data insights affect the business. They're collaborative. They have the ability to collaborate with both internal technology and business teams, as well as with integration partners and customers. You'd be working with a number of different people. And they're curious, so data engineers demonstrate a track record of learning and deep diving into complex systems and problems. 

Let's imagine you're working in this role. You'll be expected to design, develop, and deploy scalable data pipelines and data services. You'll be expected to promote best practices that enable teams to accelerate their consumption and understanding of data. You'll need to integrate new data development technologies and software engineering tools into your existing infrastructure. And you'll need to improve overall efficiency by introducing new engineering processes and tools.

You'll be expected to research opportunities for data acquisition and new uses for existing data. And you'll have to have an understanding of these existing systems and be able to recommend ways to marry disparate data sets using automation. You need to collaborate with data scientists and researchers to develop algorithms, including prototypes, predictive models, and proofs of concepts. So it's all very outcome orientated. As I mentioned earlier, you become a superhero because you're the person that can bring all this data to life.

Lectures

Introduction - What Does a Data Engineer Do? - Data Engineer vs. Data Scientist - Data Engineer vs. Database Administrator - Key Skills of a Data Engineer - Is This Role Right For Me?

About the Author
Students91802
Courses97
Learning paths58

Head of Content

Andrew is an AWS certified professional who is passionate about helping others learn how to use and gain benefit from AWS technologies. Andrew has worked for AWS and for AWS technology partners Ooyala and Adobe.  His favorite Amazon leadership principle is "Customer Obsession" as everything AWS starts with the customer. Passions around work are cycling and surfing, and having a laugh about the lessons learnt trying to launch two daughters and a few start ups.