Skip to main content

AWS re:Invent 2016: The Werner Vogels Keynote

My expectations for Werner Vogels’ keynote today were very high, and I have to admit, I was not disappointed.
The keyword for Werner’s presentation was transformation. AWS is transforming the IT industry, not only technology-wise but also structurally. They’ve spent the last 10 years building a broad set of services to choose from, giving us all the building blocks we need. At the same time, AWS is helping its customers transform too, actually turning them into transformers with superpowers.

Werner focused on three parallel areas where transformation is needed:

  • Development: This includes development, testing, and operations. This broad area is quickly evolving to help you reduce business risks, build smaller and more targeted apps, deliver changes much faster, and react to customer needs. It is also evolving to allow you to run many more experiments.
  • Data: Given that everyone has access to the same computing power and storage capabilities today, data is truly the biggest competitive differentiator of our time.
  • Compute: A very heterogeneous space where VMs, Containers, and Serverless Computing coexist.

Development Transformation

Development is where agility lives. Developers need unconstrained access to resources. And, they need automated testing with higher fidelity to reduce time to market and achieve major improvements in terms of cost and productivity.
Here is a short list of news related to development:

  • AWS OpsWorks for Chef Automate: A fully managed Chef server that is generally available today.
  • Amazon EC2 Systems Manager: A collection of AWS tools for packaging, installation, patching, resource configuration, and task automation. Available today.
  • AWS CodeBuild: A fully-managed build service for compiling the source code and running unit tests; it automatically scales and you pay only for the minutes of computation. Available today. Of course, it’s well integrated with the AWS CI/CD suite, which includes CodeCommit, CodePipeline, and CodeDeploy.
  • AWS X-Ray: A fully managed service for analyzing and debugging distributed apps in production. AWS X-Ray is available in preview today and offers great real-time visualization of complex systems, including status codes, latencies, etc. AWS Lambda support is coming soon as well.
  • AWS Personal Health Dashboard: It allows you to design personalized views of your AWS services health. Generally available today.
  • AWS Shield: A managed DDoS protection service; it’s generally available today and comes in two tiers: Standard and Advanced. Shield Standard is granted by default to every AWS user and it protects from volumetric and state exhaustion attacks (network layer). Shield Advanced is additional protection against large and more sophisticated attacks at the application layer.

Data Transformation

AWS offers a broad set of analytics capabilities, including data processing, warehousing, reporting, real-time processing, and predictive analytics. Such functionalities are supported by a whole range of data-related services, such as EMR, Athena, Redshift, Quicksight, Elasticsearch, Polly, Lex, Rekognition, and Amazon Machine Learning.

Despite such broad capabilities, 80% of what we consider analytics is not analytics at all. Indeed, most of data analytics tasks also involve discovery, indexing, data acquisition, security, storage, access, and governance operations, which contribute to less than 20% of the outcome.

Werner highlighted that Modern Data Architecture is agile, as you need to manage a constantly changing variety of users, sources, models, applications, queries, and processing needs. Sadly, the reality is that most of your data is not agile (i.e. it’s stored in “silos”).

Only three new data-related services were announced today, although they will have a big impact on your data pipelines.

  • Amazon Pinpoint: It will help you understand user behavior, define who to engage with, deliver push notifications to mobile devices, and track campaign results.
  • AWS Glue: A fully managed data catalog and ELT service (Extract, Load, Transform). It’s integrated with S3, RDS, Redshift, and any JDBC-compatible source. AWS Glue is supposed to cover all of the missing pieces of an agile data architecture so that your workflow will be 80% analytics and only 20% data preparation.
  • AWS Batch: A fully managed batch processing service that will solve all the challenges of large-scale batch processing, such as cluster provisioning, batch software install, jobs interdependencies, job queues, jobs scheduling, and cluster scaling. AWS Batch will also perform cost optimizations through EC2 spot fleet and support priority-based queues. It is available in preview.

Compute Transformation

The current landscape of AWS Compute is where Virtual Machines, Containers, and Serverless have to coexist. Werner analyzed the many dimensions that differentiate such solutions, such as packaging, updates, execution, run time, and unit of cost.
Here are a couple of news items related to the Containers world:

  • Task Placement Engine & Event Stream
  • Blox: It’s a collection of open source projects for ECS. Today, only cluster-state-service and daemon-scheduler have been published. You can find out more at blox.github.io.

AWS Lambda comes with some great news as well:

  • C# Lambda support
  • AWS Lambda@Edge: You can now run AWS Lambda functions at CloudFront locations, which allows you to process data at the edge locations to achieve low-latency request/response. It’s only available in preview, but you can apply here.
  • AWS Step Functions: Allows you to coordinate components of distributed apps using visual workflows. Indeed, you can already orchestrate multiple Lambda functions and achieve complex behavior such as concatenation, parallel execution, retry policies, long-running tasks, etc.

Further minor serverless updates have been announced during the show, but I will cover them in a dedicated post in a few days.

Conclusion

The Werner Vogels Keynote was a long series of exciting announcements. Although many services are still in preview, we can already start playing with most of them.

Let us know which of the new services are your favorites, and what you liked most at re:Invent 2016.

Avatar

Written by

Alex Casalboni

Alex is a Software Engineer with a great passion for music and web technologies. He's experienced in web development and software design, with a particular focus on frontend and UX.

Related Posts

Sam Ghardashem
Sam Ghardashem
— May 15, 2019

Aviatrix Integration of a NextGen Firewall in AWS Transit Gateway

Learn how Aviatrix’s intelligent orchestration and control eliminates unwanted tradeoffs encountered when deploying Palo Alto Networks VM-Series Firewalls with AWS Transit Gateway.Deploying any next generation firewall in a public cloud environment is challenging, not because of the f...

Read more
  • AWS
Joe Nemer
Joe Nemer
— May 3, 2019

AWS Config Best Practices for Compliance

Use AWS Config the Right Way for Successful ComplianceIt’s well-known that AWS Config is a powerful service for monitoring all changes across your resources. As AWS Config has constantly evolved and improved over the years, it has transformed into a true powerhouse for monitoring your...

Read more
  • AWS
  • Compliance
Avatar
Francesca Vigliani
— April 30, 2019

Cloud Academy is Coming to the AWS Summits in Atlanta, London, and Chicago

Cloud Academy is a proud sponsor of the 2019 AWS Summits in Atlanta, London, and Chicago. We hope you plan to attend these free events that bring the cloud computing community together to connect, collaborate, and learn about AWS. These events are all about learning. You can learn how t...

Read more
  • AWS
  • AWS Summits
Paul Hortop
Paul Hortop
— April 2, 2019

How to Monitor Your AWS Infrastructure

The AWS cloud platform has made it easier than ever to be flexible, efficient, and cost-effective. However, monitoring your AWS infrastructure is the key to getting all of these benefits. Realizing these benefits requires that you follow AWS best practices which constantly change as AWS...

Read more
  • AWS
  • Monitoring
Joe Nemer
Joe Nemer
— April 1, 2019

AWS EC2 Instance Types Explained

Amazon Web Services’ resource offerings are constantly changing, and staying on top of their evolution can be a challenge. Elastic Cloud Compute (EC2) instances are one of their core resource offerings, and they form the backbone of most cloud deployments. EC2 instances provide you with...

Read more
  • AWS
  • EC2
Avatar
Nitheesh Poojary
— March 26, 2019

How DNS Works – the Domain Name System (Part One)

Before migrating domains to Amazon's Route53, we should first make sure we properly understand how DNS worksWhile we'll get to AWS's Route53 Domain Name System (DNS) service in the second part of this series, I thought it would be helpful to first make sure that we properly understand...

Read more
  • AWS
Avatar
Stuart Scott
— March 14, 2019

Multiple AWS Account Management using AWS Organizations

As businesses expand their footprint on AWS and utilize more services to build and deploy their applications, it becomes apparent that multiple AWS accounts are required to manage the environment and infrastructure.  A multi-account strategy is beneficial for a number of reasons as ...

Read more
  • AWS
  • Identity Access Management
Avatar
Sanket Dangi
— February 11, 2019

WaitCondition Controls the Pace of AWS CloudFormation Templates

AWS's WaitCondition can be used with CloudFormation templates to ensure required resources are running.As you may already be aware, AWS CloudFormation is used for infrastructure automation by allowing you to write JSON templates to automatically install, configure, and bootstrap your ...

Read more
  • AWS
  • CloudFormation
Badrinath Venkatachari
Badrinath Venkatachari
— February 1, 2019

10 Common AWS Mistakes & How to Avoid Them

Massive migration to the public cloud is changing architecture patterns, operating principles, and governance models. That means new approaches are vital to get a handle on soaring cloud spend. Because the cloud’s short-term billing cycles call for financial discipline, you must empower...

Read more
  • AWS
  • Operations
Avatar
Andrew Larkin
— January 24, 2019

The 9 AWS Certifications: Which is Right for You and Your Team?

As companies increasingly shift workloads to the public cloud, cloud computing has moved from a nice-to-have to a core competency in the enterprise. This shift requires a new set of skills to design, deploy, and manage applications in cloud computing.As the market leader and most ma...

Read more
  • AWS
  • AWS Certifications
Avatar
Andrew Larkin
— January 15, 2019

2018 Was a Big Year for Content at Cloud Academy

As Head of Content at Cloud Academy I work closely with our customers and my domain leads to prioritize quarterly content plans that will achieve the best outcomes for our customers.We started 2018 with two content objectives: To show customer teams how to use Cloud Services to solv...

Read more
  • AWS
  • Azure
  • Cloud Computing
  • Google Cloud Platform
Avatar
Jeremy Cook
— November 29, 2018

Amazon Elastic Inference – GPU Acceleration for Faster Inferencing

“Add GPU acceleration to any Amazon EC2 instance for faster inference at much lower cost (up to 75% savings)”So you’ve just kicked off the training phase of your multilayered deep neural network. The training phase is leveraging Amazon EC2 P3 instances to keep the training time to a...

Read more
  • AWS
  • Elastic Inference
  • re:Invent 2018