AWS re:Invent 2016: The Werner Vogels Keynote

My expectations for Werner Vogels’ keynote today were very high, and I have to admit, I was not disappointed.
The keyword for Werner’s presentation was transformation. AWS is transforming the IT industry, not only technology-wise but also structurally. They’ve spent the last 10 years building a broad set of services to choose from, giving us all the building blocks we need. At the same time, AWS is helping its customers transform too, actually turning them into transformers with superpowers.

Werner focused on three parallel areas where transformation is needed:

  • Development: This includes development, testing, and operations. This broad area is quickly evolving to help you reduce business risks, build smaller and more targeted apps, deliver changes much faster, and react to customer needs. It is also evolving to allow you to run many more experiments.
  • Data: Given that everyone has access to the same computing power and storage capabilities today, data is truly the biggest competitive differentiator of our time.
  • Compute: A very heterogeneous space where VMs, Containers, and Serverless Computing coexist.

Development Transformation

Development is where agility lives. Developers need unconstrained access to resources. And, they need automated testing with higher fidelity to reduce time to market and achieve major improvements in terms of cost and productivity.
Here is a short list of news related to development:

  • AWS OpsWorks for Chef Automate: A fully managed Chef server that is generally available today.
  • Amazon EC2 Systems Manager: A collection of AWS tools for packaging, installation, patching, resource configuration, and task automation. Available today.
  • AWS CodeBuild: A fully-managed build service for compiling the source code and running unit tests; it automatically scales and you pay only for the minutes of computation. Available today. Of course, it’s well integrated with the AWS CI/CD suite, which includes CodeCommit, CodePipeline, and CodeDeploy.
  • AWS X-Ray: A fully managed service for analyzing and debugging distributed apps in production. AWS X-Ray is available in preview today and offers great real-time visualization of complex systems, including status codes, latencies, etc. AWS Lambda support is coming soon as well.
  • AWS Personal Health Dashboard: It allows you to design personalized views of your AWS services health. Generally available today.
  • AWS Shield: A managed DDoS protection service; it’s generally available today and comes in two tiers: Standard and Advanced. Shield Standard is granted by default to every AWS user and it protects from volumetric and state exhaustion attacks (network layer). Shield Advanced is additional protection against large and more sophisticated attacks at the application layer.

Data Transformation

AWS offers a broad set of analytics capabilities, including data processing, warehousing, reporting, real-time processing, and predictive analytics. Such functionalities are supported by a whole range of data-related services, such as EMR, Athena, Redshift, Quicksight, Elasticsearch, Polly, Lex, Rekognition, and Amazon Machine Learning.

Despite such broad capabilities, 80% of what we consider analytics is not analytics at all. Indeed, most of data analytics tasks also involve discovery, indexing, data acquisition, security, storage, access, and governance operations, which contribute to less than 20% of the outcome.

Werner highlighted that Modern Data Architecture is agile, as you need to manage a constantly changing variety of users, sources, models, applications, queries, and processing needs. Sadly, the reality is that most of your data is not agile (i.e. it’s stored in “silos”).

Only three new data-related services were announced today, although they will have a big impact on your data pipelines.

  • Amazon Pinpoint: It will help you understand user behavior, define who to engage with, deliver push notifications to mobile devices, and track campaign results.
  • AWS Glue: A fully managed data catalog and ELT service (Extract, Load, Transform). It’s integrated with S3, RDS, Redshift, and any JDBC-compatible source. AWS Glue is supposed to cover all of the missing pieces of an agile data architecture so that your workflow will be 80% analytics and only 20% data preparation.
  • AWS Batch: A fully managed batch processing service that will solve all the challenges of large-scale batch processing, such as cluster provisioning, batch software install, jobs interdependencies, job queues, jobs scheduling, and cluster scaling. AWS Batch will also perform cost optimizations through EC2 spot fleet and support priority-based queues. It is available in preview.

Compute Transformation

The current landscape of AWS Compute is where Virtual Machines, Containers, and Serverless have to coexist. Werner analyzed the many dimensions that differentiate such solutions, such as packaging, updates, execution, run time, and unit of cost.
Here are a couple of news items related to the Containers world:

  • Task Placement Engine & Event Stream
  • Blox: It’s a collection of open source projects for ECS. Today, only cluster-state-service and daemon-scheduler have been published. You can find out more at blox.github.io.

AWS Lambda comes with some great news as well:

  • C# Lambda support
  • AWS Lambda@Edge: You can now run AWS Lambda functions at CloudFront locations, which allows you to process data at the edge locations to achieve low-latency request/response. It’s only available in preview, but you can apply here.
  • AWS Step Functions: Allows you to coordinate components of distributed apps using visual workflows. Indeed, you can already orchestrate multiple Lambda functions and achieve complex behavior such as concatenation, parallel execution, retry policies, long-running tasks, etc.

Further minor serverless updates have been announced during the show, but I will cover them in a dedicated post in a few days.

Conclusion

The Werner Vogels Keynote was a long series of exciting announcements. Although many services are still in preview, we can already start playing with most of them.

Let us know which of the new services are your favorites, and what you liked most at re:Invent 2016.

Avatar

Written by

Alex Casalboni

Alex is a Software Engineer with a great passion for music and web technologies. He's experienced in web development and software design, with a particular focus on frontend and UX.


Related Posts

Joe Nemer
Joe Nemer
— April 3, 2020

Breaking News: All AWS Certification Exams Now Available Online

Remote proctoring for all AWS certifications Cloud Academy is an Advanced AWS Technology Partner, and we are happy to announce all AWS certification exams are available online!  What does this mean for you? You can stay focused on your certification goal. Or you can start a certifica...

Read more
  • AWS
  • AWS certification
  • AWS Certifications
Connie Benton
Connie Benton
— April 1, 2020

How To Build a Career with AWS Certifications

From Iaas and PaaS solutions to digital marketing, cloud computing reshapes the world of technology. As the influence of this technology grows, so does investment. Tens of billions of dollars are being spent on cloud computing-related services each year. This influx is continuing to inc...

Read more
  • AWS
  • Certifications
Vijayakumar Athithan
Vijayakumar Athithan
— March 27, 2020

What is Cognito in AWS?

Web applications usually allow a valid username and password combination for successful sign in to the application. Modern authentication flows incorporate more approaches to ensure user authentication. When using AWS, this is no exception, thanks to the abilities and features offered b...

Read more
  • AWS
  • AWS Cognito
  • Solutions Architect
Avatar
Andrew Larkin
— March 20, 2020

The 12 AWS Certifications: Which is Right for You and Your Team?

As companies increasingly shift workloads to the public cloud, cloud computing has moved from a nice-to-have to a core competency in the enterprise. This shift requires a new set of skills to design, deploy, and manage applications in cloud computing. As the market leader and most ma...

Read more
  • AWS
  • AWS Certifications
Alisha Reyes
Alisha Reyes
— March 17, 2020

Cloud Academy’s Blog Digest: How Do AWS Certifications Increase Your Employability, How to Become a Microsoft Certified Azure Data Engineer, and more

With everything going on right now, it's likely that the only thing you've been reading lately is related to the coronavirus pandemic. It's important to stay informed during these times, but it's also good to jump into something that can take your mind off of the current situation for j...

Read more
  • AWS
  • Azure
  • blog digest
  • Certifications
  • Cloud Academy
  • programming
  • Security
Avatar
Cloud Academy Team
— March 13, 2020

Which Certifications Should I Get?

As we mentioned in an earlier post, the old AWS slogan, “Cloud is the new normal” is indeed a reality today. Really, cloud has been the new normal for a while now and getting credentials has become an increasingly effective way to quickly showcase your abilities to recruiters and compan...

Read more
  • AWS
  • Azure
  • Certifications
  • Cloud Computing
  • Google Cloud Platform
Alisha Reyes
Alisha Reyes
— March 7, 2020

New on Cloud Academy: Intro to GitOps; AWS Courses; Java, Python, Amazon Linux 2, Ubuntu, & Docker Playgrounds; and much more

New Lab Playgrounds This month, our Content Team released six new "playground labs." Our playground labs provide a safe and secure sandbox environment for you to explore your own ideas, follow along with Cloud Academy courses, or answer your own questions — all without having to instal...

Read more
  • AWS
  • Azure
  • gitops
  • Google Cloud Platform
  • lab playground
  • programming
Alisha Reyes
Alisha Reyes
— March 6, 2020

New on Cloud Academy: Intro to GitOps; AWS Courses; Java, Python, Amazon Linux 2, Ubuntu, & Docker Playgrounds; and much more

New Lab Playgrounds This month, our Content Team released six new "playground labs." Our playground labs provide a safe and secure sandbox environment for you to explore your own ideas, follow along with Cloud Academy courses, or answer your own questions — all without having to instal...

Read more
  • AWS
  • Azure
  • gitops
  • Google Cloud Platform
  • lab playground
  • programming
Patrick Navarro
Patrick Navarro
— March 4, 2020

AWS Certifications: How Do They Increase Your Employability and Progress Your Career?

AWS certifications are no walk in the park. They’re designed to validate in-depth, specialist knowledge and comprehensive experience, often requiring months of dedicated studying to earn even for those already working with the cloud platform. But the rewards that AWS professionals ca...

Read more
  • AWS
  • AWS certification
  • certification
Avatar
Chandan Patra
— February 21, 2020

Elasticsearch vs. CloudSearch: AWS Cloud Search Choices

Elasticsearch vs. CloudSearch: What's the main difference? Let's compare AWS-based cloud tools: Elasticsearch vs. CloudSearch. While both services use proven technologies, Elasticsearch is more popular, open source, and has a flexible API to use for customization; in comparison, CloudS...

Read more
  • AWS
  • Azure
  • cloudsearch
  • elasticsearch
Avatar
Andrew Larkin
— February 13, 2020

Cloud Academy Content Roadmap Updates

Welcome to our Q1 2020 roadmap. This is the content we plan to build over the next three months, between February 1 - and April 30, 2020. Let's look at some of our roadmap highlights. Atlassian Bamboo for CI/CD We had a lot of requests for practical guides on how to apply DevOps tool...

Read more
  • Artificial Intelligence
  • AWS
  • Azure
  • Docker
  • Google Cloud Platform
  • Kubernetes
  • Machine Learning
Alisha Reyes
Alisha Reyes
— February 7, 2020

New on Cloud Academy: Git Labs, CKA and CKAD Lab Challenges, AWS and Azure Learning Paths, AGILE, and Much More

We just kicked off our first Free Weekend of 2020. This means we've unlocked our Training Library for just 72 hours. Until Sunday at 11:59 pm (PST), you can get unlimited access to our industry-leading learning paths, courses, certification prep exams, and our most popular hands-on labs...

Read more
  • agile
  • AWS
  • Azure
  • Google Cloud Platform
  • Linux
  • OWASP
  • programming
  • red hat
  • scrum