Skip to main content

AWS re:Invent 2016: The Werner Vogels Keynote

My expectations for Werner Vogels’ keynote today were very high, and I have to admit, I was not disappointed.
The keyword for Werner’s presentation was transformation. AWS is transforming the IT industry, not only technology-wise but also structurally. They’ve spent the last 10 years building a broad set of services to choose from, giving us all the building blocks we need. At the same time, AWS is helping its customers transform too, actually turning them into transformers with super powers.
Werner focused on three parallel areas where transformation is needed:

  • Development: This includes development, testing, and operations. This broad area is quickly evolving to help you reduce business risks, build smaller and more targeted apps, deliver changes much faster, and react to customer needs. It is also evolving to allow you to run many more experiments.
  • Data: Given that everyone has access to the same computing power and storage capabilities today, data is truly the biggest competitive differentiator of our time.
  • Compute: A very heterogeneous space where VMs, Containers, and Serverless Computing coexist.

Development Transformation

Development is where agility lives. Developers need unconstrained access to resources. And, they need automated testing with higher fidelity to reduce time to market and achieve major improvements in terms of cost and productivity.
Here is a short list of news related to development:

  • AWS OpsWorks for Chef Automate: A fully managed Chef server that is generally available today.
  • Amazon EC2 Systems Manager: A collection of AWS tools for packaging, installation, patching, resource configuration, and task automation. Available today.
  • AWS CodeBuild: A fully-managed build service for compiling source code and running unit tests; it automatically scales and you pay only for the minutes of computation. Available today. Of course, it’s well integrated with the AWS CI/CD suite, which includes CodeCommit, CodePipeline, and CodeDeploy.
  • AWS X-Ray: A fully managed service for analyzing and debugging distributed apps in production. AWS X-Ray is available in preview today and offers great real-time visualization of complex systems, including status codes, latencies, etc. AWS Lambda support is coming soon as well.
  • AWS Personal Health Dashboard: It allows you to design personalized views of your AWS services health. Generally available today.
  • AWS Shield: A managed DDoS protection service; it’s generally available today and comes in two tiers: Standard and Advanced. Shield Standard is granted by default to every AWS user and it protects from volumetric and state exhaustion attacks (network layer). Shield Advanced is an additional protection against large and more sophisticated attacks at the application layer.

Data Transformation

AWS offers a broad set of analytics capabilities, including data processing, warehousing, reporting, real-time processing, and predictive analytics. Such functionalities are supported by a whole range of data-related services, such as EMR, Athena, Redshift, Quicksight, Elasticsearch, Polly, Lex, Rekognition, and Amazon Machine Learning.
Despite such broad capabilities, 80% of what we consider analytics is not analytics at all. Indeed, most of data analytics tasks also involve discovery, indexing, data acquisition, security, storage, access, and governance operations, which contribute to less than 20% of the outcome.
Werner highlighted that Modern Data Architecture is agile, as you need to manage a constantly changing variety of users, sources, models, applications, queries, and processing needs. Sadly, the reality is that most of your data is not agile (i.e. it’s stored in “silos”).
Only three new data-related services were announced today, although they will have a big impact on your data pipelines.

  • Amazon Pinpoint: It will help you understand user behavior, define who to engage with, deliver push notifications to mobile devices, and track campaign results.
  • AWS Glue: A fully managed data catalog and ELT service (Extract, Load, Transform). It’s integrated with S3, RDS, Redshift, and any JDBC-compatible source. AWS Glue is supposed to cover all of the missing pieces of an agile data architecture so that your workflow will be 80% analytics and only 20% data preparation.
  • AWS Batch: A fully managed batch processing service that will solve all the challenges of large-scale batch processing, such as cluster provisioning, batch software install, jobs interdependencies, job queues, jobs scheduling, and cluster scaling. AWS Batch will also perform cost optimizations through EC2 spot fleet and support priority-based queues. It is available in preview.

Compute Transformation

The current landscape of AWS Compute is where Virtual Machines, Containers, and Serverless have to coexist. Werner analyzed the many dimensions that differentiate such solutions, such as packaging, updates, execution, run time, and unit of cost.
Here are a couple of news items related to the Containers world:

  • Task Placement Engine & Event Stream
  • Blox: It’s a collection of open source projects for ECS. Today, only cluster-state-service and daemon-scheduler have been published. You can find out more at blox.github.io.

AWS Lambda comes with some great news as well:

  • C# Lambda support
  • AWS Lambda@Edge: You can now run AWS Lambda functions at CloudFront locations, which allows you to process data at the edge locations to achieve low-latency request/response. It’s only available in preview, but you can apply here.
  • AWS Step Functions: Allows you to coordinate components of distributed apps using visual workflows. Indeed, you can already orchestrate multiple Lambda functions and achieve complex behaviour such as concatenation, parallel execution, retry policies, long-running tasks, etc.

Further minor serverless updates have been announced during the show, but I will cover them in a dedicated post in a few days.

Conclusion

The Werner Vogels Keynote was a long series of exciting announcements. Although many services are still in preview, we can already start playing with most of them.
Let us know which of the new services are your favorites, and what you liked most at re:Invent 2016.

Written by

Alex is a Software Engineer with a great passion for music and web technologies. He's experienced in web development and software design, with a particular focus on frontend and UX.

Related Posts

— September 18, 2018

How to Optimize Cloud Costs with Spot Instances: New on Cloud Academy

One of the main promises of cloud computing is access to nearly endless capacity. However, it doesn’t come cheap. With the introduction of Spot Instances for Amazon Web Services’ Elastic Compute Cloud (AWS EC2) in 2009, spot instances have been a way for major cloud providers to sell sp...

Read more
  • AWS
  • Azure
  • Google Cloud
— August 23, 2018

What are the Benefits of Machine Learning in the Cloud?

A Comparison of Machine Learning Services on AWS, Azure, and Google CloudArtificial intelligence and machine learning are steadily making their way into enterprise applications in areas such as customer support, fraud detection, and business intelligence. There is every reason to beli...

Read more
  • AWS
  • Azure
  • Google Cloud
  • Machine Learning
— August 17, 2018

How to Use AWS CLI

The AWS Command Line Interface (CLI) is for managing your AWS services from a terminal session on your own client, allowing you to control and configure multiple AWS services.So you’ve been using AWS for awhile and finally feel comfortable clicking your way through all the services....

Read more
  • AWS
Albert Qian
— August 9, 2018

AWS Summit Chicago: New AWS Features Announced

Thousands of cloud practitioners descended on Chicago’s McCormick Place West last week to hear the latest updates around Amazon Web Services (AWS). While a typical hot and humid summer made its presence known outside, attendees inside basked in the comfort of air conditioning to hone th...

Read more
  • AWS
  • AWS Summits
— August 8, 2018

From Monolith to Serverless – The Evolving Cloudscape of Compute

Containers can help fragment monoliths into logical, easier to use workloads. The AWS Summit New York was held on July 17 and Cloud Academy sponsored my trip to the event. As someone who covers enterprise cloud technologies and services, the recent Amazon Web Services event was an insig...

Read more
  • AWS
  • AWS Summits
  • Containers
  • DevOps
  • serverless
— July 11, 2018

AWS Certification Practice Exam: What to Expect from Test Questions

If you’re building applications on the AWS cloud or looking to get started in cloud computing, certification is a way to build deep knowledge in key services unique to the AWS platform. AWS currently offers nine certifications that cover the major cloud roles including Solutions Archite...

Read more
  • AWS
— June 26, 2018

Disadvantages of Cloud Computing

If you want to deliver digital services of any kind, you’ll need to compute resources including CPU, memory, storage, and network connectivity. Which resources you choose for your delivery, cloud-based or local, is up to you. But you’ll definitely want to do your homework first.Cloud ...

Read more
  • AWS
  • Azure
  • Cloud Computing
  • Google Cloud
— March 13, 2018

Choosing the Right AWS Certification for You and Your Team

As companies increasingly shift workloads to the public cloud, cloud computing has moved from a nice-to-have to a core competency in the enterprise. This shift requires a new set of skills to design, deploy, and manage applications in the cloud.As the market leader and most mature pro...

Read more
  • AWS
  • AWS certifications
— March 7, 2018

How to Encrypt an EBS Volume

Keeping data and applications safe in the cloud is one the most visible challenges facing cloud teams in 2018. Cloud storage services where data resides are frequently a target for hackers, not because the services are inherently weak, but because they are often improperly configured....

Read more
  • AWS
  • encryption
— February 28, 2018

How to Develop Machine Learning Models in TensorFlow

Predictive analytics and automation—through AI and machine learning—are increasingly being integrated into enterprise applications to support decision making and address critical issues such as security and business intelligence. Public cloud platforms like AWS offer dedicated services ...

Read more
  • Amazon Machine Learning
  • AWS
  • AWS Labs
— February 15, 2018

Is Multi-Cloud a Solution for High Availability?

With the average cost of downtime estimated at $8,850 per minute, businesses can’t afford to risk system failure. Full access to services and data anytime, anywhere is one of the main benefits of cloud computing.By design, many of the core services with the public cloud and its underl...

Read more
  • AWS
  • Azure
  • Cloud Adoption
  • Google Cloud
— February 13, 2018

Cloud Academy Sketches: Encryption in S3

Some of 2017’s largest data breaches involved unprotected Amazon Simple Storage (S3) buckets that left millions of customer data records exposed to the public. The problem wasn’t the technology, but administrators who improperly configured the security settings.For cloud teams in char...

Read more
  • AWS
Read previous post:
Amazon Rekognition – Image analysis as a Service

Amazon Rekognition: the new Image Analysis tool powered by Deep Learning Amazon itself has been powered by Machine Learning technologies...

Close