My expectations for Werner Vogels’ keynote today were very high, and I have to admit, I was not disappointed.
The keyword for Werner’s presentation was transformation. AWS is transforming the IT industry, not only technology-wise but also structurally. They’ve spent the last 10 years building a broad set of services to choose from, giving us all the building blocks we need. At the same time, AWS is helping its customers transform too, actually turning them into transformers with superpowers.
Werner focused on three parallel areas where transformation is needed:
- Development: This includes development, testing, and operations. This broad area is quickly evolving to help you reduce business risks, build smaller and more targeted apps, deliver changes much faster, and react to customer needs. It is also evolving to allow you to run many more experiments.
- Data: Given that everyone has access to the same computing power and storage capabilities today, data is truly the biggest competitive differentiator of our time.
- Compute: A very heterogeneous space where VMs, Containers, and Serverless Computing coexist.
Development is where agility lives. Developers need unconstrained access to resources. And, they need automated testing with higher fidelity to reduce time to market and achieve major improvements in terms of cost and productivity.
Here is a short list of news related to development:
- AWS OpsWorks for Chef Automate: A fully managed Chef server that is generally available today.
- Amazon EC2 Systems Manager: A collection of AWS tools for packaging, installation, patching, resource configuration, and task automation. Available today.
- AWS CodeBuild: A fully-managed build service for compiling the source code and running unit tests; it automatically scales and you pay only for the minutes of computation. Available today. Of course, it’s well integrated with the AWS CI/CD suite, which includes CodeCommit, CodePipeline, and CodeDeploy.
- AWS X-Ray: A fully managed service for analyzing and debugging distributed apps in production. AWS X-Ray is available in preview today and offers great real-time visualization of complex systems, including status codes, latencies, etc. AWS Lambda support is coming soon as well.
- AWS Personal Health Dashboard: It allows you to design personalized views of your AWS services health. Generally available today.
- AWS Shield: A managed DDoS protection service; it’s generally available today and comes in two tiers: Standard and Advanced. Shield Standard is granted by default to every AWS user and it protects from volumetric and state exhaustion attacks (network layer). Shield Advanced is additional protection against large and more sophisticated attacks at the application layer.
AWS offers a broad set of analytics capabilities, including data processing, warehousing, reporting, real-time processing, and predictive analytics. Such functionalities are supported by a whole range of data-related services, such as EMR, Athena, Redshift, Quicksight, Elasticsearch, Polly, Lex, Rekognition, and Amazon Machine Learning.
Despite such broad capabilities, 80% of what we consider analytics is not analytics at all. Indeed, most of data analytics tasks also involve discovery, indexing, data acquisition, security, storage, access, and governance operations, which contribute to less than 20% of the outcome.
Werner highlighted that Modern Data Architecture is agile, as you need to manage a constantly changing variety of users, sources, models, applications, queries, and processing needs. Sadly, the reality is that most of your data is not agile (i.e. it’s stored in “silos”).
Only three new data-related services were announced today, although they will have a big impact on your data pipelines.
- Amazon Pinpoint: It will help you understand user behavior, define who to engage with, deliver push notifications to mobile devices, and track campaign results.
- AWS Glue: A fully managed data catalog and ELT service (Extract, Load, Transform). It’s integrated with S3, RDS, Redshift, and any JDBC-compatible source. AWS Glue is supposed to cover all of the missing pieces of an agile data architecture so that your workflow will be 80% analytics and only 20% data preparation.
- AWS Batch: A fully managed batch processing service that will solve all the challenges of large-scale batch processing, such as cluster provisioning, batch software install, jobs interdependencies, job queues, jobs scheduling, and cluster scaling. AWS Batch will also perform cost optimizations through EC2 spot fleet and support priority-based queues. It is available in preview.
The current landscape of AWS Compute is where Virtual Machines, Containers, and Serverless have to coexist. Werner analyzed the many dimensions that differentiate such solutions, such as packaging, updates, execution, run time, and unit of cost.
Here are a couple of news items related to the Containers world:
- Task Placement Engine & Event Stream
- Blox: It’s a collection of open source projects for ECS. Today, only cluster-state-service and daemon-scheduler have been published. You can find out more at blox.github.io.
AWS Lambda comes with some great news as well:
- C# Lambda support
- AWS Lambda@Edge: You can now run AWS Lambda functions at CloudFront locations, which allows you to process data at the edge locations to achieve low-latency request/response. It’s only available in preview, but you can apply here.
- AWS Step Functions: Allows you to coordinate components of distributed apps using visual workflows. Indeed, you can already orchestrate multiple Lambda functions and achieve complex behavior such as concatenation, parallel execution, retry policies, long-running tasks, etc.
Further minor serverless updates have been announced during the show, but I will cover them in a dedicated post in a few days.
The Werner Vogels Keynote was a long series of exciting announcements. Although many services are still in preview, we can already start playing with most of them.
Let us know which of the new services are your favorites, and what you liked most at re:Invent 2016.
New Content: Azure DP-100 Certification, Alibaba Cloud Certified Associate Prep, 13 Security Labs, and Much More
This past month our Content Team served up a heaping spoonful of new and updated content. Not only did our experts release the brand new Azure DP-100 Certification Learning Path, but they also created 18 new hands-on labs — and so much more! New content on Cloud Academy At any time, y...
AWS Certification Practice Exam: What to Expect from Test Questions
If you’re building applications on the AWS cloud or looking to get started in cloud computing, certification is a way to build deep knowledge in key services unique to the AWS platform. AWS currently offers 12 certifications that cover major cloud roles including Solutions Architect, De...
Overcoming Unprecedented Business Challenges with AWS
From auto-scaling applications with high availability to video conferencing that’s used by everyone, every day — cloud technology has never been more popular or in-demand. But what does this mean for experienced cloud professionals and the challenges they face as they carve out a new p...
Constant Content: Cloud Academy’s Q3 2020 Roadmap
Hello — Andy Larkin here, VP of Content at Cloud Academy. I am pleased to release our roadmap for the next three months of 2020 — August through October. Let me walk you through the content we have planned for you and how this content can help you gain skills, get certified, and...
New Content: Alibaba, Azure AZ-303 and AZ-304, Site Reliability Engineering (SRE) Foundation, Python 3 Programming, 16 Hands-on Labs, and Much More
This month our Content Team did an amazing job at publishing and updating a ton of new content. Not only did our experts release the brand new AZ-303 and AZ-304 Certification Learning Paths, but they also created 16 new hands-on labs — and so much more! New content on Cloud Academy At...
Blog Digest: Which Certifications Should I Get?, The 12 Microsoft Azure Certifications, 6 Ways to Prevent a Data Breach, and More
This month, we were excited to announce that Cloud Academy was recognized in the G2 Summer 2020 reports! These reports highlight the top-rated solutions in the industry, as chosen by the source that matters most: customers. We're grateful to have been nominated as a High Performer in se...
Which Certifications Should I Get?
The old AWS slogan, “Cloud is the new normal” is indeed a reality today. Really, cloud has been the new normal for a while now and getting credentials has become an increasingly effective way to quickly showcase your abilities to recruiters and companies. With all that in mind, the s...
New Content: AWS, Azure, Typescript, Java, Docker, 13 New Labs, and Much More
This month, our Content Team released a whopping 13 new labs in real cloud environments! If you haven't tried out our labs, you might not understand why we think that number is so impressive. Our labs are not “simulated” experiences — they are real cloud environments using accounts on A...
Kickstart Your Tech Training With a Free Week on Cloud Academy
Are you looking to make a jump in your technical career? Want to get trained or certified on AWS, Azure, Google Cloud Platform, DevOps, Kubernetes, Python, or another in-demand skill? Then you'll want to mark your calendar. Starting Monday, June 22 at 12:00 a.m. PDT (3:00 a.m. EDT), ...
New Content: AZ-500 and AZ-400 Updates, 3 Google Professional Exam Preps, Practical ML Learning Path, C# Programming, and More
This month, our Content Team released tons of new content and labs in real cloud environments. Not only that, but we introduced our very first highly interactive "Office Hours" webinar. This webinar, Acing the AWS Solutions Architect Associate Certification, started with a quick overvie...
Azure vs. AWS: Which Certification Provides the Brighter Future?
More and more companies are using cloud services, prompting more and more people to switch their current IT position to something cloud-related. The problem is most people only have that much time after work to learn new technologies, and there are plenty of cloud services that you can ...
Blog Digest: 5 Reasons to Get AWS Certified, OWASP Top 10, Getting Started with VPCs, Top 10 Soft Skills, and More
Thank you for being a valued member of our community! We recently sent out a short survey to understand what type of content you would like us to add to Cloud Academy, and we want to thank everyone who gave us their input. If you would like to complete the survey, it's not too late. It ...