New AWS services and features announcements
During the first official keynote of AWS re:Invent 2015, lead by Andy Jassy, seven new services have been announced:
- Amazon QuickSight: a business intelligence service designed to help anyone get real value from their data by reducing the complexity of traditional BI tools.
- Amazon Kinesis Firehose: a service that lets you easily load data into AWS services like S3 and Redshift from any streaming data source. Firehose includes automatic scaling, concatenation, automatic, and encryption.
- Amazon Snowball: a hardware storage device for simplified secure data transfer. Ship 50TB in parallel with easily managed logistics.
- AWS Database Migration Service: easily migrate production databases to AWS with minimal downtime. The service offers continuous data replication for databases of any size and includes real-time monitoring (it costs just a few dollars and you can set it up in ten minutes).
- AWS Schema Conversion Tool: migrate between database engines reliably and easily with automatic schema and data transformation, including database functions.
- Amazon Inspector: an automated security assessment service that finds security and compliance issues, to help you identify and remediate compliance issues before they cause problems.
- AWS Config Rules (preview): set up automatically triggered compliance rules for resource configurations.
Why are builders passionate about the Cloud?
Andy explored the main reason why people love the Cloud: the possibility to be free and have control over your own destiny. Let’s recap together which kind of freedom he was referring to:
Freedom to build, unfettered
The agility given by quick provisioning and the vast infrastructure functionalities offered by AWS, together with the availability of deeper features for each one of the Amazon services, give every developer (or builder, as Andy calls them) the possibility to build without any infrastructural constraint.
Freedom to get real value from your data
Storage, big data workloads, streaming data, predictive analytics, and data warehouse capability are already offered by AWS as individual services. But in order to analyze your data and get real insights about your business, you typically need expensive and complicated BI tools, which are often handled and used only by data analysts.
In that context, Amazon QuickSight is great news. It’s an easy-to-use Business Intelligence service that allows you to build, visualize and share business insights from your own data source, faster and cheaper than any traditional BI tool.
Freedom to easily move your data into the cloud
By using Direct Upload, Direct Connect, and Import/Export, you can already move your big data into AWS, and Kinesis has solved many of your streaming problems. But AWS wanted to simplify the process of loading your streaming data into the Cloud. Thus, with Amazon Kinesis Firehose, you can now stream into AWS from any source, with automatic scaling, data concatenation, automatic compression, and optional encryption (via KMS).
Sometimes, though, your big data requirements are beyond the capacity of your network and the physical and logistical demands of using Import/Export might still be too complicated. For that, Amazon Snowball will provide you a simplified secure data transfer at a petabyte scale (up to 50TB shipped in parallel for each bag), with a guaranteed strong chain of custody, automatic conversion of legacy file systems to Object Storage (S3) and much easier logistics.
Freedom from bad (database) relationships
Old-world databases are very expensive, proprietary, generate lock-in, and come with punitive licensing.
That’s why people have been moving to open-source databases such as MySQL or Postgres, although it’s usually harder to obtain the same kind of enterprise-grade performance. AWS recently introduced Aurora, which is the fastest growing service in the ecosystem (even more than Redshift), and now a new RDS-based database management system is available: MariaDB.
Besides the ability to choose, handling migrations can be the biggest problem with database management, for which only expensive and complex tools are currently available on the market. This is why Amazon announced their AWS Database Migration Service today, which allows you to easily migrate your production DB to AWS, with minimal downtime. The service offers continuous data replication during the migration for databases of any size, including real-time monitoring and a simple ten minute set up the process. As part of this new service, the AWS Schema Conversion Tool will solve any migration involving more than one database engine, letting you migrate between different DB engines reliably and easily.
Freedom to Migrate
Andy described the typical enterprise path to the cloud: starting with new applications and moving on to whole websites, analytics and mobile, and mission-critical components and whole database migrations. This process usually involves intermediate transitioning, by means of hybrid Cloud infrastructures.
Freedom to secure your cake and eat it too
Here the point is being secure while moving fast. With the recently announced AWS Web Application Firewall (WAF) and the functionalities offered by AWS Config, including config history and change notifications, you can make sure your changes don’t break your security policies. Furthermore, AWS Config Rules will help you set up and automatically trigger compliance rules (i.e. rule = “All EBS Volumes should be encrypted”, action = “Encrypt Volumes”). This new functionality comes with reports and both pre-built and custom rules.
But how do you identify and remediate compliance issues early? Amazon Inspector will perform automated checks for you. In fact, you can think of it as an automated security assessment service that finds security and compliance issues on your AWS infrastructure.
Freedom to say yes (to new ideas)
Too often, decision-makers don’t feel they have the freedom to say yes and end up slowing useful innovation. From this point of view, with the Cloud providing the infrastructure and logic that drives digital transformation, you gain the freedom to say yes and embrace it.
Andy Jassy introduced a few interesting guests, each one either presenting a new service of presenting a partner’s story. Here is a quick recap:
Rob Alexander – CIO of Capital One – described the importance of their partnership with AWS as an innovative technology company. Since mobile banking is exploding (as much as twice as fast as the web itself, and growing fast!), Rob confidently thinks that “Mobile is the new Wallet” and offered a quick introduction to Capital One’s new mobile banking app – deployed on AWS.
Matt Wood – product strategist at AWS – presented a demo of Amazon QuickSight, describing the three main factors driving the design of this new BI tool. Matt introduced what they call SPICE – (the Super-fast Parallel In-memory Computation Engine), which, data compression and queries compiled to machine code, makes QuickSight seriously fast.
Bill Vass – VP Technology at AWS – illustrated how Amazon Snowball can help large AWS customers with enterprise requirements move a huge amount of data to the Cloud. Bill showed us a real Snowball bag: it is just 45 pounds and is rain, dust, and tamper resistant. Your data will be driven to AWS, converted from legacy FS, uploaded into S3 and encrypted. Of course, Snowball can be reused so that you don’t have to buy or handle physical media and is connected directly to your physical network via a 100G network connection.
Finally, General Electric, Accenture, MLBAM, and Stripe described the benefits of their deep relationship with AWS.
This is only the first of two scheduled keynotes at AWS re:Invent 2015 in Las Vegas, besides the 280 sessions organized within the next two days. More news and updated about those soon.
AWS Fundamentals: Understanding Compute, Storage, Database, Networking & Security
If you are just starting out on your journey toward mastering AWS cloud computing, then your first stop should be to understand the AWS fundamentals. This will enable you to get a solid foundation to then expand your knowledge across the entire AWS service catalog. It can be both d...
How to Become a DevOps Engineer
The DevOps Handbook introduces DevOps as a framework for improving the process for converting a business hypothesis into a technology-enabled service that delivers value to the customer. This process is called the value stream. Accelerate finds that applying DevOps principles of flow, f...
AWS Machine Learning Services
The speed at which machine learning (ML) is evolving within the cloud industry is exponentially growing, and public cloud providers such as AWS are releasing more and more services and feature updates to run in parallel with the trend and demand of this technology within organizations t...
AWS Control Tower & VPC Traffic Mirroring
AWS re:Inforce 2019 is a two-day conference for security, identity, and compliance learning and community building. This year's keynote, presented by AWS Vice President and CIO, Stephen Schmidt, announced the general availability of AWS Control Tower and the new VPC Traffic Mirroring fe...
Working with AWS Networking & Amazon VPC
Being able to architect your own isolated segment of AWS is a simple process using VPCs; understanding how to architect its related networking components and connectivity architecture is key to making it a powerful service. Many services within Amazon Web Services (AWS) require you t...
AWS Compute Fundamentals Update
AWS is renowned for the rate at which it reinvents, revolutionizes, and meets customer demands and expectations through its continuous cycle of feature and service updates. With hundreds of updates a month, it can be difficult to stay on top of all the changes made available. Here ...
10 Steps for an Effective Reserved Instances Strategy
Amazon Web Services (AWS) offers three different ways to pay for EC2 Instances: On-Demand, Reserved Instances, and Spot Instances. This article will focus on effective strategies for purchasing Reserved Instances. While most of the major cloud platforms offer pre-pay and reservation dis...
AWS Certification Practice Exam: What to Expect from Test Questions
If you’re building applications on the AWS cloud or looking to get started in cloud computing, certification is a way to build deep knowledge in key services unique to the AWS platform. AWS currently offers 11 certifications that cover major cloud roles including Solutions Architect, De...
AWS Certified Solutions Architect Associate: A Study Guide
The AWS Solutions Architect - Associate Certification (or Sol Arch Associate for short) offers some clear benefits: Increases marketability to employers Provides solid credentials in a growing industry (with projected growth of as much as 70 percent in five years) Market anal...
Moving Data to S3 with Apache NiFi
Moving data to the cloud is one of the cornerstones of any cloud migration. Apache NiFi is an open source tool that enables you to easily move and process data using a graphical user interface (GUI). In this blog post, we will examine a simple way to move data to the cloud using NiFi c...
Amazon DynamoDB: 10 Things You Should Know
Amazon DynamoDB is a managed NoSQL service with strong consistency and predictable performance that shields users from the complexities of manual setup. Whether or not you've actually used a NoSQL data store yourself, it's probably a good idea to make sure you fully understand the key ...
The 11 AWS Certifications: Which is Right for You and Your Team?
As companies increasingly shift workloads to the public cloud, cloud computing has moved from a nice-to-have to a core competency in the enterprise. This shift requires a new set of skills to design, deploy, and manage applications in cloud computing. As the market leader and most ma...