New AWS services and features announcements
During the first official keynote of AWS re:Invent 2015, lead by Andy Jassy, seven new services have been announced:
- Amazon QuickSight: a business intelligence service designed to help anyone get real value from their data by reducing the complexity of traditional BI tools.
- Amazon Kinesis Firehose: a service that lets you easily load data into AWS services like S3 and Redshift from any streaming data source. Firehose includes automatic scaling, concatenation, automatic, and encryption.
- Amazon Snowball: a hardware storage device for simplified secure data transfer. Ship 50TB in parallel with easily managed logistics.
- AWS Database Migration Service: easily migrate production databases to AWS with minimal downtime. The service offers continuous data replication for databases of any size and includes real-time monitoring (it costs just a few dollars and you can set it up in ten minutes).
- AWS Schema Conversion Tool: migrate between database engines reliably and easily with automatic schema and data transformation, including database functions.
- Amazon Inspector: an automated security assessment service that finds security and compliance issues, to help you identify and remediate compliance issues before they cause problems.
- AWS Config Rules (preview): set up automatically triggered compliance rules for resource configurations.
Why are builders passionate about the Cloud?
Andy explored the main reason why people love the Cloud: the possibility to be free and have control over your own destiny. Let’s recap together which kind of freedom he was referring to:
Freedom to build, unfettered
The agility given by quick provisioning and the vast infrastructure functionalities offered by AWS, together with the availability of deeper features for each one of the Amazon services, give every developer (or builder, as Andy calls them) the possibility to build without any infrastructural constraint.
Freedom to get real value from your data
Storage, big data workloads, streaming data, predictive analytics, and data warehouse capability are already offered by AWS as individual services. But in order to analyze your data and get real insights about your business, you typically need expensive and complicated BI tools, which are often handled and used only by data analysts.
In that context, Amazon QuickSight is great news. It’s an easy-to-use Business Intelligence service that allows you to build, visualize and share business insights from your own data source, faster and cheaper than any traditional BI tool.
Freedom to easily move your data into the cloud
By using Direct Upload, Direct Connect, and Import/Export, you can already move your big data into AWS, and Kinesis has solved many of your streaming problems. But AWS wanted to simplify the process of loading your streaming data into the Cloud. Thus, with Amazon Kinesis Firehose, you can now stream into AWS from any source, with automatic scaling, data concatenation, automatic compression, and optional encryption (via KMS).
Sometimes, though, your big data requirements are beyond the capacity of your network and the physical and logistical demands of using Import/Export might still be too complicated. For that, Amazon Snowball will provide you a simplified secure data transfer at a petabyte scale (up to 50TB shipped in parallel for each bag), with a guaranteed strong chain of custody, automatic conversion of legacy file systems to Object Storage (S3) and much easier logistics.
Freedom from bad (database) relationships
Old-world databases are very expensive, proprietary, generate lock-in, and come with punitive licensing.
That’s why people have been moving to open-source databases such as MySQL or Postgres, although it’s usually harder to obtain the same kind of enterprise-grade performance. AWS recently introduced Aurora, which is the fastest growing service in the ecosystem (even more than Redshift), and now a new RDS-based database management system is available: MariaDB.
Besides the ability to choose, handling migrations can be the biggest problem with database management, for which only expensive and complex tools are currently available on the market. This is why Amazon announced their AWS Database Migration Service today, which allows you to easily migrate your production DB to AWS, with minimal downtime. The service offers continuous data replication during the migration for databases of any size, including real-time monitoring and a simple ten minute set up the process. As part of this new service, the AWS Schema Conversion Tool will solve any migration involving more than one database engine, letting you migrate between different DB engines reliably and easily.
Freedom to Migrate
Andy described the typical enterprise path to the cloud: starting with new applications and moving on to whole websites, analytics and mobile, and mission-critical components and whole database migrations. This process usually involves intermediate transitioning, by means of hybrid Cloud infrastructures.
Freedom to secure your cake and eat it too
Here the point is being secure while moving fast. With the recently announced AWS Web Application Firewall (WAF) and the functionalities offered by AWS Config, including config history and change notifications, you can make sure your changes don’t break your security policies. Furthermore, AWS Config Rules will help you set up and automatically trigger compliance rules (i.e. rule = “All EBS Volumes should be encrypted”, action = “Encrypt Volumes”). This new functionality comes with reports and both pre-built and custom rules.
But how do you identify and remediate compliance issues early? Amazon Inspector will perform automated checks for you. In fact, you can think of it as an automated security assessment service that finds security and compliance issues on your AWS infrastructure.
Freedom to say yes (to new ideas)
Too often, decision-makers don’t feel they have the freedom to say yes and end up slowing useful innovation. From this point of view, with the Cloud providing the infrastructure and logic that drives digital transformation, you gain the freedom to say yes and embrace it.
Andy Jassy introduced a few interesting guests, each one either presenting a new service of presenting a partner’s story. Here is a quick recap:
Rob Alexander – CIO of Capital One – described the importance of their partnership with AWS as an innovative technology company. Since mobile banking is exploding (as much as twice as fast as the web itself, and growing fast!), Rob confidently thinks that “Mobile is the new Wallet” and offered a quick introduction to Capital One’s new mobile banking app – deployed on AWS.
Matt Wood – product strategist at AWS – presented a demo of Amazon QuickSight, describing the three main factors driving the design of this new BI tool. Matt introduced what they call SPICE – (the Super-fast Parallel In-memory Computation Engine), which, data compression and queries compiled to machine code, makes QuickSight seriously fast.
Bill Vass – VP Technology at AWS – illustrated how Amazon Snowball can help large AWS customers with enterprise requirements move a huge amount of data to the Cloud. Bill showed us a real Snowball bag: it is just 45 pounds and is rain, dust, and tamper resistant. Your data will be driven to AWS, converted from legacy FS, uploaded into S3 and encrypted. Of course, Snowball can be reused so that you don’t have to buy or handle physical media and is connected directly to your physical network via a 100G network connection.
Finally, General Electric, Accenture, MLBAM, and Stripe described the benefits of their deep relationship with AWS.
This is only the first of two scheduled keynotes at AWS re:Invent 2015 in Las Vegas, besides the 280 sessions organized within the next two days. More news and updated about those soon.
WaitCondition Controls the Pace of AWS CloudFormation Templates
AWS's WaitCondition can be used with CloudFormation templates to ensure required resources are running.As you may already be aware, AWS CloudFormation is used for infrastructure automation by allowing you to write JSON templates to automatically install, configure, and bootstrap your ...
The 9 AWS Certifications: Which is Right for You and Your Team?
As companies increasingly shift workloads to the public cloud, cloud computing has moved from a nice-to-have to a core competency in the enterprise. This shift requires a new set of skills to design, deploy, and manage applications in cloud computing.As the market leader and most ma...
Two New EC2 Instance Types Announced at AWS re:Invent 2018 – Monday Night Live
The announcements at re:Invent just keep on coming! Let’s look at what benefits these two new EC2 instance types offer and how these two new instances could be of benefit to you. If you're not too familiar with Amazon EC2, you might want to familiarize yourself by creating your first Am...
Google Cloud Certification: Preparation and Prerequisites
Google Cloud Platform (GCP) has evolved from being a niche player to a serious competitor to Amazon Web Services and Microsoft Azure. In 2018, research firm Gartner placed Google in the Leaders quadrant in its Magic Quadrant for Cloud Infrastructure as a Service for the first time. In t...
Understanding AWS VPC Egress Filtering Methods
In order to understand AWS VPC egress filtering methods, you first need to understand that security on AWS is governed by a shared responsibility model where both vendor and subscriber have various operational responsibilities. AWS assumes responsibility for the underlying infrastructur...
S3 FTP: Build a Reliable and Inexpensive FTP Server Using Amazon’s S3
Is it possible to create an S3 FTP file backup/transfer solution, minimizing associated file storage and capacity planning administration headache?FTP (File Transfer Protocol) is a fast and convenient way to transfer large files over the Internet. You might, at some point, have conf...
Microservices Architecture: Advantages and Drawbacks
Microservices are a way of breaking large software projects into loosely coupled modules, which communicate with each other through simple Application Programming Interfaces (APIs).Microservices have become increasingly popular over the past few years. The modular architectural style,...
What Are Best Practices for Tagging AWS Resources?
There are many use cases for tags, but what are the best practices for tagging AWS resources? In order for your organization to effectively manage resources (and your monthly AWS bill), you need to implement and adopt a thoughtful tagging strategy that makes sense for your business. The...
How to Optimize Amazon S3 Performance
Amazon S3 is the most common storage options for many organizations, being object storage it is used for a wide variety of data types, from the smallest objects to huge datasets. All in all, Amazon S3 is a great service to store a wide scope of data types in a highly available and resil...
How to Optimize Cloud Costs with Spot Instances: New on Cloud Academy
One of the main promises of cloud computing is access to nearly endless capacity. However, it doesn’t come cheap. With the introduction of Spot Instances for Amazon Web Services’ Elastic Compute Cloud (AWS EC2) in 2009, spot instances have been a way for major cloud providers to sell sp...
What are the Benefits of Machine Learning in the Cloud?
A Comparison of Machine Learning Services on AWS, Azure, and Google CloudArtificial intelligence and machine learning are steadily making their way into enterprise applications in areas such as customer support, fraud detection, and business intelligence. There is every reason to beli...
How to Use AWS CLI
The AWS Command Line Interface (CLI) is for managing your AWS services from a terminal session on your own client, allowing you to control and configure multiple AWS services.So you’ve been using AWS for awhile and finally feel comfortable clicking your way through all the services....