10 Common AWS Mistakes & How to Avoid Them

Massive migration to the public cloud is changing architecture patterns, operating principles, and governance models. That means new approaches are vital to get a handle on soaring cloud spend. Because the cloud’s short-term billing cycles call for financial discipline, you must empower end-users to monitor the financial impact of their decisions and give them the tools to optimize for cost and good governance.  

Making the Right Decisions on AWS Using Data-Driven Approaches

On Wednesday, February 13, 2019, HyperGrid™ and CloudAcademy will host a webinar “Best Practices to Optimize Costs and Govern AWS at Scale” (register here in advance). We will take a closer look at key strategies to help you manage costs, continuously optimize, and govern AWS. We will also be addressing the common mistakes and how to use data-driven approaches to answer the questions we’ve outlined here in this post.

Upcoming Webinar Key Takeaways:
  • Get a close look at the top 10 common mistakes to avoid on AWS
  • How to implement strategies and best practices to continuously optimize, reduce costs, increase ROI, and avoid security and governance pitfalls
  • How to make data-driven decisions that take advantage of arbitrage opportunities within AWS

Let’s look at the top 10 mistakes made when managing resources on AWS:

1. Are you provisioning the capacity you need—no more, no less?

According to 451Research at HCTS Conference this year, it’s been reported that cost is the top enterprise pain point when operating in the cloud. We know that AWS EC2 instance types are sized and priced exponentially. With millions of sizing options and pricing points, choosing the wrong instance type can mean a major pricing premium—or worse, a substantial performance penalty!We see many organizations choose an instance type based on generic guidelines that do not take their specific requirements into account.

2. Do you continuously re-look at instance usage and costs?

AWS expands its choices regularly, so you need to dynamically re-evaluate as your business evolves. The cloud presents many arbitrage opportunities including instance families, generations, types, and regions—but trying to do this manually is a recipe for time-consuming frustration. Don’t fall victim to Instance Inertia: even though the process of making a change is simple enough, it can be difficult to accomplish without having any conclusive evidence of either cost gains or performance improvements.

3. Are there better alternatives to EC2 that can help you save?

AWS Serverless Computing (Lambda) gives you a DevOps-friendly, provision-free, highly scalable, and available ecosystem without having to build a supporting infrastructure in EC2. However, pricing uncertainty can make Lambda daunting for large-scale deployments and a poorly architected Lambda can cost more than its EC2 equivalent! So how do you analyze and optimize Lambda costs? For example, running 30 transactions per second —with each transaction having a runtime of one second consuming 1024MB of memory —will cost $1304.94 on Lambda. A c5.4xlarge instance could most likely run the same workload with similar performance and cost about a third of Lambda ($489.6 monthly).

4. Do you have unused reserved capacity on AWS?

Reservations can be the simplest way to optimize your AWS costs. But accuracy is key because unused reservations are an easy way to lose money in AWS. Worse: if you try to sell an unused RI on the Marketplace, AWS charges a fee, which can make up-front RIs more expensive to sell! Reservations are not guaranteed to be applied towards your bill and apply only if your utilization matches the terms of the reservation. They can only be purchased in 1- and 3-year variants; it can be hard to plan that accurately and that far in advance.

5. Are you regularly surprised with off-budget cloud bills?

Applications need to be modeled in their entirety, not mapped roughly to instances. Their interactions and network traffic between components must be captured and analyzed before making recommendations on placement. Lack of a holistic view of costs before deploying the whole application can lead to unwelcome pricing surprises. Cloud application-planning means taking into account such factors as network and data transfer costs and data durability. How can you ensure a durable deployment architecture without those pricing “wake-up calls” plus gain a placement that factors in details like data and network transfer costs and storage tiers?

6. Do you have an RI strategy?

Purchasing an RI is only the beginning; you should have a process in place to continuously monitor RI utilization and modify unused RIs (split/join or exchange convertible RIs) to maximize their usage. A common AWS billing model is a centralized account with consolidated billing, linked to autonomous accounts so individual accounts can purchase RIs based on their individual usage patterns. But when RIs purchased in an individual account—and not utilized by this account—can’t be reused, you’re risking wastage. Individual accounts may not be linked to each other. Price breaks due to reservations are isolated in individual accounts or accounts that are linked to it. This means unused RIs cannot be shared between accounts in this topology. How do you solve this impasse?

7. Are your developers aware of the financial impact of their decisions?

A new tool called AWS Organizations enables you to manage accounts on organizational boundaries. But many customers already have an account structure based on previous best practices. AWS customers use accounts as units of autonomy and as a security boundary between environments. But often, accounts are linked to VPCs and not to organizational or business units. This makes it hard to create a linkage between spend and business initiatives. How can you ensure that your users have a path to the most cost-efficient choices?

8. Are you managing costs proactively—or risking a shock?

Managing costs is a challenge when spend can balloon past initial projections—and yet be overlooked until it’s too late. If you wait until the end of the monthly AWS billing cycle to see utilization, you may be unpleasantly surprised, and lose the ability to address problems as they occur. Customers who rely on the AWS billing cycle are almost guaranteed to be shocked by the bill when it arrives. Proactive cost management is critical to the ability to maintain good cost governance in the cloud. And that means empowering your users to monitor the financial impact of their decisions, as well as giving them the tools to optimize costs. So how can you manage costs proactively?

9. Are you enforcing end-user accountability?

AWS Cost Governance Best Practices state, “Your organization should emphasize the creation of clear, effective policies and governance mechanisms around cloud deployment, usage, and cost responsibility.”But this can often be at odds with the autonomy that individual users expect to procure, enable, and disable resources at will, without first having to go through a central process for approval. Focusing on cost management and accountability is “back end policy,” after the spend has been incurred. But good cloud governance means enforcing proactive “front end policy” as well, to ensure that any deviations from the norm are addressed as early as possible.For good cloud governance, your end-users need to be accountable for their own costs, plus they need the tools to optimize. AWS Budgets helps you assign budgets, but it’s a monitoring solution and not an enforcement tool. How do you enforce proactive policies and address deviations from the norm as early as possible?

10. Do you share responsibility organization-wide for security with your end users?

By giving your users autonomy to operate in the cloud, but without sharing the responsibility of security with them, you are creating the same security bottlenecks as found in on-premise data centers. A centralized team, far removed from the details of the applications, will inevitably create a perimeter-based security model—which we know is not applicable to the cloud. AWS operates on a shared responsibility model. But end-users are often unaware of security concerns and rely on centralized audits to highlight issues. That lack of awareness is a major roadblock in achieving a shared security model. For transparency and compliance, your end-users need visibility into the security impact of their activities. Can you give them the right tools for that?

A well-thought-out AWS strategy is crucial to your long-term cloud gains.

Register for the webinar to learn best practices for AWS and how to avoid common mistakes

Get a deeper dive into how you can achieve successful, cost-effective cloud operations. Webinar attendees will also receive a complimentary copy of our eBook, 10 Strategies to Manage Costs and Optimize AWS. Come with questions regarding AWS cost and governance we may help answer. We look forward to seeing you then!   

Register Now for the Webinar on Wed., Feb. 13, 2019 at 10 A.M. Pacific Time

About Badri Venkatachari

Badri Venkatachari leads product management and product marketing at HyperGrid. He joined HyperGrid from Microsoft where he managed the StorSimple business, which was a highly successful acquisition that Microsoft made in 2012. His team was responsible for rapidly growing the hybrid cloud storage business and expanding its market reach to more than 60 countries. His responsibilities included product management & marketing, business strategy, GTM, ISV/resale partnerships, and supply-chain planning and fulfillment. Prior to Microsoft, he led product and partner marketing at StorSimple through its acquisition and led post-acquisition integration efforts coordinating across multiple teams. He has also held senior roles in corporate strategic & financial advisory, product management and R&D for distributed systems in Turin Networks, ADC and Novell. Badri has an MBA from Kellogg School of Management. He also holds Masters degrees in Computer Science from Worcester Polytechnic Institute and in Physics from BITS, Pilani, India.

Badrinath Venkatachari

Written by

Badrinath Venkatachari

Badri Venkatachari leads product management and product marketing at HyperGrid. He joined HyperGrid from Microsoft where he managed the StorSimple business, which was a highly successful acquisition that Microsoft made in 2012. His team was responsible for rapidly growing the hybrid cloud storage business and expanding its market reach to more than 60 countries. His responsibilities included product management & marketing, business strategy, GTM, ISV/resale partnerships, and supply-chain planning and fulfillment. Prior to Microsoft, he led product and partner marketing at StorSimple through its acquisition and led post-acquisition integration efforts coordinating across multiple teams. He has also held senior roles in corporate strategic & financial advisory, product management and R&D for distributed systems in Turin Networks, ADC and Novell. Badri has an MBA from Kellogg School of Management. He also holds Masters degrees in Computer Science from Worcester Polytechnic Institute and in Physics from BITS, Pilani, India.


Related Posts

Joe Nemer
Joe Nemer
— April 3, 2020

Breaking News: All AWS Certification Exams Now Available Online

Remote proctoring for all AWS certifications Cloud Academy is an Advanced AWS Technology Partner, and we are happy to announce all AWS certification exams are available online!  What does this mean for you? You can stay focused on your certification goal. Or you can start a certifica...

Read more
  • AWS
  • AWS certification
  • AWS Certifications
Connie Benton
Connie Benton
— April 1, 2020

How To Build a Career with AWS Certifications

From Iaas and PaaS solutions to digital marketing, cloud computing reshapes the world of technology. As the influence of this technology grows, so does investment. Tens of billions of dollars are being spent on cloud computing-related services each year. This influx is continuing to inc...

Read more
  • AWS
  • Certifications
Vijayakumar Athithan
Vijayakumar Athithan
— March 27, 2020

What is Cognito in AWS?

Web applications usually allow a valid username and password combination for successful sign in to the application. Modern authentication flows incorporate more approaches to ensure user authentication. When using AWS, this is no exception, thanks to the abilities and features offered b...

Read more
  • AWS
  • AWS Cognito
  • Solutions Architect
Avatar
Andrew Larkin
— March 20, 2020

The 12 AWS Certifications: Which is Right for You and Your Team?

As companies increasingly shift workloads to the public cloud, cloud computing has moved from a nice-to-have to a core competency in the enterprise. This shift requires a new set of skills to design, deploy, and manage applications in cloud computing. As the market leader and most ma...

Read more
  • AWS
  • AWS Certifications
Alisha Reyes
Alisha Reyes
— March 17, 2020

Cloud Academy’s Blog Digest: How Do AWS Certifications Increase Your Employability, How to Become a Microsoft Certified Azure Data Engineer, and more

With everything going on right now, it's likely that the only thing you've been reading lately is related to the coronavirus pandemic. It's important to stay informed during these times, but it's also good to jump into something that can take your mind off of the current situation for j...

Read more
  • AWS
  • Azure
  • blog digest
  • Certifications
  • Cloud Academy
  • programming
  • Security
Avatar
Cloud Academy Team
— March 13, 2020

Which Certifications Should I Get?

As we mentioned in an earlier post, the old AWS slogan, “Cloud is the new normal” is indeed a reality today. Really, cloud has been the new normal for a while now and getting credentials has become an increasingly effective way to quickly showcase your abilities to recruiters and compan...

Read more
  • AWS
  • Azure
  • Certifications
  • Cloud Computing
  • Google Cloud Platform
Alisha Reyes
Alisha Reyes
— March 7, 2020

New on Cloud Academy: Intro to GitOps; AWS Courses; Java, Python, Amazon Linux 2, Ubuntu, & Docker Playgrounds; and much more

New Lab Playgrounds This month, our Content Team released six new "playground labs." Our playground labs provide a safe and secure sandbox environment for you to explore your own ideas, follow along with Cloud Academy courses, or answer your own questions — all without having to instal...

Read more
  • AWS
  • Azure
  • gitops
  • Google Cloud Platform
  • lab playground
  • programming
Alisha Reyes
Alisha Reyes
— March 6, 2020

New on Cloud Academy: Intro to GitOps; AWS Courses; Java, Python, Amazon Linux 2, Ubuntu, & Docker Playgrounds; and much more

New Lab Playgrounds This month, our Content Team released six new "playground labs." Our playground labs provide a safe and secure sandbox environment for you to explore your own ideas, follow along with Cloud Academy courses, or answer your own questions — all without having to instal...

Read more
  • AWS
  • Azure
  • gitops
  • Google Cloud Platform
  • lab playground
  • programming
Patrick Navarro
Patrick Navarro
— March 4, 2020

AWS Certifications: How Do They Increase Your Employability and Progress Your Career?

AWS certifications are no walk in the park. They’re designed to validate in-depth, specialist knowledge and comprehensive experience, often requiring months of dedicated studying to earn even for those already working with the cloud platform. But the rewards that AWS professionals ca...

Read more
  • AWS
  • AWS certification
  • certification
Avatar
Chandan Patra
— February 21, 2020

Elasticsearch vs. CloudSearch: AWS Cloud Search Choices

Elasticsearch vs. CloudSearch: What's the main difference? Let's compare AWS-based cloud tools: Elasticsearch vs. CloudSearch. While both services use proven technologies, Elasticsearch is more popular, open source, and has a flexible API to use for customization; in comparison, CloudS...

Read more
  • AWS
  • Azure
  • cloudsearch
  • elasticsearch
Avatar
Andrew Larkin
— February 13, 2020

Cloud Academy Content Roadmap Updates

Welcome to our Q1 2020 roadmap. This is the content we plan to build over the next three months, between February 1 - and April 30, 2020. Let's look at some of our roadmap highlights. Atlassian Bamboo for CI/CD We had a lot of requests for practical guides on how to apply DevOps tool...

Read more
  • Artificial Intelligence
  • AWS
  • Azure
  • Docker
  • Google Cloud Platform
  • Kubernetes
  • Machine Learning
Alisha Reyes
Alisha Reyes
— February 7, 2020

New on Cloud Academy: Git Labs, CKA and CKAD Lab Challenges, AWS and Azure Learning Paths, AGILE, and Much More

We just kicked off our first Free Weekend of 2020. This means we've unlocked our Training Library for just 72 hours. Until Sunday at 11:59 pm (PST), you can get unlimited access to our industry-leading learning paths, courses, certification prep exams, and our most popular hands-on labs...

Read more
  • agile
  • AWS
  • Azure
  • Google Cloud Platform
  • Linux
  • OWASP
  • programming
  • red hat
  • scrum