Massive migration to the public cloud is changing architecture patterns, operating principles, and governance models. That means new approaches are vital to get a handle on soaring cloud spend. Because the cloud’s short-term billing cycles call for financial discipline, you must empower end-users to monitor the financial impact of their decisions and give them the tools to optimize for cost and good governance.
Making the Right Decisions on AWS Using Data-Driven Approaches
On Wednesday, February 13, 2019, HyperGrid™ and CloudAcademy will host a webinar “Best Practices to Optimize Costs and Govern AWS at Scale” (register here in advance). We will take a closer look at key strategies to help you manage costs, continuously optimize, and govern AWS. We will also be addressing the common mistakes and how to use data-driven approaches to answer the questions we’ve outlined here in this post.
Upcoming Webinar Key Takeaways:
- Get a close look at the top 10 common mistakes to avoid on AWS
- How to implement strategies and best practices to continuously optimize, reduce costs, increase ROI, and avoid security and governance pitfalls
- How to make data-driven decisions that take advantage of arbitrage opportunities within AWS
Let’s look at the top 10 mistakes made when managing resources on AWS:
1. Are you provisioning the capacity you need—no more, no less?
According to 451Research at HCTS Conference this year, it’s been reported that cost is the top enterprise pain point when operating in the cloud. We know that AWS EC2 instance types are sized and priced exponentially. With millions of sizing options and pricing points, choosing the wrong instance type can mean a major pricing premium—or worse, a substantial performance penalty!We see many organizations choose an instance type based on generic guidelines that do not take their specific requirements into account.
2. Do you continuously re-look at instance usage and costs?
AWS expands its choices regularly, so you need to dynamically re-evaluate as your business evolves. The cloud presents many arbitrage opportunities including instance families, generations, types, and regions—but trying to do this manually is a recipe for time-consuming frustration. Don’t fall victim to Instance Inertia: even though the process of making a change is simple enough, it can be difficult to accomplish without having any conclusive evidence of either cost gains or performance improvements.
3. Are there better alternatives to EC2 that can help you save?
AWS Serverless Computing (Lambda) gives you a DevOps-friendly, provision-free, highly scalable, and available ecosystem without having to build a supporting infrastructure in EC2. However, pricing uncertainty can make Lambda daunting for large-scale deployments and a poorly architected Lambda can cost more than its EC2 equivalent! So how do you analyze and optimize Lambda costs? For example, running 30 transactions per second —with each transaction having a runtime of one second consuming 1024MB of memory —will cost $1304.94 on Lambda. A c5.4xlarge instance could most likely run the same workload with similar performance and cost about a third of Lambda ($489.6 monthly).
4. Do you have unused reserved capacity on AWS?
Reservations can be the simplest way to optimize your AWS costs. But accuracy is key because unused reservations are an easy way to lose money in AWS. Worse: if you try to sell an unused RI on the Marketplace, AWS charges a fee, which can make up-front RIs more expensive to sell! Reservations are not guaranteed to be applied towards your bill and apply only if your utilization matches the terms of the reservation. They can only be purchased in 1- and 3-year variants; it can be hard to plan that accurately and that far in advance.
5. Are you regularly surprised with off-budget cloud bills?
Applications need to be modeled in their entirety, not mapped roughly to instances. Their interactions and network traffic between components must be captured and analyzed before making recommendations on placement. Lack of a holistic view of costs before deploying the whole application can lead to unwelcome pricing surprises. Cloud application-planning means taking into account such factors as network and data transfer costs and data durability. How can you ensure a durable deployment architecture without those pricing “wake-up calls” plus gain a placement that factors in details like data and network transfer costs and storage tiers?
6. Do you have an RI strategy?
Purchasing an RI is only the beginning; you should have a process in place to continuously monitor RI utilization and modify unused RIs (split/join or exchange convertible RIs) to maximize their usage. A common AWS billing model is a centralized account with consolidated billing, linked to autonomous accounts so individual accounts can purchase RIs based on their individual usage patterns. But when RIs purchased in an individual account—and not utilized by this account—can’t be reused, you’re risking wastage. Individual accounts may not be linked to each other. Price breaks due to reservations are isolated in individual accounts or accounts that are linked to it. This means unused RIs cannot be shared between accounts in this topology. How do you solve this impasse?
7. Are your developers aware of the financial impact of their decisions?
A new tool called AWS Organizations enables you to manage accounts on organizational boundaries. But many customers already have an account structure based on previous best practices. AWS customers use accounts as units of autonomy and as a security boundary between environments. But often, accounts are linked to VPCs and not to organizational or business units. This makes it hard to create a linkage between spend and business initiatives. How can you ensure that your users have a path to the most cost-efficient choices?
8. Are you managing costs proactively—or risking a shock?
Managing costs is a challenge when spend can balloon past initial projections—and yet be overlooked until it’s too late. If you wait until the end of the monthly AWS billing cycle to see utilization, you may be unpleasantly surprised, and lose the ability to address problems as they occur. Customers who rely on the AWS billing cycle are almost guaranteed to be shocked by the bill when it arrives. Proactive cost management is critical to the ability to maintain good cost governance in the cloud. And that means empowering your users to monitor the financial impact of their decisions, as well as giving them the tools to optimize costs. So how can you manage costs proactively?
9. Are you enforcing end-user accountability?
AWS Cost Governance Best Practices state, “Your organization should emphasize the creation of clear, effective policies and governance mechanisms around cloud deployment, usage, and cost responsibility.”But this can often be at odds with the autonomy that individual users expect to procure, enable, and disable resources at will, without first having to go through a central process for approval. Focusing on cost management and accountability is “back end policy,” after the spend has been incurred. But good cloud governance means enforcing proactive “front end policy” as well, to ensure that any deviations from the norm are addressed as early as possible.For good cloud governance, your end-users need to be accountable for their own costs, plus they need the tools to optimize. AWS Budgets helps you assign budgets, but it’s a monitoring solution and not an enforcement tool. How do you enforce proactive policies and address deviations from the norm as early as possible?
10. Do you share responsibility organization-wide for security with your end users?
By giving your users autonomy to operate in the cloud, but without sharing the responsibility of security with them, you are creating the same security bottlenecks as found in on-premise data centers. A centralized team, far removed from the details of the applications, will inevitably create a perimeter-based security model—which we know is not applicable to the cloud. AWS operates on a shared responsibility model. But end-users are often unaware of security concerns and rely on centralized audits to highlight issues. That lack of awareness is a major roadblock in achieving a shared security model. For transparency and compliance, your end-users need visibility into the security impact of their activities. Can you give them the right tools for that?
A well-thought-out AWS strategy is crucial to your long-term cloud gains.
Register for the webinar to learn best practices for AWS and how to avoid common mistakes
Get a deeper dive into how you can achieve successful, cost-effective cloud operations. Webinar attendees will also receive a complimentary copy of our eBook, 10 Strategies to Manage Costs and Optimize AWS. Come with questions regarding AWS cost and governance we may help answer. We look forward to seeing you then!
About Badri Venkatachari
Badri Venkatachari leads product management and product marketing at HyperGrid. He joined HyperGrid from Microsoft where he managed the StorSimple business, which was a highly successful acquisition that Microsoft made in 2012. His team was responsible for rapidly growing the hybrid cloud storage business and expanding its market reach to more than 60 countries. His responsibilities included product management & marketing, business strategy, GTM, ISV/resale partnerships, and supply-chain planning and fulfillment. Prior to Microsoft, he led product and partner marketing at StorSimple through its acquisition and led post-acquisition integration efforts coordinating across multiple teams. He has also held senior roles in corporate strategic & financial advisory, product management and R&D for distributed systems in Turin Networks, ADC and Novell. Badri has an MBA from Kellogg School of Management. He also holds Masters degrees in Computer Science from Worcester Polytechnic Institute and in Physics from BITS, Pilani, India.
New on Cloud Academy: AWS Solution Architect Lab Challenge, Azure Hands-on Labs, Foundation Certificate in Cyber Security, and Much More
Now that Thanksgiving is over and the craziness of Black Friday has died down, it's now time for the busiest season of the year. Whether you're a last-minute shopper or you already have your shopping done, the holidays bring so much more excitement than any other time of year. Since our...
Understanding Enterprise Cloud Migration
What is enterprise cloud migration? Cloud migration is about moving your data, applications, and even infrastructure from your on-premises computers or infrastructure to a virtual pool of on-demand, shared resources that offer compute, storage, and network services at scale. Why d...
6 Reasons Why You Should Get an AWS Certification This Year
In the past decade, the rise of cloud computing has been undeniable. Businesses of all sizes are moving their infrastructure and applications to the cloud. This is partly because the cloud allows businesses and their employees to access important information from just about anywhere. ...
AWS Regions and Availability Zones: The Simplest Explanation You Will Ever Find Around
The basics of AWS Regions and Availability Zones We’re going to treat this article as a sort of AWS 101 — it’ll be a quick primer on AWS Regions and Availability Zones that will be useful for understanding the basics of how AWS infrastructure is organized. We’ll define each section,...
Application Load Balancer vs. Classic Load Balancer
What is an Elastic Load Balancer? This post covers basics of what an Elastic Load Balancer is, and two of its examples: Application Load Balancers and Classic Load Balancers. For additional information — including a comparison that explains Network Load Balancers — check out our post o...
Advantages and Disadvantages of Microservices Architecture
What are microservices? Let's start our discussion by setting a foundation of what microservices are. Microservices are a way of breaking large software projects into loosely coupled modules, which communicate with each other through simple Application Programming Interfaces (APIs). ...
Kubernetes Services: AWS vs. Azure vs. Google Cloud
Kubernetes is a popular open-source container orchestration platform that allows us to deploy and manage multi-container applications at scale. Businesses are rapidly adopting this revolutionary technology to modernize their applications. Cloud service providers — such as Amazon Web Ser...
AWS Internet of Things (IoT): The 3 Services You Need to Know
The Internet of Things (IoT) embeds technology into any physical thing to enable never-before-seen levels of connectivity. IoT is revolutionizing industries and creating many new market opportunities. Cloud services play an important role in enabling deployment of IoT solutions that min...
Which Certifications Should I Get?
As we mentioned in an earlier post, the old AWS slogan, “Cloud is the new normal” is indeed a reality today. Really, cloud has been the new normal for a while now and getting credentials has become an increasingly effective way to quickly showcase your abilities to recruiters and compan...
How to Go Serverless Like a Pro
So, no servers? Yeah, I checked and there are definitely no servers. Well...the cloud service providers do need servers to host and run the code, but we don’t have to worry about it. Which operating system to use, how and when to run the instances, the scalability, and all the arch...
AWS Security: Bastion Hosts, NAT instances and VPC Peering
Effective security requires close control over your data and resources. Bastion hosts, NAT instances, and VPC peering can help you secure your AWS infrastructure. Welcome to part four of my AWS Security overview. In part three, we looked at network security at the subnet level. This ti...
Top 13 Amazon Virtual Private Cloud (VPC) Best Practices
Amazon Virtual Private Cloud (VPC) brings a host of advantages to the table, including static private IP addresses, Elastic Network Interfaces, secure bastion host setup, DHCP options, Advanced Network Access Control, predictable internal IP ranges, VPN connectivity, movement of interna...