Using AWS tags to control deployment sprawl
Possible structural profiles that can benefit from AWS tags
- Environment-based tags can be used by customers with larger AWS footprints. These tags will help you quickly distinguish between resources that are part of your production, development, or staging infrastructure.
- Application-based tags can be used to describe the set of disparate resources (or clusters) that work together to deliver a particular product or service. Such tags can also make sense for resource identification in smaller environments.
- Role-based tags are used to describe either the function or owner of a particular node (web server, database server, load balancer, etc). Such tags are appropriate for smaller deployments.
How AWS tags help
Here’s one obvious scenario. Imagine an operation providing multiple separate applications served through dozens or hundreds of EC2 instances along with the accompanying environment infrastructure.
Just keeping track of your ongoing billing costs can be a headache. Ask yourself these questions: Which AWS resources (instances, volumes, snapshots…) are actually in use and which are currently lying idle or detached? Which Tiers or environments are incurring the highest costs? Should this be changed? Which business unit is exceeding their AWS cost allocations?
Tags can help. Being able to visually or programmatically identify resources by descriptive tags can make it much easier to understand both their purpose and provenance. If you know what a resource is supposed to be doing, then you’re in a much better position to quickly assess and, if necessary, adjust its costs. Tagging is a simple but essential feature that helps us reduce and control costs by improving the way we understand what’s really going on.
AWS Tags: in detail
Each AWS tag consists of a key and a value, both of which can be defined by the user. Not every AWS service permits customer-defined tags for every service, and some that do can only be tagged only using API Command Line access. The following Screen Shot shows the current tag-status of AWS resources. Resources with tagging restrictions of “None” can be tagged with API actions, the CLI, and the console.
The following diagram illustrates how tagging works:
In this example, I am assigning two tags to each of my EC2 instances, one called Owner and another called Stack. Each of the tags also has an associated value.
Owner = Nitheesh, Stack = Production
You can define AWS tags from the EC2 console by selecting the relevant instance and selecting the “Tags” option. Alternatively, you can select the instance, click “Actions” and select “Add/Edit Tags.”
AWS Tagging limitations and cost leakage
Currently, AWS Tags have important limitations. For example, a tag associated with a single AWS resource will apply only to that resource and is not automatically propagated to dependent attached resources.
For example, imagine an EC2 instance whose dependent resources include devices like EBS volumes, Security Groups, and Snapshots. A simple RAID configuration could involve as many as eight EBS Volumes and an unmanageable number of snapshots. But none of these dependent devices will automatically inherit their parent’s tags.
Now imagine how this might look if you’re running thousands of EC2 instances. You’ll have to find each EBS volume associated with a particular instance and individually tag it. Managing this is easier said than done, and the slightest typing error can lead to significant cost leakage.
What if there was a tool to automate tagging for dependent AWS resources? It will surely reduce a great deal of manual labor, and help us identify and, if necessary, remove all dependent resources along with a newly redundant EC2 instance. This would avoid leakages and reduce the cost of cloud operations in very dynamic AWS environments.
Welcome to Graffiti Monkey
There is just such a tool. Graffiti Monkey goes around tagging things automatically. By looking at the tags of an EC2 instance, it copies those tags to all attached EBS Volumes and copies those tags to the EBS Snapshots as well. This small automation reduces hours of manual labor on large AWS deployments, helping us efficiently manage our cloud infrastructure and reduce the cost leakages.
Step 1: Installing Graffiti Monkey
Step 2: Using Graffiti Monkey
graffiti-monkey --region ap-southeast-2 --verbose
AWS Security: Bastion Host, NAT instances and VPC Peering
Effective security requires close control over your data and resources. Bastion hosts, NAT instances, and VPC peering can help you secure your AWS infrastructure. Welcome to part four of my AWS Security overview. In part three, we looked at network security at the subnet level. This ti...
Top 13 Amazon Virtual Private Cloud (VPC) Best Practices
Amazon Virtual Private Cloud (VPC) brings a host of advantages to the table, including static private IP addresses, Elastic Network Interfaces, secure bastion host setup, DHCP options, Advanced Network Access Control, predictable internal IP ranges, VPN connectivity, movement of interna...
Big Changes to the AWS Certification Exams
With AWS re:Invent 2019 just around the corner, we can expect some early announcements to trickle through with upcoming features and services. However, AWS has just announced some big changes to their certification exams. So what’s changing and what’s new? There is a brand NEW ...
New on Cloud Academy: ITIL® 4, Microsoft 365 Tenant, Jenkins, TOGAF® 9.1, and more
At Cloud Academy, we're always striving to make improvements to our training platform. Based on your feedback, we released some new features to help make it easier for you to continue studying. These new features allow you to: Remove content from “Continue Studying” section Disc...
AWS Security Groups: Instance Level Security
Instance security requires that you fully understand AWS security groups, along with patching responsibility, key pairs, and various tenancy options. As a precursor to this post, you should have a thorough understanding of the AWS Shared Responsibility Model before moving onto discussi...
Cloud Migration Risks & Benefits
If you’re like most businesses, you already have at least one workload running in the cloud. However, that doesn’t mean that cloud migration is right for everyone. While cloud environments are generally scalable, reliable, and highly available, those won’t be the only considerations dri...
Real-Time Application Monitoring with Amazon Kinesis
Amazon Kinesis is a real-time data streaming service that makes it easy to collect, process, and analyze data so you can get quick insights and react as fast as possible to new information. With Amazon Kinesis you can ingest real-time data such as application logs, website clickstre...
Google Cloud Functions vs. AWS Lambda: The Fight for Serverless Cloud Domination
Serverless computing: What is it and why is it important? A quick background The general concept of serverless computing was introduced to the market by Amazon Web Services (AWS) around 2014 with the release of AWS Lambda. As we know, cloud computing has made it possible for users to ...
Google Vision vs. Amazon Rekognition: A Vendor-Neutral Comparison
Google Cloud Vision and Amazon Rekognition offer a broad spectrum of solutions, some of which are comparable in terms of functional details, quality, performance, and costs. This post is a fact-based comparative analysis on Google Vision vs. Amazon Rekognition and will focus on the tech...
New on Cloud Academy: CISSP, AWS, Azure, & DevOps Labs, Python for Beginners, and more…
As Hurricane Dorian intensifies, it looks like Floridians across the entire state might have to hunker down for another big one. If you've gone through a hurricane, you know that preparing for one is no joke. You'll need a survival kit with plenty of water, flashlights, batteries, and n...
Amazon Route 53: Why You Should Consider DNS Migration
What Amazon Route 53 brings to the DNS table Amazon Route 53 is a highly available and scalable Domain Name System (DNS) service offered by AWS. It is named by the TCP or UDP port 53, which is where DNS server requests are addressed. Like any DNS service, Route 53 handles domain regist...
How to Unlock Complimentary Access to Cloud Academy
Are you looking to get trained or certified on AWS, Azure, Google Cloud Platform, DevOps, Cloud Security, Python, Java, or another technical skill? Then you'll want to mark your calendars for August 23, 2019. Starting Friday at 12:00 a.m. PDT (3:00 a.m. EDT), Cloud Academy is offering c...