Bootstrapping EC2 Instances with Chef

This is a guest post from 47Line Technologies

In the previous blogs, we introduced Chef and set up the Chef Server, Workstation on EC2 instances. Please refer to the earlier blogs here.
Configuration Management – Introducing Chef
Getting Started with Chef on Amazon AWS

In the blog, we will look into bootstrapping EC2 instances with Chef.

The bootstrapping process involves setting up a Chef Client on a node. Chef Client Communicates with the Chef Server to receive directions for its own configuration. After the client receives the policy, it applies to the node to ensure the client is configured as per the directions of the server.

Knife-ec2 is official Chef Knife plugin for EC2. This plugin gives knife the ability to create, bootstrap, and manage EC2 instances.

Install the knife-ec2 plugin on your workstation

sudo apt-get install gcc g++ make autoconf
sudo apt-get install libxml2 libxml2-dev libxslt1-dev
sudo /opt/chef/embedded/bin/gem install nokogiri -v '1.5.2' -- --with-xml2-lib=/usr/lib/i386-linux-gnu --with-xml2-include=/usr/include/libxml2 --with-xslt-lib=/usr/lib/i386-linux-gnu --with-xslt-include=/usr/include/libxslt
sudo /opt/chef/embedded/bin/gem install knife-ec2 –V

The plugin provides the following sub-commands. Use the — help flag to find specific command options.

knife ec2 server create
knife ec2 server delete
knife ec2 server list

On the workstation, create the required cookbooks and upload to the Chef Server.

cd ~/chef-repo/cookbooks/
#clone the repositories from github
git clone https://github.com/opscode-cookbooks/apt/
git clone https://github.com/socrata-cookbooks/java
git clone https://github.com/opscode-cookbooks/openssl
git clone https://github.com/opscode-cookbooks/tomcat
# upload the cookbooks to the server
knife cookbook upload java apt
knife cookbook upload openssl tomcat

A role is a way to define certain patterns and processes that exist across nodes in an organization as belonging to a single job function. Each role consists of zero (or more) attributes and a run list. Each node can have zero (or more) roles assigned to it.

We will create a “tomcatwebapp” role and then use it bootstrap an EC2 instance.

export EDITOR=$(which vi)
# Create tomcatwebapp role
knife role create tomcatwebapp

the command will open up the vim editor, edit the file contents as below.

{
"name": "tomcatwebapp",
 "description": "Install Java and Tomcat",
"json_class": "Chef::Role", 
"default_attributes": {  }, 
"chef_type": "role",
"run_list": [  "recipe[apt]",  "recipe[tomcat]  ], 
"env_run_lists": {   }, 
"override_attributes": {  }
}

Login to the Chef Server and navigate to the Roles tab, you must see the role we created.
Chef Server Roles tab
Now we are all set to bootstrap an EC2 instance with the tomcatwebapp role with the following command.

knife ec2 server create -I ami-3c39686e -r "role[tomcatwebapp]" -Z ap-southeast-1a --groups Chef-SecGrp -S chef -i chef.pem -f m1.medium -A 'AKIXXXXXXXXXXXXXXXXXX' -K "XXXXXXXXXXXXXXXXXXXXXXX" --region ap-southeast-1 --ssh-user ubuntu

A m1.medium EC2 instance will be launched in the ap-southeast-1a zone with the given group and key name.  The role ‘tomcatwebapp’ will be applied to the instance as well.

When the role ‘tomcatwebapp’ is run against the node, the configuration details of that node are compared against the attributes of the role, and then the contents of the role’s run list are applied to the node’s configuration details. When a chef-client runs, it merges its own attributes and runs lists with those contained within each assigned role.

On the Chef Server, we will be able to list the nodes and see the node with the tomcatwebapp role.
List of the nodes with the tomcatwebapp role
In the next blog, we will introduce creating cookbooks and recipes.

Avatar

Written by

47Line Technologies

47Line is building solutions solving critical business problems using “cloud as the backbone”. The team has been working in Cloud Computing domain for last 6 years and have proven thought leadership in Cloud, Big Data technologies.


Related Posts

Alisha Reyes
Alisha Reyes
— December 5, 2019

New on Cloud Academy: AWS Solution Architect Lab Challenge, Azure Hands-on Labs, Foundation Certificate in Cyber Security, and Much More

Now that Thanksgiving is over and the craziness of Black Friday has died down, it's now time for the busiest season of the year. Whether you're a last-minute shopper or you already have your shopping done, the holidays bring so much more excitement than any other time of year. Since our...

Read more
  • AWS
  • AWS solution architect
  • AZ-203
  • Azure
  • cyber security
  • FCCS
  • Foundation Certificate in Cyber Security
  • Google Cloud Platform
  • Kubernetes
Avatar
Cloud Academy Team
— December 4, 2019

Understanding Enterprise Cloud Migration

What is enterprise cloud migration? Cloud migration is about moving your data, applications, and even infrastructure from your on-premises computers or infrastructure to a virtual pool of on-demand, shared resources that offer compute, storage, and network services at scale. Why d...

Read more
  • AWS
  • Azure
  • Data Migration
Wendy Dessler
Wendy Dessler
— November 27, 2019

6 Reasons Why You Should Get an AWS Certification This Year

In the past decade, the rise of cloud computing has been undeniable. Businesses of all sizes are moving their infrastructure and applications to the cloud. This is partly because the cloud allows businesses and their employees to access important information from just about anywhere. ...

Read more
  • AWS
  • Certifications
  • certified
Avatar
Andrea Colangelo
— November 26, 2019

AWS Regions and Availability Zones: The Simplest Explanation You Will Ever Find Around

The basics of AWS Regions and Availability Zones We’re going to treat this article as a sort of AWS 101 — it’ll be a quick primer on AWS Regions and Availability Zones that will be useful for understanding the basics of how AWS infrastructure is organized. We’ll define each section,...

Read more
  • AWS
Avatar
Dzenan Dzevlan
— November 20, 2019

Application Load Balancer vs. Classic Load Balancer

What is an Elastic Load Balancer? This post covers basics of what an Elastic Load Balancer is, and two of its examples: Application Load Balancers and Classic Load Balancers. For additional information — including a comparison that explains Network Load Balancers — check out our post o...

Read more
  • ALB
  • Application Load Balancer
  • AWS
  • Elastic Load Balancer
  • ELB
Albert Qian
Albert Qian
— November 13, 2019

Advantages and Disadvantages of Microservices Architecture

What are microservices? Let's start our discussion by setting a foundation of what microservices are. Microservices are a way of breaking large software projects into loosely coupled modules, which communicate with each other through simple Application Programming Interfaces (APIs). ...

Read more
  • AWS
  • Docker
  • Kubernetes
  • Microservices
Nisar Ahmad
Nisar Ahmad
— November 12, 2019

Kubernetes Services: AWS vs. Azure vs. Google Cloud

Kubernetes is a popular open-source container orchestration platform that allows us to deploy and manage multi-container applications at scale. Businesses are rapidly adopting this revolutionary technology to modernize their applications. Cloud service providers — such as Amazon Web Ser...

Read more
  • AWS
  • Azure
  • Google Cloud
  • Kubernetes
Avatar
Stuart Scott
— October 31, 2019

AWS Internet of Things (IoT): The 3 Services You Need to Know

The Internet of Things (IoT) embeds technology into any physical thing to enable never-before-seen levels of connectivity. IoT is revolutionizing industries and creating many new market opportunities. Cloud services play an important role in enabling deployment of IoT solutions that min...

Read more
  • AWS
  • AWS IoT Events
  • AWS IoT SiteWise
  • AWS IoT Things Graph
  • IoT
Avatar
Cloud Academy Team
— October 23, 2019

Which Certifications Should I Get?

As we mentioned in an earlier post, the old AWS slogan, “Cloud is the new normal” is indeed a reality today. Really, cloud has been the new normal for a while now and getting credentials has become an increasingly effective way to quickly showcase your abilities to recruiters and compan...

Read more
  • AWS
  • Azure
  • Certifications
  • Cloud Computing
  • Google Cloud Platform
Valery Calderón Briz
Valery Calderón Briz
— October 22, 2019

How to Go Serverless Like a Pro

So, no servers? Yeah, I checked and there are definitely no servers. Well...the cloud service providers do need servers to host and run the code, but we don’t have to worry about it. Which operating system to use, how and when to run the instances, the scalability, and all the arch...

Read more
  • AWS
  • Lambda
  • Serverless
Avatar
Stuart Scott
— October 16, 2019

AWS Security: Bastion Hosts, NAT instances and VPC Peering

Effective security requires close control over your data and resources. Bastion hosts, NAT instances, and VPC peering can help you secure your AWS infrastructure. Welcome to part four of my AWS Security overview. In part three, we looked at network security at the subnet level. This ti...

Read more
  • AWS
Avatar
Sudhi Seshachala
— October 9, 2019

Top 13 Amazon Virtual Private Cloud (VPC) Best Practices

Amazon Virtual Private Cloud (VPC) brings a host of advantages to the table, including static private IP addresses, Elastic Network Interfaces, secure bastion host setup, DHCP options, Advanced Network Access Control, predictable internal IP ranges, VPN connectivity, movement of interna...

Read more
  • AWS
  • best practices
  • VPC