Bootstrapping EC2 Instances with Chef

This is a guest post from 47Line Technologies

In the previous blogs, we introduced Chef and set up the Chef Server, Workstation on EC2 instances. Please refer to the earlier blogs here.
Configuration Management – Introducing Chef
Getting Started with Chef on Amazon AWS

In the blog, we will look into bootstrapping EC2 instances with Chef.

The bootstrapping process involves setting up a Chef Client on a node. Chef Client Communicates with the Chef Server to receive directions for its own configuration. After the client receives the policy, it applies to the node to ensure the client is configured as per the directions of the server.

Knife-ec2 is official Chef Knife plugin for EC2. This plugin gives knife the ability to create, bootstrap, and manage EC2 instances.

Install the knife-ec2 plugin on your workstation

sudo apt-get install gcc g++ make autoconf
sudo apt-get install libxml2 libxml2-dev libxslt1-dev
sudo /opt/chef/embedded/bin/gem install nokogiri -v '1.5.2' -- --with-xml2-lib=/usr/lib/i386-linux-gnu --with-xml2-include=/usr/include/libxml2 --with-xslt-lib=/usr/lib/i386-linux-gnu --with-xslt-include=/usr/include/libxslt
sudo /opt/chef/embedded/bin/gem install knife-ec2 –V

The plugin provides the following sub-commands. Use the — help flag to find specific command options.

knife ec2 server create
knife ec2 server delete
knife ec2 server list

On the workstation, create the required cookbooks and upload to the Chef Server.

cd ~/chef-repo/cookbooks/
#clone the repositories from github
git clone https://github.com/opscode-cookbooks/apt/
git clone https://github.com/socrata-cookbooks/java
git clone https://github.com/opscode-cookbooks/openssl
git clone https://github.com/opscode-cookbooks/tomcat
# upload the cookbooks to the server
knife cookbook upload java apt
knife cookbook upload openssl tomcat

A role is a way to define certain patterns and processes that exist across nodes in an organization as belonging to a single job function. Each role consists of zero (or more) attributes and a run list. Each node can have zero (or more) roles assigned to it.

We will create a “tomcatwebapp” role and then use it bootstrap an EC2 instance.

export EDITOR=$(which vi)
# Create tomcatwebapp role
knife role create tomcatwebapp

the command will open up the vim editor, edit the file contents as below.

{
"name": "tomcatwebapp",
 "description": "Install Java and Tomcat",
"json_class": "Chef::Role", 
"default_attributes": {  }, 
"chef_type": "role",
"run_list": [  "recipe[apt]",  "recipe[tomcat]  ], 
"env_run_lists": {   }, 
"override_attributes": {  }
}

Login to the Chef Server and navigate to the Roles tab, you must see the role we created.
Chef Server Roles tab
Now we are all set to bootstrap an EC2 instance with the tomcatwebapp role with the following command.

knife ec2 server create -I ami-3c39686e -r "role[tomcatwebapp]" -Z ap-southeast-1a --groups Chef-SecGrp -S chef -i chef.pem -f m1.medium -A 'AKIXXXXXXXXXXXXXXXXXX' -K "XXXXXXXXXXXXXXXXXXXXXXX" --region ap-southeast-1 --ssh-user ubuntu

A m1.medium EC2 instance will be launched in the ap-southeast-1a zone with the given group and key name.  The role ‘tomcatwebapp’ will be applied to the instance as well.

When the role ‘tomcatwebapp’ is run against the node, the configuration details of that node are compared against the attributes of the role, and then the contents of the role’s run list are applied to the node’s configuration details. When a chef-client runs, it merges its own attributes and runs lists with those contained within each assigned role.

On the Chef Server, we will be able to list the nodes and see the node with the tomcatwebapp role.
List of the nodes with the tomcatwebapp role
In the next blog, we will introduce creating cookbooks and recipes.

Avatar

Written by

47Line Technologies

47Line is building solutions solving critical business problems using “cloud as the backbone”. The team has been working in Cloud Computing domain for last 6 years and have proven thought leadership in Cloud, Big Data technologies.

Related Posts

Avatar
Michael Sheehy
— August 19, 2019

What Exactly Is a Cloud Architect and How Do You Become One?

One of the buzzwords surrounding the cloud that I'm sure you've heard is "Cloud Architect." In this article, I will outline my understanding of what a cloud architect does and I'll analyze the skills and certifications necessary to become one. I will also list some of the types of jobs ...

Read more
  • AWS
  • Cloud Computing
Avatar
Nitheesh Poojary
— August 16, 2019

Boto: Using Python to Automate AWS Services

Boto allows you to write scripts to automate things like starting AWS EC2 instances Boto is a Python package that provides programmatic connectivity to Amazon Web Services (AWS). AWS offers a range of services for dynamically scaling servers including the core compute service, Elastic...

Read more
  • Automated AWS Services
  • AWS
  • Boto
  • Python
Avatar
Andrew Larkin
— August 13, 2019

Content Roadmap: AZ-500, ITIL 4, MS-100, Google Cloud Associate Engineer, and More

Last month, Cloud Academy joined forces with QA, the UK’s largest B2B skills provider, and it put us in an excellent position to solve a massive skills gap problem. As a result of this collaboration, you will see our training library grow with additions from QA’s massive catalog of 500+...

Read more
  • AWS
  • Azure
  • content roadmap
  • Google Cloud Platform
Avatar
Adam Hawkins
— August 9, 2019

DevSecOps: How to Secure DevOps Environments

Security has been a friction point when discussing DevOps. This stems from the assumption that DevOps teams move too fast to handle security concerns. This makes sense if Information Security (InfoSec) is separate from the DevOps value stream, or if development velocity exceeds the band...

Read more
  • AWS
  • cloud security
  • DevOps
  • DevSecOps
  • Security
Avatar
Stefano Giacone
— August 8, 2019

Test Your Cloud Knowledge on AWS, Azure, or Google Cloud Platform

Cloud skills are in demand | In today's digital era, employers are constantly seeking skilled professionals with working knowledge of AWS, Azure, and Google Cloud Platform. According to the 2019 Trends in Cloud Transformation report by 451 Research: Business and IT transformations re...

Read more
  • AWS
  • Cloud skills
  • Google Cloud
  • Microsoft Azure
Avatar
Andrew Larkin
— August 7, 2019

Disadvantages of Cloud Computing

If you want to deliver digital services of any kind, you’ll need to estimate all types of resources, not the least of which are CPU, memory, storage, and network connectivity. Which resources you choose for your delivery —  cloud-based or local — is up to you. But you’ll definitely want...

Read more
  • AWS
  • Azure
  • Cloud Computing
  • Google Cloud Platform
Joe Nemer
Joe Nemer
— August 6, 2019

Google Cloud vs AWS: A Comparison (or can they be compared?)

The "Google Cloud vs AWS" argument used to be a common discussion among our members, but is this still really a thing? You may already know that there are three major players in the public cloud platforms arena: Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP)...

Read more
  • AWS
  • Google Cloud Platform
  • Kubernetes
Avatar
Stuart Scott
— July 29, 2019

Deployment Orchestration with AWS Elastic Beanstalk

If you're responsible for the development and deployment of web applications within your AWS environment for your organization, then it's likely you've heard of AWS Elastic Beanstalk. If you are new to this service, or simply need to know a bit more about the service and the benefits th...

Read more
  • AWS
  • elastic beanstalk
Avatar
Stuart Scott
— July 26, 2019

How to Use & Install the AWS CLI

What is the AWS CLI? | The AWS Command Line Interface (CLI) is for managing your AWS services from a terminal session on your own client, allowing you to control and configure multiple AWS services and implement a level of automation. If you’ve been using AWS for some time and feel...

Read more
  • AWS
  • AWS CLI
  • Command line interface
Alisha Reyes
Alisha Reyes
— July 22, 2019

Cloud Academy’s Blog Digest: July 2019

July has been a very exciting month for us at Cloud Academy. On July 10, we officially joined forces with QA, the UK’s largest B2B skills provider (read the announcement). Over the coming weeks, you will see additions from QA’s massive catalog of 500+ certification courses and 1500+ ins...

Read more
  • AWS
  • Azure
  • Cloud Academy
  • Cybersecurity
  • DevOps
  • Kubernetes
Avatar
Stuart Scott
— July 18, 2019

AWS Fundamentals: Understanding Compute, Storage, Database, Networking & Security

If you are just starting out on your journey toward mastering AWS cloud computing, then your first stop should be to understand the AWS fundamentals. This will enable you to get a solid foundation to then expand your knowledge across the entire AWS service catalog.   It can be both d...

Read more
  • AWS
  • Compute
  • Database
  • fundamentals
  • networking
  • Security
  • Storage
Avatar
Adam Hawkins
— July 17, 2019

How to Become a DevOps Engineer

The DevOps Handbook introduces DevOps as a framework for improving the process for converting a business hypothesis into a technology-enabled service that delivers value to the customer. This process is called the value stream. Accelerate finds that applying DevOps principles of flow, f...

Read more
  • AWS
  • AWS Certifications
  • DevOps
  • DevOps Foundation Certification
  • Engineer
  • Kubernetes