Skip to main content

AWS: RAID 0 Configuration on EBS Volumes

Amazon Web Services EBS Volumes provides the block level storage volumes of Amazon EC2 instances. EBS volumes are highly available and reliable storage volumes that can be attached to the EC2 instances of the same Availability Zone over AWS internal network. Elastic Block Storage (EBS) is a storage service that is backed by network-connected block storage. So IOPS performance of an EBS volume is measured by the network throughput between the instance and EBS volume.

Two kinds of EBS volumes available

Standard Volumes offer cost-effective storage and can deliver approximately 100 IOPS on average, or burst of hundreds of IOPS. Standard Volumes size can range between 1 GB to 1 TB.

Provisioned IOPS (PIOPS) Volumes are designed for heavy I/O intensive workloads like databases and consistent high I/O throughput. You can specify an IOPS rate when you create the volume. PIOPS Volumes size can range between 10 GB and 1 TB.

The Standard or Provisioned IOPS Volumes I/O performance will depend on the Volume Size and Instance Type.

RAID on EBS Volumes

To get both a faster I/O performance and more than 1TB of volume sizes, you can create a RAID 0 striping using more than one EBS volume.

Advantage: When we perform the RAID 0 Striping of multiple volumes, IOPS are distributed among the volumes of a stripe. If you add another volume to RAID 0, you get the straight addition of IOPS throughput of that volume and additional volume size.

To take advantage of the RAID 0 striping, the instance type should support the High Networking Performance (like m3.xlarge, c3.2xlarge, r3.2xlarge, etc.).

Disadvantage: Loss of a single volume results in a complete data loss.

To avoid the data loss, we should take Snapshots of the RAID volumes frequently, and suspend the writes while taking the snapshot to ensure data integrity and reliability.

Here we will discuss on how to configure the RAID 0 Striping on 2 EBS volumes of several Linux machines. You can expand this to any number of volumes as per your requirements.

Create RAID Configuration

  1. Create the two EBS volumes with a size of 5 GB and attach them to the Amazon Linux Instance.
  2. Create a RAID 0 striped array using the two attached volumes:
    mdadm –create /dev/md0 –level=0 –level=stripe –raid-devices=2 /dev/xvdc /dev/xvdd
    (Assuming the 2 EBS volumes are attached as /dev/xvdc and /dev/xvdd respectively)
  3. Format the raid volume with your favorite file system:
    mkfs.ext4 /dev/md0
  4. Mount it on a temporary directory:
    mount /dev/md0 /srv/raid0
  5. Create some dummy data on /srv/raid0 directory:
    dd if=/dev/zero of=file1 bs=1024 count=65530 (run it about 10 times)
    It will fill 9GB of information onto the RAID meta device. Both the volumes contains data, given that each volume size is 5 GB.

Snapshot RAID volumes

  1. Create snapshots of the two volumes after suspending writes on those volumes.

Restore RAID Volumes

  1. Create the new EBS volumes from the snapshots we have created before.
  2. Launch an EC2 instance of either Amazon Linux or CentOS and attach the newly created EBS volumes.
  3. You can see the RAID meta device is created automatically by the OS itself. Use the fdisk -l command to check it out. Can you mount on a temporary mount point and verify whether 9GB of data is available or not?
  4. Now, launch an EC2 instance of Ubuntu and attach the newly created EBS volumes.
  5. Run the fdisk –l command and verify whether the RAID meta device created automatically by the OS itself. If not, run the following command to create the RAID meta device
    madam –assemble /dev/md0 /dev/xvdc /dev/xvdd
  6. Now you can see a meta device with the name /dev/md0. You can mount it and check its content.

Hope this article will help you to manage the RAID configuration on EBS volumes to gain the maximum IOPS.

Avatar

Written by

Praveen Kumar Muppala

I have strong experience on Multiple Unix/Linux flavours, LAMP Stack, Monitoring Systems, Database, NoSQL. I love to explore the new concepts/services in Cloud Computing World. I have written 4 certifications in different flavours of Linux/Unix.

Related Posts

Jeff Hyatt
Jeff Hyatt
— June 18, 2019

10 Steps for an Effective Reserved Instances Strategy

Amazon Web Services (AWS) offers three different ways to pay for EC2 Instances: On-Demand, Reserved Instances, and Spot Instances. This article will focus on effective strategies for purchasing Reserved Instances. While most of the major cloud platforms offer pre-pay and reservation dis...

Read more
  • AWS
  • EC2
Joe Nemer
Joe Nemer
— June 18, 2019

AWS Certification Practice Exam: What to Expect from Test Questions

If you’re building applications on the AWS cloud or looking to get started in cloud computing, certification is a way to build deep knowledge in key services unique to the AWS platform. AWS currently offers 11 certifications that cover major cloud roles including Solutions Architect, De...

Read more
  • AWS
  • AWS Certifications
Avatar
John Chell
— June 13, 2019

AWS Certified Solutions Architect Associate: A Study Guide

The AWS Solutions Architect - Associate Certification (or Sol Arch Associate for short) offers some clear benefits: Increases marketability to employers Provides solid credentials in a growing industry (with projected growth of as much as 70 percent in five years) Market anal...

Read more
  • AWS
  • AWS Certifications
Chris Gambino and Joe Niemiec
Chris Gambino and Joe Niemiec
— June 11, 2019

Moving Data to S3 with Apache NiFi

Moving data to the cloud is one of the cornerstones of any cloud migration. Apache NiFi is an open source tool that enables you to easily move and process data using a graphical user interface (GUI).  In this blog post, we will examine a simple way to move data to the cloud using NiFi c...

Read more
  • AWS
  • S3
Avatar
Chandan Patra
— June 11, 2019

Amazon DynamoDB: 10 Things You Should Know

Amazon DynamoDB is a managed NoSQL service with strong consistency and predictable performance that shields users from the complexities of manual setup.Whether or not you've actually used a NoSQL data store yourself, it's probably a good idea to make sure you fully understand the key ...

Read more
  • AWS
  • DynamoDB
Avatar
Andrew Larkin
— June 6, 2019

The 11 AWS Certifications: Which is Right for You and Your Team?

As companies increasingly shift workloads to the public cloud, cloud computing has moved from a nice-to-have to a core competency in the enterprise. This shift requires a new set of skills to design, deploy, and manage applications in cloud computing.As the market leader and most ma...

Read more
  • AWS
  • AWS Certifications
Sam Ghardashem
Sam Ghardashem
— May 15, 2019

Aviatrix Integration of a NextGen Firewall in AWS Transit Gateway

Learn how Aviatrix’s intelligent orchestration and control eliminates unwanted tradeoffs encountered when deploying Palo Alto Networks VM-Series Firewalls with AWS Transit Gateway.Deploying any next generation firewall in a public cloud environment is challenging, not because of the f...

Read more
  • AWS
Joe Nemer
Joe Nemer
— May 3, 2019

AWS Config Best Practices for Compliance

Use AWS Config the Right Way for Successful ComplianceIt’s well-known that AWS Config is a powerful service for monitoring all changes across your resources. As AWS Config has constantly evolved and improved over the years, it has transformed into a true powerhouse for monitoring your...

Read more
  • AWS
  • Compliance
Avatar
Francesca Vigliani
— April 30, 2019

Cloud Academy is Coming to the AWS Summits in Atlanta, London, and Chicago

Cloud Academy is a proud sponsor of the 2019 AWS Summits in Atlanta, London, and Chicago. We hope you plan to attend these free events that bring the cloud computing community together to connect, collaborate, and learn about AWS. These events are all about learning. You can learn how t...

Read more
  • AWS
  • AWS Summits
Paul Hortop
Paul Hortop
— April 2, 2019

How to Monitor Your AWS Infrastructure

The AWS cloud platform has made it easier than ever to be flexible, efficient, and cost-effective. However, monitoring your AWS infrastructure is the key to getting all of these benefits. Realizing these benefits requires that you follow AWS best practices which constantly change as AWS...

Read more
  • AWS
  • Monitoring
Joe Nemer
Joe Nemer
— April 1, 2019

AWS EC2 Instance Types Explained

Amazon Web Services’ resource offerings are constantly changing, and staying on top of their evolution can be a challenge. Elastic Cloud Compute (EC2) instances are one of their core resource offerings, and they form the backbone of most cloud deployments. EC2 instances provide you with...

Read more
  • AWS
  • EC2
Avatar
Nitheesh Poojary
— March 26, 2019

How DNS Works – the Domain Name System (Part One)

Before migrating domains to Amazon's Route53, we should first make sure we properly understand how DNS worksWhile we'll get to AWS's Route53 Domain Name System (DNS) service in the second part of this series, I thought it would be helpful to first make sure that we properly understand...

Read more
  • AWS