Skip to main content

Riak CS: a Cloud Storage Solution Compatible with Amazon S3

Riak CS is an open source cloud storage technology compatible with Amazon S3 and Openstack Swift. Discover why more and more companies are using it.

Riak CS may not be the best-known cloud storage technology right now, but it’s definitely worthy of our attention. This post isn’t meant to provide an end-to-end installation and configuration guide, but to familiarize you with its function and features and to explain why you might want to use it, rather than various alternatives.

What is Riak CS?

Riak CS (“CS” stands for Cloud Storage) is object storage management software that’s built on top of Riak, Basho’s distributed database. It can be used to store any type of data like images, video, documents, and database backups. Riak CS stores key/value pairs in namespaces called Buckets. It’s open source and can be easily downloaded.

Why use Riak CS?

With the increasing adoption of cloud technologies, storage must not only exist in ever increasing capacity, but must also be reliable, easy to maintain, distributed, scalable, and cheap. But Riak isn’t the only storage option available for handling large volumes of data. Why not, for instance, stick with local solutions like SAN or NAS?

The traditional approaches to storage were designed for structured data, but today the major sources of data are machines (like sensors and smartphones). These data are unstructured and require a more robust storage solution to handle the greater variety. Earlier storage designs, on the other hand, were not very fault tolerant and would need greater effort to maintain their reliability.

Besides being better at handling unstructured data, Riak CS tries to address all the major drawbacks of traditional storage solutions by avoiding the single point of failure architectures, and by introducing greater fault tolerance, more robust management, scaling, and lower costs.

But what about other cloud solutions, and especially AWS’s dominant Simple Storage Service? What can Riak CS possibly offer that we can’t already get from S3?

This one is a bit more tricky.

Amazon S3 is a pay-as-you-go service that’s as reliable as just about anything else out there, and it’s cost effective. But, as it’s provided by a public provider, you lose some control over uptime (even though AWS’s record is very good). Moreover, there will be cases where you are simply reluctant to store secured data outside your data center.

Riak CS gives you the flexibility to configure the entire setup within your datacenter – behind your organization’s firewall. If done right, this can provide better security and more control over your storage operations. Therefore, Riak CS can be a preferred choice even over AWS S3 for customers looking for…

  • Complete control over storage design and configuration.
  • Storage protected behind the organization’s firewall.
  • Control over uptime and quality of service.
  • Customized solutions implemented in ways similar to cloud drives (like Dropbox).
  • Huge unstructured data stores that can dynamically (and economically) scale.
  • Low Latency.
  • High read/write availability.
Riak CS architecture
How Riak CS works

Ok. So given that there are going to be use cases where Riak CS can outperform other solutions in its class, we should still ask ourselves: Why Riak CS and not Riak? Both are built for storage, both are highly available and scalable. Why not Riak?

Here we will need to understand some key structural differences between Riak & Riak CS.

  • Riak CS is used to store very large objects – into the terabyte size range. But Riak excels at quickly storing and retrieving smaller objects.
  • Riak is a database, and it’s never recommended to directly expose a database to a network without authentication or authorization – something Riak currently lacks. Riak CS, on the other hand, is designed for web users, and hence supports both authentication and authorization.
  • Compatibility with major players in the storage market is critically important for full integration. Riak CS’s APIs are compatible with AWS S3, but that’s not possible with Riak. Riak uses native HTTP or Protocol Buffers APIs, but Riak CS is compatible with Amazon’s S3 and OpenStack’s Swift APIs
  • Data consistency is vital for cloud storage solutions even though writes are being requested in parallel from all ends of a cluster, it’s very important that the data remain consistent – especially if you’re relying on user level authentication. Riak, compared to Riak CS, doesn’t provide a particularly high level of consistency.

Riak CS Features

Now that we’re a bit more familiar with some of Riak CS’s ideal use cases, let’s focus briefly on some specific features to help inform your enterprise deployment decision.

  • The Riak CS API is compatible with the Amazon S3 API.
  • Riak CS doesn’t work with a master-slave model, hence all nodes are responsible for all kind of requests.
  • With its Per Tenant Visibility capability, it’s easier to track per-tenant usage.
  • Riak CS cluster nodes can scale dynamically without any downtime.
  • With Riak CS’s enterprise edition, the data can be replicated across different data centers for greater reliability.
  • You can store individual images, text, video, documents, database backups, software binaries and other content up to 5GB as a single, easily retrievable object.
  • Cost effective.
  • Easy setup.
  • Easy maintenance.

Riak CS is making noise in its market and has been adopted by some serious customers. Perhaps its time for a closer look.

To learn more about the storage services provided by AWS, Cloud Academy’s AWS Storage Fundamentals is your go-to training course to get an in-depth understanding of AWS storage features, when and why you might use the service within your own environment.

Avatar

Written by

Vineet Badola

Working as a cloud professional for last 6 years in various organizations, I have experience in three of the most popular cloud platforms, AWS IaaS, Microsoft Azure and Pivotal Cloud Foundry PaaS platform.Having around 10 years of IT experience in various roles and I take great interest in learning and sharing my knowledge on newer technologies. Wore many hats as developer, lead, architect in cloud technologies implementation. During Leisure time I enjoy good soothing music, playing TT and sweating out in Gym. I believe sharing knowledge is my way to make this world a better place.

Related Posts

Avatar
John Chell
— June 13, 2019

AWS Certified Solutions Architect Associate: A Study Guide

The AWS Solutions Architect - Associate Certification (or Sol Arch Associate for short) offers some clear benefits: Increases marketability to employers Provides solid credentials in a growing industry (with projected growth of as much as 70 percent in five years) Market anal...

Read more
  • AWS
  • AWS Certifications
Chris Gambino and Joe Niemiec
Chris Gambino and Joe Niemiec
— June 11, 2019

Moving Data to S3 with Apache NiFi

Moving data to the cloud is one of the cornerstones of any cloud migration. Apache NiFi is an open source tool that enables you to easily move and process data using a graphical user interface (GUI).  In this blog post, we will examine a simple way to move data to the cloud using NiFi c...

Read more
  • AWS
  • S3
Avatar
Chandan Patra
— June 11, 2019

Amazon DynamoDB: 10 Things You Should Know

Amazon DynamoDB is a managed NoSQL service with strong consistency and predictable performance that shields users from the complexities of manual setup.Whether or not you've actually used a NoSQL data store yourself, it's probably a good idea to make sure you fully understand the key ...

Read more
  • AWS
  • DynamoDB
Avatar
Andrew Larkin
— June 6, 2019

The 11 AWS Certifications: Which is Right for You and Your Team?

As companies increasingly shift workloads to the public cloud, cloud computing has moved from a nice-to-have to a core competency in the enterprise. This shift requires a new set of skills to design, deploy, and manage applications in cloud computing.As the market leader and most ma...

Read more
  • AWS
  • AWS Certifications
Sam Ghardashem
Sam Ghardashem
— May 15, 2019

Aviatrix Integration of a NextGen Firewall in AWS Transit Gateway

Learn how Aviatrix’s intelligent orchestration and control eliminates unwanted tradeoffs encountered when deploying Palo Alto Networks VM-Series Firewalls with AWS Transit Gateway.Deploying any next generation firewall in a public cloud environment is challenging, not because of the f...

Read more
  • AWS
Joe Nemer
Joe Nemer
— May 3, 2019

AWS Config Best Practices for Compliance

Use AWS Config the Right Way for Successful ComplianceIt’s well-known that AWS Config is a powerful service for monitoring all changes across your resources. As AWS Config has constantly evolved and improved over the years, it has transformed into a true powerhouse for monitoring your...

Read more
  • AWS
  • Compliance
Avatar
Francesca Vigliani
— April 30, 2019

Cloud Academy is Coming to the AWS Summits in Atlanta, London, and Chicago

Cloud Academy is a proud sponsor of the 2019 AWS Summits in Atlanta, London, and Chicago. We hope you plan to attend these free events that bring the cloud computing community together to connect, collaborate, and learn about AWS. These events are all about learning. You can learn how t...

Read more
  • AWS
  • AWS Summits
Paul Hortop
Paul Hortop
— April 2, 2019

How to Monitor Your AWS Infrastructure

The AWS cloud platform has made it easier than ever to be flexible, efficient, and cost-effective. However, monitoring your AWS infrastructure is the key to getting all of these benefits. Realizing these benefits requires that you follow AWS best practices which constantly change as AWS...

Read more
  • AWS
  • Monitoring
Joe Nemer
Joe Nemer
— April 1, 2019

AWS EC2 Instance Types Explained

Amazon Web Services’ resource offerings are constantly changing, and staying on top of their evolution can be a challenge. Elastic Cloud Compute (EC2) instances are one of their core resource offerings, and they form the backbone of most cloud deployments. EC2 instances provide you with...

Read more
  • AWS
  • EC2
Avatar
Nitheesh Poojary
— March 26, 2019

How DNS Works – the Domain Name System (Part One)

Before migrating domains to Amazon's Route53, we should first make sure we properly understand how DNS worksWhile we'll get to AWS's Route53 Domain Name System (DNS) service in the second part of this series, I thought it would be helpful to first make sure that we properly understand...

Read more
  • AWS
Avatar
Stuart Scott
— March 14, 2019

Multiple AWS Account Management using AWS Organizations

As businesses expand their footprint on AWS and utilize more services to build and deploy their applications, it becomes apparent that multiple AWS accounts are required to manage the environment and infrastructure.  A multi-account strategy is beneficial for a number of reasons as ...

Read more
  • AWS
  • Identity Access Management
Avatar
Sanket Dangi
— February 11, 2019

WaitCondition Controls the Pace of AWS CloudFormation Templates

AWS's WaitCondition can be used with CloudFormation templates to ensure required resources are running.As you may already be aware, AWS CloudFormation is used for infrastructure automation by allowing you to write JSON templates to automatically install, configure, and bootstrap your ...

Read more
  • AWS
  • CloudFormation