HDInsight – Azure’s Hadoop Big Data Service

How can Azure HDInsight solve your big data challenges? Big data refers to large volumes of fast-moving data in any format that haven’t yet been handled by your traditional data processing system. In other words, it refers to data which have Volume, Variety and Velocity (commonly termed as V3 in Big Data circles). Data can..

Microsoft Azure Data Lake Store: an introduction

The Azure Data Lake Store service provides a platform for organizations to park – and process and analyse – vast volumes of data in any format. Find out how. With increasing volumes of data to manage, enterprises are looking for appropriate infrastructure models to help them apply analytics to their big data, or simply to..

AWS Elastic MapReduce: a hands-on guide to Big Data on Amazon

AWS Elastic MapReduce: a guided lab Amazon’s Elastic MapReduce (EMR) is a managed Hadoop framework that allows enterprise and academic users to quickly and easily process huge data sets. Use cases can include log analysis, web indexing, data warehousing, machine learning, financial analysis, scientific simulation, and bioinformatics. AWS Elastic MapReduce works, using the MapReduce architecture,..

DynamoDB: An Inside Look Into NoSQL – Part 1

This is a guest post from 47Line Technologies. In our earlier posts (here and here), we introduced the Hadoop ecosystem & explained its various components using a real world example of the retail industry. We now possess a fair idea of the advantages of Big Data. NoSQL datastores are being used extensively in real-time &..

Hadoop Learning Series – Hive, Flume, HDFS and Retail Analysis

This is a guest article by 47Line Technologies. Last week we introduced Big Data ecosystem and showed a glimpse of the possibilities. This week we take one industry (Retail) use case and illustrate how the various tools can be orchestrated to provide insights. Background The last couple of decades has seen a tectonic shift in..

Big Data: getting Started with Hadoop, Sqoop & Hive

This is a guest post by 47Line Technologies We live in the Data Age! Web has been growing rapidly in size as well as scale during the last 10 years and shows no signs of slowing down. Statistics show that every passing year more data gets generated than all the previous years combined. Moore’s law..