Machine Learning Predictive APIs and Apps: a first-hand report from the recent second International Conference in Sydney, Australia
Last week I had the good fortune to be able to attend the Second International Conference on PAPIs held in Sydney. Let me share a brief summary of all the presentations that were held on the first day and try to highlight some of the more interesting machine learning facts, tricks, and trends that came my way.
Real-World Predictive Applications
The Keynote address was on Real-World Predictive Applications with Amazon Machine Learning and was delivered by Danny Lange himself – the General Manager of Amazon Machine Learning. Danny began by saying that building smart apps is hard and by the end of the day I was definitely ready to agree with him. He also stated that there is a dearth of Data Scientists available to fill the needed positions in this field. So if you love data and wouldn’t mind being employed in the near future, you should probably set your sites on studying up on Predictive APIs.
To be honest, I didn’t gain too much from the first part of the talk – it was mostly an overview of Amazon Machine Learning.
However, his real-world example was fascinating: an end-to-end social media listening application powered by ML technology.
The application continuously monitors all tweets that mention your company’s Twitter handle, and predicts whether or not your company’s customer support team should reach out to the poster. Danny showed how, by using a Machine Learning model as your first tier of support, you can lower support costs and increase customer satisfaction. A simple but effective example of Amazon Machine Learning in action. He also showed how the application integrates Amazon Machine Learning with Amazon Mechanical Turk, Amazon Kinesis, AWS Lambda, and Amazon Simple Notification Service (Amazon SNS).
Cloud Academy now has a full course on Amazon Machine Learning to guide you through the whole process, from working with large data sources to generating accurate predictions.
Small Data is the new Big Data
Next up was the Technical Director and Partner at Resolve Digital, David Jones. His basic theme was that small data can be enough and that quality can be more important than blindly insisting on the more trendy Big Data. David then went on to show that you may not need as much data as you think to get real-world benefits.
David’s company procured a contract with an online wine retailer and, using off the shelf, well-implemented algorithms, generated a 71% increase in revenue. They didn’t use Google or AWS but rather an open-source system (whose name escapes me for the moment). Using open-source also helped keep costs down. David’s last word was that PAPI’s are awesome and that Machine Learning can be very effective when used in an eCommerce environment. I’ll drink to that.
Making Machine Learning accessible
Following David was Konstantin Davydov, a Software Engineer at Google who waxed lyrical about Simple Machine Learning for the masses. He said that, by using Google’s Cloud Machine Learning Services, users can set up an entire Machine Learning pipeline quickly and with limited or no Machine Learning expertise, and that it is also possible to build applications on top of the Prediction API that allows non-technical users to leverage the power of Machine Learning to help solve real-world problems.
I never thought that I was using Machine Learning in my day-to-day activities, but when Konstantin went on to explain, as an example, that the smart autofill add-on in Google Sheets is actually a predictive API, it dawned on me that Predictive APIs are probably more ubiquitous then I had thought.
Consumable, programmable, and scalable machine learning
After lunch, Poul E. J. Petersen, Chief Infrastructure Officer at BigML, hit the stage with what seemed to be the most technically detailed discussion of the day. He started off with a very optimistic statement:
In this tutorial you will learn how to perform classification, clustering, and anomaly detection tasks – all using the BigML REST API. By the end of this presentation, you will be ready to code your own predictive application in python using BigML.
Sorry to disappoint you Poul, but I can’t say that I’m quite there yet. Not being a python programmer I did find this presentation a bit of a strain, and the fact that it was straight after lunch didn’t help either: Poul shared a story from his youth where he would always fall asleep in Spanish class and thought he hated Spanish, but then realized it was the fact that the class was always after the lunch break, and in fact, he did like Spanish. So maybe I can code my own predictive application in python using BigML, but not straight after lunch.
To summarize Poul’s talk, he described how his team has been working hard for the past four years to democratize machine learning – making it more consumable, programmable, and scalable. Because of their well-defined workflow and powerful visualizations, it’s relatively easy for anyone to rapidly prototype ML solutions, and that at its core, BigML is really nothing more than a powerful and extensible Machine Learning API. In his tutorial Poul then showed how to perform classification, clustering, and anomaly detection tasks – all using the BigML REST API.
Predictive maintenance applications
Finally, Yan Zhang, a Microsoft data scientist showed us what’s available from Redmond. There were a few giggles from the audience when her Microsoft Windows Laptop failed to connect to the wi-fi. But to her credit, she recovered nicely and gave a very solid description of the landscape and challenges of predictive maintenance applications in the industry. She also did a good job illustrating how to formulate a problem with three different machine learning models (regression, binary classification, and multi-class classification).
Yan’s real-world example was of a publicly available aircraft engine run-to-failure data set, which showed how the models can be conveniently trained and compared with different algorithms in Azure ML. This was very interesting to me because, even though the bottom line of all this is to make money, an added benefit is obviously to improve airline safety and ultimately save lives (like mine, for instance).
Overall I enjoyed the day immensely. Not being a programmer, some of it made my head spin a little, but I definitely get the feeling that Machine Learning and more specifically, Predictive APIs and Apps are a big deal – and getting bigger all the time – and that Predictive apps will be the next big thing in app development. Don’t believe me? I’ll leave you with these thoughts:
“In the next 20 years, machine learning will have more impact than mobile has.” — Vinod Khosla, Founder of Khosla Ventures
“Predictive is the ‘killer app’ for Big Data” — Waqar Hasan, InsightsOne CEO
“If we can get usable, flexible, dependable machine learning software into the hands of domain experts, benefits to society are bound to follow.” —Dr Kiri L. Wagstaff, Researcher at NASA
Interested in reading more Machine Learning material? It’s one of Cloud Academy’s favorite blog topics!
Content Roadmap: AZ-500, ITIL 4, MS-100, Google Cloud Associate Engineer, and More
Last month, Cloud Academy joined forces with QA, the UK’s largest B2B skills provider, and it put us in an excellent position to solve a massive skills gap problem. As a result of this collaboration, you will see our training library grow with additions from QA’s massive catalog of 500+...
Disadvantages of Cloud Computing
If you want to deliver digital services of any kind, you’ll need to estimate all types of resources, not the least of which are CPU, memory, storage, and network connectivity. Which resources you choose for your delivery — cloud-based or local — is up to you. But you’ll definitely want...
How to Effectively Use Azure Management Groups, Subscriptions, and Resource Groups
When used individually, Azure Management Groups, Subscriptions, and Resource Groups are very powerful. But when used together, they can establish the entire organizational structure of Azure. In this article, I will explain Azure Resource Manager, Management Groups, Subscriptions an...
Cloud Academy’s Blog Digest: July 2019
July has been a very exciting month for us at Cloud Academy. On July 10, we officially joined forces with QA, the UK’s largest B2B skills provider (read the announcement). Over the coming weeks, you will see additions from QA’s massive catalog of 500+ certification courses and 1500+ ins...
Top 10 Things Cybersecurity Professionals Need to Know
There has been an increase in data breaches over the recent years. With almost 143 million Americans who have had their data compromised in data breaches. These breaches include all sorts of sensitive data, including financial information, election controversies, social security, just t...
Running Apache Spark on Azure Databricks
In this article, we’ll cover how to set up an Azure Databricks cluster and how to run queries in an interactive notebook. However, this article only scratches the surface of what you can do with Azure Databricks. If you would like to learn more, including how to create graphs, run sched...
Understanding the Core Azure Architectural Components
Microsoft Azure relies on a few key architectural components to provide redundancy and high availability. Core Azure architectural components include Azure regions, Azure Availability Zones, resource groups, and the Azure Resource Manager. In this article, we’ll discuss the basics ab...
How to Become a Microsoft Certified Azure Administrator
Microsoft Azure is one of the hottest cloud services on the planet, and it’s growing at a phenomenal rate. This rapid growth has created a huge demand for people who know how to administer and manage Azure implementations. To make it easier for employers to verify the skills of Azure...
Preparing for the Microsoft AZ-900 Exam
Microsoft has offered Azure certification exams for years, but until recently, they were all meant for technical IT professionals. Now non-technical professionals, such as salespeople and managers, can take the new AZ-900 exam to prove their understanding of Azure fundamentals. People w...
An Overview of Azure Storage (Part 2)
Archive Storage Archive Storage offers the lowest storage costs of all Azure storage. Its retrieval costs, however, are higher when compared to Hot and Cool storage. The archive tier of storage is designed for data that can tolerate several hours of latency when being retrieved. It’s a...
An Overview of Azure Storage (Part 1)
Welcome to part one of our series on Azure Storage. Stay tuned for the second part. An Overview of Azure Storage Microsoft Azure Storage is a cloud-based storage offering that provides multiple storage solutions for organizations. In addition to a massively scalable object store for ...
NEW: Custom Hands-On Labs for Azure and Google Cloud Platform
Harvard Business Review recently estimated that some 90% of corporate training never gets applied on the job. Given the $200B training industry, that is a staggering amount of waste. One reason for the disconnect? Lack of context. Cloud Academy’s platform was built to make it extraor...