Machine Learning Predictive APIs and Apps: conference report

Machine Learning Predictive APIs and Apps: a first hand report from the recent second International Conference in Sydney, Australia

Machine LearningLast week I had the good fortune to be able to attend the Second International Conference on PAPIs held in Sydney. Let me share a brief summary of all the presentations that were held on the first day and try to highlight some of the more interesting machine learning facts, tricks, and trends that came my way.

Real-World Predictive Applications

The Keynote address was on Real-World Predictive Applications with Amazon Machine Learning and was delivered by Danny Lange himself – the General Manager of Amazon Machine Learning. Danny began by saying that building smart apps is hard and by the end of the day I was definitely ready to agree with him. He also stated that there is a dearth of Data Scientists available to fill the needed positions in this field. So if you love data and wouldn’t mind being employed in the near future, you should probably set your sites on studying up on Predictive APIs.
To be honest I didn’t gain too much from the first part of the talk – it was mostly an overview of Amazon Machine Learning. However his real-world example was fascinating: an end-to-end social media listening application powered by ML technology.
The application continuously monitors all tweets that mention your company’s Twitter handle, and predicts whether or not your company’s customer support team should reach out to the poster. Danny showed how, by using a Machine Learning model as your first tier of support, you can lower support costs and increase customer satisfaction. A simple but effective example of Amazon Machine Learning in action. He also showed how the application integrates Amazon Machine Learning with Amazon Mechanical Turk, Amazon Kinesis, AWS Lambda, and Amazon Simple Notification Service (Amazon SNS).
Cloud Academy now has a full course on Amazon Machine Learning to guide you through the whole process, from working with large data sources to generating accurate predictions.

Small Data is the new Big Data

Next up was the Technical Director and Partner at Resolve Digital, David Jones. His basic theme was that small data can be enough and that quality can be more important than blindly insisting on the more trendy “Big Data.” David then went on to show that you may not need as much data as you think to get real-world benefits.
David’s company procured a contract with an online wine retailer and, using off the shelf, well implemented algorithms, generated a 71% increase in revenue. They didn’t use Google or AWS but rather an open-source system (whose name escapes me for the moment). Using open-source also helped keep costs down. David’s last word was that PAPI’s are awesome and that Machine Learning can be very effective when used in an eCommerce environment. I’ll drink to that.

Making Machine Learning accessible

Following David was Konstantin Davydov, a Software Engineer at Google who waxed lyrical about Simple Machine Learning for the masses. He said that, by using Google’s Cloud Machine Learning Services, users can set up an entire Machine Learning pipeline quickly and with limited or no Machine Learning expertise, and that it is also possible to build applications on top of the Prediction API that allow non-technical users to leverage the power of Machine Learning to help solve real-world problems. I never thought that I was using Machine Learning in my day-to-day activities, but when Konstantin went on to explain, as an example, that the SmartAutofill add-on in Google Sheets is actually a predictive API, it dawned on me that Predictive APIs are probably more ubiquitous then I had thought.

Consumable, programmable, and scalable machine learning

After lunch, Poul E. J. Petersen, Chief Infrastructure Officer at BigML, hit the stage with what seemed to be the most technically detailed discussion of the day. He started off with the very optimistic statement:

In this tutorial you will learn how to perform classification, clustering, and anomaly detection tasks – all using the BigML REST API. By the end of this presentation, you will be ready to code your own predictive application in python using BigML.

Sorry to disappoint you Poul, but I can’t say that I’m quite there yet. Not being a python programmer I did find this presentation a bit of a strain, and the fact that it was straight after lunch didn’t help either: Poul shared a story from his youth where he would always fall asleep in Spanish class and thought he hated Spanish, but then realized it was the fact that the class was always after the lunch break, and in fact, he did like Spanish. So maybe I can code my own predictive application in python using BigML, but not straight after lunch.
To summarize Poul’s talk, he described how his team has been working hard for the past four years to democratize machine learning – making it more consumable, programmable, and scalable. Because of their well defined workflow and powerful visualizations, it’s relatively easy for anyone to rapidly prototype ML solutions, and that at its core, BigML is really nothing more than a powerful and extensible Machine Learning API. In his tutorial Poul then showed how to perform classification, clustering, and anomaly detection tasks – all using the BigML REST API.

Predictive maintenance applications

Finally, Yan Zhang, a Microsoft data scientist showed us what’s available from Redmond. There were a few giggles from the audience when her Microsoft Windows Laptop failed to connect to the wi-fi. But to her credit, she recovered nicely and gave a very solid description of the landscape and challenges of predictive maintenance applications in the industry. She also did a good job illustrating how to formulate a problem with three different machine learning models (regression, binary classification, and multi-class classification).
Yan’s real-world example was of a publicly available aircraft engine run-to-failure data set, which showed how the models can be conveniently trained and compared with different algorithms in Azure ML.  This was very interesting to me because, even though the bottom line of all this is to make money, an added benefit is obviously to improve airline safety and ultimately save lives (like mine, for instance).
Overall I enjoyed the day immensely. Not being a programmer, some of it made my head spin a little, but I definitely get the feeling that Machine Learning and more specifically, Predictive APIs and Apps are a big deal – and getting bigger all the time – and that Predictive apps will be the next big thing in app development. Don’t believe me? I’ll leave you with these thoughts:

“In the next 20 years, machine learning will have more impact than mobile has.”Vinod Khosla, Founder of Khosla Ventures

“Predictive is the ‘killer app’ for Big Data” — Waqar Hasan, InsightsOne CEO

“If we can get usable, flexible, dependable machine learning software into the hands of domain experts, benefits to society are bound to follow.”Dr Kiri L. Wagstaff, Researcher at NASA

Interested in reading more Machine Learning material? It’s one of Cloud Academy’s favorite blog topics!

Written by

I have been UNIX/Linux System Administrator for the past 15 years and am slowly moving those skills into the AWS Cloud arena. I am passionate about AWS and Cloud Technologies and the exciting future that it promises to bring.

Related Posts

— November 21, 2018

Google Cloud Certification: Preparation and Prerequisites

Google Cloud Platform (GCP) has evolved from being a niche player to a serious competitor to Amazon Web Services and Microsoft Azure. In 2018, research firm Gartner placed Google in the Leaders quadrant in its Magic Quadrant for Cloud Infrastructure as a Service for the first time. In t...

Read more
  • AWS
  • Azure
  • Google Cloud
— October 30, 2018

Azure Stack Use Cases and Applications

This is the second of a two-part series covering Azure Stack. Our first post provided an introduction to Azure Stack. Why would your organization consider using Azure Stack? What are the key differences between Azure Stack and Microsoft Azure? In this post, we'll begin to answer bot...

Read more
  • Azure
  • Hybrid Cloud
  • Virtualization
— October 3, 2018

Highlights from Microsoft Ignite 2018

Microsoft Ignite 2018 was a big success. Over 26,000 people attended Microsoft’s flagship conference for IT professionals in sunny Orlando, Florida. As usual, Microsoft made a huge number of announcements, ranging from minor to major in importance. To save you the trouble of sifting thr...

Read more
  • Azure
  • Ignite
— September 20, 2018

Planning for Microsoft Ignite 2018 Sessions: What Not to Miss

Cloud Academy is proud to be a sponsor of the Microsoft Ignite Conference to be held September 24 - 28 in Orlando, Florida. This is Microsoft’s biggest event of the year and is a great way to stay up to date on how to get the most from Microsoft’s products. In this post, I’ll help you p...

Read more
  • Azure
— September 18, 2018

How to Optimize Cloud Costs with Spot Instances: New on Cloud Academy

One of the main promises of cloud computing is access to nearly endless capacity. However, it doesn’t come cheap. With the introduction of Spot Instances for Amazon Web Services’ Elastic Compute Cloud (AWS EC2) in 2009, spot instances have been a way for major cloud providers to sell sp...

Read more
  • AWS
  • Azure
  • Google Cloud
— August 23, 2018

What are the Benefits of Machine Learning in the Cloud?

A Comparison of Machine Learning Services on AWS, Azure, and Google CloudArtificial intelligence and machine learning are steadily making their way into enterprise applications in areas such as customer support, fraud detection, and business intelligence. There is every reason to beli...

Read more
  • AWS
  • Azure
  • Google Cloud
  • Machine Learning
— July 5, 2018

How Does Azure Encrypt Data?

In on-premises environments, data security is typically a siloed activity, with a company's security team telling the internal technology groups (server administration, database, networking, and so on) what needs to be protected against intrusion.This approach is absolutely a bad...

Read more
  • Azure
— June 26, 2018

Disadvantages of Cloud Computing

If you want to deliver digital services of any kind, you’ll need to compute resources including CPU, memory, storage, and network connectivity. Which resources you choose for your delivery, cloud-based or local, is up to you. But you’ll definitely want to do your homework first.Cloud ...

Read more
  • AWS
  • Azure
  • Cloud Computing
  • Google Cloud
Albert Qian
— June 19, 2018

Preparing for the Microsoft Azure 70-535 Exam

The credibility of Microsoft Azure continues to grow in the first quarter of 2018 with an increasing number of enterprises migrating their workloads, resulting in a jump for Azure from 10% to 13% in market share. Most organizations will find that simply “lifting and shifting” applicatio...

Read more
  • Azure
  • Compute
  • Database
  • Security
— April 12, 2018

Azure Migration Strategy: A Checklist to Get Started

By now, you’ve heard it many times and from many sources: cloud technology is the future of IT. If your organization isn’t already running critical workloads on a cloud platform (and, if your career isn’t cloud-focused), you’re running the very real risk of being overtaken by nimbler co...

Read more
  • Azure
— March 2, 2018

Three Must-Use Azure Security Services

Keeping your cloud environment safe continues to be the top priority for the enterprise, followed by spending, according to RightScale’s 2018 State of the Cloud report.The safety of your cloud environment—and the data and applications that your business runs on—depends on how well you...

Read more
  • Azure
  • Security
— February 15, 2018

Is Multi-Cloud a Solution for High Availability?

With the average cost of downtime estimated at $8,850 per minute, businesses can’t afford to risk system failure. Full access to services and data anytime, anywhere is one of the main benefits of cloud computing.By design, many of the core services with the public cloud and its underl...

Read more
  • AWS
  • Azure
  • Cloud Adoption
  • Google Cloud