Internet of Things - The Salesforce Lego Machine CloudAndrew FawcettFinancialForce.com, CTO@andyinthecloud

Andrew FawcettFinancialForce.com, CTO@andyinthecloud

About FinancialForce.com

• San Francisco Headquarters• Harrogate, UK• Granada, Spain• Toronto, Canada• Manchester, US• Opening Sydney, AUS in Sept, 2014

• 350+ Employees• 400+ by 12/31/2014

• Customers in 31 countries• 80% Y-o-Y revenue growth• Advent commitment of $50 million 

Session Resources• Follow the Session in the Dreamforce

App, I will share this slide deck and other related links on the Feed

• Be social and feel free to ask follow up questions!

Introduction• What are the device requirements?• How intelligent does the device need to be?• What is a Machine Cloud?• Building a Machine Cloud with Salesforce1 Platform• Demos• How to make your own Machine Cloud with with Lego Mindstorms EV3

What does a Device need to call the Salesforce API’s?

• Ability to connect to a local internet gateway– e.g. phone or other computer connected to Internet

• Ability to connect direct to Internet– SSL support ideally, though non-SSL end points

proxies can be used• Ability to parse XML or JSON

– String manipulation or ideally JSON or XML parsers• Ability to consume Java libraries

– Ideally Salesforce Web Service Connector

Basic Capabilities, limited RAM/CPU

Advanced Capabilities e.g. running OS’s

What does a Device need to call the Salesforce API’s?• Common runtime language

– Such as Java!• Oracle port to ARMv5 process running on Lego Mindstorms EV3• Community Java runtime known as Lejos for Lego Mindstorms NXT

How intelligent should the device be?• Processing power and storage can vary

– Depends on sensor input and output demands– Cloud based logic can be used via HTTPS communications– HTTPS communications

• Streaming communications vs Polling• Ability to connect locally to the device is useful

– Lego Mindstorms EV3 runs a Lego variation of Linux– Can TELNET to it and execute Unix commands– Java Remote Debug is also possible

LEGO Mindstorms EV3 Programmable Brick

Feature SpecDisplay Monochrome LCD

178 x 128 pixelsOperating System Linux based

Main Processor 300 MH Texas Instruments Sitara AM11808 (ARM9 core)

Main Memory 64 MB RAM, 16 MB Flash

USB Host Port Yes

WiFi Yes via USB Dongle

Bluetooth Yes

What is a Machine Cloud?• A single place for machines to communicate and share information

• Machines can communicate to us and other machines across the world

• Can be used to store data• Can perform calculations on behalf of devices, with access to more information, also easier maintenance and updates to software

Introducing a Machine Cloud built with Salesforce1 Platform

Salesforce1 Mobile

Custom Objects

REST and Streaming

API’s

Connected Applications

Controlling Machines through Custom Objects#clicksnotcode

Controlling Machines through Custom Objects#clicksnotcode

Demo : PairingPairing Mindstorm EV3 Robots to our Machine Cloud and sending commands

Ok so what just happened under the hood?

SalesforceStreaming and

REST APIEV3 #1

ev3force.jar

Heroku Connected App

EV3 Pairing REST API

EV3 #2

ev3force.jar

Custom Objects

Commands

Commands

Pairing Pairing

You want to go further under the hood?

SalesforceStreaming and

REST API

Heroku Connected App

EV3 Pairing REST API

EV3

2. Get Pin

3. Wait for PIN Entry and receive oAuth Token

4. User Enters PIN, oAuth Token is passed

/ev3force.properties5. EV3 stores oAuth Token

ev3force.jar

Custom Objects

1. oAuth Token stored?

First time ev3force.jar runs

Each time ev3force.jar runs

6. Read Robot Details

7. Start Listening8. Create Command records

Demo: Controlling a Lego RobotMoving a Robot around

Demo: Programming a RobotPre-creating Command records and sending a Run Program command

How is it implemented?

Code: Pairing// Http commons with pairing serviceHttpClient httpClient = new HttpClient();httpClient.setConnectTimeout(20 * 1000); // Connection timeouthttpClient.setTimeout(120 * 1000); // Read timeouthttpClient.start();

// Get a pin numberContentExchange getPin = new ContentExchange();getPin.setMethod("GET");getPin.setURL("https://ev3forcepairing.herokuapp.com/service/pin");httpClient.send(getPin);getPin.waitForDone();Map<String, Object> parsed = (Map<String, Object>) JSON.parse(getPin.getResponseContent()); // Display pin number to enter into SalesforceLCD.clear();LCD.drawString("Pin " + parsed.get("pin"), 0, 3);

Code: Pairing// Wait for oAuth token for the given pin numberwhile(true){ getPin = new ContentExchange(); getPin.setMethod("GET"); getPin.setURL("https://ev3forcepairing.herokuapp.com/service/pin?pin=" + pin); httpClient.send(getPin); getPin.waitForDone(); parsed = (Map<String, Object>) JSON.parse(getPin.getResponseContent()); oAuthToken = (String) parsed.get("oAuthToken"); robotId = (String) parsed.get("robotId"); serverUrl = (String) parsed.get(”serverUrl"); if(oAuthToken!=null)

break; LCD.drawString("Waiting " + waitCount++, 0, 4); Delay.msDelay(1000);}

Code: Pairing<td><b>Pin:</b></td> <td> <form action="/default/pinset.jsp">

<input name="pin"/><input type="submit" value="Pair"/><input name=”refreshToken" type="hidden"

value="${canvasRequest.client.refreshToken}"/><input name="recordId" type="hidden"

value="${canvasRequest.context.environmentContext.record.Id}"/> </form> </td>

<body><%

String pin = request.getParameter("pin");String refreshToken = request.getParameter(”refreshToken");String robotId = request.getParameter("recordId"); PairingResource.setConnection(pin, refreshToken, robotId);

%>Now check your EV3!</body>

Code: Listening for Commands via Streaming API // Subscribe to the 'commands' topic to listen for new Command__c records client.getChannel("/topic/commands").subscribe(new ClientSessionChannel.MessageListener() {

public void onMessage(ClientSessionChannel channel, Message message) {

HashMap<String, Object> data = (HashMap<String, Object>) JSON.parse(message.toString()); HashMap<String, Object> record = (HashMap<String, Object>) data.get("data"); HashMap<String, Object> sobject = (HashMap<String, Object>) record.get("sobject"); String commandName = (String) sobject.get("Name"); String command = (String) sobject.get("Command__c"); String commandParameter = (String) sobject.get("CommandParameter__c"); String programToRunId = (String) sobject.get("ProgramToRun__c"); executeCommand( commandName, command, commandParameter, programToRunId, partnerConnection); } });

Code: Moving the Robot around with Lejosimport lejos.hardware.motor.Motor;

public static void moveForward(int rotations){ Motor.B.rotate((180 * rotations)*1, true); Motor.C.rotate((180 * rotations)*1, true); while (Motor.B.isMoving() || Motor.C.isMoving()); Motor.B.flt(true); Motor.C.flt(true);}

public static void moveBackwards(int rotations){ Motor.B.rotate((180 * rotations)*-1, true); Motor.C.rotate((180 * rotations)*-1, true); while (Motor.B.isMoving() || Motor.C.isMoving()); Motor.B.flt(true); Motor.C.flt(true);}

Building your Lego Robot• What do I need?

– Edimax EW-7811UN 150Mbps Wireless Nano USB Adapter– Micro SD Card (SDHC Only), 1GB, no greater than 32GB– Lego Mindstorms EV3 Set, Gripper Robot!

Creating your own Lego Robot Machine Cloud!• Installation in Salesforce

– Install the Machine Cloud managed package (see Readme)• https://github.com/afawcett/legoev3-machinecloud

• Installation on Lego Mindstorms EV31. Install Lejos on your SDCard and install in the EV3

• http://sourceforge.net/p/lejos/wiki/Home/

2. Use the Lejos menu on the EV3 to connect to your Wifi3. Copy the ev3force.jar to your EV3 Robot (from /dist folder in GitHub Repo)

• Run the /bin/ev3console UI and deploy using the Programs tab

Creating your own Lego Robot Machine Cloud!• Connecting your Robots

1. Run the ev3force.jar application on the EV32. Note the PIN number shown on the EV3 Robot3. Login to your Salesforce org and create a Robot record4. Enter PIN number, wait for the device to connect to Salesforce5. Send it commands and programs to run!

Further Ideas…• Expose the Machine Cloud via Salesforce Communities• Machine Cloud API?

– Perhaps we already have this?• Using the Salesforce API to insert records to the Command__c object?

• Add support for other Devices?– Watches, Phones etc

• Add support for Generic Streaming API events– Events not driven by Database events but by processes

Session Resources• Follow the Session in the Dreamforce

App, I will share this slide deck and other related links on the Feed

• Be social and feel free to ask follow up questions!