skynet week 9 h4d stanford 2016

28
Skynet Sam Gussman (creative generalist), Alvin Goh (hacker), Olga Musayev (project development), Kevin Mott (project manager) Liaisons/Mentors: Steve Behmer, Ryan Blake, Wayne Chen, Andrew Smallwood # Interviewed this week: 12 4 User, 8 Experts, 6 Engineers, 2 Business Leaders # interviewed total: 90 Developing autonomous drones for situational awareness. Helping prevent battlefield fatalities by pinpointing friendly and enemy positions.

Upload: steve-blank

Post on 08-Jan-2017

35.130 views

Category:

Education


2 download

TRANSCRIPT

Page 1: Skynet Week 9 H4D Stanford 2016

SkynetSam Gussman (creative generalist), Alvin Goh (hacker), Olga Musayev (project

development), Kevin Mott (project manager)

Liaisons/Mentors: Steve Behmer, Ryan Blake, Wayne Chen, Andrew Smallwood# Interviewed this week: 12

4 User, 8 Experts, 6 Engineers, 2 Business Leaders# interviewed total: 90

Developing autonomous drones for situational awareness. Helping prevent battlefield fatalities by

pinpointing friendly and enemy positions.

Page 2: Skynet Week 9 H4D Stanford 2016

MVP Demo for JulyHuman Detection and Manual Classification

ATAK Integration

Mil Reticle

Page 3: Skynet Week 9 H4D Stanford 2016

Customer DiscoveryHypotheses Results Actions

DARPA is a potential customer and a beneficiary

Interviews Validated. One of interviewees is trying to start a program in COTS drones, and our demo could be used to help pitch it to the Director of DARPA. There is also a BAA-16-31 that is directly relevant to our project, though it is office-wide and not tied to any specific program.

Talk to the PMs for the offices that could be interested in our project.

Apply to the BAA after talking.

DARPA acquisitions are made by the PMs.

Interviews with DARPA PMs, research

Partly validated. The PMs for the office make the initial decisions. It’s important to meet with the PMs before applying to increase chances of being selected. If they give a thumbs up, they then pitch it up the DARPA chain.The level of needed approval depends on the amount of money.

Meet with PMs for the offices and demo our technology, to help them select our product and pitch it to the Deputy Director of DARPA.

We could find labelled training data and a CV expert before July

Interviews with CV Lab, Movidius, research

Validated. CV Lab and AFRL have offered to provide labelled training data that we could use. CV Lab may get us a student to work on our problem. The processing may take more than 50 hours.

Get and process the labelled data.

Get student with low hourly rate so as to not blow our budget

Experiments

Page 4: Skynet Week 9 H4D Stanford 2016

Customer DiscoveryHypotheses Results Actions

JSOC is a beneficiary with a unique value proposition

Interviews Validated. JSOC has many of the same use cases as other groups in SOCOM, but also “unique” cases that emphasize low cost and COT.

Maintain a line of products that’s totally off-the-shelf and under $3,500.

AFRL is doing something similar to our project

Interviews Partly validated. We talked with an AFRL group that’s working on vehicle recognition and they said there’s another group that’s doing person recognition on drone feed data. Right now, they’re both in the data collection stage.

Talk with AFRL group that’s doing person recognition in drone feed data.

Our July demo should include person recognition, ATAK integration, and Mil Reticle.

Interviews Validated. Multiple users confirmed that this would be the features to prioritize.

Build a demo that does human detection, ATAK integration (plugin), and Mil Reticle.

Experiments

Page 5: Skynet Week 9 H4D Stanford 2016

Partners-ResourcesComputer Vision Expert:One of the following:

- Stanford Computer Vision Lab- Independent Contractor

AFRL (has code that does this on ATAK and will share it with us)

Activities Resources

Partners

People Recognition

Geolocation of person

ATAK Integration

Easy UI/UX

Pre-plan Routes

Autonomous Flight

Web Servers / Dataset Tagging,Training Data,

Algorithm / Model

Camera Metadata (DJI API),Drone Location data

ATAK Source Code,ATAK Testing

User Feedback

Litchi,Open Source Navigation Code,

Drones

Trained Deep Learning Model,Drones

ATAK Team- AFRL (R.K)- DARPA (M.F., K.U., B.)

SOCOM

Litchi Open source drone software community

DJI (short-term supplier)Kespry (long-term strategic alliance?)

Suppliers

Page 6: Skynet Week 9 H4D Stanford 2016

Joint Business Dev: DARPADARPA

Motivations- PM wants to pitch new program for COTS drones to Director of DARPA-- needs cool projects

- Improve utility of ATAK with new plug-ins

- Manage work constraints by off-loading development of technical

features for ATAK

Skynet

Motivations- Get money from any agency

- Develop program on ATAK to take advantage of easy integration and great UI

-Get guidance and mentors for

ATAK source code and ecosystem, technical help, feedback, advice, Money?

New features for ATAK, demo for DARPA Director convincing him to start a program for drones

Risks: We could get “locked into” DARPA; PM could change jobs and drone program won’t happen; ATAK team could use us as free labor for their tech development

Page 7: Skynet Week 9 H4D Stanford 2016

Key Supplier: DJI(Long-term) Strategic Alliance: KespryKespry

(Autonomous Drones)

Motivations- Currently working in construction

only, which is a limited market

- Needs to branch out to new markets and use cases

- Need new channels to enter new markets

Skynet(Computer Vision) Motivations

- In short-term, can deliver betas to first-line of users using DJI drones

-In long term, need to partner with drone maker to build features required by the military-- route planning, object avoidance,

noise, battery life, etc.

Autonomous Drones, features SOCOM needs that we can’t build

ourselves

Channel into the military, new revenue stream from licensing

Risks: Kespry might not be able to deliver; might steal our ideas, might fail too early

Page 8: Skynet Week 9 H4D Stanford 2016

The Partnership we need to have: Computer Vision Expert

CV Experts

Motivations- Publish, develop reputation for expertise

- Work on the cutting edge of computer vision, solve challenging problems

- Money (over $350 per hour)

Skynet

Motivations- Develop product applying computer vision to drone feed data

-Reach high level of accuracy with few false positives and negatives to create reliability

Limit costs to fall under budget

Tune algorithm on trained data to detect humans on new data

??? Equity? Money?

Page 9: Skynet Week 9 H4D Stanford 2016

What we learned about costsWhat We Did: Created line-item expenses using structured analysis, fleshed out line items to specific costs, compiled expenses and restructured timeline to optimize expenditure, added 20% overhead to each quarter + $250 / week per employee.

CV Expert Dilemma: We need money to hire a CV expert to make a white paper to submit to a BAA to get money to hire a CV expert...

● Where do we get the initial funding to hire an expert?● Can we recruit one with equity alone?

Post S&T Options: After S&T runs out, we have three options:● Sell product to established DoD company and move on● Get S&T funding from another agency and keep going (viable)● Continue low-level sales and try to become a program of record (may not be viable)

Opportunity Costs: Even though our financial expenses may be low, we are paying with our time-- is this what we want to do for the next year?

Page 10: Skynet Week 9 H4D Stanford 2016

Costed Bill of Materials

Page 11: Skynet Week 9 H4D Stanford 2016

Finance and Operations Timeline

11

No Money

2019

2017

2018

2020

2021

2016 Q1 Q2 Q1 Q2 Q1 Q2 Q1 Q2 Q1 Q2Q1 Q2 Q3 Q4 Q3 Q4 Q3 Q4 Q3 Q4 Q3 Q4

DIUx - $500k

$1m

$5m

Prod

uct

Mile

ston

es

MVP

Busin

esse

sM

ilest

ones

Beta 2.0 Release

Class ends

Demo events

Apply SOCOM S&T, DARPA BAAs, SBIRs

SOCOM S&T Funding or DARPA BAA funding

1.0 Release

DIUxDemo events

Demo events

Sell product to large DoD contractor

Find other Agency S&T Funding

Try to become program of record while sustaining individual sales

Apply Other Agency S&T Funding

Page 12: Skynet Week 9 H4D Stanford 2016

Mission Model Canvas-Software development computer vision on drone feeds-People recognition -Geolocation of person populated on map-Integration with ATAK and existing DoD tech-Autonomous drone hacking-not manufacturing- Hack COT drone like DJI- Partner with drone maker- Become sensor neutral

DoD- SOCOM: S&T and acquisition PMs- DARPA PMs

ATAK Integration- ATAK Programmers in DARPA and AFRL

Computer Vision-MotionDSP, OceanIT-Computer vision experts

- Increase situational awareness through computer vision, recognition of people and objects- Provide low-cost method of reconnaissance -Easy UI and use through integration w/ ATAK- New contracts and revenue streams through the DoD- New use cases for product- Reputation and awareness- Share data, work, insight-Added value to current program/technology-Provide demo to pitch new program to Director of DARPA- Low-cost detection of movement and people at border- Increase ability to respond to sensors

- Fulfill S&T Topic of Interest requirements- Establish and meet Key Performance Parameters (KPPs) - Achieve 80% accuracy rate on detecting people, with few false positives- Start new program for small UAVs in DARPA- Fulfill technical wishlist for ATAK- Improved identification and tracking of suspected illegal border crossers.- Achieve sustainable business selling in S&T phase to multiple agencies

Get awareness w/ demo days, technical experiment. conferences, etc.-S&T UAV Topic of Area-- submit white paper-SBIR Phase 1 Grant-Exchange expertise and collaborate-Talk with PMs, submit to BAA-16-31-Demo TE, TILO, and Ranger training events in JulyQ3, 2016 (May – June): $5,925 ($407 / Week)

Q4, 2016 (July – Sept): $16,847 ($1,296 / Week)Q1, 2017 (Oct – Dec): $129,000 ($9,923 / Week)Q2, 2017 (Jan – March): $249,600 ($19,200 / Week)

-Demonstrate utility + low-cost- gain support from senior personnel-Show opportunities for new applications-Add utility to current program of record to increase adoption-Start a company or get acquired by another company

Beneficiaries

Mission AchievementMission Budget/Costs

Buy-In/Support

Deployment

Value PropositionKey Activities

Funding/Money, AccessATAK Integration-ATAK source code-DJI SDK or open-source Computer Vision-Algorithms (CV lab)-Computing power (AWS, movidius)-Training data: blimp or drone footage (AFRL)Autonomous Drone (DJI)

Key Resources

Key PartnersSOCOM- Tactical operators - SOF (SF, Ranger, SEALS, JSOC, MARSOC/Recon, drone operators)- SOCOM PMs- Small UAV S&T PM, Acquisition PM,Kespry, OceanIT, motionDSP, Stanford CV lab, AFRL, Computer Vision Expert, drone manufacturersDARPATactical Technology Office-SquadX and future Small UAV program Persistent Air Support ProjectATAK Program ManagerAFRLDHSBorder PatrolSkynet

__= New

Because you asked for more color coding . . .

Page 13: Skynet Week 9 H4D Stanford 2016

Memorial Day- 30 May

SPC Jameson L. LindskogKIA 29 March 2011Kunar Province, Afghanistan

SFC Ofren ArrechagaKIA 29 March 2011Kunar Province, Afghanistan

Page 14: Skynet Week 9 H4D Stanford 2016

SkyNet: Value Proposition Canvas

- Demo to show cool new product for new program

- Prove that program creates utility by funding useful products

Bring new, useful programs to

DARPA

Customer Jobs

- Hard to convince Director To give lots of money to new projects

DARPA PM

Gains

Pains

Gain Creators

Pain Relievers

- Help pitch new program on small COT UAVs to DARPA Director-Produce great products for theSquadX program

- utilize low-cost drone swarm to increase border coverage

- distributed autonomous drones ensure high refresh rate across the whole border

Products& ServicesDemo for drone

with visual recognition

software

Page 15: Skynet Week 9 H4D Stanford 2016

SkyNet: Value Proposition Canvas

- Image recognition software applied on video feed- Aerial perspective- Hi-def camera- Flexible deployment

Monitor the border and respond to emergencies,

aliens and complaints

Customer Jobs

- border area is too large, unable to ensure full coverage- Impossible to look at the whole border 24/7 - Limited aerial assets

Border Patrol

Gains

Pains

Gain Creators

Pain Relievers

- Survey more area without needing more men- Increased awareness when entering situations

- utilize low-cost drone swarm to increase border coverage

- distributed autonomous drones ensure high refresh rate across the whole border

Products& Services

Drone with visual recognition

software

Page 16: Skynet Week 9 H4D Stanford 2016

SkyNet: Value Proposition Canvas

- Knowing the locations of friends/enemies/civilians- Reduced ambiguity - autonomous assessment of aerial perspectives and video feed Custome

r JobsShoot bad

guys without getting shot- Cognitive overload from

existing tools-Manpower losses - Hassle of systems not communicating

SOF Elements (combat)

Gains

Pains

Gain Creators

Pain Relievers

-Increased situational awareness on the battlefield- Reconnaissance of inaccessible places

- Integrate with current systems that soldiers are familiar with- Frees up another soldier

Products& ServicesSituationally

awaredrone with visual

interface

Page 17: Skynet Week 9 H4D Stanford 2016

SkyNet: Value Proposition Canvas

- Automatic patrol- Facial Recognition of people identified in vicinity- Automatic threat detection to flag security threats Custome

r JobsForce protectionDay-to-day security patrols

are manpower intensive

Difficult to be always aware of surroundings

SOF Elements (non-combat)

Gains

Pains

Gain Creators

Pain Relievers

- Reliable 24/7 Security Awareness- Knowing who lives around you, and who doesn’t- Ability to respond quickly to threats

- Swarms of drones can replace patrol units

-24/7 situation awareness of surroundings

Products& ServicesSituationally

awareautonomous

drones

Page 18: Skynet Week 9 H4D Stanford 2016

SkyNet: Value Proposition Canvas

- Access into SOCOM acquisitions

- building company’s presence in military

Customer Jobs

Make more moneyBuild customer relationships

- Difficult to get large contracts, technology still maturing, only have limited consumer market share

Commercial Partners

Gains

Pains

Gain Creators

Pain Relievers

-New revenue stream-Potential long term partnership

- Contracts with military, willing and eager to adopt new technology (early adopters) even if tech is not fully matured

Products& ServicesPartnership /

contract

Page 19: Skynet Week 9 H4D Stanford 2016

SkyNet: Value Proposition Canvas

- Integrating drone camera feed enhanced with image recognition

- augmenting ATAK interface with image processing

Customer Jobs

Manage ATAKSystem under

cost- Proprietary technologythat does not talk to othertech- low adoption rate, ‘fancy new toy’ that’s not used much

ATAK Project Manager

Gains

Pains

Gain Creators

Pain Relievers

-Increased value to ATAK program

- Easy integration with ATAK- Promote culture of open-source- improving receptiveness to ATAK

Products& ServicesAutonomous

drone with live video feed

integrated with ATAK

Page 20: Skynet Week 9 H4D Stanford 2016

SkyNet: Value Proposition Canvas

-Image recognition software first of its kind in the military

- tool could potentially be applied across platforms (as a software plugin)

Customer Jobs

Manage ProgramsFill gaps

- Tech is new and recognitionof potential enemy may triggerblowback- new technology always too expensive, sometimes they don’t get used after purchasing

SOCOM Small UAS PM

Gains

Pains

Gain Creators

Pain Relievers

- Provides new tool that existing programs don’t provide - Potential to scale

-Retain man-in-the-loop, test software during training stateside and slowly scale to overseas.- Maintain low costs by utilizing COTS, consistently engage user feedback at all stages of development.

Products& Services

COTS Drone with visual recognition

software

Page 21: Skynet Week 9 H4D Stanford 2016

Appendix

Page 22: Skynet Week 9 H4D Stanford 2016

LRC1 (present - end of class)

Page 23: Skynet Week 9 H4D Stanford 2016

LRC2 (JUL-SEP)

Page 24: Skynet Week 9 H4D Stanford 2016

LRC3 (OCT-DEC)

Page 25: Skynet Week 9 H4D Stanford 2016

Mission AchievementOrganization Beneficiary Mission Achievement

SOCOM Tactical operators Increase awareness of surroundings with minimal operator input.

PMs Get the right equipment to troops at a reasonable cost.

DARPA ATAK PM Get ATAK utilized in multiple military organizations, create a plugin ecosystem to add value over time

TAK sUAS plugin team Fully implemented plugin features

DHS Border Patrol Improved identification and tracking of suspected illegal border crossers.

Potential commercial partners

Kespry/OceanIT/motionDSP Decreased R&D Costs, new revenue streams, relationships with US Government customers. Improvements to existing technology

Skynet Team Skynet (Us) Awarded SBIR phase 1 & 2OR Transition to S&T acquisition process (via SOCOM) or corporate partnership

Page 26: Skynet Week 9 H4D Stanford 2016

Get/Keep/Grow Diagram

Aw

aren

ess

Inte

rest

/Exc

item

ent

Pre

ssur

e on

M

anag

emen

t

S&

T or

SB

IR

acqu

isiti

on Joint P

rogram of

Record

Up-sell

Unbundling

Adoption by

other Agencies

Keep Customers

Page 27: Skynet Week 9 H4D Stanford 2016

Get / Keep / Grow – Border Patrol (SWAG)

Get

Strategy: Ethos, Excitement

Tactics: Utilize preexisting SOCOM contracts to build ethos, Demo / industry day, quarterly exercises

Keep

Strategy: Become program of record, training and support

Tactics: Take steps to become program of record, maintenance program & warranty, quality customer support, youtube training videos “How to do X in 5 mins”

Grow

Strategy: Get adopted by other agencies, upsell, develop dual use

Tactics: Unbundle from ATAK, develop new interfaces (AR), upgrade to object classification, partner w/ traditional vendors and manufacturers, become joint program of record, work with CTTO, RTTO and other agencies,

Page 28: Skynet Week 9 H4D Stanford 2016

Get / Keep / Grow – SOCOM

Get

Strategy: Awareness, Excitement, Pressure on Management, Acquisition through S&T or SBIR process

Tactics: Demo days, industry days, company nights, technical experimentation events, yearly conference, quarterly exercises, cold calling, referrals by network, hackathons, focus on Tier 1 Units (e.g. JSOC) and echelon 1 PMs

- Both operators and PMs

Keep

Strategy: training, support, iterate. Support phone number, support email, Field Service Representative

Tactics: Maintenance program & warranty, quality customer support, youtube training videos “How to do X in 5 mins”

Grow

Strategy: Get adopted by other agencies, upsell, develop dual use

Tactics: Unbundle from ATAK, develop new interfaces (AR), upgrade to object classification, partner w/ traditional vendors and manufacturers, become joint program of record, work with CTTO, RTTO and other agencies.