1

Data Driven Farming:Week 2 Data

UnderstandingDr. Brand Niemann

Director and Senior Data Scientist/Data JournalistSemantic CommunitySemantic Community

Data ScienceBig Data Science for Precision Farming Business

Week 2 Data UnderstandingAugust 4, 2015

2

Sources of Farm Data and Precision Farming Success

• USDA and GODAN• US Office of Management & Budget Memo 13-13• Quotes on Data Access• USDA/Microsoft Innovation Challenge• GODAN Reports on Data• AgGateway’s Ag Industry Identification System (AGIIS)• Precision Agriculture at Universities• The InfoAg Conference 2015• Improving Performance, Uptime and Efficiencies of Machines Through the

Use of Data: YouTube Video

3

USDA and GODAN

• The USDA Open Data Initiative (OpenAg) expands and promotes a culture of Open Government among the Department by making its information resources widely accessible, discoverable, and usable by Federal government agencies and by the general public.

• USDA is the cornerstone for the Global Open Data for Agriculture and Nutrition (GODAN) Imitative. GODAN supports efforts to make agriculturally and nutritionally relevant data available for public global use. • Open data on agriculture, nutrition and food systems can be a powerful tool for long-term sustainable development by improving

the economic opportunities for farmers and the health of all consumers. • The initiative encourages collaboration and cooperation among existing agriculture and open data activities, and brings together

all stakeholders to solve long-standing global problems.

• Published over 500 data sets for public consumption via the federal repository Data.gov• Developed repeatable processes to ensure USDA data continues to be available, reliable and accessible for the

public• Constantly improving our customer engagement and customer feedback processes to ensure the deliver of high-

valued datasets• Actively support Civic Hackathons by providing Agricultural Data• Developing Open Data Standards

• Creating an Agricultural Domain within the Department of Homeland Security (DHS) National Information Exchange Model (NIEM)• Working closely with the Precision Ag and Ag Gateway industry partners to develop a common set of standards

Source: USDA: Open Data, Big Data and Precision Ag, Joyce Hunter, Slides 07/30/2015

4

US Office of Management & Budget Memo 13-13

• OMB Memo 13-13 released last year, requires federal agencies to develop and release data that can be used by other government agencies, industry, academia, and the public.• It also requires Agencies to develop and maintain and enterprise data

inventory that can be Expanded, Enriched and is Open.• It requires Agencies to make their data machine readable and using

open formats and data standards for new information development and collection. It requires Agencies to use open licenses and establishes processes that will identify information that can not be release for various reasons. (privacy, legal, security).

5

Quotes on Data Access

• “Simply making data available is only one half of the open data equation; the other is interoperability – making our data machine readable so it can be mixed with others’ datasets to produce new information and insights.” Krysta Harden, Deputy Secretary of the U.S. Department of Agriculture• http://blogs.usda.gov/2015/07/15/financing-for-development-conference-boosts-

support-for-open-data/

• “Our challenge is the opening of access to this data not just through coding but through awareness and use.” Chris Addison, CTA, Technical Centre for Agricultural and Rural Cooperation• 5. Realising the full potential of open data: next steps in

How can we improve agriculture, food and nutrition with open data?

6

http://blogs.usda.gov/2015/07/24/usdamicrosoft-innovation-challenge-offers-60k-in-prizes-to-software-developers/

7

http://usdaapps.devpost.com/

8

http://usdaapps.devpost.com/details/resources

My Note: My Data Science Audit found there are problems with these data sets. See Slides 13-14.

9

http://www.godan.info/

My Note: Two PDF Reports to Knowledge Base‘How can we improve agriculture, food and nutrition with open data?’Open Data and Smallholder Food and Nutritional Security

10

Key data sets

11

Semantic CommunityData ScienceBig Data Science for Precision Farming BusinessWeek 2 Data Understanding

12

13

FarmDataDashboard.xlsx

14

15

http://www.aggateway.org/

AgGateway’s Ag Industry Identification System (AGIIS) is a robust, interactive database that provides an eBusiness “vocabulary” used every day by hundreds of companies.The Ag Industry Identification System (AGIIS):Contains 5 million unique entities, 930,000 licenses for seed, and more than 140,000 product identifiers.

16

http://fabe.osu.edu/precisionag_contact

17

http://www.precisionag.umn.edu/precision-links/

18

http://cropwatch.unl.edu/home/

My Note: Do Data Science on This Excellent Content For Week 3 Data Preparation

19

Crop Watch: Management Topics

• Economics & Marketing• Crop production budgets, farm real estate, and

custom rates; markets; policy and Farm Bill; and more.

• Farm Real Estate• Nebraska Farm Real Estate reports and related tools.

• Grain Storage Management• Links to resources on grain quality and storage;

engineering grain storage and aeration systems; aeration management; stored grain pest management; grain storage articles from CropWatch newsletter; and temporary/emergency grain storage.

• Insect Management• Entomology and insect management information for

crop production.

• Plant Disease Management• Plant disease information and management

recommendations for agricultural crops.

• Precision Agriculture• Information for crop producers, agricultural consultants,

extension educators and other agricultural professionals.

• Soil Management• Find soil management recommendations and resources,

information on Nebraska research and extension projects, and more.

• Tillage/No-Till Systems• Information on tillage systems, concepts, soil structure,

and more.

• Water Management• For information on irrigation and for managing water for

crop production, visit the Agricultural Production section of the Nebraska Extension site, Water.unl.edu. It includes information and tools to optimize water use efficiency while protecting water quality.

• Weed Management• Weed management resources.http://cropwatch.unl.edu/management

20

http://cropwatch.unl.edu/ssm

My Note: Do Data Science on This Excellent Content For Week 3 Data Preparation

21

http://infoag.org/

22

http://infoag.org/program/5/

79 Speakers51 Slides (PDF)6 Hands-on Workshops83 Exhibitors

23

https://www.youtube.com/watch?v=hdftNZZ_M6c&index=4&list=PLh0k4GzppsqF70qU3SAblo-Wcep9fQCBH

Precise Positioning

Precise Measurement

Adoption of Telematics

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

Improving Performance, Uptime and Efficiencies of Machines Through the Use of Data: Video Notes

• GPS Enabled Precision Ag: Satellite Feeds• Farm Sight:

• Machine Optimization• Logistics & Job Optimization• Ag Decision Support

• But, complexity has driven slow adoption• Producer Challenges of Machine Management, Information, and Relationships• Wireless Connected Machines: WiFi and Satellite• To the Point of “What Will Happen” to Maximize Uptime• Farmer’s Data Goes to Platform Which Goes to Agronomist• Intelligent Solutions Group (Google Like) User Interfaces for Row and Plant Level• Soil Moisture Sensors Data to Machine to Application Instructions• Adjust to Harvesting Multiple Hybrids (Future)

44

https://www.climate.com/