small things of big (geospatial) data

27
© 2016 PIXEL SOFTEK PVT. LTD. Perform. Xcel. L 1 The Trademarks/Logos belong to the respective companies Perform. Xcel. Lead. Presenter Raghavendran S GM Technical (GIS)

Upload: raghavendran-s

Post on 16-Apr-2017

519 views

Category:

Technology


5 download

TRANSCRIPT

Page 1: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead.

1The Trademarks/Logos belong to the respective companies

Perform. Xcel. Lead.

Presenter

Raghavendran SGM Technical (GIS)

Page 2: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead.

2The Trademarks/Logos belong to the respective companies

• Incorporated in 1996

• HQ in Bangalore, India, Offices in Delhi and Chennai

• Subsidiary company PIXEL Softek, Inc. based in Atlanta, USA

• 200+ employees, most with GIS / IT background

• Technical staff from varied domains

• ISO 9001:2008, CMMI Level 3 certification

• Focus on customer-specific IT / GIS solutions using industry-standard

technology platforms

• Competitive cost structure with sustained QA / QC standards

• Clients include major companies and public organizations in India, US and APAC

About PIXEL

Page 3: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead.

3The Trademarks/Logos belong to the respective companies

Geospatial

Mobile AppData Conversion & Migration

* Registered Trademarks belong to respective Companies

Utility Network Design/Mapping

Technology Portfolio

Page 4: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 4The Trademarks/Logos belong to the respective companies

Data Explosion

Imagine the good old days of Map India!And today...

Page 5: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 5The Trademarks/Logos belong to the respective companies

Information Explosion/ Big Data Facts• In the networked world

today of Clicks and Likes, do we realise the vast amount of data generated in a minute or 60 seconds?

Page 6: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 6The Trademarks/Logos belong to the respective companies

Information Explosion/ Big Data Facts• Internet of Things

(IoTs)• Gartner (Year 2016)

Number of Connected Devices (6.4bn)

World Population (7.4 bn)

Page 7: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 7The Trademarks/Logos belong to the respective companies

Big Data• Broad term for datasets

• So Large• So Complex

that current/ traditional systems cannot handle(Wikipedia)

Page 8: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 8The Trademarks/Logos belong to the respective companies

Big (Geospatial) Data

GEOSPATIAL DATA

• Geospatial Data has always been BIG data• Presenting its own set of opportunities and

challenges

Page 9: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 9The Trademarks/Logos belong to the respective companies

LiDAR

Big (Geospatial) Data: Some Examples

Satellite Imagery

UAV

Sensor basedReal time Monitoring

Crowdsourcing

Attribute/ Textual/Video/Photo etc

Page 10: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 10The Trademarks/Logos belong to the respective companies

Is my GIS data: Small Data or Big Data?

Small Data

BigData

Page 11: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 11The Trademarks/Logos belong to the respective companies

Big (Geospatial) Data Deluge GIS User or Organization

generating and or consuming geospatial data, suddenly finding yourself drowning in so much of data

Challenges: Capture (Store), Query, Analysis, Visualization, Dissemination

Page 12: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 12The Trademarks/Logos belong to the respective companies

Welcome to the World of Big (Geospatial) Data

Big (Geospatial) Data

Page 13: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 13The Trademarks/Logos belong to the respective companies

Big (Geospatial)

Data ≠ BIG

(Geospatial) Data

Big (Geospatial) Data

Page 14: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 14The Trademarks/Logos belong to the respective companies

3 V’s or Small Things of Big (Geospatial) Data

Big (GIS)Data

Page 15: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 15The Trademarks/Logos belong to the respective companies

Small Things of Big (Geospatial) Data

Page 16: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 16The Trademarks/Logos belong to the respective companies

DIGITALALCHEMY

FME (Feature Manipulation Engine)a spatial ETL (Extract, Transform & Load) tool from

Safe Software, Inc., Canada

Page 17: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 17The Trademarks/Logos belong to the respective companies

Big (Geospatial) Data meets FME

Page 18: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 18The Trademarks/Logos belong to the respective companies

FME : Volume, Velocity & Variety

Support for over 345+ CAD/ GIS/Database/Web formats (includes proprietary as well as OGC formats)

Page 19: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 19The Trademarks/Logos belong to the respective companies

Big (GIS) Data & FME: Volume Big data services: Equipped to handle the volume and complexity of very large

data sets Adopting big data solutions requires the migration of legacy data of different

types and models to the new system. FME eases this process with support for several big data applications including:

Amazon DynamoDB Amazon RDS Amazon Redshift Amazon S3 Google BigQuery MarkLogic...

Make the move to BIG data

Page 20: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 20The Trademarks/Logos belong to the respective companies

Big (GIS) Data & FME: Variety

Support for over 345+ CAD/ GIS/Database/Web formats (includes proprietary as well as OGC formats)

Page 21: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 21The Trademarks/Logos belong to the respective companies

Big (GIS) Data & FME: Velocity GIS & Non-GIS data today

available for use in real time or near real time

Advancing speed in which new information floods the system, from an increasing number of diverse data sources and types.

Page 22: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 22The Trademarks/Logos belong to the respective companies

Big (GIS) Data & FME: Velocity FME’s real-time processing has the ability to

immediately respond to events and trigger different FME actions to ensure real-time data is delivered exactly how it's needed in actual real-time.

“Right Information”

at the

“Right Time”

in the

“Right Form”

Page 23: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 23The Trademarks/Logos belong to the respective companies

FME: Feature Manipulation Engine

FME Desktop

FME Server

FME Cloud

CREATE AND RUN WORKFLOWS

FME Desktop lets you connect and transform data in limitless ways.

AUTOMATE WORKFLOWS (ON-PREMISE)

FME Server provides enterprise-level access to FME's powerful capabilities.

AUTOMATE WORKFLOWS (CLOUD)

FME Cloud is the hosted version of FME Server. No hardware required.

Page 24: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 24The Trademarks/Logos belong to the respective companies

FME & Big (GIS) Data CapabilitiesConvert spatial data between

hundreds of formats

Transform spatial data into the precise data model you need

Integrate multiple different data types into a single data model

Share spatial data with people where, when and how they need it

Page 25: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 25The Trademarks/Logos belong to the respective companies

Big (Geospatial) Data: The “Safe” Way

Convert, Transform, Share and or Integrate Big (Geospatial) Data

using FME and gain geospatially, not just in a

BIG way but also in a “Safe” way!

Page 26: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 26The Trademarks/Logos belong to the respective companies

FME World Tour 2016: India

Register at www.pixelsoftek.in/fme-world-tourRise above GIS file format barriers & Achieve Total Spatial Data Mastery

“Connecting our World”New Delhi: April 26th, 2016 Bangalore: April 27th, 2016

Page 27: Small Things of Big (Geospatial) Data

© 2016 PIXEL SOFTEK PVT. LTD.Perform. Xcel. Lead. 27The Trademarks/Logos belong to the respective companies

PIXEL SOFTEK PVT. [email protected]

Thank You

Perform. Xcel. Lead.

Raghavendran (aka SRG)[email protected]

8 & 9th Floor, Vokkaligara Bhavana,Hudson Circle, Bangalore 560027India.T: 91.080.22485241 F: 91.080.22485247• Atlanta, GA, USA • Chennai & Delhi, India