Upload File

data science, machine learning and big data

16
Data Science, Machine Learning and Big Data Fabrício J. Barth

Upload: fabricio-barth

Post on 15-Jan-2015

287 views

Category:

Technology


8 download

Report

Tags:

DESCRIPTION

 

TRANSCRIPT

Page 1: Data Science, Machine Learning and Big Data

Data Science, Machine Learning and Big Data

Fabrício J. Barth

Page 2: Data Science, Machine Learning and Big Data

Entrada: 13 milhões de registros históricos sobre crimes em LA.Saída: determinar quando um crime irá acontecer.

Page 3: Data Science, Machine Learning and Big Data

Entrada: rede de sensores que cobre todo o mundoSaída: determinar quando um terremoto irá acontecer

Page 4: Data Science, Machine Learning and Big Data

Entrada: milhões de itens e milhões de usuáriosSaída: recomendar itens com acurácia alta para os usuários (clientes)

Page 5: Data Science, Machine Learning and Big Data
Page 6: Data Science, Machine Learning and Big Data
Page 7: Data Science, Machine Learning and Big Data
Page 8: Data Science, Machine Learning and Big Data

Criar rôbos que compram e vendem ações

Page 9: Data Science, Machine Learning and Big Data

O que estes projetos têm em comun?

✤ Manipulam grandes volumes de informação

✤ Outros exemplos de grandes volumes de informação:

✤ A380: Heathrow - JFK: 640 TBs de log

✤ Twitter: 12+ TBs of tweet every day

✤ Facebook: 25+ TBs of log data every day

Page 10: Data Science, Machine Learning and Big Data

O que estes projetos têm em comun?

✤ A origem dos dados é muito variada.

Page 11: Data Science, Machine Learning and Big Data

O que estes projetos têm em comun?

Page 12: Data Science, Machine Learning and Big Data

Queremos modelos preditivos

Page 13: Data Science, Machine Learning and Big Data

Big Data refers to:

✤ All data that comes at high Volume

✤ All data that comes at high Velocity

✤ All data that comes from a Variety of Sources (structured + unstructured data)

✤ Future

Page 14: Data Science, Machine Learning and Big Data

Fluxo de transformação dos dados

✤ Coleta e pré-processamento dos dados

✤ Aplicação do modelo

✤ Apresentação dos resultados

Page 15: Data Science, Machine Learning and Big Data

Como o modelo é desenvolvido?

Page 16: Data Science, Machine Learning and Big Data

Habilidades de um cientísta de dados


Caterpillar Big Data Infrastructure Big Data, Data Analytics, and … · Caterpillar Big Data Infrastructure Big Data, Data Analytics, and Machine Learning. Caterpillar is the world’s

Big data, data mining, and machine learning

Introduction to Big Data, Data Mining, and Machine Learning

Big Data and Machine Learning at Zalando€¦ · BIG DATA AT ZALANDO Business Intelligence Machine Learning Data Governance Data at the core of everything we do. 10 A TYPICAL BIG

Machine Learning in Big Data

Big Data, Machine Learning, and the Social Sciences · Big Data, Machine Learning, and the Social Sciences Hanna Wallach ... Predictive Modeling} few constraints ... Big data is used

Big Data and Machine Learning at the IMF · Big Data and Machine Learning at the IMF WORKSHOP ON “BIG DATA & MACHINE LEARNING APPLICATIONS FOR CENTRAL BANKS” BANK OF ITALY - OCTOBER

Machine Learning Big Data using Map Reduce - PBworksmachinelearningbigdata.pbworks.com/w/file/fetch/50030744/Machine... · Machine Learning Big Data using Map Reduce By Michael Bowles,

Big Data, Data Science, Machine Intelligence and Learning · Big Data, Data Science, Machine Intelligence and Learning: Demysti cation, Trends, Challenges and Opportunities for O

Big Data Machine learning Business intelligence

Big Data, Model Complexity, and Interpretability: Machine

Introduction to Big Data/Machine Learning

IEEE TRANSACTION ON BIG DATA 1 A Machine Learning …bmlaser.physics.ecu.edu/literature/2017-4_A Machine...Index Terms—Big Data, Diffraction Image, Machine Learning, Deep Learning,

Big Data, Big Computation, and Machine Learning · Takemasa Miyoshi Data Assimilation Research Team RIKEN. Ph.D. (Meteorology) Data Assimilation Scientist. Big Data, Big Computation,

Big data, artificial intelligence, machine learning and ...ico.org.uk/media/for-organisations/documents/2013559/big-data-ai-ml-and-data...Big data, artificial intelligence, machine

Using R for Big Data Advanced Analytics and Machine ... · Using R for Big Data Advanced Analytics and Machine Learning Hands-On Lab ... Using R for Big Data AA and Machine Learning

62418 Big Data Analytics and Machine Learning for real ... · Introduction to Machine Learning 2. ... Complex Event Processing Machine Learning Big Data. ... Oracle, Data Warehouse,

Chaire Machine Learning for Big Data

Intro au Big Data & Machine Learning

Machine Learning on Big Data with HADOOP

Big Data Analytics and Machine Intelligence Capability

Data Quality Considerations for Big Data and Machine

Machine Learning and Big Data at Foursquare

Big Data and Machine Learning

Big Data and AI Strategies€¦ · Overview of Big Data and Machine Learning Part Two: Alternative Data Part Three: Machine Learning and A.I. 2 Factors Leading to Big Data Revolution

GraphChi: Big Data – small machine

Big Data Week: Forget Big Data - Think Machine Learning!

Parallelizing Big Data Machine Learning Applications with ...dsc.soic.indiana.edu/publications/Parallelizing Big Data Machine... · Parallelizing Big Data Machine Learning Applications

Big Data Machine Learning

Machine Learning on Big Data - ClassIntro

Big Data, künstliche Intelligenz und Data Analytics · Big Data, künstliche Intelligenz, Machine Learning, Data Analytics & Co. How big is big? Big Data in der Versicherung sind

Data Mining/Machine Learning/ Big Data

Building a Big Data Machine Learning Platform

Big data and machine learning @ Spotify

Big Universe, Big Data: Machine Learning and Image ... · Big Universe, Big Data: Machine Learning and Image Analysis for Astronomy ... CCD, typically acquired through only a handful