data collection & entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation...

18
Data Collection & Entry

Upload: others

Post on 13-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

Data Collection & Entry

Page 2: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

Creating a Good Data Gathering Sheet

•  How easy is it to read?

•  Are column and row definitions clear?

•  Is there metadata?

•  How similar is it to your digital data entry form?

•  Can you use it at 4am?

Page 3: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥
Page 4: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥
Page 5: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

The Dimensions of Data

• Number of complete observations

• Number of things measured per observation

Page 6: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

Wide Data

•  OneObserva*onperrow•  Alldatafieldsarecolumns

Page 7: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥
Page 8: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

Long Data

•  Eachmeasurement1row•  Allinforma*onaboutmeasurementinrow

Page 9: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

Hybrid Data

•  Neitherlongnorwide•  Eachrowhasmul*plemeasurements…butalsosomeuniquequali*es

•  Eachrowisnotacompleteobserva*on

Page 10: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

Efficiency May Drive Data Sheet Design

Page 11: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

Efficiency May Drive Data Sheet Design

Page 12: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

Is this wide, long, other, or bad?

Page 13: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

What is bad practice here?

Page 14: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

What is wrong here?

Page 15: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

What is bad practice here?

Page 16: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

General Rules for Good Data Creation

•  Columns should have only 1 type of data

•  Keep metadata separate or repeated

•  No bare space

•  Consistent NA character

•  Others?

Page 17: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

EXCEL TIME!

Page 18: Data Collection & Entrybyrneslab.net/classes/data_science/lectures/03_entry.pdf · observation . Wide Data ... 16 Rho 20 21 22 . DATE "29," o 8/30/1* 7/27/05 SCD' SCD' SCI* SCt¥

EXCEL TIME!

EntryFillsBasicFunc/onsFunc/onsforErrorCheckingPivottablesControlledVocabularies