rti international rti international is a trade name of research triangle institute. new dimensions...
TRANSCRIPT
![Page 1: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/1.jpg)
RTI International
RTI International is a trade name of Research Triangle Institute. www.rti.org
New Dimensions of Mobile Data Quality
Michael Keating, Charles Loftis, Joseph McMichael, Jamie Ridenhour
March 19, 2014
![Page 2: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/2.jpg)
RTI International
Contents
• Overview of Sensors in Mobile Technology
• Lessons Learned from In-Person Field Survey Implementations
• Expanding Future Possibilities
• Conclusion
![Page 3: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/3.jpg)
RTI International
Overview of Sensors in Mobile Technology
![Page 4: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/4.jpg)
RTI International
Consider this….
Relative computing power of modern mobile devices:– Average smartphone is 100 times more powerful than the
average satellite (NASA, 2012).– The first computer could perform 385 multiplications per second
while modern iPhones can perform 2,000,000,000 instructions per second (Straus, 2012).
Image source: http://www.bitrebels.com/technology/power-in-your-palm-the-computing-power-in-todays-smartphones/attachment/eniac-the-worlds-first-computer-2/
Image source: http://www3.pcmag.com/media/images/406235-google-nexus-5-unlocked.jpg?thumb=y
![Page 5: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/5.jpg)
RTI International
Sensors and New Data Quality Possibilities
Accelerometer– Linear Acceleration– Rotation vector– Gyroscope
Ambient temperature Audio Camera (front and back)
Air pressure Proximity Light Global Positioning
System Magnetic Field Gravity
Questions to consider… How can we use sensors to improve data quality? Can we finally rid survey research of “curb stoning?” How do we recommend organizations approach data quality
with mobile technology?
![Page 6: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/6.jpg)
RTI International
Towards a Mobile Data Quality Framework
Mobile Data
Quality
Photo Capture
GPS Capture
Paradata Analysis
Audio CaptureMagnometer (Compass)
Response Data Analysis
Bluetooth External Sensors
BiometricsSmartwatchesGoogle Glass
Accelerometers
![Page 7: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/7.jpg)
RTI International
Lessons Learned from In-Person Field Survey Implementations
![Page 8: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/8.jpg)
RTI International
Computer Audio-Recorded Interview
CARI was initially developed for use on laptops.– Audio quality was not always great.
Audio quality in mobile technology is much improved.– Isolation of respondent voices to limit background noise.– Enough sensitivity to detect relatively quiet voices and the voice
of someone on the other side of the room.
Collecting CARI files is easier than ever, audio files are small (usually only a few kilobites), and data connection speeds are fast enough to allow for fast upload.
![Page 9: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/9.jpg)
RTI International
Global Positioning Systems (GPS)
Common in modern mobile devices.
Flexible implementations for researchers:– Active GIS coordinate capture by interviewer.– Passive GIS coordinate capture during survey administration.
Data quality implications:– Detect accidental error.– Create automated ways to flag cases for possible falsification.
![Page 10: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/10.jpg)
RTI International
Geofencing Address-Based Samples
Create virtual perimeters to proactively detect survey error.
Looks good! Accidental error?
![Page 11: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/11.jpg)
RTI International
How accurate is the GPS?
Collected coordinates at ~18,000 households in a recent field study.
95% of coordinates were accurate within 26 feet.
99% of coordinates were accurate within 80 feet.
Image source: http://www.trbimg.com/img-51561838/turbine/sfl-hurricane-center-breaks-accuracy-records-2-002/440/440x400
![Page 12: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/12.jpg)
RTI International
?
![Page 13: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/13.jpg)
RTI International
?
![Page 14: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/14.jpg)
RTI International
Geotagged Photography
![Page 15: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/15.jpg)
RTI International
Combine Photography with GPS
Photo quality is sufficient, even at twilight.
Combine photography with geographic coordinates to verify FI location.
Supplement with additional data sources for additional verification.
![Page 16: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/16.jpg)
RTI International
Too much data!
Image Source: http://cloudtweaks.com/wp-content/uploads/2012/10/cloud-hoskins.jpg
![Page 17: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/17.jpg)
RTI International
Tips for Future Implementers
It’s so easy to collect these data that it should always be done on outgoing CAPI surveys.
One GPS coordinate is not enough.
Remove the human and automate whenever possible!
Create a single data quality hub that allows managers to consume mobile data quality points in a single location.
Use a sampling framework to verify a subset of cases and adjust accordingly.
![Page 18: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/18.jpg)
RTI International
Expanding Future Possibilities
Mobile Data
Quality
Photo Capture
GPS Capture
Paradata Analysis
Audio CaptureMagnometer (Compass)
Response Data Analysis
Bluetooth External Sensors
BiometricsSmartwatchesGoogle Glass
Accelerometers
![Page 19: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/19.jpg)
RTI International
The Internet of Things has Arrived
Google Glass– Does augmented reality and
navigation improve survey data quality?
Complex Accelerometers– We would expect certain
patterns of field interviewer physical activity before and after an interview. Can we use this to catch curb stoning?
Biometrics– Could we use biometric
sensors on interviewers to catch falsification?
![Page 20: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/20.jpg)
RTI International
Conclusions
Mobile data collection has unlocked a whole spectrum of new data quality possibilities.
To date we have not found a “silver bullet” that solves all data quality issues and catches all falsification.
Combine multiple data quality points to create a multidimensional approach to field studies.
Collecting these data quality points on field studies should be considered survey best practice.
![Page 21: RTI International RTI International is a trade name of Research Triangle Institute. New Dimensions of Mobile Data Quality Michael Keating,](https://reader035.vdocument.in/reader035/viewer/2022062511/5519d899550346d67b8b4596/html5/thumbnails/21.jpg)
RTI International
Presenters
Michael Keating
Survey Manager
919.541.7166