ISR Training

February 12, 2010

Data Retrieval from Statistics Canada Surveys

2

What we’ll cover…

Overview of <odesi> and TDR – When to use– How to access

<odesi> – Searching

TDR (and the <odesi> browse)– Prime facts and overview of structure– Browsing– Downloading B2020 and Excel files– Subsetting raw data files

What we want you to know at the Desk…

3

Overview of TDR and <odesi>

The interface to Survey data– TDR: TUG interface– <odesi>: OCUL interface

Formats/Types of files: raw data, Excel, B2020 Search or browse surveys Subset the survey Download the data for analysis Access the documentation NB: Nesstar is the software running behind both

TDR and <odesi> for data download and subsetting

4

Overview of TDR and <odesi>

Terminology to know…– Metadata: data describing the data (i.e., the data’s

catalogue record) Study Description (Biblographic Citation, Study Scope,

Methodology and Processing, Data Access) Data Files Description Other Documentation (codebooks, user guides, etc.)

– Variables: the questions asked– PUMF: public use microdata file– Synthetic file: data are all mixed up – these files should be

used only for testing syntax of programs

5

Overview of TDR and <odesi>

Nesstar symbols to know:– + : click to open (not at the survey yet!)– Grid: click to open (at title of survey)– Funnel: subset button– Disk: download button

6

Overview of TDR and <odesi>

Uses the drilldown method for Browsing– Major category– Year – Geography– Survey

Remember the symbols? – Click on them to get where you need to be!

Clicking on the title of the product retrieves the Abstract

Documentation is under Metadata Other Documentation

May vary slightly depending on what’s available

7

Overview of TDR and <odesi>

Slightly different for <odesi> - and includes French

Major Categories (TDR)

TDR vs <odesi> : when to use

TDR to download known datasets

and/or documentation to identify, locate, or access

datasets and other statistical or data files not on <odesi> (e.g., non-web-based Statistics Canada products, such as InterCorporate Ownership, and those from 3rd party sources, such as SourceOECD)

<odesi> for searching for public opinion polls (Gallup,

CORA, etc.) if TDR is down!

8

Think of it as TRELLIS vs Primo!

Accessing TDR and <odesi>

Library’s homepage Resources for

Research E-Data Select TDR or

<odesi>

9

10

Accessing TDR

11

Accessing TDR

Let’s go live with TDR!

Icons Identifying types of files Viewing the metadata (abstract, keywords, etc.) Accessing B2020 and Excel files Accessing documentation Getting quick stats Downloading and Subsetting (if time)

12

13

Exercise 1: TDR Basic Information

1. What types of files are available for the 2006 Census of Population (Canada)?

2. Why was the Canadian Travel Survey developed? (Hint: check the Abstract)

3. How many cycles are available for the General Social Survey (Canada)?

4. What is the title of GSS Cycle X?

14

Exercise 1 (cont’d): TDR Basic Information

5. What documentation is available for the Canadian Community Health Survey, Cycle 2.2 (Nutrition)?

6. According to the CCHS 2.2, how many people have ever smoked cigarettes on a daily basis?

Exercise 2: TDR Accessing B2020 and Excel Files

1. Go to the 2001 Census of Population [Canada] Profiles. According to the Profile of Language Characteristics, for Canada, Provinces, Territories, Census Divisions and Census Subdivisions, 2001 Census, how many respondents said their mother tongue was German? (use the number for Canada)

2. Go to the Annual Demographic Statistics [Canada] 2004. According to the Annual population estimates for July 1, 1971 - 2001, Canada, provinces and teritories, (intercensal estimates), how many people resided in New Brunswick in 1980?

15

Overview of <odesi>

OCUL interface Contains

– Statistics Canada Surveys (DLI)– Public Opinion Polls (Gallup Canada, Voice of the

People, Ipsos-Reid, CORA – metadata only)

Searching function (MarkLogic) is tough to beat!

RSS feed availability

16

Accessing <odesi>

17

Accessing <odesi>

18

Let’s go live with <odesi>

Searching

19

20

Exercise 3: Searching <odesi>

1. Do a search for “suicide” anywhere in all collections. How many hits do you get? What are some of the series?

2. Narrow it to “suicide” in Keywords. How many hits do you get? What is the source of the first several hits?

3. Try adding other keywords or narrowing by collection.

4. Pick a topic of your choice on which to search.

21

What Sandra and Agnes want you to know at the Desk…

How to access TDR and <odesi> Where to find the documentation (e.g., the

codebook) How to access B2020 and Excel files (when

they’re available) Searching in <odesi> The Nesstar symbols Basic terminology

22

The End

Congratulations!!!