pasdc: the commonwealth’s official source for population and socioeconomic statistics class...

PaSDC: The Commonwealth’s Official Source for Population and Socioeconomic Statistics

Class Overview:• Intro to the Pennsylvania State Data Center • Decennial Census • The American Community Survey• Population Estimates Program• Extract and download data from American FactFinder

The PaSDCThe PaSDC

• Established in 1981 by Executive Order of the Governor

• We are the Commonwealth’s Official Source for Population and Socio-Economic Statistics

• Located at Penn State Harrisburg within the Institute of State and Regional Affairs (Church Hall)

• We are a cost recovery operation



The Decennial CensusThe Decennial Census

• The census is a count of everyone living in the United States every 10 years.

• Taken every 10 years since 1790. • Mandated by the U.S. Constitution and participation is

required by law.

Mission:Count everyone once, only once, and in the right place


Census Data are used to:• Distribute Congressional seats to states and

determine state legislative boundaries• Make decisions at every level of government• Distribute $400 billion in federal funds to

communities each year


Census 2010Census 2010

• Census 2010 was short-form ONLY.– Shortest Census questionnaire in

modern history.– Takes less than 10 minutes to

complete.• American Community Survey

– Now the premier source for Socio-economic data


American Community SurveyAmerican Community Survey

• A large, continuous demographic survey– Produces annual and multi-year estimates

of the characteristics of the population and housing

– Produces characteristics, not a population count– Produces information for small areas including

tracts, block groups and population subgroups - updated every year

Key component of re-engineered 2010 census


American Community SurveyHow Does it Work?

American Community SurveyHow Does it Work?

• The American Community Survey uses moving averages to collect data for small areas:– Continuous surveying, ‘rolled up’ into one-year,

three-year or five-year averages (multi-year estimates).

– For example: Averages for 2007-2011 include results collected in 2007, 2008, 2009, 2010 and 2011. • January 1, 2007– December 31, 2011


What is a Survey?What is a Survey?A survey uses data gathered

from a sample of the target population to represent the

rest of the population.

• Survey-based datasets usually include much more detail.

AMERICAN FACTFINDER The U.S. Census Bureau’s Online Data Dissemination

Tool

Link from www.census.gov

Or, go directly to factfinder2.census.gov

http://www.census.gov/

THE AMERICAN FACTFINDER

Sources of Data in FactFinder:

• Decennial Census• American Community Survey• Population Estimates Program • Economic Census• Annual Economic Surveys


Archived Datasets:

• 1990 Census• 2000-2004 American Community Survey• 2000-2001 Supplementary Survey• 1997 Economic Census• 2003 Annual Survey of Manufactures• 2003 Nonemployer Statistics

Archive Business Rules:

• Decennial Census and Economic Census– Retain and display the current and 1 prior– Ex. Census 2010 and Census 2000

• Econ 2007 and Econ 2000

• Annual Surveys– Retain and display the current and 4 prior (*5 for ACS)– Ex. ACS: 2010, 2009-2005

• County Business Patters: 2009, 2008-2005


THE NEW AMERICAN FACTFINDER

New Interface is fundamentally different from Legacy AFF

• Main/Search Pages are main interface of New FactFinder

• Old Step-by-Step process replaced by a variety of search mechanisms

• FACTSHEETS are NOT available; Demographic Profiles located at top of search

NEW FACTFINDER VS. LEGACY

NEW FACTFINDER• Numerous search

mechanisms to get to the same data

• Data searches are more topic-driven

• Enhanced table manipulation features

and mapping features

LEGACY FACTFINDER • Linear – Step by Step – process

to extracting data• Searches require further

knowledge of census bureau datasets

• Factsheets available on main page for quick access to community profiles

* Legacy FactFinder deactivated on January 20, 2012

The New Census.gov

The New American FactFinder Main Page

Resources: Using FactFinder - provides useful

resources forunderstanding AFF various search methods

and more.

Data Search Methods can also be accessed on the Ribbon

(*Ribbon can be accessed from any page in American

FactFinder)

Data Search Methods• Community Facts – basics for one Geography• Guided Search – Step-by-Step with Breadcrumb trail• Advanced Search – multiple data products, tables

and geographies• Download Options – access to FTP site for large

data files and archived data sets.

Click the categories and data value will change

Community Facts• Enter a state, county, city,

town, or zip code in the Community Facts text box, then click GO.

• Cannot select lower-level census geographies such as tracts and blocks

• Receive the central statistic for the nine categories listed as the blue buttons on left hand side.

• Example, click Age to view Area’s “Median Age”

• Click the links under "Popular tables for this Geography" to see tables containing other commonly requested data for your community.

(i.e. DP-1 thru DP-5)

Start• Topics relating to People,

Housing, or Businesses and Industries.

• Directed to novice users (must be aware that multiple datasets will be included in results.)

• Search using Dataset or Specific Table Number

• Requires understanding about Census Bureau datasets and table number conventions

• Click the radio button, then Next to continue the guided search.

Guided Search

Topics• Depending on the universe

option selected in Step 1, “Topics” will display a listing of characteristics relevant to that universe.

• Select one or more topics to add to Your Selections. As you add and remove topics, the number of tables matching Your Selections is updated.

• Topics are also updated when search is refined.

• Subcategories display a number in parenthesis to indicate number of products for a specific search

Geographies• Functions identical to List

Tab in Advanced Search (see advanced search section for details).

• Only most commonly selected geographic areas area available.

• Text Search is only available for the geographies listed

• You may add more than one text search result, but no psuedo-georaphies are available in text search (i.e. all counties within Pennsylvania)

Race/Ethnic Groups• Search for Census data for

one or more race or ethnic groups, tribes, or ancestries.

• Both Text Search and Filter Search Options Available.

• Selection of Race/Ethnicity may not be possible because of items in “Your Selections “.

• In this case, you would have to remove a search criteria so that a data product containing race/ethnic group filter is available.

Search Results• Click on 5 Search Result button in breadcrumb at

anytime during Guided Search to view results.• Provides only the top ten Search Results.

• Must got to Advanced Search to view all results• Users can select one table at a time

• Again, must go to Advanced to select multiple tables (i.e. Zipping multiple files for download)

TABLE TYPESTable Type

Sample Table ID, Title and Dataset Definition

Comparison ProfilesCP02 - SELECTED SOCIAL CHARACTERISTICS IN THE UNITED STATESACS 1-year estimates

Users can compare data across time periods for one geographic area in the same table

Data ProfilesDP-1 - Profile of General Population and Housing Characteristics: 20102010 Demographic Profile SF

A profile includes tables that provide various demographic, social, economic, and housing

characteristics

Detailed Tables

B19019 – Median Household Income in the Past 12 Months by Household Size

American Community Survey

Tables from summary files that provide the most detailed data on all topics and

geographic areas

Geographic Comparison Tables

GCT-H2 - General Housing Characteristics: 2010 - United States -- States; and Puerto Rico2010 SF1 100% Data

Users can compare data across geographic areas in the same table

Geographic HeaderG001 - GEOGRAPHIC IDENTIFIERS

ACS

Geographic Header tables list various codes and other information about the selected

geographies.

Narrative ProfilesNP01 - Population and Housing Narrative Profile: 2010ACS 1-year and 3-year estimates

Narrative Profiles are text-based summaries of Census data

Subject TablesS0101 - AGE AND SEX

ACS

Similar to data profiles but include more detailed ACS data, classified by subject.

Quick Tables

QT-H2 - Tenure, Household Size, and Age of Householder: 2000 more information110th Congressional District Summary File (100-Percent)DP-1 - Profile of General Population and Housing Characteristics: 2010

Predefined tables with frequently requested information for a single geographic area.

• Series of questions used to get user to data they’re seeking. A "breadcrumb" trail provided at top of the page. – Breadcrumb trail is clickable so that user can go back to specific step to

change search criteria.

• Offers insight as to how the Census Bureau structures its data.– Each step allows user to understand another aspect of data organization

• “People”, “Housing” and “Businesses or Industries” define a data universe. “Dataset” limits search to one particular dataset.– If “specific dataset” radio button is not selected in IMAGEE, you cannot select

a specific dataset later in the search

– This may cause data users to mistakenly select figures from different dataset (i.e. Want = Census Data, Result = Population Estimate)

GUIDED SEARCH NOTES

Data Selection Tools:• Topics (people, housing, specific data

set)• Geographies (geo type, summary

level)• Population Groups (ancestry, race,

ethnicity) • Industry Codes (search by NAICS

code)• EEO Occupation Codes (search by EEO

occ.)

Advanced Search

Advanced Search Text Box Features:

• Type-ahead overlay will appear with common search terms

• This occurs in all text boxes in American FactFinder

• Spell correction feature (alert if correction is made)

• A “Did you mean..” function for searches that closely match common searches

• Wild Card search by using “*” in your search

• Topics, population groups, or industries radio buttons

– Drop down list appears for suggest search terms within each category

Your Selections:• All search filters must appear in “Your

Selections”• Number and type of search results will

change as “Your Selections” is updated• Selections can be added or removed at

any time• Helps to track and manage your search

criteria• Provides an outline of your data search

Topics Filters:• Selected from the Topics

Menu to narrow search to age-

related data items from 2010 Census

Summary File – 1

Geography Filters:• Selected from the Geography

Menu to narrow search to Geographic area(s) specified.

Click on the to remove a single selection

from “Your Selections”

Click on the “clear all selections” to remove all search

criteria from “Your Selections”

• Once cleared, filters cannot be recovered.

Topic Filters Include:

• People – Characteristics of people such as age, and sex

• Survey – Characteristics of data surveys such as program, year, and survey name

• Dataset –select the dataset you wish to retrieve data from

• Housing – Characteristics of housing such as count, and owner costs

• Business and Industry – Measurements of businesses and industries such as expenses, capital expenditures and assets

SEARCH BY TOPICS

• Use the Dataset Filter in Topics Menu to mimic a Legacy FactFinder search– Limit search results to a specific data set

• Expand search categories and select items to add to “Your Selections”– Results will be refined each time an item is added or removed

• Topics are also updated when search is refined.

– Subcategories display a number in parenthesis to indicate number of products for a specific search

Topic Filter Group

Topic Filter Group Subgroup

Topic Filters

Collapse Button

Expand Button

Click the to expand or contract the

filter

Topics Allows Users to Search and Select Topic

Filters

• Expand categories to select items to add to “Your Selections”

• Topics categories will also update each time a search is refined.

• Each subcategory displays a number in parenthesis that indicate the number of corresponding products for a search topic.

• Each time a Topic Filter is added “Search Results” are updated.

Geographies Allows Users to Select Geographic Areas

• Click on Geographies from the Data Selection Tools

• The Geographies Overlay appears over the Search Results Page

SEARCH BY GEOGRAPHIES

• Search by List–Revival of Legacy FactFinder Geography Search Mechanism– User does not have access to all Geographic Summary Levels!

• Search for Geographic Area by Name–Note – You must clear your geography filters before searching

for additional, unrelated geographies

• Search by Address–Provides the Census Geographic areas for a given address

• Search by Map–Select Geographic Areas from a map

Search Using Geography: List

• List is the default Tab when Geography Overlay Opens

• Restores Legacy FactFinder Geography Search

Chose the level of Geography you wish to get data for from the

drop down list(Caution! Not all

Summary Levels are available)

Next, narrow your search by selecting higher

geographic areas from the dropdowns provided.

Finally, select your geographies from the list

provided and click “ADD TO YOUR SELECTIONS”.

• Hold Control Key while clicking to select

multiple geographies from the list

Geography Results shows how many

geographies match the Geography Filters – up

to 75 displayed per page

Geography Index Selector

• Three levels of detail available

• System performance declines as level of detail increases

Search Using Geography: Name

Select Your Geographic Filters

• Select the geographic level you want to end up with First!

• Then, Trim away at the geography results using the “Within” Filter (Similar to the drop down list functionality)

Text Search• Type in name

of geographic area

No Geographies are selected until you click on the “Geography Name” or check

the box, then click “Add” to send it to “Your Selections”

Select Your Geographic Filters

• Select the geographic level you want to end up with First!

• Then, Trim away at the geography results using the “Within” Filter

• Must go back and remove Geographic Filters to expand search options

This will reveal geographies that are not filtered out by the geography filters previously put in place

Notice that Geography Results are updated each

time a filter is applied

Geographic Components

• Enable searching and selection of geographic components

Other GeographySearch Options

Search using Geo Codes• Enable users to search using

Federal Information Processing Standard (FIPS) Code

Include in Results Selector• Use the radio buttons under “Include

in results” to display all geographies, only individual geographies, or only groups of geographies in the Geography Results Pane.

Search Geographies Using Address Tab

• Search census geographies by entering an address and clicking “GO”

• Select geographies to add to “Your Selections”

• Note: search uses the latest available data beginning with 2010 and working backwards.

Close Geography Overlay by Clicking

the

Search Geographies

Using Map Tab

• Search a single geography by clicking the map

• Select multiple geographies by drawing with Map Selection Tools

• Add the selected geographic areas to “Your Selections”

GEOGRAPHY SEARCH – REFERENCE MAPS

Point – Click on the map to add individual geographic areas to the selection results.

Rectangle – Click on the map and drag the mouse pointer to draw a rectangle on the map. Areas that intersect this rectangle will be added to the selection results.

Polygon – Click on the map to define the borders of a polygon. To finish drawing the polygon, double-click the last point. Areas that intersect this polygon will be added to the selection results.

Radius - Click on the map and drag the mouse pointer to draw a circle on the map. Areas that intersect this circle will be added to the selection results.

Map Selection Tools:

Reference Maps and Address

Geography Search• Can be assessed on the

American FactFinder Main Page

• Note: Only 2010 Census Geography is available via Maps and Address searches

Race and Ethnic Groups• Enter a population group name in

the population group search box or select population group filters

Race and Ethnic Groups are only available for data files that have separate records for individual race groups such as Summary File 2 and the ACS.

SEARCH BY RACE & ETHNIC GROUPS

Race and Ethnic Groups filters include:•Basic Race Category

» White, Black, AIAN, Asian, NHOPI, Some Other Race and Two or more Races

•Ethnic Category» Hispanic and Not Hispanic

•Race combinations » Alone, Alone or in combination

•Ancestry Group» German, Irish, Italian, ect.

•Country of Birth» Native, Foreign Born, Specific County

Industry Codes• Enter an industry name or

number in the industry code search box or by selecting industry code filters from filter groups.

Industry Codes are only available for data files that have separate records for industries, such as files from the Economic Census and County Business Patterns

SEARCH BY INDUSTRY GROUPS

Industry codes filters include:• Code Type

– Commodity; Material/Fuel; NAICS Industry

• Code Year• Industry Sector

– 00: Total for All Sectors; 21: Mining; ect.

• Industry Level– 2-digit through 6-digit NAICS Codes

* Industry Group Search can be used to separate population and economic survey data in the New AFF.

EEO Occupation Codes• Enter an Equal Employment

Opportunity name or number in the EEO code search box or by selecting EEO code filters from filter groups.

EEO Occupation Codes are only available for data files pertaining to the Equal Employment Opportunity Special Tabulation Data – DO NOT use with the Economic Census and related programs, as you will not receive any results.

Working with Search Results• Search Results are displayed on the

“Search Results Pane”• (First 25 tables are shown, can be

expanded to 75) • Data in “Search Result Pane” are

based on items added to “Your Selections”

• Browse and select data to view and download

Search Results• Indicates the number of data items that meet

search criteria

Table #

Table Selecto

r

Dataset • refers to source

file

opens a table shell

• Similar to “What’s This?” in Legacy AFF

Max of 75 Results Per

page

Sortable Column Headers

Table Title

Once a table is checked, the action bar becomes active. Click “View” to see

the TableUsers can also click the

hyper-linked table title

(limited to one table selection)

“Refine your search results”• Allows user to further refine search results

by entering keyword(s)• Keyword(s) are added to “Your

Selections”• AFF will offer table suggestions that can be

clicked and added to “Your Selections” • Limited Geographies can also be added in

Geography Search Text Box.

• No way to view ALL tables and data products generated by a given search– Maximum allowed is 75

• No way to select ALL search results– Must click each individually (P12*)

• List of currently selected tables is absent– Must view/download tables independently if they are not

returned as part of the same search

WORKING WITH SEARCH RESULTS

Refine Search Results

Remove Filter to ExpandSearch Results

• Click to remove search filter(s) from “Your Selections” to expand the search or prepare for a new set of search criteria

American FactFinder lists the results based on the set of rules that follow:• FactFinder assumes that the user is looking for the most

current data available• Data that gives an overview is ranked higher than detailed

data. – For example, a summary data profile of Pennsylvania from 2010 will

rank higher than a summary data profile from 2007 and also higher than a data table entitled “Median Income by Place of birth in Pennsylvania” data table from 2010.

RANKING OF SEARCH RESULTS

Quick Table or Profile allow user to view data for one geography at

a time - online(multi-geographies can be selected and

downloaded as a .csv file – just not viewed online)

Use drop down arrow to view other geographies

selected.

Table ID & Table Title

Page through Selected Tables;

View as PDF

Action Bar

Detailed Tables provide specific data for multiple geographies

View Table and Geography Notes

Table Notes• Detailed notes pertaining the

table that is being view• Provides updates on data

variables, question changes, ect.

Geography Notes• Offers detailed list of geographic changes

by state• Code, boundary, annexation changes for are

available – great resource for historical data and mapping projects!

Click on • Enables user to modify

table using various Table Tools

Check or Uncheck• To modify table using a

specific Table Tool

Transposed Table

Filter

TABLE MODIFICATION TOOLS• Re-order rows and columns /• Show/hide rows and columns

• Sort Ascending/Descending

• Collapse/Expand data Categories

• Reset Table to original view

• Filter Estimate/MOE

• Transpose Rows & Columns

– Swap the rows and columns of a table so that the original column headers are row headers and the original row headers are column headers

Click “Open”• Map of select variable will

appear

Select Data Item to Map by clicking

on the hyper-linked data item

Click “Open”• The zip file will open

in the program chosen by user

Select Download Format

• csv. files open in numerous spreadsheet programs, including Excel• Check “Include

descriptive data elements” if you wish to have data variable descriptions below data variable id’s.

• Presentation-ready formats• Excel and PDF• Will only show what is

provided on the screen at the time of download – not all geographies selected

Create Bookmark• Add data tables to internet

browser’s favorites.• Copy and Paste links into e-

mail and website

Save Query• Save data tables to

computer hard-drive or network(s)

Load Query (Step 1) • Click Load Query Button • Located on the AFF Main

Page

Load Query (Step 2) • Click Browse and Find File

on hard-drive or network(s)

• Click OK to Load data table

AFF Data Release Schedule• Search by dataset to find out when

the latest releases will be available• Click on linked text to be directed

to programs data release page

AFF News/Notes• Displays information about data

releases and other announcements about American FactFinder

Download Options• Read about the various ways

that you can download, and the formats available.

• access to the Census Bureau FTP site for high volume download.

U.S. Census Burea’s File Transfer Protocol

(FTP) Site

• All datasets and archived datasets will be available on the FTP site

• Archived datasets include: 1990 Census, 2004 ACS and earlier, 1997 Economic Census, and more.

• Click on linked text to be directed to data files

• Each directory contains a “Read me” file with instructions on how to access the data

• Direct link is: www2.census.gov

AFF Deep Linking Guide

• Located on bottom right-hand side to Main Page

• American FactFinder provides website developers the ability to create URLs that Deep Link to the following:

• FactFinder Tables• A set of Search Results• Reference map centered on a specific

geo• Geography Overlay (Name, Address,

or Map tabs)• Quick Start search results (Topic or

Table Name, Population Group, or Industry search, with or without a Geography)

QUESTIONS?

JOHN R. MAURER

STATE CAPITAL OFFICE COORDINATOR

PENN STATE HARRISBURG

777 HARRISBURG PIKE

MIDDLETOWN, PA 17057

717-948-6336

[email protected]

pasdc: the commonwealth’s official source for population and socioeconomic statistics class...

Documents

census slide

search slide

american factfinder

merican f act f inder

socioeconomic data slide

year slide

socioeconomic statistics

data data searches