gary king, jennifer pan, molly roberts · for 2 unusual topics: constant censorship e ort 0 5 10 15...
TRANSCRIPT
![Page 1: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/1.jpg)
Reverse Engineering Chinese Censorship
Gary King, Jennifer Pan, Molly Roberts
Institute for Quantitative Social ScienceHarvard University
(talk at MIT Operations Research Center, 11/21/2013)
1/29
![Page 2: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/2.jpg)
Papers
An Observational Study:
How Censorship in China Allows Government Criticism butSilences Collective Expression (American Political Science Review, May 2013)
Experimental and Participatory Studies:
A Randomized Experimental Study of Censorship in China
Copies at GaryKing.org
2/29
![Page 3: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/3.jpg)
Chinese Censorship
The largest selective suppression of human expression in history
:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop collective action
Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 4: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/4.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop collective action
Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 5: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/5.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop collective action
Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 6: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/6.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop criticism of the state
2 Stop collective action
Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 7: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/7.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop criticism of the state
2 Stop collective action
Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 8: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/8.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop criticism of the state
2 Stop collective action
Right
Either or both could be right or wrong.
(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 9: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/9.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop criticism of the state Wrong
2 Stop collective action
Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 10: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/10.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop criticism of the state Wrong
2 Stop collective action Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 11: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/11.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop criticism of the state Wrong
2 Stop collective action Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 12: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/12.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop criticism of the state Wrong
2 Stop collective action Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 13: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/13.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop criticism of the state Wrong
2 Stop collective action Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 14: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/14.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop criticism of the state Wrong
2 Stop collective action Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 15: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/15.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop criticism of the state Wrong
2 Stop collective action Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 16: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/16.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop criticism of the state Wrong
2 Stop collective action Right
Either or both could be right or wrong.(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 17: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/17.jpg)
Chinese Censorship
The largest selective suppression of human expression in history:
implemented manually,
by ≈ 200, 000 workers,
located in government and inside social media firms
Theories of the Goal of Censorship
1 Stop criticism of the state Wrong
2 Stop collective action Right
Either or both could be right or wrong.
(They also censor 2 other smaller categories we’ll talk about)
Benefit
?
Huge
Cost
Huge
None
3/29
![Page 18: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/18.jpg)
Chinese Social Media: Fractured over 1,400+ sites
4/29
![Page 19: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/19.jpg)
Chinese Social Media: Fractured over 1,400+ sites
hi.baidu 12%
bbs.voc.com.cn 5%
bbs.m4.cn 4%tianya 3%bbs.beijingww.com 2%
Share of Posts in Our Analysis by Internet Content Provider (ICP)
(Plus 59% from Sina Blog)5/29
![Page 20: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/20.jpg)
Observational Study
Collect 3,674,698 social media posts in 85 topic areas over 6 months
Random sample: 127,283
(Repeat design; Total analyzed: 11,382,221)
For each post (on a timeline in one of 85 content areas):
Download content the instant it appears(Carefully) revisit each later to determine if it was censoredUse computer-assisted methods of text analysis (some existing, somenew, all adapted to Chinese)
6/29
![Page 21: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/21.jpg)
Observational Study
Collect 3,674,698 social media posts in 85 topic areas over 6 months
Random sample: 127,283
(Repeat design; Total analyzed: 11,382,221)
For each post (on a timeline in one of 85 content areas):
Download content the instant it appears(Carefully) revisit each later to determine if it was censoredUse computer-assisted methods of text analysis (some existing, somenew, all adapted to Chinese)
6/29
![Page 22: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/22.jpg)
Observational Study
Collect 3,674,698 social media posts in 85 topic areas over 6 months
Random sample: 127,283
(Repeat design; Total analyzed: 11,382,221)
For each post (on a timeline in one of 85 content areas):
Download content the instant it appears(Carefully) revisit each later to determine if it was censoredUse computer-assisted methods of text analysis (some existing, somenew, all adapted to Chinese)
6/29
![Page 23: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/23.jpg)
Observational Study
Collect 3,674,698 social media posts in 85 topic areas over 6 months
Random sample: 127,283
(Repeat design; Total analyzed: 11,382,221)
For each post (on a timeline in one of 85 content areas):
Download content the instant it appears(Carefully) revisit each later to determine if it was censoredUse computer-assisted methods of text analysis (some existing, somenew, all adapted to Chinese)
6/29
![Page 24: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/24.jpg)
Observational Study
Collect 3,674,698 social media posts in 85 topic areas over 6 months
Random sample: 127,283
(Repeat design; Total analyzed: 11,382,221)
For each post (on a timeline in one of 85 content areas):
Download content the instant it appears(Carefully) revisit each later to determine if it was censoredUse computer-assisted methods of text analysis (some existing, somenew, all adapted to Chinese)
6/29
![Page 25: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/25.jpg)
Observational Study
Collect 3,674,698 social media posts in 85 topic areas over 6 months
Random sample: 127,283
(Repeat design; Total analyzed: 11,382,221)
For each post (on a timeline in one of 85 content areas):
Download content the instant it appears
(Carefully) revisit each later to determine if it was censoredUse computer-assisted methods of text analysis (some existing, somenew, all adapted to Chinese)
6/29
![Page 26: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/26.jpg)
Observational Study
Collect 3,674,698 social media posts in 85 topic areas over 6 months
Random sample: 127,283
(Repeat design; Total analyzed: 11,382,221)
For each post (on a timeline in one of 85 content areas):
Download content the instant it appears(Carefully) revisit each later to determine if it was censored
Use computer-assisted methods of text analysis (some existing, somenew, all adapted to Chinese)
6/29
![Page 27: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/27.jpg)
Observational Study
Collect 3,674,698 social media posts in 85 topic areas over 6 months
Random sample: 127,283
(Repeat design; Total analyzed: 11,382,221)
For each post (on a timeline in one of 85 content areas):
Download content the instant it appears(Carefully) revisit each later to determine if it was censoredUse computer-assisted methods of text analysis (some existing, somenew, all adapted to Chinese)
6/29
![Page 28: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/28.jpg)
Censorship is not Ambiguous: Example Error Page
7/29
![Page 29: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/29.jpg)
Censorship is not Ambiguous: BBS Error Page
8/29
![Page 30: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/30.jpg)
The Censors are Fast; Our Automated Methods are Faster
Days Until Censorship, Shanghai Subway Analysis
Days After Post Was Written
Num
ber C
enso
red
0 1 2 3 4 5 6 7
050
100
150
200
250
9/29
![Page 31: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/31.jpg)
The Censors are Fast; Our Automated Methods are FasterExample: Shanghai Subway Crash
Days Until Censorship, Shanghai Subway Analysis
Days After Post Was Written
Num
ber C
enso
red
0 1 2 3 4 5 6 7
050
100
150
200
250
9/29
![Page 32: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/32.jpg)
The Censors are Fast; Our Automated Methods are FasterExample: Shanghai Subway Crash
Days Until Censorship, Shanghai Subway Analysis
Days After Post Was Written
Num
ber C
enso
red
0 1 2 3 4 5 6 7
050
100
150
200
250
9/29
![Page 33: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/33.jpg)
For 2 Unusual Topics: Constant Censorship Effort
05
1015
Count
Jan Mar Apr May Jun
Count PublishedCount Censored
Count PublishedCount Censored
010
2030
4050
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored
Students Throw Shoes at
Fang BinXing
Pornography Criticism of the Censors
10/29
![Page 34: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/34.jpg)
For 2 Unusual Topics: Constant Censorship Effort0
510
15
Count
Jan Mar Apr May Jun
Count PublishedCount Censored
Count PublishedCount Censored
010
2030
4050
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored
Students Throw Shoes at
Fang BinXing
Pornography Criticism of the Censors
10/29
![Page 35: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/35.jpg)
All other topics: Censorship & Post Volume are “Bursty”
010
2030
4050
6070
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 36: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/36.jpg)
All other topics: Censorship & Post Volume are “Bursty”0
1020
3040
5060
70
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 37: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/37.jpg)
All other topics: Censorship & Post Volume are “Bursty”0
1020
3040
5060
70
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 38: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/38.jpg)
All other topics: Censorship & Post Volume are “Bursty”0
1020
3040
5060
70
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst
(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 39: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/39.jpg)
All other topics: Censorship & Post Volume are “Bursty”0
1020
3040
5060
70
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 40: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/40.jpg)
All other topics: Censorship & Post Volume are “Bursty”0
1020
3040
5060
70
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 41: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/41.jpg)
All other topics: Censorship & Post Volume are “Bursty”0
1020
3040
5060
70
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 42: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/42.jpg)
All other topics: Censorship & Post Volume are “Bursty”0
1020
3040
5060
70
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 43: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/43.jpg)
All other topics: Censorship & Post Volume are “Bursty”0
1020
3040
5060
70
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 44: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/44.jpg)
All other topics: Censorship & Post Volume are “Bursty”0
1020
3040
5060
70
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 45: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/45.jpg)
All other topics: Censorship & Post Volume are “Bursty”0
1020
3040
5060
70
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 46: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/46.jpg)
All other topics: Censorship & Post Volume are “Bursty”0
1020
3040
5060
70
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 47: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/47.jpg)
All other topics: Censorship & Post Volume are “Bursty”0
1020
3040
5060
70
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored Riots in
Zengcheng
Unit of analysis:
volume burst(≈ 3 SDs greaterthan baseline volume)
We monitored 85 topicareas (Jan–July 2011)
Found 87 volume burstsin total
Identified real worldevents associated witheach burst
Our hypothesis: The government censors all posts in volume burstsassociated with events with collective action potential (regardless of howcritical or supportive of the state)
11/29
![Page 48: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/48.jpg)
Observational Test 1: Post Volume
Begin with our 87 volume bursts in 85 topics areas
For each burst, calculate change in % censorship inside to outsideeach volume burst within topic areas – censorship magnitude
If goal of censorship is to stop collective action, we expect:
1 On average, % censoredshould increase duringvolume bursts
2 Some bursts (associatedwith politically relevantevents) should havemuch higher censorship -0.2 0.0 0.2 0.4 0.6 0.8
01
23
45
Censorship Magnitude
Density
12/29
![Page 49: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/49.jpg)
Observational Test 1: Post Volume
Begin with our 87 volume bursts in 85 topics areas
For each burst, calculate change in % censorship inside to outsideeach volume burst within topic areas – censorship magnitude
If goal of censorship is to stop collective action, we expect:
1 On average, % censoredshould increase duringvolume bursts
2 Some bursts (associatedwith politically relevantevents) should havemuch higher censorship -0.2 0.0 0.2 0.4 0.6 0.8
01
23
45
Censorship Magnitude
Density
12/29
![Page 50: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/50.jpg)
Observational Test 1: Post Volume
Begin with our 87 volume bursts in 85 topics areas
For each burst, calculate change in % censorship inside to outsideeach volume burst within topic areas – censorship magnitude
If goal of censorship is to stop collective action, we expect:
1 On average, % censoredshould increase duringvolume bursts
2 Some bursts (associatedwith politically relevantevents) should havemuch higher censorship -0.2 0.0 0.2 0.4 0.6 0.8
01
23
45
Censorship Magnitude
Density
12/29
![Page 51: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/51.jpg)
Observational Test 1: Post Volume
Begin with our 87 volume bursts in 85 topics areas
For each burst, calculate change in % censorship inside to outsideeach volume burst within topic areas – censorship magnitude
If goal of censorship is to stop collective action, we expect:
1 On average, % censoredshould increase duringvolume bursts
2 Some bursts (associatedwith politically relevantevents) should havemuch higher censorship -0.2 0.0 0.2 0.4 0.6 0.8
01
23
45
Censorship Magnitude
Density
12/29
![Page 52: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/52.jpg)
Observational Test 1: Post Volume
Begin with our 87 volume bursts in 85 topics areas
For each burst, calculate change in % censorship inside to outsideeach volume burst within topic areas – censorship magnitude
If goal of censorship is to stop collective action, we expect:
1 On average, % censoredshould increase duringvolume bursts
2 Some bursts (associatedwith politically relevantevents) should havemuch higher censorship -0.2 0.0 0.2 0.4 0.6 0.8
01
23
45
Censorship Magnitude
Density
12/29
![Page 53: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/53.jpg)
Observational Test 1: Post Volume
Begin with our 87 volume bursts in 85 topics areas
For each burst, calculate change in % censorship inside to outsideeach volume burst within topic areas – censorship magnitude
If goal of censorship is to stop collective action, we expect:
1 On average, % censoredshould increase duringvolume bursts
2 Some bursts (associatedwith politically relevantevents) should havemuch higher censorship
-0.2 0.0 0.2 0.4 0.6 0.8
01
23
45
Censorship Magnitude
Density
12/29
![Page 54: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/54.jpg)
Observational Test 1: Post Volume
Begin with our 87 volume bursts in 85 topics areas
For each burst, calculate change in % censorship inside to outsideeach volume burst within topic areas – censorship magnitude
If goal of censorship is to stop collective action, we expect:
1 On average, % censoredshould increase duringvolume bursts
2 Some bursts (associatedwith politically relevantevents) should havemuch higher censorship -0.2 0.0 0.2 0.4 0.6 0.8
01
23
45
Censorship Magnitude
Density
12/29
![Page 55: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/55.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2
3
4 (Other) News
5 Government Policies
13/29
![Page 56: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/56.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2
3
4 (Other) News
5 Government Policies
13/29
![Page 57: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/57.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2
3
4 (Other) News
5 Government Policies
13/29
![Page 58: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/58.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internet
individuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2
3
4 (Other) News
5 Government Policies
13/29
![Page 59: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/59.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;
topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2
3
4 (Other) News
5 Government Policies
13/29
![Page 60: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/60.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2
3
4 (Other) News
5 Government Policies
13/29
![Page 61: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/61.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2 Criticism of censors
3
4 (Other) News
5 Government Policies
13/29
![Page 62: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/62.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2 Criticism of censors
3 Pornography
4 (Other) News
5 Government Policies
13/29
![Page 63: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/63.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2 Criticism of censors
3 Pornography
4 (Other) News
5 Government Policies
13/29
![Page 64: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/64.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2 Criticism of censors
3 Pornography
4 (Other) News
5 Government Policies
13/29
![Page 65: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/65.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2 Criticism of censors
3 Pornography
4 (Other) News
5 Government Policies
13/29
![Page 66: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/66.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2 Criticism of censors
3 Pornography
4 (Other) News
5 Government Policies
13/29
![Page 67: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/67.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2 Criticism of censors
3 Pornography
4 (Other) News
5 Government Policies
13/29
![Page 68: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/68.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2 Criticism of censors
3 Pornography
4 (Other) News
5 Government Policies
13/29
![Page 69: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/69.jpg)
Observational Test 2: The Events Generating the Bursts
Event classification (each category can be +, −, or neutral commentsabout the state)
1 Collective Action Potential
protest or organized crowd formation outside the Internetindividuals who have organized or incited collective action on theground in the past;topics related to nationalism or nationalist sentiment that have incitedprotest or collective action in the past.
2 Criticism of censors
3 Pornography
4 (Other) News
5 Government Policies
13/29
![Page 70: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/70.jpg)
What Types of Events Are Censored?
Censorship Magnitude
Density
02
46
810
12
-0.2 -0.1 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8
Collective ActionCriticism of CensorsPornography
PolicyNews
14/29
![Page 71: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/71.jpg)
What Types of Events Are Censored?
Censorship Magnitude
Popular Book Published in Audio FormatDisney Announced Theme ParkEPA Issues New Rules on LeadChinese Solar Company Announces EarningsChina Puts Nuclear Program on HoldGov't Increases Power PricesJon Hunstman Steps Down as Ambassador to ChinaNews About Iran Nuclear ProgramIndoor Smoking Ban Takes EffectPopular Video Game ReleasedEducation Reform for Migrant ChildrenFood Prices RiseU.S. Military Intervention in Libya
Censorship Magnitude
New Laws on Fifty Cent PartyRush to Buy Salt After Earthquake
Students Throw Shoes at Fang BinXingFuzhou Bombing
Localized Advocacy for Environment LotteryGoogle is Hacked
Collective Anger At Lead Poisoning in JiangsuAi Weiwei Arrested
Pornography Mentioning Popular BookZengcheng Protests
Baidu Copyright LawsuitPornography Disguised as News
Protests in Inner Mongolia
PoliciesNews
Collective ActionCriticism of CensorsPornography
-0.2 0 0.1 0.3 0.5 0.7
14/29
![Page 72: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/72.jpg)
Censoring Collective Action: Ai Weiwei’s Arrest
010
2030
40
Count
Jan Mar Apr May Jun Jul
Count PublishedCount Censored
Ai Weiwei arrested
15/29
![Page 73: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/73.jpg)
Censoring Collective Action: Protests in Inner Mongolia
05
1015
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored
Protests in Inner Mongolia
16/29
![Page 74: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/74.jpg)
Low Censorship on One Child Policy
010
2030
40
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored
Speculation of
Policy Reversal at NPC
17/29
![Page 75: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/75.jpg)
Low Censorship on News: Power Prices
010
2030
4050
6070
Count
Jan Feb Mar Apr May Jun Jul
Count PublishedCount Censored
Power shortages Gov't raises power prices
to curb demand
18/29
![Page 76: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/76.jpg)
Observational Test 3: Content of Posts
We adapted “ReadMe” (Hopkins-King) methodology to the content ofcensored posts in Chinese
Standardize encoding of Chinese text
Eliminate punctuation and stop words
Experiment with segmenting characters into words
Calculate the quantity of interest (% censored by category)
Code a validation setReadMe estimates: % of posts in each categoryQuantity of interest: % of posts censored in a category
P(Censored |Category) =P(Category |Censored)P(Censored)
P(Category)
19/29
![Page 77: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/77.jpg)
Observational Test 3: Content of Posts
We adapted “ReadMe” (Hopkins-King) methodology to the content ofcensored posts in Chinese
Standardize encoding of Chinese text
Eliminate punctuation and stop words
Experiment with segmenting characters into words
Calculate the quantity of interest (% censored by category)
Code a validation setReadMe estimates: % of posts in each categoryQuantity of interest: % of posts censored in a category
P(Censored |Category) =P(Category |Censored)P(Censored)
P(Category)
19/29
![Page 78: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/78.jpg)
Observational Test 3: Content of Posts
We adapted “ReadMe” (Hopkins-King) methodology to the content ofcensored posts in Chinese
Standardize encoding of Chinese text
Eliminate punctuation and stop words
Experiment with segmenting characters into words
Calculate the quantity of interest (% censored by category)
Code a validation setReadMe estimates: % of posts in each categoryQuantity of interest: % of posts censored in a category
P(Censored |Category) =P(Category |Censored)P(Censored)
P(Category)
19/29
![Page 79: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/79.jpg)
Observational Test 3: Content of Posts
We adapted “ReadMe” (Hopkins-King) methodology to the content ofcensored posts in Chinese
Standardize encoding of Chinese text
Eliminate punctuation and stop words
Experiment with segmenting characters into words
Calculate the quantity of interest (% censored by category)
Code a validation setReadMe estimates: % of posts in each categoryQuantity of interest: % of posts censored in a category
P(Censored |Category) =P(Category |Censored)P(Censored)
P(Category)
19/29
![Page 80: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/80.jpg)
Observational Test 3: Content of Posts
We adapted “ReadMe” (Hopkins-King) methodology to the content ofcensored posts in Chinese
Standardize encoding of Chinese text
Eliminate punctuation and stop words
Experiment with segmenting characters into words
Calculate the quantity of interest (% censored by category)
Code a validation setReadMe estimates: % of posts in each categoryQuantity of interest: % of posts censored in a category
P(Censored |Category) =P(Category |Censored)P(Censored)
P(Category)
19/29
![Page 81: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/81.jpg)
Observational Test 3: Content of Posts
We adapted “ReadMe” (Hopkins-King) methodology to the content ofcensored posts in Chinese
Standardize encoding of Chinese text
Eliminate punctuation and stop words
Experiment with segmenting characters into words
Calculate the quantity of interest (% censored by category)
Code a validation setReadMe estimates: % of posts in each categoryQuantity of interest: % of posts censored in a category
P(Censored |Category) =P(Category |Censored)P(Censored)
P(Category)
19/29
![Page 82: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/82.jpg)
Observational Test 3: Content of Posts
We adapted “ReadMe” (Hopkins-King) methodology to the content ofcensored posts in Chinese
Standardize encoding of Chinese text
Eliminate punctuation and stop words
Experiment with segmenting characters into words
Calculate the quantity of interest (% censored by category)
Code a validation set
ReadMe estimates: % of posts in each categoryQuantity of interest: % of posts censored in a category
P(Censored |Category) =P(Category |Censored)P(Censored)
P(Category)
19/29
![Page 83: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/83.jpg)
Observational Test 3: Content of Posts
We adapted “ReadMe” (Hopkins-King) methodology to the content ofcensored posts in Chinese
Standardize encoding of Chinese text
Eliminate punctuation and stop words
Experiment with segmenting characters into words
Calculate the quantity of interest (% censored by category)
Code a validation setReadMe estimates: % of posts in each category
Quantity of interest: % of posts censored in a category
P(Censored |Category) =P(Category |Censored)P(Censored)
P(Category)
19/29
![Page 84: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/84.jpg)
Observational Test 3: Content of Posts
We adapted “ReadMe” (Hopkins-King) methodology to the content ofcensored posts in Chinese
Standardize encoding of Chinese text
Eliminate punctuation and stop words
Experiment with segmenting characters into words
Calculate the quantity of interest (% censored by category)
Code a validation setReadMe estimates: % of posts in each categoryQuantity of interest: % of posts censored in a category
P(Censored |Category) =P(Category |Censored)P(Censored)
P(Category)
19/29
![Page 85: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/85.jpg)
Observational Test 3: Content of Posts
We adapted “ReadMe” (Hopkins-King) methodology to the content ofcensored posts in Chinese
Standardize encoding of Chinese text
Eliminate punctuation and stop words
Experiment with segmenting characters into words
Calculate the quantity of interest (% censored by category)
Code a validation setReadMe estimates: % of posts in each categoryQuantity of interest: % of posts censored in a category
P(Censored |Category) =P(Category |Censored)P(Censored)
P(Category)
19/29
![Page 86: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/86.jpg)
“ReadMe” Algorithm Validated in Chinese
20/29
![Page 87: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/87.jpg)
“ReadMe” Algorithm Validated in ChineseExample: Labor Strikes, 2010 (Training set: 100; Test set: 900)
20/29
![Page 88: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/88.jpg)
“ReadMe” Algorithm Validated in ChineseExample: Labor Strikes, 2010 (Training set: 100; Test set: 900)
0.0
0.2
0.4
0.6
ReadMe Results for Chinese Sampled, Not Segmented
Probability
Facts Supporting Employers
Facts Supporting Workers
Opinions Supporting Workers
Opinions Supporting Employers or Irrelevant
20/29
![Page 89: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/89.jpg)
“ReadMe” Algorithm Validated in ChineseExample: Labor Strikes, 2010 (Training set: 100; Test set: 900)
0.0
0.2
0.4
0.6
ReadMe Results for Chinese Sampled, Not Segmented
Probability
Facts Supporting Employers
Facts Supporting Workers
Opinions Supporting Workers
Opinions Supporting Employers or Irrelevant
ReadMeTrue
20/29
![Page 90: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/90.jpg)
Uncensored: Non-Collective Action Posts (that Support orOppose the State)
Per
cent
Cen
sore
d
0.0
0.2
0.4
0.6
0.8
1.0
Criticize Support Criticize Support Criticize Support
One Child Policy Corruption Policy Food Prices Rise
21/29
![Page 91: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/91.jpg)
Uncensored: Non-Collective Action Posts (that Support orOppose the State)
Per
cent
Cen
sore
d
0.0
0.2
0.4
0.6
0.8
1.0
Criticize Support Criticize Support Criticize Support
One Child Policy Corruption Policy Food Prices Rise
21/29
![Page 92: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/92.jpg)
Censored: Collective Action Posts (that Support orCriticize the State)
Per
cent
Cen
sore
d
0.0
0.2
0.4
0.6
0.8
1.0
Criticize Support Criticize Support Criticize Support
Ai Weiwei Inner MongoliaFuzhou Bombing
22/29
![Page 93: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/93.jpg)
Censored: Collective Action Posts (that Support orCriticize the State)
Per
cent
Cen
sore
d
0.0
0.2
0.4
0.6
0.8
1.0
Criticize Support Criticize Support Criticize Support
Ai Weiwei Inner MongoliaFuzhou Bombing
22/29
![Page 94: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/94.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)Created 2 accounts on each (from inside China all over the country)Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)Submitted posts randomly assigned to typeChecked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)Our goal: change our sources’ incentivesProcedure: create our own social media website in ChinaBought URL; contracted with firms for servers & software; posted andcensored ourselvesTo learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 95: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/95.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)Created 2 accounts on each (from inside China all over the country)Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)Submitted posts randomly assigned to typeChecked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)Our goal: change our sources’ incentivesProcedure: create our own social media website in ChinaBought URL; contracted with firms for servers & software; posted andcensored ourselvesTo learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 96: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/96.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)Created 2 accounts on each (from inside China all over the country)Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)Submitted posts randomly assigned to typeChecked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)Our goal: change our sources’ incentivesProcedure: create our own social media website in ChinaBought URL; contracted with firms for servers & software; posted andcensored ourselvesTo learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 97: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/97.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)
Created 2 accounts on each (from inside China all over the country)Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)Submitted posts randomly assigned to typeChecked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)Our goal: change our sources’ incentivesProcedure: create our own social media website in ChinaBought URL; contracted with firms for servers & software; posted andcensored ourselvesTo learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 98: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/98.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)Created 2 accounts on each (from inside China all over the country)
Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)Submitted posts randomly assigned to typeChecked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)Our goal: change our sources’ incentivesProcedure: create our own social media website in ChinaBought URL; contracted with firms for servers & software; posted andcensored ourselvesTo learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 99: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/99.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)Created 2 accounts on each (from inside China all over the country)Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)
Submitted posts randomly assigned to typeChecked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)Our goal: change our sources’ incentivesProcedure: create our own social media website in ChinaBought URL; contracted with firms for servers & software; posted andcensored ourselvesTo learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 100: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/100.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)Created 2 accounts on each (from inside China all over the country)Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)Submitted posts randomly assigned to type
Checked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)Our goal: change our sources’ incentivesProcedure: create our own social media website in ChinaBought URL; contracted with firms for servers & software; posted andcensored ourselvesTo learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 101: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/101.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)Created 2 accounts on each (from inside China all over the country)Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)Submitted posts randomly assigned to typeChecked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)Our goal: change our sources’ incentivesProcedure: create our own social media website in ChinaBought URL; contracted with firms for servers & software; posted andcensored ourselvesTo learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 102: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/102.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)Created 2 accounts on each (from inside China all over the country)Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)Submitted posts randomly assigned to typeChecked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)
Our goal: change our sources’ incentivesProcedure: create our own social media website in ChinaBought URL; contracted with firms for servers & software; posted andcensored ourselvesTo learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 103: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/103.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)Created 2 accounts on each (from inside China all over the country)Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)Submitted posts randomly assigned to typeChecked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)Our goal: change our sources’ incentives
Procedure: create our own social media website in ChinaBought URL; contracted with firms for servers & software; posted andcensored ourselvesTo learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 104: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/104.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)Created 2 accounts on each (from inside China all over the country)Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)Submitted posts randomly assigned to typeChecked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)Our goal: change our sources’ incentivesProcedure: create our own social media website in China
Bought URL; contracted with firms for servers & software; posted andcensored ourselvesTo learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 105: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/105.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)Created 2 accounts on each (from inside China all over the country)Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)Submitted posts randomly assigned to typeChecked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)Our goal: change our sources’ incentivesProcedure: create our own social media website in ChinaBought URL; contracted with firms for servers & software; posted andcensored ourselves
To learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 106: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/106.jpg)
Additional Research Designs
1 Randomized Experiment (for causal inferences)
Selected 100 top social media sites (∼87% of blogs, >500M Users,geographically diverse)Created 2 accounts on each (from inside China all over the country)Wrote 1,200 unique social media posts (CA/not CA, Pro/Anti)Submitted posts randomly assigned to typeChecked on censorship (from computers all over the world)
2 Participatory Study (for descriptive inferences)
Current method of learning how they censor: ask (carefully!)Our goal: change our sources’ incentivesProcedure: create our own social media website in ChinaBought URL; contracted with firms for servers & software; posted andcensored ourselvesTo learn: we tried every software option, read the documentation, andcalled customer support(!)
23/29
![Page 107: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/107.jpg)
Mechanisms of Censorship
24/29
![Page 108: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/108.jpg)
Mechanisms of Censorship
24/29
![Page 109: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/109.jpg)
Mechanisms of Censorship
24/29
![Page 110: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/110.jpg)
Mechanisms of Censorship
24/29
![Page 111: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/111.jpg)
Posts For v. Against Government: Zero Causal Effect
25/29
![Page 112: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/112.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
25/29
![Page 113: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/113.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
PanxuProtest
25/29
![Page 114: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/114.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
●
PanxuProtest
25/29
![Page 115: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/115.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
●
PanxuProtest
●
TibetanSelf−
Immolations
25/29
![Page 116: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/116.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
●
PanxuProtest
●
TibetanSelf−
Immolations
●
Ai WeiweiAlbum
25/29
![Page 117: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/117.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
●
PanxuProtest
●
TibetanSelf−
Immolations
●
Ai WeiweiAlbum
●
Protestsin
Xinjiang
25/29
![Page 118: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/118.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
●
PanxuProtest
●
TibetanSelf−
Immolations
●
Ai WeiweiAlbum
●
Protestsin
Xinjiang
●
CorruptionPolicy
25/29
![Page 119: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/119.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
●
PanxuProtest
●
TibetanSelf−
Immolations
●
Ai WeiweiAlbum
●
Protestsin
Xinjiang
●
CorruptionPolicy
●
EliminateGoldenWeek
25/29
![Page 120: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/120.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
●
PanxuProtest
●
TibetanSelf−
Immolations
●
Ai WeiweiAlbum
●
Protestsin
Xinjiang
●
CorruptionPolicy
●
EliminateGoldenWeek
●
RentalTax
25/29
![Page 121: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/121.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
●
PanxuProtest
●
TibetanSelf−
Immolations
●
Ai WeiweiAlbum
●
Protestsin
Xinjiang
●
CorruptionPolicy
●
EliminateGoldenWeek
●
RentalTax
●
YellowLightFines
25/29
![Page 122: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/122.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
●
PanxuProtest
●
TibetanSelf−
Immolations
●
Ai WeiweiAlbum
●
Protestsin
Xinjiang
●
CorruptionPolicy
●
EliminateGoldenWeek
●
RentalTax
●
YellowLightFines
●
StockMarketCrash
25/29
![Page 123: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/123.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
●
PanxuProtest
●
TibetanSelf−
Immolations
●
Ai WeiweiAlbum
●
Protestsin
Xinjiang
●
CorruptionPolicy
●
EliminateGoldenWeek
●
RentalTax
●
YellowLightFines
●
StockMarketCrash
●
Investigationof Sichuan
ViceGovernor
25/29
![Page 124: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/124.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
●
PanxuProtest
●
TibetanSelf−
Immolations
●
Ai WeiweiAlbum
●
Protestsin
Xinjiang
●
CorruptionPolicy
●
EliminateGoldenWeek
●
RentalTax
●
YellowLightFines
●
StockMarketCrash
●
Investigationof Sichuan
ViceGovernor
●
GenderImbalance
25/29
![Page 125: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/125.jpg)
Posts For v. Against Government: Zero Causal Effect
● ●
−0.
50.
00.
51.
0
Cen
sors
hip
Diff
eren
ce (
Pro
− A
nti)
●
TibetanSelf−
Immolations
●
PanxuProtest
●
Ai WeiweiAlbum
●
Protestsin
Xinjiang
●
CorruptionPolicy
●
EliminateGoldenWeek
●
RentalTax
●
YellowLightFines
●
StockMarketCrash
●
Investigationof Sichuan
ViceGovernor
●
GenderImbalance
●
Li TianyiScandal
25/29
![Page 126: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/126.jpg)
Collective Action Events: Large Causal Effect
26/29
![Page 127: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/127.jpg)
Collective Action Events: Large Causal Effect
● ●0.0
0.1
0.2
0.3
0.4
0.5
Cen
sors
hip
Diff
eren
ce (
CA
Eve
nt −
Non
−C
A E
vent
)
26/29
![Page 128: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/128.jpg)
Collective Action Events: Large Causal Effect
● ●0.0
0.1
0.2
0.3
0.4
0.5
Cen
sors
hip
Diff
eren
ce (
CA
Eve
nt −
Non
−C
A E
vent
)
PanxuProtest
26/29
![Page 129: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/129.jpg)
Collective Action Events: Large Causal Effect
● ●0.0
0.1
0.2
0.3
0.4
0.5
Cen
sors
hip
Diff
eren
ce (
CA
Eve
nt −
Non
−C
A E
vent
)
●
PanxuProtest
26/29
![Page 130: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/130.jpg)
Collective Action Events: Large Causal Effect
● ●0.0
0.1
0.2
0.3
0.4
0.5
Cen
sors
hip
Diff
eren
ce (
CA
Eve
nt −
Non
−C
A E
vent
)
●
PanxuProtest
●
TibetanSelf−
Immolations
26/29
![Page 131: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/131.jpg)
Collective Action Events: Large Causal Effect
● ●0.0
0.1
0.2
0.3
0.4
0.5
Cen
sors
hip
Diff
eren
ce (
CA
Eve
nt −
Non
−C
A E
vent
)
●
PanxuProtest
●
TibetanSelf−
Immolations
●
Ai WeiweiAlbum
26/29
![Page 132: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/132.jpg)
Collective Action Events: Large Causal Effect
● ●0.0
0.1
0.2
0.3
0.4
0.5
Cen
sors
hip
Diff
eren
ce (
CA
Eve
nt −
Non
−C
A E
vent
)
●
PanxuProtest
●
TibetanSelf−
Immolations
●
Ai WeiweiAlbum
●
Protestsin
Xinjiang
26/29
![Page 133: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/133.jpg)
Censorship to Preempt Collective Action: Ai Weiwei’sArrest
Mar 19 Mar 29 Apr 08 Apr 18
0.0
0.2
0.4
0.6
0.8
1.0
2011
% o
f Pos
ts C
enso
red
Actual %censorship
Predicted %censor trend basedon 3/19−3/29 data
Mar. 29,5 days prior
Apr. 3,Ai Weiwei Arrested
Placebo Test: Mostextreme of all effects
27/29
![Page 134: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/134.jpg)
Censorship to Preempt Collective Action: Ai Weiwei’sArrest
Mar 19 Mar 29 Apr 08 Apr 18
0.0
0.2
0.4
0.6
0.8
1.0
2011
% o
f Pos
ts C
enso
red
Actual %censorship
Predicted %censor trend basedon 3/19−3/29 data
Mar. 29,5 days prior
Apr. 3,Ai Weiwei Arrested
Placebo Test: Mostextreme of all effects
27/29
![Page 135: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/135.jpg)
Censorship to Preempt Collective Action: Ai Weiwei’sArrest
Mar 19 Mar 29 Apr 08 Apr 18
0.0
0.2
0.4
0.6
0.8
1.0
2011
% o
f Pos
ts C
enso
red
Actual %censorship
Predicted %censor trend basedon 3/19−3/29 data
Mar. 29,5 days prior
Apr. 3,Ai Weiwei Arrested
Placebo Test:
Mostextreme of all effects
27/29
![Page 136: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/136.jpg)
Censorship to Preempt Collective Action: Ai Weiwei’sArrest
Mar 19 Mar 29 Apr 08 Apr 18
0.0
0.2
0.4
0.6
0.8
1.0
2011
% o
f Pos
ts C
enso
red
Actual %censorship
Predicted %censor trend basedon 3/19−3/29 data
Mar. 29,5 days prior
Apr. 3,Ai Weiwei Arrested
Placebo Test: Mostextreme of all effects
27/29
![Page 137: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/137.jpg)
Concluding Remarks
Chinese people’s speech: Individually Free, Collectively in Chains
The Chinese Censorship Program:
Stops collective action, not criticismReveals government intentions; predicts actions
Our methodology:
Observational, Experimental, ParticipatoryAutomated text analysis methods validated in Chinese (withouttranslation)Enables continuous time measurement of Chinese governmentcensorship activitiesReveals information about state action when traditional media is silentPossibly applicable to other countries
28/29
![Page 138: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/138.jpg)
Concluding Remarks
Chinese people’s speech: Individually Free, Collectively in Chains
The Chinese Censorship Program:
Stops collective action, not criticismReveals government intentions; predicts actions
Our methodology:
Observational, Experimental, ParticipatoryAutomated text analysis methods validated in Chinese (withouttranslation)Enables continuous time measurement of Chinese governmentcensorship activitiesReveals information about state action when traditional media is silentPossibly applicable to other countries
28/29
![Page 139: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/139.jpg)
Concluding Remarks
Chinese people’s speech: Individually Free, Collectively in Chains
The Chinese Censorship Program:
Stops collective action, not criticismReveals government intentions; predicts actions
Our methodology:
Observational, Experimental, ParticipatoryAutomated text analysis methods validated in Chinese (withouttranslation)Enables continuous time measurement of Chinese governmentcensorship activitiesReveals information about state action when traditional media is silentPossibly applicable to other countries
28/29
![Page 140: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/140.jpg)
Concluding Remarks
Chinese people’s speech: Individually Free, Collectively in Chains
The Chinese Censorship Program:
Stops collective action, not criticism
Reveals government intentions; predicts actions
Our methodology:
Observational, Experimental, ParticipatoryAutomated text analysis methods validated in Chinese (withouttranslation)Enables continuous time measurement of Chinese governmentcensorship activitiesReveals information about state action when traditional media is silentPossibly applicable to other countries
28/29
![Page 141: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/141.jpg)
Concluding Remarks
Chinese people’s speech: Individually Free, Collectively in Chains
The Chinese Censorship Program:
Stops collective action, not criticismReveals government intentions; predicts actions
Our methodology:
Observational, Experimental, ParticipatoryAutomated text analysis methods validated in Chinese (withouttranslation)Enables continuous time measurement of Chinese governmentcensorship activitiesReveals information about state action when traditional media is silentPossibly applicable to other countries
28/29
![Page 142: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/142.jpg)
Concluding Remarks
Chinese people’s speech: Individually Free, Collectively in Chains
The Chinese Censorship Program:
Stops collective action, not criticismReveals government intentions; predicts actions
Our methodology:
Observational, Experimental, ParticipatoryAutomated text analysis methods validated in Chinese (withouttranslation)Enables continuous time measurement of Chinese governmentcensorship activitiesReveals information about state action when traditional media is silentPossibly applicable to other countries
28/29
![Page 143: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/143.jpg)
Concluding Remarks
Chinese people’s speech: Individually Free, Collectively in Chains
The Chinese Censorship Program:
Stops collective action, not criticismReveals government intentions; predicts actions
Our methodology:
Observational, Experimental, Participatory
Automated text analysis methods validated in Chinese (withouttranslation)Enables continuous time measurement of Chinese governmentcensorship activitiesReveals information about state action when traditional media is silentPossibly applicable to other countries
28/29
![Page 144: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/144.jpg)
Concluding Remarks
Chinese people’s speech: Individually Free, Collectively in Chains
The Chinese Censorship Program:
Stops collective action, not criticismReveals government intentions; predicts actions
Our methodology:
Observational, Experimental, ParticipatoryAutomated text analysis methods validated in Chinese (withouttranslation)
Enables continuous time measurement of Chinese governmentcensorship activitiesReveals information about state action when traditional media is silentPossibly applicable to other countries
28/29
![Page 145: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/145.jpg)
Concluding Remarks
Chinese people’s speech: Individually Free, Collectively in Chains
The Chinese Censorship Program:
Stops collective action, not criticismReveals government intentions; predicts actions
Our methodology:
Observational, Experimental, ParticipatoryAutomated text analysis methods validated in Chinese (withouttranslation)Enables continuous time measurement of Chinese governmentcensorship activities
Reveals information about state action when traditional media is silentPossibly applicable to other countries
28/29
![Page 146: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/146.jpg)
Concluding Remarks
Chinese people’s speech: Individually Free, Collectively in Chains
The Chinese Censorship Program:
Stops collective action, not criticismReveals government intentions; predicts actions
Our methodology:
Observational, Experimental, ParticipatoryAutomated text analysis methods validated in Chinese (withouttranslation)Enables continuous time measurement of Chinese governmentcensorship activitiesReveals information about state action when traditional media is silent
Possibly applicable to other countries
28/29
![Page 147: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/147.jpg)
Concluding Remarks
Chinese people’s speech: Individually Free, Collectively in Chains
The Chinese Censorship Program:
Stops collective action, not criticismReveals government intentions; predicts actions
Our methodology:
Observational, Experimental, ParticipatoryAutomated text analysis methods validated in Chinese (withouttranslation)Enables continuous time measurement of Chinese governmentcensorship activitiesReveals information about state action when traditional media is silentPossibly applicable to other countries
28/29
![Page 148: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/148.jpg)
For more information
GaryKing.org
j.mp/JenPan
j.mp/MollyRoberts
29/29
![Page 149: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/149.jpg)
Appendix
30/29
![Page 150: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/150.jpg)
Predicting the South China Sea Peace Agreement
Jun 12 Jun 22 Jul 02
0.0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
2011
% o
f Pos
ts C
enso
red
Predicted % censortrend basedon 6/10−6/20 data
Actual %censorship
Jun. 20,5 days prior
Jun. 25,PeaceAgreement
Placebo Test: Mostextreme of all effects
31/29
![Page 151: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/151.jpg)
Predicting the South China Sea Peace Agreement
Jun 12 Jun 22 Jul 02
0.0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
2011
% o
f Pos
ts C
enso
red
Predicted % censortrend basedon 6/10−6/20 data
Actual %censorship
Jun. 20,5 days prior
Jun. 25,PeaceAgreement
Placebo Test: Mostextreme of all effects
31/29
![Page 152: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/152.jpg)
Predicting the South China Sea Peace Agreement
Jun 12 Jun 22 Jul 02
0.0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
2011
% o
f Pos
ts C
enso
red
Predicted % censortrend basedon 6/10−6/20 data
Actual %censorship
Jun. 20,5 days prior
Jun. 25,PeaceAgreement
Placebo Test:
Mostextreme of all effects
31/29
![Page 153: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/153.jpg)
Predicting the South China Sea Peace Agreement
Jun 12 Jun 22 Jul 02
0.0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
2011
% o
f Pos
ts C
enso
red
Predicted % censortrend basedon 6/10−6/20 data
Actual %censorship
Jun. 20,5 days prior
Jun. 25,PeaceAgreement
Placebo Test: Mostextreme of all effects
31/29
![Page 154: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/154.jpg)
Censorship Pre-empting Collective Action: Wang Lijun’sDemotion
Jan 23 Jan 30 Feb 06 Feb 13
−0.
20.
00.
20.
40.
60.
81.
0
2012
% o
f Pos
ts C
enso
red
Jan. 28,5 days prior
Feb. 2,Wang Lijundemoted
Actual %censorship
Predicted %censor trend basedon 1/18−1/28 data
Placebo Test: Mostextreme of all effects
32/29
![Page 155: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/155.jpg)
Censorship Pre-empting Collective Action: Wang Lijun’sDemotion
Jan 23 Jan 30 Feb 06 Feb 13
−0.
20.
00.
20.
40.
60.
81.
0
2012
% o
f Pos
ts C
enso
red
Jan. 28,5 days prior
Feb. 2,Wang Lijundemoted
Actual %censorship
Predicted %censor trend basedon 1/18−1/28 data
Placebo Test: Mostextreme of all effects
32/29
![Page 156: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/156.jpg)
Censorship Pre-empting Collective Action: Wang Lijun’sDemotion
Jan 23 Jan 30 Feb 06 Feb 13
−0.
20.
00.
20.
40.
60.
81.
0
2012
% o
f Pos
ts C
enso
red
Jan. 28,5 days prior
Feb. 2,Wang Lijundemoted
Actual %censorship
Predicted %censor trend basedon 1/18−1/28 data
Placebo Test:
Mostextreme of all effects
32/29
![Page 157: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/157.jpg)
Censorship Pre-empting Collective Action: Wang Lijun’sDemotion
Jan 23 Jan 30 Feb 06 Feb 13
−0.
20.
00.
20.
40.
60.
81.
0
2012
% o
f Pos
ts C
enso
red
Jan. 28,5 days prior
Feb. 2,Wang Lijundemoted
Actual %censorship
Predicted %censor trend basedon 1/18−1/28 data
Placebo Test: Mostextreme of all effects
32/29
![Page 158: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/158.jpg)
Uncensored Posts (w/o Collective Action Potential)Critical of the State
33/29
![Page 159: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/159.jpg)
Uncensored Posts (w/o Collective Action Potential)Critical of the State
33/29
![Page 160: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/160.jpg)
Uncensored Posts (w/o Collective Action Potential)Critical of the State
This is a city government [Yulin City,Shaanxi] that treats life with contempt, thisis government officials run amuck, a citygovernment without justice, a city govern-ment that delights in that which is vul-gar, a place where officials all have mis-tresses, a city government that is shamelesswith greed, a government that trades dig-nity for power, a government without hu-manity, a government that has no limits onimmorality, a government that goes back onits word, a government that treats kindnesswith ingratitude, a government that caresnothing for posterity. . .
33/29
![Page 161: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/161.jpg)
Censored Post (with Collective Action Potential)Supporting the State
34/29
![Page 162: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/162.jpg)
Censored Post (with Collective Action Potential)Supporting the State
34/29
![Page 163: Gary King, Jennifer Pan, Molly Roberts · For 2 Unusual Topics: Constant Censorship E ort 0 5 10 15 Count Jan Mar Apr May Jun Count Published Count Censored Count Published Count](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba4c1fd32fa436fd781fc7/html5/thumbnails/163.jpg)
Censored Post (with Collective Action Potential)Supporting the State
The bombing led not only to the tragedy ofhis death but the death of many governmentworkers. Even if we can verify what QianMingqi said on Weibo that the building de-molition caused a great deal of personal dam-age, we should still condemn his extreme actof retribution. . . . The government has con-tinually put forth measures and laws to pro-tect the interests of citizens in building de-molition. And the media has called attentionto the plight of those experiencing housingdemolition. The rate at which compensationfor housing demolition has increased exceedsinflation. In many places, this compensationcan change the fate of an entire family.
34/29