cept: collaborative editing tool for non-native...

CEPT: Collaborative Editing Tool for Non-Native Authors

Yeshuang Zhu, Shichao Yue, Chun Yu, Yuanchun Shi

http://pi.cs.tsinghua.edu.cn

Background

• Language editing is important and necessary for L2 writing.

• L2 problems: word choice, style, and L1 interference. (Park, T., et al. UIST 2008)

Background


• L2 problems: word choice, style, and L1 interference.

• Language service by experts is not the first option.

• Considerations: cost, delay, domain mismatch, etc.

(Park, T., et al. UIST 2008)

Background


• L2 problems: word choice, style, and L1 interference.

• Language service by experts is not the first option.

• Considerations: cost, delay, domain mismatch, etc.

• Collaborative editing (CE) is most often adopted by NNSs.

(Park, T., et al. UIST 2008)

Two Is Better than One


• Collaborators have different and complementary knowledge about how to improve the writing.

(Piaget, J. On the development of memory and identity, 1968)


• Collaborators have different and complementary knowledge about how to improve the writing.

• Picking from alternatives (recognition) is easier than generating new ones (recall).

(Winke, P. Studies in Second Language Acquisition, 2007)

(Piaget, J. On the development of memory and identity, 1968)

Tools for Collaborative Writing and Editing


Email + edit mode


Email + edit mode

(Noël, S., et al. CSCW 2004)

Online (synchronous) document


Email + edit mode



(Tomlinson, B., et al. CHI EA 2012)

Version control


Email + edit mode



(Tomlinson, B., et al. CHI EA 2012)

Version control

None is specially designed for language editing

Why Not Synchronous Document?


• Edit mode is hard to interpret and share


• Edit mode is hard to interpret and share

• Different opinions are not welcomed by nature

(Birnholtz, J., et al. CSCW 2012)


Contribution in CEKnowledge in language

NNS 2

NNS 1

NNS 3

From Single Version to Parallel

Multi-Versioning: A Pilot Study

• Four Google Docs placed in parallel

SettingsP1 P2

P3 P4

• Four Google Docs placed in parallel

• Participants could:• edit their own copy only• refer to others• commenting on others

SettingsP1 P2

P3 P4

P1 P2

P3 P4

Lessons Learned

P1 P2

P3 P4

Lessons Learned

• Edit mode is hard to interpret• Full of strike-throughs

P1 P2

P3 P4

Lessons Learned


• Mess of multiple versions• Difficult to locate areas concerned

P1 P2

P3 P4

Lessons Learned


• Mess of multiple versions• Difficult to locate areas concerned

• Lack of interaction• Direct with the edits

CEPT - Design ?

CEPT - Interface DesignOverview

CEPT - A Use CaseStep #1: Alice Uploads an Essay

And She invites 3 friends to help:Bob, Carol, and Dave

CEPT - A Use CaseStep #2: Bob Edits on His Own

CEPT - A Use CaseStep #3: More Editors Join (Carol and Dave)

CEPT - A Use CaseStep #4: Alice Aggregates the Revisions

CEPT - Four Design Features

Feature #1: Aligned Sentences View


User sentence


User sentence

Automatic summary of revisions


User sentence


Revision with cross-sentence edits


User sentence


Revision with cross-sentence edits

Details of each summarized revision

Beyond Sentences

Many to one (Sentences are merged by others)

One to many (Sentences are merged by me)

Beyond Sentences

One to zero (One sentence is deleted by others)

Zero to one (New sentence is inserted by others)

Feature #2: Refined Edit Presentation

1. Newton lost himsself in thought of the relation between objects.

2. Newton lost himssself in thought of the relation between objects.

3. Newton lost himhisself in thought of the relation between objects.

4. Newton lost himselfhisself in thought of the relation between objects.

(Raw tracking)

(Raw tracking)

(Raw tracking)

(Word-level diff-ing)

Toggle Visibility of Deleted Text

Feature #3: Edit Summarization

…

Feature #4: Interaction with Others

CEPT - Implementation

Technique #1: Sentence Mapping

S1 S2 S3 S4 S5

S1' S2', S3' S4 Snew S5'V1:

V0:

Example

1

2

3

4

5

1) Edit in Sentences

1

2

3

4

5

2) Insert A Sentence

1

2

3

4

5

2) Insert A Sentence

1

2

3

4

5

?

3) Remove A Sentence

1

2

3

4

5

Technique #2: Edit Summary and Borrowing

Sharing their lives on social media becomes really necessary.Alice:

Sharing their lives on social media becomes really necessary.Bob:

Sharing their lives on social media becomes really necessary.Carol:





Sharing their lives on social media becomes really necessary.excessive






Sharing their lives on social media becomes really necessary.over acting




Sharing their lives on social media becomes really necessary.Carol: Sharing their lives on social media becomes really necessary.takes too much time


Sharing their lives on social media becomes really necessary.over acting




Sharing their lives on social media becomes really necessary.Carol: Sharing their lives on social media becomes really necessary.takes too much time

Sharing their lives on social media becomes really necessary.becomes excessive

Sharing their lives on social media becomes really necessary.becomes over acting


Carol: Sharing their lives on social media becomes really necessary.takes too much time

Alice: Sharing their lives on social media becomes really necessary.becomes excessive

Bob: Sharing their lives on social media becomes really necessary.becomes over acting

Summarized: Sharing their lives on social media becomes really necessary .3

Preliminary Evaluation

Interface #1: CEPT

Interface #2: Baseline

Design

…Initial revision Final revision Quality Evaluation

1 NS rater12 NNS participants3 NNS "Collaborators"

2 paragraphs

Design

…Initial revision Final revision Quality Evaluation

1 NS rater12 NNS participants3 NNS "Collaborators"

2 paragraphs

12 “quartets”

Results

Results

• CEPT improves edit quality more than a plain interface:• Reducing 18% more errors (t11 = −2.54, p < .05)

Results


• Two is better than one:• 9 out of 12 cases 4-NNSs could outperform a NS.

Results


• Two is better than one:• 9 out of 12 cases 4-NNSs could outperform a NS.

• CEPT draws intensive interaction• And also receives strong subjective preference.

Future Work: Field Deployment

CEPT: Collaborative Editing Tool for Non-Native Authors

Yeshuang Zhu, Shichao Yue, Chun Yu, Yuanchun Shi

http://pi.cs.tsinghua.edu.cn

cept: collaborative editing tool for non-native...

Documents