daemo the solution a self˜governed crowd˜ …gaikwad/assets/publications/daemo-uist... · rolando...

1
LACK OF TRUST AND POWER: POOR QUALITY WORK NO PAY A SELF-GOVERNED CROWD- SOURCING MARKETPLACE THE PROBLEM THE SOLUTION NO INTERNAL GOVERNANCE Workflow Open Governance FUTURE WORK & CONCLUSION To assess the impact of a demo- cratic approach as a governance model, 3 ideas were proposed, and the research group voted for their preferred method: The next step for the platform is to CODE What do existing platforms provide: CODE GOVERNANCE/ POLICY MISSION: DEMOCRACY CHOOSE CATEGORY INSERT PROJECT DETAILS MAKE PROTOTYPE TASK: A SMALLER VERSION OF YOUR TASK TO TEST WORKERS AND REFINE PROJECT DESCRIPTIONS APPROVE WORKERS AND PROVIDE TASK DETAILS AND MILESTONES REVIEW MILESTONES, APPROVE AND PAY nj The interface allows for both micro and macro tasks with the same workflow. A prototype task ensures the quality of outcomes: A novel platform, called Daemo. But how is it different from other labor-market platforms? Expectations of market participants: REQUESTERS HIGH-QUALITY, FAST, COST EFFECTIVE SUBMISSIONS WORKERS GAIN REPUTATION, BUILD A CAREER, EARN INCOME Micro Tasks LARGER TASKS THAT REQUIRE EXPERTISE SMALL, UNSKILLED TASKS Macro Tasks CREATE INCENTIVE- COMPATIBLE REPUTATION SYSTEMS GOOD ONLY FOR 1 TYPE OF TASK Ultimately, we aim to inspire current crowd marketplaces to adopt alternative visions, or achieve a foothold ourselves in the crowd work ecosystem. STANFORD CROWD RESEARCH COLLECTIVE The leadership board is elected by a representative democracy, and is composed of 3 workers, 3 requesters and 1 researcher. This board is empowered to make policy decisions about the plat- form. Including all vested parties in the governance provides many opportunities for engage- ment to resolve platform issues. DIRECT DEMOCRACY DEMOCRACY WEIGHTED BY PARTICIPATION LEVEL ELECTED LEADERSHIP BOARD Daemo envisions a future for crowd work with the following values: TRUST ANTAGONISM OPEN GOVERNANCE STRUCTURE HELPS TO EMPOWER ALL PARTIES OWNED BY ITS MEMBERS ALLOWS MICRO AND MACRO TASKS MILESTONES REVIEWS TO EASE REQUESTER/ WORKER EXCHANGES LOW-RISK METHOD TO TEST QUALITY Snehal (Neil) Gaikwad, Durim Morina, Rohit Nistala, Megha Agarwal, Alison Cossette, Radhika Bhanu, Saiph Savage, Vishwajeet Narwal, Karan Rajpal, Jeff Regino, Aditi Mithal, Adam Ginzberg, Aditi Nath, Karolina R. Ziulkoski, Trygve Cossette, Dilrukshi Gamage, Angela Richmond-Fuller, Ryo Suzuki, Jeerel Herrejón, Kevin Viet Le, Claudia Flores-Savia- ga, Haritha Thilakarathne, Kajal Gupta, William Dai, Ankita Sastry, Shirish Goyal, Thejan Rajapakshe, Niki Abolhassani, Angela Xie, Abigail Reyes, Surabhi Ingle, Verónica Jaramillo, Martin Daniel, Walter Ángel, Carlos Toxtli, Juan Pablo Flores, Asmita Gupta, Vineet Sethia, Diana Padilla, Kristy Milland, Kristiono Setyadi, Nuwan Wajirasena, Muthitha Batagoda, Rolando Cruz, James Damon, Divya Nekkanti, Tejas Sarma, Mohamed Saleh, Gabriela Gongora-Svartzman, Soroosh Bateni, Gema Toledo, Alex Peña, Ryan Compton, Deen Aariff, Luis Daniel Palacios, Manuela P. Ritter, Nisha K.K., Alan James Kay, Jana Uhrmeister, Srivalli Nistala, Milad Esfahani, Elsa Bakiu, Christopher Diemert, Luca Matsumoto, Manik Singh, Krupa Patel, Ranjay Krishna, Geza Kovacs, Rajan Vaish, Michael Bernstein Future Usability Test The usability of the task workflows will be tested using heuristic eval- uation and direct observation. Given the preliminary results we believe that we can achieve task quality and fairness with our aug- mented task workflow and an open governance model. http://daemo.stanford.edu/ DAEMO DAEMO

Upload: others

Post on 19-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DAEMO THE SOLUTION A SELF˜GOVERNED CROWD˜ …gaikwad/assets/publications/daemo-uist... · Rolando Cruz, James Damon, Divya Nekkanti, Tejas Sarma, Mohamed Saleh, Gabriela Gongora-Svartzman,

LACK OF TRUST AND POWER: POOR QUALITY WORK NO PAY

A SELF-GOVERNED CROWD-SOURCING MARKETPLACE

THE PROBLEM

THE SOLUTION

NO INTERNAL GOVERNANCE

Work�ow

Open Governance

FUTURE WORK & CONCLUSION

To assess the impact of a demo-cratic approach as a governance model, 3 ideas were proposed, and the research group voted for their preferred method:

The next step for the platform is to

CODE

What do existing platforms provide:

CODE

GOVERNANCE/POLICY

MISSION: DEMOCRACY

CHOOSE CATEGORY

INSERT PROJECTDETAILS

MAKE PROTOTYPETASK: A SMALLERVERSION OF YOURTASK TO TEST WORKERS AND REFINE PROJECT DESCRIPTIONS

APPROVE WORKERSAND PROVIDETASK DETAILS AND MILESTONES

REVIEW MILESTONES,APPROVE AND PAY

� � � � � � � � �

The interface allows for both micro and macro tasks with the same work�ow. A prototype task ensures the quality of outcomes:

A novel platform, called Daemo. But how is it di�erent from other labor-market platforms?

Expectations of market participants:

REQUESTERSHIGH-QUALITY, FAST, COST EFFECTIVE SUBMISSIONS

WORKERSGAIN REPUTATION, BUILD

A CAREER, EARN INCOME

Micro Tasks

�LARGER TASKS THAT REQUIRE EXPERTISE

SMALL, UNSKILLEDTASKS

Macro Tasks

CREATE INCENTIVE-COMPATIBLE REPUTATION SYSTEMS

GOOD ONLY FOR 1 TYPE OF TASK

Ultimately, we aim to inspire current crowd marketplaces to adopt alternative visions, or achieve a foothold ourselves in the crowd work ecosystem.

STANFORD CROWD RESEARCH COLLECTIVE

The leadership board is elected by a representative democracy, and is composed of 3 workers, 3 requesters and 1 researcher. This board is empowered to make policy decisions about the plat-form. Including all vested parties in the governance provides many opportunities for engage-ment to resolve platform issues.

DIRECTDEMOCRACYDEMOCRACY WEIGHTED BY PARTICIPATION LEVELELECTED LEADERSHIP BOARD

Daemo envisions a future for crowd work with the following values:

�TRUST �ANTAGONISM

OPEN GOVERNANCESTRUCTURE HELPS TO EMPOWER ALLPARTIES

OWNED BY ITSMEMBERS

ALLOWS MICROAND MACRO TASKS

MILESTONES REVIEWS TO EASE REQUESTER/WORKER EXCHANGES

LOW-RISK METHODTO TEST QUALITY

Snehal (Neil) Gaikwad, Durim Morina, Rohit Nistala, Megha Agarwal, Alison Cossette, Radhika Bhanu, Saiph Savage, Vishwajeet Narwal, Karan Rajpal, Je� Regino, Aditi Mithal, Adam Ginzberg, Aditi Nath, Karolina R. Ziulkoski, Trygve Cossette, Dilrukshi Gamage, Angela Richmond-Fuller, Ryo Suzuki, Jeerel Herrejón, Kevin Viet Le, Claudia Flores-Savia-ga, Haritha Thilakarathne, Kajal Gupta, William Dai, Ankita Sastry, Shirish Goyal, Thejan Rajapakshe, Niki Abolhassani, Angela Xie, Abigail Reyes, Surabhi Ingle, Verónica Jaramillo, Martin Daniel, Walter Ángel, Carlos Toxtli, Juan Pablo Flores, Asmita Gupta, Vineet Sethia, Diana Padilla, Kristy Milland, Kristiono Setyadi, Nuwan Wajirasena, Muthitha Batagoda, Rolando Cruz, James Damon, Divya Nekkanti, Tejas Sarma, Mohamed Saleh, Gabriela Gongora-Svartzman, Soroosh Bateni, Gema Toledo, Alex Peña, Ryan Compton, Deen Aari�, Luis Daniel Palacios, Manuela P. Ritter, Nisha K.K., Alan James Kay, Jana Uhrmeister, Srivalli Nistala, Milad Esfahani, Elsa Bakiu, Christopher Diemert, Luca Matsumoto, Manik Singh, Krupa Patel, Ranjay Krishna, Geza Kovacs, Rajan Vaish, Michael Bernstein

Future Usability TestThe usability of the task work�ows will be tested using heuristic eval-uation and direct observation. Given the preliminary results we believe that we can achieve task quality and fairness with our aug-mented task work�ow and an open governance model.

http://daemo.stanford.edu/

DAEMO

DAEMO