How Task Perceptions Matter on Micro-Task Crowdsourcing Platforms

How Task Perceptions Matter on Micro-Task Crowdsourcing Platforms

Author: Sara Moussawi

Publisher:

Published: 2018

Total Pages: 46

ISBN-13:

DOWNLOAD EBOOK

Though a large percentage of micro-task crowdsourcing workers have a college degree and report a household income above the national median, they persistently return to crowdsourcing platforms, despite the low pay and relative simplicity of the tasks. In this study, we aim to understand why prior research has identified task-related factors to be important determinants of worker behavior on micro-task crowdsourcing platforms. We explore workers' perceptions of task characteristics and their impact on subjective and objective outputs in micro-task crowdsourcing contexts, taking into account the unique nature of crowdsourcing platforms as a new IT artifact. We draw on two theories, the theory of motivation through work design and the expectancy theory, and aim to extend them by incorporating the IT artifact in them, in the context of micro-task crowdsourcing. Our findings help understand workers' behaviors on micro-task crowdsourcing platforms and thus inform the task and platform design process.


An Experiment in Microtask Crowdsourcing Software Design

An Experiment in Microtask Crowdsourcing Software Design

Author: Consuelo Lopez

Publisher:

Published: 2016

Total Pages: 131

ISBN-13: 9781369173994

DOWNLOAD EBOOK

Microtask crowdsourcing is a form of crowdsourcing in which work is decomposed into a set of small, self-contained tasks, which each can typically be completed in a matter of minutes. The approach has been used to address a number of different problems, ranging from labeling images to planning travel. To date, however, little is known about the potential of microtask crowdsourcing in software engineering.This thesis explores microtask crowdsourcing as applied to software design work. We particularly conducted a large study with Amazon Mechanical Turk workers, who each provided one or more solution alternatives for a small, partial software design problem. We included two experimental conditions: (1) user interface design work versus internal code design work, and (2) workers operating independently versus workers being shown previous designs from other workers.We report on various results concerning solution diversity, solution quality, and perceived task difficulty, across the different experimental conditions. Our primary findings show that: (1) it is feasible for a crowd to generate a broad range of solution alternatives for a software design problem, (2) solutions alternatives range all over the quality spectrum, and (3) many workers perceived the task as difficult.


A Comparative Study of the Role of Examples in Microtask Crowdsourcing for Software Design

A Comparative Study of the Role of Examples in Microtask Crowdsourcing for Software Design

Author: Fernando Spanghero

Publisher:

Published: 2016

Total Pages: 99

ISBN-13: 9781369174342

DOWNLOAD EBOOK

Crowdsourcing is gradually becoming an accepted form of work across different disciplines. Not surprisingly, it has attracted the attention of the software engineering community as well. Previous work started exploring the feasibility of crowdsourcing for software design by conducting experiments in which workers from Amazon Mechanical Turk were asked to engage in a set of software design tasks. It was found that, when workers are exposed to examples of previous designs, they generate overall lower quality contributions. The intuition is that, since these experiments displayed all previous contributions as examples to workers, the presence of low quality examples may have negatively influenced workers.This thesis compares the designs produced in the previous experiments to designs obtained in a new experiment in which examples were evaluated against pre-defined quality criteria before being displayed to workers. Only examples that were of sufficient quality were shared with workers, with the hope of stimulating them to provide higher quality designs.We report results from an analysis in which we compare the designs from the current and previous experiments in terms of quantity, diversity of ideas, quality, completeness, perceived task difficulty, and how often workers borrow elements from examples. The major findings are twofold. First, workers who were exposed to sufficient quality examples produced better quality work as compared to workers exposed to all examples. Second, the quality of the designs they produced still did not reach the quality of the designs produced by workers who were not exposed to examples at all.


Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments

Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments

Author: Daniel Archambault

Publisher: Springer

Published: 2017-09-27

Total Pages: 200

ISBN-13: 3319664352

DOWNLOAD EBOOK

As the outcome of the Dagstuhl Seminar 15481 on Crowdsourcing and Human-Centered Experiments, this book is a primer for computer science researchers who intend to use crowdsourcing technology for human centered experiments. The focus of this Dagstuhl seminar, held in Dagstuhl Castle in November 2015, was to discuss experiences and methodological considerations when using crowdsourcing platforms to run human-centered experiments to test the effectiveness of visual representations. The inspiring Dagstuhl atmosphere fostered discussions and brought together researchers from different research directions. The papers provide information on crowdsourcing technology and experimental methodologies, comparisons between crowdsourcing and lab experiments, the use of crowdsourcing for visualisation, psychology, QoE and HCI empirical studies, and finally the nature of crowdworkers and their work, their motivation and demographic background, as well as the relationships among people forming the crowdsourcing community.


ECIC2015-7th European Conference on Intellectual Capital

ECIC2015-7th European Conference on Intellectual Capital

Author: Dr. Juan Gabriel Cegarra Navarro

Publisher: Academic Conferences and publishing limited

Published: 2015

Total Pages: 528

ISBN-13: 1910810002

DOWNLOAD EBOOK

These proceedings represent the work of presenters at the 7th European Conference on Intellectual Capital (ECIC 2015). This year the conference is being hosted by The Technical University of Cartagena, Spain on the 9-10 April 2015. The Conference Co-Chairs are Dr. Eva Martinez Caro, Dr. María Eugenia Sánchez & Dr. David Cegarra Leiva from the Technical University of Cartagena and the Programme Chair is Dr. Juan Gabriel Cegarra Navarro also from the Technical University of Cartagena. The opening keynote address is by Constantin Bratianu, Bucharest University of Economic Studies, Romania on the topic of “A Dynamic Perspective on Intellectual Capital” Dr Scott Erickson from the School of Business, Ithaca College and Dr Helen Rothberg, Marist College, Poughkeepsie, USA will address the topic “Does intellectual capital have a role in making the big strategic decisions? On the second day of the conference Dr José Maria Viedma Marti from the Polytechnic University of Catalonia in Barcelona, Spain will talk about xxxx. The primary aim of this conference is to contribute to the further advancement of intellectual capital theory and practice. The conference provides a platform for presenting findings and ideas for the intellectual capital community and associated fields. The range of people, issues and the mix of approaches followed will ensure an interesting two days. 115 abstracts were received for this conference. After the double blind, peer review process there are 43 academic papers, 13 PhD papers and 2 Masters Research Papers and 1 Work In Progress Paper published in these Conference Proceedings. These papers represent truly global research from some xx different countries, including the Albania, Australia, Austria, Canada, Czech Republic, Espana, Finland, France, Germany, Hungary, Indonesia, Italy, Kazakhstan, Malaysia Netherlands, Nigeria, Pakistan, Portugal, Romania, Russia, Slovakia, Spain Thailand, United Arab Emirates, UK and the USA


Value Sensitive Design

Value Sensitive Design

Author: Batya Friedman

Publisher: MIT Press

Published: 2019-05-21

Total Pages: 258

ISBN-13: 0262039532

DOWNLOAD EBOOK

Using our moral and technical imaginations to create responsible innovations: theory, method, and applications for value sensitive design. Implantable medical devices and human dignity. Private and secure access to information. Engineering projects that transform the Earth. Multigenerational information systems for international justice. How should designers, engineers, architects, policy makers, and others design such technology? Who should be involved and what values are implicated? In Value Sensitive Design, Batya Friedman and David Hendry describe how both moral and technical imagination can be brought to bear on the design of technology. With value sensitive design, under development for more than two decades, Friedman and Hendry bring together theory, methods, and applications for a design process that engages human values at every stage. After presenting the theoretical foundations of value sensitive design, which lead to a deep rethinking of technical design, Friedman and Hendry explain seventeen methods, including stakeholder analysis, value scenarios, and multilifespan timelines. Following this, experts from ten application domains report on value sensitive design practice. Finally, Friedman and Hendry explore such open questions as the need for deeper investigation of indirect stakeholders and further method development. This definitive account of the state of the art in value sensitive design is an essential resource for designers and researchers working in academia and industry, students in design and computer science, and anyone working at the intersection of technology and society.


The Participatory Cultures Handbook

The Participatory Cultures Handbook

Author: Aaron Alan Delwiche

Publisher: Routledge

Published: 2013

Total Pages: 314

ISBN-13: 0415882230

DOWNLOAD EBOOK

The Participatory Cultures Handbook will help students and scholars navigate this rapidly changing media and cultural terrain. Composed of newly commissioned essays from contributors across disciplines, this handbook will introduce students to the concept of participatory culture, explain how researchers approach participatory culture studies, and provide original examples of participatory culture in action. The wide range of topics explored in participatory culture include crowdsourcing, citizen journalism, fanfiction, wikis, video games, video sharing, transmedia storytelling, and much more.


Crowdsourcing

Crowdsourcing

Author: Jeff Howe

Publisher: Currency

Published: 2009-09-15

Total Pages: 338

ISBN-13: 0307396215

DOWNLOAD EBOOK

Why does Procter & Gamble repeatedly call on enthusiastic amateurs to solve scientific and technical challenges? How can companies as diverse as iStockphoto and Threadless employ just a handful of people, yet generate millions of dollars in revenue every year? "Crowdsourcing" is how the power of the many can be leveraged to accomplish feats that were once the responsibility of a specialized few. Jeff Howe reveals that the crowd is more than wise–it’s talented, creative, and stunningly productive. It’s also a perfect meritocracy, where age, gender, race, education, and job history no longer matter; the quality of the work is all that counts. If you can perform the service, design the product, or solve the problem, you’ve got the job. But crowdsourcing has also triggered a dramatic shift in the way work is organized, talent is employed, research is conducted, and products are made and marketed. As the crowd comes to supplant traditional forms of labor, pain and disruption are inevitable, and Howe delves into both the positive and negative consequences of this intriguing phenomenon. Through extensive reporting from the front lines of this workplace revolution, he employs a brilliant array of stories to look at the economic, cultural, business, and political implications of crowdsourcing.


Digital Labour Platforms and the Future of Work

Digital Labour Platforms and the Future of Work

Author: Janine Berg

Publisher:

Published: 2018

Total Pages: 168

ISBN-13:

DOWNLOAD EBOOK

The emergence of online digital labour platforms has been one of the major transformations in the world of work over the past decade. This report provides one of the first comparative studies of working conditions on five major micro-task platforms that operate globally. It is based on an ILO survey covering 3,500 workers in 75 countries around the world and other qualitative surveys. The report analyses the working conditions on these micro-task platforms, including pay rates, work availability and intensity, social protection coverage and work-life balance. The report recommends 18 principles for ensuring decent work on digital labour platforms.