The Journal of Peer Production - New perspectives on the implications of peer production for social change New perspectives on the implications of peer production for social change
Signals (Crowdsourcing Citizen Science) image

Signals are an important part of the JoPP peer review process. They are intended to widen the scope of publishable articles by placing the reputational cost of publishing an imperfect article on authors, rather than on the journal.

Please note:

Positive signal = 1, negative signal = 0, positive/negative signal = 0.5

Only signals marked with a “*” are used to calculate the JoPP Signal.

Objective categories

Activist: 1/3

Article proposes a critique of a policy or practice with specific action proposals or suggestions.

Academic: 3/3*

Article follows conventions of academic research article ­­ e.g. position in literature, cited sources, and claimed contribution.

Prospective: 0/3

Article is based on developments that have not yet occurred.

Formalised: 0/3

Article is based on formal logic or mathematical technique.

Language quality: 3/3*

Standard of English expression in article is excellent.

Subjective categories

Scope of debate: 0/3

Article addresses an issue which is widely known and debated.

Comprehensiveness: 3/3*

Most related sources are mentioned in article [this is an invitation to careful selection rather than a demonstration of prowess in citation collection ­­ i.e. apt and representative choices made in source citations].

Logical flow: 3/3*

Ideas are well organised in article.

Originality: 3/3*

The argument presented in article is new.

Review impact: 1/3

The article has been significantly changed as a result of the review process.


Reviewers indicate their appreciation of the article in the form of a 50 word statement.

Reviewer A

Approaching crowdsourced science through the lens of labor provides a refreshing take on these processes. This may be more useful to a critical understanding of contemporary citizen science than the democratization rhetorics that still inform much STS scholarship on this topic.

Reviewer B

The paper combines two areas of literature and reflexive work that were previously dissociated: citizen science studies and labour, specifically crowdsourced labour studies. By looking at the case of Zooniverse – a crowdsourced citizen science platform – the paper provides a significant case study demonstrating the questionable labour practices possible under the participatory promise of citizen science.

Reviewer C

This article is based on an interesting fieldwork of citizen science and highlights the contradiction in crowdsourcing platforms. Efficiency and rigorous work in scientific work are counterbalanced by isolated micro tasks without sense for a part of volunteers. That result highlights the importance of explanation from scientists concerning their approach to large datasets.