The Journal of Peer Production - New perspectives on the implications of peer production for social change New perspectives on the implications of peer production for social change
reviews (Karma, precious Karma!) image

Review A

Reviewer: Joseph Reagle

1) Is the subject matter relevant?

Yes.
2) Is the treatment of the subject matter intellectually interesting? Are there citations of bodies of literature you think are essential to which the author has not referred?

The subject matter is very interesting to me. Generally, the appropriate literature is made use of though I would recommend the following:

With respect to the objective/subjective assessment of code/prose see Stalder’s (2006) functional/expressive distinction. (“On the differences between open source and open culture.”)
The author’s might be interested in discussions of evaluation and quantification in a forthcoming chapter of my own http://reagle.org/joseph/2013/photo/photo-net.html . (However, it is not yet published and need not be cited.)
3) Are there any noticeable problems with the author’s mean of validating assumptions or making judgments?

Not that I discern.

4) Is the article well written?

The prose is syntactically and grammatically well formed. However, the overall structure and arguments could be more strongly framed and sentences and jargon could be simplified. On the first point, I felt that it is a long time before we actually get to the substance of the case and I felt at a loss as to where this was going. This is likely related to the fact that the article is long. No section need necessarily be excised, but I think with judicious editing 10 to 20% of the word length could be removed. Also, giving the reader a better clue that particular karma-whoring techniques and counter-strategies will be discussed could be useful.

This could be aided by focusing on what argument is the author making? rather than the more indirect and passive “this paper analyses internal meta-discourses …”. I’m not fond of speaking of papers doing things; the authors are doing something and I’d like them to make a more direct argument.

In terms of clarity at the sentence level, the prose is rather complex and could be simplified. Additionally, concepts are sometimes introduced that could use further substantiation. Below I note some issues the authors may wish to consider:

section 1

internally problematised: jargon
and even commute material gifts: like what, what does this mean?
The generated traffic functions as an incentive for embedded, commercial advertisement.: Could you give an example?
karmawhore: this term did not arise on Reddit, perhaps it’s emergence should be further contextualized (e.g., Slashdot)
section 2

And it has since operated… It later sold: the timing/history of these events is confusing
econometrization: while the term appears in the title, it’s never really defined
section 4

Web back then ‘. (Pelling): placement of period
we will describe exemplary approaches: exemplary often has a positive connotation, perhaps a different word?
An exemplary Karmawhoring-technique: okay, this is finally getting interesting
identifying and repeating broadly appealing content: this phrase confuses me within its sentence.
terminologically: jargon
section 5

One encounters a discrepancy between discursive assertions of a (historically founded) user mentality…: this sentence is tough to follow
functionalistic: jargon
5) Are there portions of the article that you recommend to be shortened, excised or expanded?

As noted, I believe the word count of the full article should be lessened (10,000 is a bit much).

Review B