10 August 2009 | Ed Chi
Part one of this post, which shared findings on the slowing growth of Wikipedia, recently received coverage in the New Scientist (as well as Fast Company, Business Insider/ Silicon Alley Insider, and more). In this second part, we share some more details on the plateauing, more-linear-than-exponential growth rate of Wikipedia. (These findings will be published in WikiSym2009).
This figure illustrates how the slowdown in Wikipedia activity differs among “editor classes”, as defined by frequency of their monthly edits. [Adhering to power law, we classified users using an exponential scale -- this resulted in 5 classes of users that were recalculated for each month: contributing 1 edit (power of 10), 2-9 edits, 10 to 99 edits, 100 to 999, and more than 1000 edits.]
All editing classes contributing less than 1000 edits slightly decreased their monthly edits beginning in 2007. Only the most frequently editing class (dark blue line at right) show an increase in monthly edits.
Another way to look at this data: analyze relative activity for each editor class. Complementing the figure above, the figure at right shows the percentage volume of edits that each class contributes relative to the total.
The two most-frequently editing classes of editors account for more than half the total monthly edits (56% from 2005 to 2008). Furthermore, the proportional contributions by the most-frequently editing class has increased since 2005. The editors in the 1000+ class have been producing edits at an increasing rate (average monthly edits per editor: 1740 in 2005, 1859 in 2006, 1869 in 2007, and 2095 in 2008).
Let’s examine some specific evidence about what might have contributed to the slowdown for everyone but the most-frequent editors. REVERT is the action of deleting a prior edit. We analyzed the percentage of edits that were reverted monthly for each editor class (vandalism- and bot-related edits were excluded). This figure illustrates two indicators of growing resistance to new content:
(1) The total percentage of monthly reverted edits (black line at left) has steadily increased over the years for all classes of editors — from 2.9 in 2005 to 5.8 in 2008.
(2) More interestingly: less-frequent or occasional editors (two top reddish lines at left) experience greater resistance compared to most-frequent editors.
The disparate treatment of edits from different editor classes has been widening steadily over the years — and not in favor to the less-frequent editors.
We consider this disparity as evidence of the dominant Wikipedia community’s growing resistance to new content, especially when the edits come from occasional editors.
Michael,
Yes, it definitely is part of an evolutionary process. The question is whether this is “normal”, and what does “normal” mean?
If “normal” means as systems get more complex, they must develop procedures for curating content that tends to be hierarchical, and that it is natural to have barriers for contribution, then yes, perhaps Wikipedia is going through a “normal” evolutionary process. Coordination breeds conflict and brings with it costs that are hard to contain. Is that what “normal” means?
From a scientific point of view, does this research mean that, no matter what, eventually you will run into enough coordination costs that hierarchy needs to be created to manage those costs?
On the other hand, if we believe that Wikipedia has been constructed from a different and flatter organization that relies on “wisdom” from the crowd, and that it ought to continue to evolve with minimal barriers for contribution, then it certainly isn’t evolving “normally” in the Web2.0 sense.
We may need more research in understanding how to further lower the cost of coordination (and perhaps invent new technology for conflict resolution or for forming consensus)…
[...] mentioned in our first post on the slowing growth rate of Wikipedia [see also our second and third posts on the topic] it appears that Wikipedia article growth peaked around 2007. It [...]
ambient intelligence AR augmented reality authentication batteries brainstorming business of innovation CHI cleantech collaboration collective intelligence competitive edge computer vision context-aware computing contextual intelligence crowdsourcing curation data centers decision making disruptive innovation electric vehicles email energy energy efficiency epic conference ethnography ethnography in industry ethnomethodology ev everyware field of use government green HCI information overload innovation innovation culture innovation strategy intellectual property IP IT kiffets licensing lithium-ion location based services long tail malware materials minimum viable product mobile computing mobile devices & interfaces mobile security MVP natural language processing news NSF open innovation opportunity discovery organic electronics Pasteur's Quadrant personal information management pervasive computing phishing photovoltaics portfolio management printed electronics privacy QR codes recommendation systems research methodology responsive mirror SaaS search smart environment smart grid social analytics social computational systems social indexing social media social streams social web software as a service technology scouting technology trends terms thin film transistors twitter ubicomp user behavior modeling user centered design user experience user interface design v2g vehicle-to-grid virtualization virtual machines virtual reality web 2.0 Wikipedia
August 11th, 2009 at 3:55am
Posted by Michael J
Might this also be framed as a picture of a normal evolutionary process. As I understand the blog post, the less frequent editors were reversed – disincented? or not able to gain the reward they wanted?, the more frequent editors were more successful at earning the rewards they desired.
Given the notion that experts need talent +10,000 hours of practice, is it possible that from a system point of view, we are watching the mechanisms of the emergence of a Wikipedia “expert functionality”?