posts tagged ‘crowdsourcing’

Experts’ domain knowledge improves automated recommendations

9 November 2009 | Ellen Isaacs

It’s almost eerie how well the music website Pandora recommends music based on just one example of a favorite song. It does so by relying on human experts to characterize songs based on a large and musically sophisticated set of characteristics (melody, harmony, rhythm, orchestration, etc.). This approach -- of using human expertise to develop a rich set of attributes that deeply capture the essence of an item -- could be adapted to greatly improve the recommendations currently being offered in other domains, such as news, movies, hotels and so on. In our enthusiasm to develop automated recommendation systems, Pandora reminds us of the value of incorporating the intelligence of domain experts into the process.

Experimenting on Mechanical Turk: 5 How Tos

21 July 2009 | Markus Jakobsson

Performing human-subjects experiments on Amazon Mechanical Turk offers many benefits, including very low experiment costs, quick turn-around rates, and relatively simple approvals from human subjects boards. But you have to be careful to avoid bias and error...