From the post:
Last week, together with Praveen Paritosh from Google, we presented a 6-hour tutorial at the WWW 20111 conference, on crowdsourcing and human computation. The title of the tutorial was “Managing Crowdsourced Human Computation”.
Check the post for other links, resources.
Perhaps the lesson is to automate when possible and to use human computation when necessary. And the trick is to know when to switch.