crowdsourcing-class.org

What It Is

NETS 213 “Crowdsourcing and Human Computation” is a University of Pennsylvania course on crowdsourcing and human computation, positioned at the intersection of economics and computer science. The course explores how humans can be used to complete complex tasks that current AI systems still struggle with, and uses online marketplaces such as Mechanical Turk as a foundation for understanding concepts such as micropayments, human intelligence tasks, and humans as callable software functions.

Core Content and Teaching Format

The course covers applications of crowdsourcing in machine learning, next-generation user interfaces, and data mining. It also extends to the sharing economy, prediction markets, how companies leverage collective intelligence, and the basic principles of democracy and group decision-making. The page indicates that in Spring 2021, the course was taught live via Zoom every Tuesday and Thursday from 3:00–4:30 PM Eastern Time. It also used a Piazza discussion forum, OHQ office hours, and a Gradescope regrade mechanism. The readings are mainly academic papers, suggesting a relatively high level of research and theoretical depth.

Pricing, Assessment, and Projects

The page does not provide tuition or certificate information, but it states that students should expect to spend around USD 50–100 of their own money on MTurk or other crowdsourcing platforms. Assessment is project-based rather than exam-based: weekly assignments account for 50%, the final project for 45%, and participation for 5%. The final project requires teams of 4–6 students, must use a crowd, and must include quality control, result aggregation, and analysis. It should also include a machine learning or human-computer interaction component, with a project video as the final deliverable.

Pros and Cons

The main strength is the course’s well-rounded structure: it combines theoretical readings with practical training in real task design, cost analysis, quality control, and statistical analysis. Teaching assistant office hours are frequent, and the support system is clearly organized. The downside is that there are explicit prerequisites: CIS 120 or prior programming experience. It is also unclear whether external learners can officially enroll, receive grades, or obtain a certificate. In addition, while the course is marked as a 2021 offering, the page also shows 2024 assignment information, so its current availability should be verified.

Who It’s For and Access from China

This course is best suited to university students and research-oriented learners with a programming background who are interested in crowdsourcing systems, data labeling, social computing, HCI, or machine learning data workflows. For users in China, the accessibility of the course website itself cannot be determined from the page. However, supporting tools such as Zoom, Google Drive, Vimeo, and MTurk may involve network access or payment uncertainty in mainland China. If participation is not feasible, courses on human-computer interaction, machine learning data annotation, or social computing from platforms such as Coursera, edX, and MIT OCW may be reasonable alternatives.