LabintheWild: Conducting large-scale online experiments with uncompensated samples
K Reinecke, KZ Gajos - Proceedings of the 18th ACM conference on …, 2015 - dl.acm.org
Proceedings of the 18th ACM conference on computer supported cooperative …, 2015•dl.acm.org
Web-based experimentation with uncompensated and unsupervised samples has the
potential to support the replication, verification, extension and generation of new results with
larger and more diverse sample populations than previously seen. We introduce the
experimental online platform LabintheWild, which provides participants with personalized
feedback in exchange for participation in behavioral studies. In comparison to conventional
in-lab studies, LabintheWild enables the recruitment of participants at larger scale and from …
potential to support the replication, verification, extension and generation of new results with
larger and more diverse sample populations than previously seen. We introduce the
experimental online platform LabintheWild, which provides participants with personalized
feedback in exchange for participation in behavioral studies. In comparison to conventional
in-lab studies, LabintheWild enables the recruitment of participants at larger scale and from …
Web-based experimentation with uncompensated and unsupervised samples has the potential to support the replication, verification, extension and generation of new results with larger and more diverse sample populations than previously seen. We introduce the experimental online platform LabintheWild, which provides participants with personalized feedback in exchange for participation in behavioral studies. In comparison to conventional in-lab studies, LabintheWild enables the recruitment of participants at larger scale and from more diverse demographic and geographic backgrounds. We analyze Google Analytics data, participants' comments, and tweets to discuss how participants hear about the platform, and why they might choose to participate. Analyzing three example experiments, we additionally show that these experiments replicate previous in-lab study results with comparable data quality.
ACM Digital Library