One of Us: a Multiplayer Web-based Game for Digital Evidence Acquisition of Scripts through Crowdsourcing
Pages 187 - 196
Abstract
Digital devices are an integral part of our lives. Through these devices, people produce and save personal data, with or without their explicit awareness. This personal digital information has been exploited by companies, but users find it hard to access and search in a uniform way, due to the heterogeneity, fragmentation of data and non-uniform access interface. By integrating and organizing this information into common kinds of everyday episodes ("scripts") that people engage in, we can help users recall and explore forgotten details of their past. However, being able to recognize such episodes in the user’s personal digital information requires not only script knowledge (e.g., the steps/actions in the script), but also explicit knowledge about the digital traces potentially left behind by each of the actions. In this paper, we present "One Of Us", a web-based multiplayer game, which collects descriptions of different kinds of personal digital traces, by having players identify the digital traces that might be produced by each of the actions in a given script. We report on the results of an experimental study, which gives evidence that our game is i) enjoyable, ii) accounts for uncommon answers, iii) validates and assesses knowledge by having the players vote on other’s responses - thus not requiring a second round of quality assessment, and iv) dynamically acquires new pieces of information.
References
[1]
Taiwo Ayodele, Galyna Akmayeva, and Charles A Shoniregun. 2012. Machine learning approach towards email management. In World Congress on Internet Security (WorldCIS). IEEE.
[2]
Deborah Barreau and Bonnie A Nardi. 1995. Finding and reminding: file organization from the desktop. ACM SigChi 27(1995), 39–43.
[3]
Deborah K Barreau. 1995. Context as a factor in personal information management systems. Journal of the American Society for Information Science 46, 5(1995), 327–339.
[4]
Michael Beigl. 2000. MemoClip: A location-based remembrance appliance. Personal Technologies 4, 4 (2000), 230–233.
[5]
Alexander Borgida, Varvara Kalokyri, and Amélie Marian. 2019. Description Logics and Specialization for Structured BPMN. In International Conference on Business Process Management. Springer, 19–31.
[6]
Richard W DeVaul, Alex Pentland, and Vicka R Corey. 2003. The memory glasses: subliminal vs. overt memory support with imperfect information. In Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings.
[7]
Anind K Dey and Gregory D Abowd. 2000. Cybreminder: A context-aware system for supporting reminders. In Int. Symposium on Handheld and Ubiquitous Computing. 172–186.
[8]
Xin Dong, Alon Halevy, Ema Nemes, Stephan B. Sigurdsson, and Pedro Domingos. 2004. Semex: Toward on-the-fly personal information integration. In Workshop on Information Integration on the Web (IIWEB.
[9]
Xin Dong and Alon Y. Halevy. 2005. A Platform for Personal Information Management and Integration. In CIDR. 119–130.
[10]
Anton N Dragunov, Thomas G Dietterich, Kevin Johnsrude, Matthew McLaughlin, Lida Li, and Jonathan L Herlocker. 2005. TaskTracer: a desktop environment to support multi-tasking knowledge workers. In Conf. on Intelligent User Interfaces (IUI’05). 75–82.
[11]
Susan Dumais, Edward Cutrell, Jonathan J. Cadiz, Gavin Jancke, Raman Sarin, and Daniel C. Robbins. 2003. Stuff I’ve Seen: A System for Personal Information Retrieval and Re-Use. In (SIGIR’03).
[12]
Stijn Goedertier, Jan Vanthienen, and Filip Caron. 2015. Declarative business process modelling: principles and modelling languages. Enterprise Information Systems 9, 2 (2015), 161–185.
[13]
Cathal Gurrin, Alan F Smeaton, Aiden R Doherty, 2014. Lifelogging: Personal big data. Foundations and Trends® in information retrieval 8, 1(2014), 1–125.
[14]
Steve Hodges, Lyndsay Williams, Emma Berry, Shahram Izadi, James Srinivasan, Alex Butler, Gavin Smyth, Narinder Kapur, and Ken Wood. 2006. SenseCam: A Retrospective Memory Aid. (2006).
[15]
Matthew B Hoy. 2018. Alexa, Siri, Cortana, and more: an introduction to voice assistants. Medical reference services quarterly 37, 1 (2018), 81–88.
[16]
Innersloth. 2018. Among Us. https://among-us.fandom.com/wiki/Among_Us. Accessed: 2022-05-15.
[17]
Telltale Publishing Jackbox Games. 2014. Jackbox Game: Push the button. https://www.jackboxgames.com/push-the-button/. Accessed: 2022-05-15.
[18]
Vaiva Kalnikaite, Abigail Sellen, Steve Whittaker, and David Kirk. 2010. Now let me see where i was: understanding how lifelogs mediate memory. In Human Factors in Computing. 2045–2054.
[19]
Varvara Kalokyri, Alexander Borgida, and Amélie Marian. 2018. Yourdigitalself: A personal digital trace integration tool. In Proceedings of the 27th ACM International Conference on information and knowledge management. 1963–1966.
[20]
Varvara Kalokyri, Alexander Borgida, and Amelie Marian. 2022. Supporting Human Memory by Reconstructing Personal Episodic Narratives from Digital Traces. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 16. 453–464.
[21]
Victor Kaptelinin. 2003. UMEA: translating interaction histories into project contexts. In SIGCHI conference on Human factors in computing systems. 353–360.
[22]
Narinder Kapur, Elizabeth L Glisky, and Barbara A Wilson. 2004. External memory aids and computers in memory rehabilitation. The essential handbook of memory disorders for clinicians (2004).
[23]
David R. Karger, Karun Bakshi, David Huynh, Dennis Quan, and Vineet Sinha. 2005. Haystack: A General-Purpose Information Management Tool for End Users Based on Semistructured Data. In CIDR’05. 13–26.
[24]
Vivi Katifori, Antonella Poggi, Monica Scannapieco, Tiziana Catarci, and Yannis E. Ioannidis. 2005. OntoPIM: how to rely on a personal ontology for Personal Information Management. In ISWC Wkshop. on The Semantic Desktop. 258–262.
[25]
Douglas B Lenat. 1995. CYC: A large-scale investment in knowledge infrastructure. Commun. ACM 38, 11 (1995), 33–38.
[26]
Henry Lieberman, Dustin Smith, and Alea Teeters. 2007. Common Consensus: a web-based game for collecting commonsense goals. In ACM Workshop on Common Sense for Intelligent Interfaces.
[27]
Hugo Liu and Push Singh. 2004. ConceptNet: a practical commonsense reasoning tool-kit. BT technology journal 22, 4 (2004).
[28]
Georgios Meditskos, Pierre-Marie Plans, Thanos G Stavropoulos, Jenny Benois-Pineau, Vincent Buso, and Ioannis Kompatsiaris. 2018. Multi-modal activity recognition from egocentric vision, semantic enrichment and lifelogging applications for the care of dementia. Visual Commun. and Image Representation 51 (2018), 169–190.
[29]
George A Miller. 1995. WordNet: a lexical database for English. Commun. ACM 38, 11 (1995), 39–41.
[30]
Harumi Murakami and Kenta Mitsuhashi. 2012. A System for Creating User’s Knowledge Space from Various Information Usages to Support Human Recollection. International Journal of Advancements in Computing Technology 4, 22(2012).
[31]
Usman Naeem, John Bigham, and Jinfu Wang. 2007. Recognising activities of daily life using hierarchical plans. In European Conf. on Smart Sensing and Context. 175–189.
[32]
OMG. 2016. Business Process Model and Notation. http://www.bpmn.org/.
[33]
Maarten Sap. 2020. ACL 2020 Commonsense Tutorial (T6). https://tinyurl.com/acl2020-commonsense
[34]
R Schank and R Abelson. 1977. Scripts, plans, goals, and understanding: an inquiry into human knowledge structures.(1977).
[35]
Push Singh, Thomas Lin, Erik T Mueller, Grace Lim, Travell Perkins, and Wan Li Zhu. 2002. Open mind common sense: Knowledge acquisition from the general public. In OTM. 1223–1237.
[36]
Shashi Thakur. 2016. Personalization for google now: user understanding and application to information recommendation and exploration. In Proceedings of the 10th ACM Conference on Recommender Systems. 3–3.
[37]
Elise Van Den Hoven, Corina Sas, and Steve Whittaker. 2012. Introduction to this special issue on designing for personal memories: past, present, and future. HCI 27, 1-2 (2012), 1–12.
[38]
Wil M. P. van der Aalst and Arthur H. M. ter Hofstede. 2005. YAWL: yet another workflow language. Inf. Syst. 30, 4 (2005), 245–275. https://doi.org/10.1016/j.is.2004.02.002
[39]
Daniela Vianna, Varvara Kalokyri, Alexander Borgida, Amélie Marian, and Thu Nguyen. 2019. Searching heterogeneous personal digital traces. Proceedings of the Association for Information Science and Technology 56, 1 (2019), 276–285.
[40]
Luis Von Ahn and Laura Dabbish. 2008. Designing games with a purpose. Commun. ACM 51, 8 (2008), 58–67.
[41]
Luis Von Ahn, Mihir Kedia, and Manuel Blum. 2006. Verbosity: a game for collecting common-sense facts. In Proceedings of the SIGCHI conference on Human Factors in computing systems. 75–78.
[42]
Lilian Diana Awuor Wanzare. 2020. Script acquisition: a crowdsourcing and text mining approach. Ph. D. Dissertation. Saarländ.
[43]
Steve Whittaker, Victoria Bellotti, and Jacek Gwizdka. 2006. Email in personal information management. ACM 49, 1 (2006), 68–73.
[44]
Steve Whittaker and Candace Sidner. 1996. Email overload: exploring personal information management of email. In Proceedings of the SIGCHI conference on Human factors in computing systems. 276–283.
Index Terms
- One of Us: a Multiplayer Web-based Game for Digital Evidence Acquisition of Scripts through Crowdsourcing
Recommendations
An investigation of player motivations in Eyewire, a gamified citizen science project
Sustained engagement of participants is essential for the success of a citizen science project. However, the motivations of why people engage with such activities can be idiosyncratic, varied, and evolving. In this article we examine player ...
Designing a Crowdsourcing System for the Elderly: A Gamified Approach to Speech Collection
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsDespite the need for representation of older adults in crowdsourced data, crowd work is generally not designed for older adults and participation by older adults is low. In this paper, we demonstrate a process for designing crowd work for older adults; ...
Points, stories, worlds, and diegesis
A few themes indicate differences between the story-based and the points-based games.The story-based game is strongly preferred over the points-based game.The story-based game may be more useful for attracting and engaging players. We conducted an ...
Comments
Information & Contributors
Information
Published In
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 20 March 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
CHIIR '23: ACM SIGIR Conference on Human Information Interaction and Retrieval
March 19 - 23, 2023
TX, Austin, USA
Acceptance Rates
Overall Acceptance Rate 55 of 163 submissions, 34%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 62Total Downloads
- Downloads (Last 12 months)15
- Downloads (Last 6 weeks)1
Reflects downloads up to 07 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format