skip to main content
10.1145/3295750.3298929acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Understanding Context for Tasks and Activities

Published: 08 March 2019 Publication History

Abstract

Human activity is one of the most important pieces of context affecting an individual's information needs. Understanding the relationship between activities, time, location, and other contextual features can improve the quality of various intelligent systems, including contextual search engines, task managers, digital personal assistants, chat bots, and recommender systems.
In this work, we propose a method for extraction of an extensive set of open-vocabulary activities from social media. In particular, we derive tens of thousands of ongoing activities from Twitter, where people share information about their past, present, and future events and, using attached metadata, we establish spatiotemporal models of these activities at the time of posting. While public Twitter content is subject to self-censorship (not all activities are tweeted about), we compare extracted data with unbiased survey data (ATUS) and show evidence that for activities which are tweeted about, the underlying spatiotemporal profiles correctly capture their real distributions of activity conditioned on time and location. Next, to better understand the set of activities present in this dataset (and what role self-censorship may play), we perform a qualitative analysis to understand the activities, locations, and their temporal properties. Finally, we go on to solve predictive tasks centered on the relationship between activity and spatiotemporal context that are aimed at supporting an individual's information needs. Our predictive models, which incorporate text, personal history and temporal features, show a significant performance gain over a strong frequency-based baseline.

References

[1]
Gediminas Adomavicius and Alexander Tuzhilin. 2015. Context-aware recommender systems. In Recommender systems handbook. Springer, 191--226.
[2]
Marco Aurelio Beber, Carlos Andres Ferrero, Renato Fileto, and Vania Bogorny. 2016. Towards activity recognition in moving object trajectories from Twitter data. In Proc. of GeoInfo. 68--79.
[3]
Jan R Benetka, Krisztian Balog, and Kjetil Nørvåg. 2017. Anticipating Information Needs Based on Check-in Activity. In Proc. of WSDM.
[4]
Paul N Bennett, Filip Radlinski, Ryen W White, and Emine Yilmaz. 2011. Inferring and using location metadata to personalize web search. In Proc. in SIGIR. ACM, 135--144.
[5]
Frank R Bentley and Crysta J Metcalf. 2008. Location and activity sharing in everyday mobile communication. In CHI Extended Abstracts. ACM, 2453--2462.
[6]
Kalina Bontcheva, Leon Derczynski, Adam Funk, Mark A. Greenwood, Diana Maynard, and Niraj Aswani. 2013. TwitIE: An Open-Source Information Extraction Pipeline for Microblog Text. In Proc. of RANLP. Association for Computational Linguistics.
[7]
AJ Bernheim Brush, John Krumm, James Scott, and T Scott Saponas. 2011. Recognizing activities from mobile sensor data: Challenges and opportunities. In Proc. of Ubicomp.
[8]
Liming Chen, Jesse Hoey, Chris D Nugent, Diane J Cook, and Zhiwen Yu. 2012. Sensor-based activity recognition. IEEE Trans. on SMC, Vol. 42, 6 (2012), 790--808.
[9]
Karen Church and Barry Smyth. 2009. Understanding the intent behind mobile information needs. In Proc. of IUI. ACM, 247--256.
[10]
David Dearman, Timothy Sohn, and Khai N Truong. 2011. Opportunities exist: continuous discovery of places to perform activities. In Proc. of CHI. ACM, 2429--2438.
[11]
David Dearman and Khai N Truong. 2010. Identifying the activities supported by locations with community-authored content. In Proc. of Ubicomp. ACM, 23--32.
[12]
David Graus, Paul N Bennett, Ryen W White, and Eric Horvitz. 2016. Analyzing and Predicting Task Reminders. In Proc. of UMAP. ACM, 7--15.
[13]
Nir Grinberg, Mor Naaman, Blake Shaw, and Gilad Lotan. 2013. Extracting Diurnal Patterns of Real World Activity from Social Media. In Proc. of ICWSM.
[14]
Bo Han and Timothy Baldwin. 2011. Lexical normalisation of short text messages: Makn sens a# twitter. In Proc. of HLT. Association for Computational Linguistics, 368--378.
[15]
Annika M Hinze, Carole Chang, and David M Nichols. 2010. Contextual queries express mobile information needs. In Proc. of MobileHCI. ACM, 327--336.
[16]
Nabil Hossain, Tianran Hu, Roghayeh Feizi, Ann Marie White, Jiebo Luo, and Henry Kautz. 2016. Inferring fine-grained details on user activities and home location from social media: Detecting drinking-while-tweeting patterns in communities. arXiv preprint arXiv:1603.03181 (2016).
[17]
Giovanni Iachello, Ian Smith, Sunny Consolvo, Gregory Abowd, Jeff Hughes, James Howard, Fred Potter, James Scott, Timothy Sohn, Jeffrey Hightower, et almbox. 2005. Control, deception, and communication: Evaluating the deployment of a location-enhanced messaging service. Proc. of UbiComp, 903--903.
[18]
Akshay Java, Xiaodan Song, Tim Finin, and Belle Tseng. 2009. Why we twitter: An analysis of a microblogging community. Advances in Web Mining and Web Usage Analysis (2009), 118--138.
[19]
F Thomas Juster and Frank P Stafford. 1985. Time, goods, and well-being.
[20]
Daniel Kahneman, Alan B Krueger, David A Schkade, Norbert Schwarz, and Arthur A Stone. 2004. A survey method for characterizing daily life experience: The day reconstruction method. Science, Vol. 306, 5702 (2004), 1776--1780.
[21]
Shian-Ru Ke, Hoang Le Uyen Thuc, Yong-Jin Lee, Jenq-Neng Hwang, Jang-Hee Yoo, and Kyoung-Ho Choi. 2013. A review on video-based human activity recognition. Computers, Vol. 2, 2 (2013), 88--131.
[22]
John Krumm, Dany Rouhana, and Ming-Wei Chang. 2015. Placer: Semantic place labels beyond the visit. In Proc. of PerCom. IEEE, 11--19.
[23]
Michael G Lamming and William M Newman. 1992. Activity-based Information Retrieval: Technology in Support of Personal Memory. In IFIP Congress (3), Vol. 14. 68--81.
[24]
Eugene Leypunskiy, Emre Kiciman, Mili Shah, Olivia J Walch, Andrey Rzhetsky, Aaron R Dinner, and Michael J Rust. 2018. Geographically Resolved Rhythms in Twitter Use Reveal Social Pressures on Daily Activity Patterns. Current Biology, Vol. 28, 23 (2018), 3763--3775.
[25]
Mitchell P Marcus, Mary Ann Marcinkiewicz, and Beatrice Santorini. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational linguistics, Vol. 19, 2 (1993), 313--330.
[26]
Alice E Marwick and Danah Boyd. 2011. I tweet honestly, I tweet passionately: Twitter users, context collapse, and the imagined audience. New media & society, Vol. 13, 1 (2011), 114--133.
[27]
Sahisnu Mazumder, Dhaval Patel, and Sameep Mehta. 2014. Actminer: Discovering location-specific activities from community-authored reviews. In Proc. of DaWaK. Springer, 332--344.
[28]
Joan Melià-Segu'i, Rui Zhang, Eugene Bart, Bob Price, and Oliver Brdiczka. 2012. Activity duration analysis for context-aware services using foursquare check-ins. In Proc. of Self-IoT. ACM, 13--18.
[29]
Mor Naaman, Jeffrey Boase, and Chih-Hui Lai. 2010. Is it really about me?: message content in social awareness streams. In Proc. of CSCW. ACM, 189--192.
[30]
Anastasios Noulas, Salvatore Scellato, Cecilia Mascolo, and Massimiliano Pontil. 2011. An Empirical Study of Geographic User Activity Patterns in Foursquare. In Proc. of ICWSM.
[31]
Alexandra Olteanu, Emre Kiciman, and Carlos Castillo. 2018. A Critical Review of Online Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries. In Proc. of WSDM. 785--786.
[32]
Xin Rong, Adam Fourney, Robin N Brewer, Meredith Ringel Morris, and Paul N Bennett. 2017. Managing Uncertainty in Time Expressions for Virtual Assistants. In Proc. of CHI. ACM, 568--579.
[33]
Kristina J Shelley. 2005. Developing the American time use survey activity classification system. Monthly Lab. Rev., Vol. 128 (2005), 3.
[34]
Timothy Sohn, Kevin A Li, William G Griswold, and James D Hollan. 2008. A diary study of mobile information needs. In Proc. of CHI.
[35]
Yangqiu Song, Zhengdong Lu, Cane Wing-ki Leung, and Qiang Yang. 2013. Collaborative boosting for activity classification in microblogs. In Proc. of SIGKDD. ACM, 482--490.
[36]
Jaime Teevan, Amy Karlson, Shahriyar Amini, AJ Bernheim Brush, and John Krumm. 2011. Understanding the importance of location, time, and people in mobile local search behavior. In Proc. of MobileHCI. ACM, 77--80.
[37]
Sergey Volokhin and Eugene Agichtein. 2018. Understanding Music Listening Intents During Daily Activities with Implications for Contextual Music Recommendation. In CHIIR.
[38]
Wouter Weerkamp, Maarten De Rijke, et almbox. 2012. Activity prediction: A twitter-based exploration. In Proc. of TAIA.
[39]
Dingqi Yang, Daqing Zhang, Vincent W. Zheng, and Zhiyong Yu. 2015. Modeling User Activity Preference by Leveraging User Spatial Temporal Characteristics in LBSNs. IEEE Trans. on SMC, Vol. 45, 1 (2015), 129--142.
[40]
Chao Zhang, Mengxiong Liu, Zhengchao Liu, Carl Yang, Luming Zhang, and Jiawei Han. 2018. Spatiotemporal Activity Modeling Under Data Scarcity: A Graph-Regularized Cross-Modal Embedding Approach. AAAI.
[41]
Chao Zhang, Keyang Zhang, Quan Yuan, Fangbo Tao, Luming Zhang, Tim Hanratty, and Jiawei Han. 2017. React: Online multimodal embedding for recency-aware spatiotemporal activity modeling. In SIGIR.
[42]
Zack Zhu, Ulf Blanke, and Gerhard Tröster. 2016. Recognizing composite daily activities from crowd-labelled social media data. Pervasive and Mobile Computing, Vol. 26 (2016), 103--120.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHIIR '19: Proceedings of the 2019 Conference on Human Information Interaction and Retrieval
March 2019
463 pages
ISBN:9781450360258
DOI:10.1145/3295750
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 March 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. activity context
  2. activity location
  3. activity prediction
  4. human daily activities
  5. spatiotemporal context
  6. tasks

Qualifiers

  • Research-article

Conference

CHIIR '19
Sponsor:

Acceptance Rates

Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)9
  • Downloads (Last 6 weeks)0
Reflects downloads up to 31 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media