skip to main content
10.1145/3173574.3173882acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

“Debrief O'Clock”: Planning, Recording, and Making Sense of a Day in the Field in Design Research

Published: 21 April 2018 Publication History

Abstract

Design research is generative, intuitive, experiential, and tactical. Documenting the design research process helps to communicate these decisions, judgements, and values that are embodied in design products. Yet, practices for documenting design research are underreported in the CHI community, particularly for immersive design research field studies. We contribute the "Debrief O'Clock" fieldnote practice for documenting design research field studies, comprising collaborative discussion sessions and the production of written research accounts. We show how the Debrief O'Clock practice emerged in the context of a Digital Community Noticeboard project with a very remote Australian Aboriginal community, and explain three key purposes of Debrief O'Clock as: 1) an early stage data recording and analysis process; 2) a tactical manoeuvre in responsive project planning; and 3) a mechanism for personal debriefing and reflexivity. We conclude with a series of open practical, ethical, and methodological questions to advance the discussion of design research documentation practices.

Supplementary Material

suppl.mov (pn2898-file5.mp4)
Supplemental video

References

[1]
AIATSIS. 2012. Guidelines for Ethical Research in Australian Indigenous Studies. AIATSIS, Canberra. Retrieved from http://www.aiatsis.gov.au/research/docs/GERAIS.p df
[2]
Yoko Akama and Ann Light. 2012. A Candor in Reporting: Designing Dexterously for Fire Preparedness. Proc. CHI 2012: 281--290.
[3]
Yaw Anokwa, Thomas N Smyth, Divya Ramachandran, Jahanzeb Sherwani, Yael Schwartzman, Rowena Luk, Melissa Ho, Neema Moraveji, and Brian DeRenzi. 2009. Stories from the Field?: Reflections on HCI4D Experiences. Information Technologies & International Development 5, 4: 101--115.
[4]
Paul Atkinson, Amanda Coffey, Sara Delamont, John Lofland, and Lyn Lofland. 2007. Handbook of Ethnography. Sage Publications, London.
[5]
Jeffrey Bardzell and Shaowen Bardzell. 2016. Humanistic HCI. Interactions 23, 20--29.
[6]
Jeffrey Bardzell, Shaowen Bardzell, Peter Dalsgaard, Shad Gross, and Kim Halskov. 2016. Documenting the Research Through Design Process. Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS '16: 96-- 107.
[7]
Shaowen Bardzell. 2010. Feminist HCI: Taking Stock and Outlining an Agenda for Design. In Proceedings of CHI 2010, 1301--1310.
[8]
Victoria Bellotti and Ian Smith. 2000. Informing the design of an information management system with iterative fieldwork. Proceedings of the Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, DIS: 227--237.
[9]
Dawn Bessarab and Bridget Ng'andu. 2010. Yarning About Yarning as a Legitimate Method in Indigenous Research. International Journal of Critical Indigenous Studies 3, 1: 37--50.
[10]
Nicola J Bidwell, Thomas Reitmaier, Gary Marsden, and Susan Hansen. 2010. Designing with mobile digital storytelling in rural Africa. In Proceedings of CHI 2010, 1593--1602.
[11]
Herbert Blumer. 1954. What is Wrong with Social Theory? American Sociological Review 19, 1: 3--10.
[12]
V. Braun and V. Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, May 2015: 77--101.
[13]
Margot Brereton, Paul Roe, Thomas Amagula, Serena Bara, Judy Larara, and Anita Lee Hong. 2013. Growing Existing Aboriginal Designs to Guide a Cross-Cultural Design Project. In Proceedings of the 14th IFIP TC13 International Conference on Human-Computer Interaction 2013 (INTERACT '13), 323--330.
[14]
Margot Brereton, Paul Roe, and Anita Lee Hong. 2012. Evolving a relationship for cross-cultural participatory innovation. In Proceedings of Participatory Innovation Conference 2012, 1--5. Retrieved from http://eprints.qut.edu.au/48143/
[15]
Margot Brereton, Paul Roe, Ronald Schroeter, Anita Lee Hong, and Anita Lee Hong. 2014. Beyond Ethnography?: Engagement and Reciprocity as Foundations for Design Research Out Here. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), 1183-- 1186.
[16]
Nela Brown, Peter Landin Building, and Tony Stockman. 2013. Examining the Use of Thematic Analysis as a Tool for Informing Design of New Family Communication Technologies. In Proceedings of the 27th International BCS Human Computer Interaction Conference, 21.
[17]
Ko-le Chen. 2017. HCI Knowledges and Situated Dissemination. In DIS '17 Proceedings of the 2017 Conference on Designing Interactive Systems Companion, 396--398.
[18]
Ko-Le Chen, Rachel Clarke, Teresa Almeida, Matthew Wood, and David S. Kirk. 2017. Situated Dissemination through an HCI Workplace. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17, 2078--2090.
[19]
Teena Clerke and Nick Hopwood. 2014. Doing ethnography in teams: A case study of asymmetries in collaborative research. Springer Science & Business Media, Berlin, Heidelberg.
[20]
James Clifford. 1990. Notes on (field)notes. Fieldnotes: The Makings of Anthropology, 47--70.
[21]
Juliet Corbin and Anselm Strauss. 2008. Basics of Qualitative Research. Sage Publications Inc, Thousand Oaks, CA.
[22]
Andy Crabtree, David M Nichols, Jon O Brien, Mark Rouncefield, and Michael B Twidale. 2000. Ethnomethodologically Informed Ethnography and Information System Design. Journal of the American Society for Information Science 51, 7: 666--682.
[23]
Paul Dourish. 2006. Implications for design. In Proceedings of the SIGCHI conference on Human Factors in computing systems, 541--550.
[24]
Robert M Emerson, Rachel I. Fretz, and Linda L. Shaw. 2011. Writing Ethnographic Fieldnotes. University of Chicago Press, Chicago, Illinois, USA.
[25]
Robert M Emerson, Rachel I Fretz, and Linda L Shaw. 2001. Participant Observation and Fieldnotes. In Handbook of Ethnography. Sage Publications Inc, London, 352--369.
[26]
Susan Farrell. 2016. Field Studies. Neislen Norman Group Website. Retrieved September 19, 2017 from https://www.nngroup.com/articles/field-studies/
[27]
Haakon Faste. 2017. Intuition in Design?: Reflections on the Iterative Aesthetics of Form. Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '17: 3403--3413.
[28]
David J Flinders. 2016. In search of ethical guidance?: constructing a basis for dialogue. International Journal of Qualitative Studies in Education 5, 2: 101--115.
[29]
Christopher Frayling. 1993. Research in Art and Design. Royal College of Art Research Papers 1, 1: 1--5.
[30]
Harold Garfinkel. 1964. Studies of the Routine Grounds of Everyday Activities. Social Problems 11, 3: 225--250.
[31]
Bill Gaver, Tony Dunne, and Elena Pacenti. 1999. Cultural Probes. Interactions 6, 1: 21--29.
[32]
William Gaver. 2011. Making Spaces: How Design Workbooks Work. Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11: 1551--1560.
[33]
William Gaver. 2012. What Should We Expect From Research Through Design?? In Proceedings of CHI 2012, 937--946.
[34]
Karen Holtzblatt and Hugh Beyer. 2015. Contextual Design: Evolved. Morgan & Claypool, San Rafael, California.
[35]
Hilary Hutchinson, Wendy E. Mackay, Bo Westerlund, Benjamin B Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, Stéphane Conversy, Helen Evans, Heiko Hansen, Nicolas Roussel, Björn Eiderbäck, and others. 2003. Technology probes: inspiring design for and with families. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '03, 5: 17--24.
[36]
Lilly Irani, Janet Vertesi, Paul Dourish, Kavita Philip, and Rebecca E. Grinter. 2010. Postcolonial Computing: A Lens on Design and Development. Proceedings of the 28th international conference on Human factors in computing systems - CHI '10: 1312--1320.
[37]
Brigitte Jordan and Austin Henderson. 1995. Interaction Analysis: Foundations and Practice. Journal of the Learning Sciences 4, 1: 39--103.
[38]
Tobie Kerridge. 2017. Turning people into workbooks. Interactions 24, 6: 6--7.
[39]
Vera Khovanskaya, Phoebe Sengers, Melissa Mazmanian, and Charles Derrah. 2017. Reworking the Gaps between Design and Ethnography. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems: 5373--5385.
[40]
Jesper Kjeldskov and Connor Graham. 2003. A Review of Mobile HCI Research Methods. In Lecture Notes in Computer Science (LNCS, volume 2795). Springer, Berlin, Heidelberg, 317--335.
[41]
Ann Light. 2015. Troubling Futures: can participatory design research provide a constitutive anthropology for the 21st century? Interaction Design and Architecture(s) Journal, 26: 81--94.
[42]
Ann Light and Yoko Akama. 2012. The Human Touch: Participatory practice and the role of facilitation in designing with communities. Proceedings of the 12th Participatory Design Conference (PDC '12): 61--70.
[43]
John Loftland and Lyn Loftland. 2006. Analyzing Social Settings: A Guide to Qualitative Observation and Analysis. Wadsworth/Thomson Learning, Belmont, CA.
[44]
John Van Maanen. 1988. Tales of the Field: On Writing Ethnography. Chicago University Press, Chicago, Illinois.
[45]
Matthew Miles and Michael Huberman. 1994. Qualitative Data Analysis: An Expanded Sourcebook. Sage Publications, Thousand Oaks, CA.
[46]
Cosmin Munteanu, Heather Molyneaux, Wendy Moncur, Mario Romero, Susan O'Donnell, and John Vines. 2015. Situational Ethics: Re-thinking Approaches to Formal Ethics Requirements for Human-Computer Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 105--114.
[47]
James Pierce, Phoebe Sengers, Tad Hirsch, Tom Jenkins, William Gaver, and Carl Disalvo. 2015. Expanding and Refining Design and Criticality in HCI. In Proceedings of CHI 2015, 2083--2092.
[48]
Suvi Pihkala and Helena Karasti. 2016. Reflexive Engagement: Enacting Reflexivity in Design and for ?Participation in Plural." Proceedings of the 14th Participatory Design Conference: Full Papers - Volume 1: 21--30.
[49]
Jenny Preece, Yvonne Rogers, and Helen Sharp. 2015. Interaction Design: Beyond HumanComputer Interaction. Wiley, West Sussex.
[50]
Toni Robertson and Jesper Simonsen. 2012. Participatory Design: An Introduction. In Routledge International Handbook of Participatory Design, J Simonsen and T Robertson (eds.). Taylor & Francis, Florence, 1--18.
[51]
Jennifer a Rode. 2011. Reflexivity in Digital Anthropology. In Proceedings of CHI 2011, 123-- 132.
[52]
Daniela K Rosner, Saba Kawas, Wenqi Li, Nicole Tilly, and Yi-Chen Sung. 2016. Out of time, out of place: Reflections on design workshops as a research method. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16): 1131-- 1141.
[53]
Roger Sanjek. 1990. Fieldnotes: The Makings of Anthropology. Cornell University Press, Ithaca, NY.
[54]
Maggi Savin-Baden and Claire Howell Major. 2013. Qualitative Research: The Essential Guide to Theory and Practice. Routledge, Abingon, UK.
[55]
Ari Schlesinger, W Keith Edwards, and Rebecca E Grinter. 2017. Intersectional HCI?: Engaging Identity through Gender, Race, and Class. In Proceedings of CHI 2017, 5412--5427.
[56]
Phoebe Sengers, Kirsten Boehner, Shay David, and Joseph ?Jofish" Kaye. 2005. Reflective design. Proceedings of the 4th decennial conference on Critical computing between sense and sensibility CC '05: 49.
[57]
Royce A. Singleton Jr, Bruce C Straits, and Margaret Miller Straits. 1993. Approaches to social research. Oxford University Press, Oxford.
[58]
Alessandro Soro, Margot Brereton, Anita Lee Hong, and Paul Roe. 2015. Bi-Cultural Content Publication on a Digital Noticeboard: A Design and Cultural Differences Case Study. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI '15), 217--221.
[59]
Alessandro Soro, Margot Brereton, Jennyfer Lawrence Taylor, Anita Lee Hong, and Paul Roe. 2017. A Cross-Cultural Noticeboard for a Remote Community: Design, Deployment, and Evaluation. In Proceedings of INTERACT 2017.
[60]
Alessandro Soro, Margot Brereton, Jennyfer Lawrence Taylor, Anita Lee Hong, and Paul Roe. 2016. Cross-Cultural Dialogical Probes. In Proceedings of the First African Conference on Human Computer Interaction (AfriCHI'16).
[61]
Alessandro Soro, Anita Lee Hong, Grace Shaw, Paul Roe, and Margot Brereton. 2015. A Noticeboard in "Both Worlds" Unsurprising Interfaces Supporting Easy Bi-Cultural Content Publication. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15), 2181--2186.
[62]
Lucy Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge University Press, Cambridge.
[63]
Jennyfer Lawrence Taylor, Alessandro Soro, Margot Brereton, Anita Lee Hong, and Paul Roe. 2016. Designing Evaluation Beyond Evaluating Design?: Measuring Success in Cross- - Cultural Projects. In Proceedings of the 28th Australian Conference on Computer-Human Interaction (OzCHI '16).
[64]
Jennyfer Lawrence Taylor, Alessandro Soro, Anita Lee Hong, Paul Roe, and Margot Brereton. 2016. Designing For Cross-Cultural Perspectives of Time. In Proceedings of AfriCHI 2016.
[65]
Jennyfer Lawrence Taylor, Alessandro Soro, Anita Lee Hong, Paul Roe, and Margot Brereton. 2017. "Situational When": Designing for Cross-Cultural Time Practices with an Australian Aboriginal Community. In Proceedings of CHI 2017, 6461-- 6474. Retrieved from
[66]
Cathy Urquhart, Hans Lehmann, and Michael D. Myers. 2010. Putting the "theory" back into grounded theory: Guidelines for grounded theory studies in information systems. Information Systems Journal 20, 4: 357--381.
[67]
Geoffrey Walford. 2009. The practice of writing ethnographic fieldnotes. Ethnography and Education 4, 2: 117--130.
[68]
Jill Woelfer and David Hendry. 2012. Homeless young people on social network sites. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12: 2825.
[69]
Tracee Vetting Wolf, Jennifer A Rode, Jeremy Sussman, and Wendy A Kellogg. 2006. Dispelling Design as the " Black Art " of CHI. In Proceedings of CHI 2016, 521--530.
[70]
John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of CHI 2007 (CHI '07), 493--502.

Cited By

View all

Index Terms

  1. “Debrief O'Clock”: Planning, Recording, and Making Sense of a Day in the Field in Design Research

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
    April 2018
    8489 pages
    ISBN:9781450356206
    DOI:10.1145/3173574
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 April 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. design research documentation
    2. field data
    3. field studies
    4. fieldnotes
    5. qualitative analysis

    Qualifiers

    • Research-article

    Funding Sources

    • Australian Research Council

    Conference

    CHI '18
    Sponsor:

    Acceptance Rates

    CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)54
    • Downloads (Last 6 weeks)5
    Reflects downloads up to 24 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media