technical-note

RepliCHI: the workshop II

Authors:

Max L. Wilson,

Ed H. Chi,

Stuart Reeves,

David CoyleAuthors Info & Claims

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Pages 33 - 36

https://doi.org/10.1145/2559206.2559233

Published: 26 April 2014 Publication History

Get Access

Abstract

The replication or recreation of research is a core part of many disciplines. Yet unlike many other disciplines, like medicine, physics, or mathematics, we have almost no drive and barely any reason to consider investigating the work of other HCI researchers. Our community is driven to publish novel results in novel spaces using novel designs, and to keep up with evolving technology. Further, our community contains a broad spectrum of research styles, from those that would aim to investigate cultural phenomenon observed with ethnographic measures, to those who would validate or refute prior work with experimental methods. The aim of this workshop is to continue to facilitate a cultural shift towards our community naturally adopting replication techniques in situations that are considered worth investigating.

References

[1]

Chhabra, S. and Resnick, P. NewsCube Replication: Experience Report. In Proc. RepliCHI 2013, 34--38.

Google Scholar

[2]

Crabtree, A., Tolmie, P. and Rouncefield, M. "How Many Bloody Examples Do You Want?" Fieldwork and Generalisation. In Proc. ECSCW 2013, Springer (2013) 1--20.

Crossref

Google Scholar

[3]

Greiffenhagen, C. and Reeves, S. Is Replication Important for HCI? In Proc. RepliCHI 2013, 8--13.

Google Scholar

[4]

Karnik, M., et al. Uses & gratifications of a facebook media sharing group. In Proc. CSCW 2013, ACM Press (2013), 821--826.

Digital Library

Google Scholar

[5]

Patil, S. RepliPRI: Challenges in Replicating Studies of Online Privacy. In Proc. RepliCHI 2013, 14--18.

Google Scholar

[6]

Rooksby, J. Can Plans and Situated Actions be Replicated? In Proc. CSCW 2014. ACM (in press).

Digital Library

Google Scholar

[7]

Tractinsky, N. Replicating and Extending Research on Relations between Visual Aesthetics and Usability. In Proc. RepliCHI 2013, 24--28.

Google Scholar

[8]

Wilson, M. L. Teaching HCI Methods: Replicating a Study of Collaborative Search. In Proc. RepliCHI 2013, 39--43.

Google Scholar

[9]

Wilson, M. L., Chi, E. H., Coyle, D. and Resnick, P. Proceedings of the CHI2013 Workshop on the Replication of HCI Research (RepliCHI 2013). Paris, FR.

Google Scholar

[10]

Wilson, M. L. and Mackay, W. RepliCHI We do not value replication of HCI research: discuss. In Ext Abs. CHI'11 (Panel), ACM (2011), 463--466.

Digital Library

Google Scholar

[11]

Wilson, M. L., Resnick, P., Coyle, D. and Chi, E. H. RepliCHI The Workshop. In Ext Abs. CHI'13 (Workshop), ACM (2013), 3159--3162.

Digital Library

Google Scholar

Cited By

View all

Yamanaka S(2024)Relative Merits of Nominal and Effective Indexes of Difficulty of Fitts’ Law: Effects of Sample Size and the Number of Repetitions on Model FitInternational Journal of Human–Computer Interaction10.1080/10447318.2024.230320141:1(574-591)Online publication date: 14-Jan-2024
https://doi.org/10.1080/10447318.2024.2303201
Deterding SCutting J(2023)Objective Difficulty-Skill Balance Impacts Perceived Balance but Not Behaviour: A Test of Flow and Self-Determination Theory PredictionsProceedings of the ACM on Human-Computer Interaction10.1145/36110657:CHI PLAY(1179-1205)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3611065
Wacharamanotham CYang FPu XSarma A(2023)Transparent Practices for Quantitative Empirical ResearchExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3574168(1-5)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3574168
Show More Cited By

Index Terms

RepliCHI: the workshop II
1. Information systems
  1. Information retrieval
  2. Information storage systems

Recommendations

RepliCHI: the workshop
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

The replication of, or perhaps the replicability of, research is often considered to be a cornerstone of scientific progress. Yet unlike many other disciplines, like medicine, physics, or mathematics, we have almost no drive and barely any reason to ...
RepliCHI - CHI should be replicating and validating results more: discuss
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

The replication of research findings is a cornerstone of good science. Replication confirms results, strengthens research, and makes sure progress is based on solid foundations. CHI, however, rewards novelty and is focused on new results. As a community,...
RepliCHI SIG: from a panel to a new submission venue for replication
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

At CHI2011 we ran a panel on how the CHI community handles the replicability of research and the reproducibility of findings. Careful scientific scholarship should build on firm foundations, which includes re-examining old evidences in the face of new ...

Comments

Information & Contributors

Information

Published In

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

April 2014

2620 pages

ISBN:9781450324748

DOI:10.1145/2559206

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Check for updates

Author Tags

Qualifiers

Technical-note

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI EA '14 Paper Acceptance Rate 1,000 of 3,200 submissions, 31%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
236
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 31 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Yamanaka S(2024)Relative Merits of Nominal and Effective Indexes of Difficulty of Fitts’ Law: Effects of Sample Size and the Number of Repetitions on Model FitInternational Journal of Human–Computer Interaction10.1080/10447318.2024.230320141:1(574-591)Online publication date: 14-Jan-2024
https://doi.org/10.1080/10447318.2024.2303201
Deterding SCutting J(2023)Objective Difficulty-Skill Balance Impacts Perceived Balance but Not Behaviour: A Test of Flow and Self-Determination Theory PredictionsProceedings of the ACM on Human-Computer Interaction10.1145/36110657:CHI PLAY(1179-1205)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3611065
Wacharamanotham CYang FPu XSarma A(2023)Transparent Practices for Quantitative Empirical ResearchExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3574168(1-5)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3574168
Salehzadeh Niksirat KGoswami LS. B. Rao PTyler JSilacci AAliyu SAebli AWacharamanotham CCherubini M(2023)Changes in Research Ethics, Openness, and Transparency in Empirical Studies between CHI 2017 and CHI 2022Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580848(1-23)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580848
Hidaka TSei YNishida NYamanaka SShizuki B(2023)Advanced Investigation of Steering Performance with Error-Accepting DelaysInternational Journal of Human–Computer Interaction10.1080/10447318.2023.219258640:14(3622-3635)Online publication date: 3-Apr-2023
https://doi.org/10.1080/10447318.2023.2192586
Yamanaka S(2022)Test-retest Reliability on Movement Times and Error Rates in Target PointingProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533450(178-188)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533450
Kitkowska AHögberg JWästlund E(2022)Online Terms and Conditions: Improving User Engagement, Awareness, and Satisfaction through UI DesignProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517720(1-22)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517720
Gould S(2022)Consumption experiences in the research processProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502001(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502001
Wacharamanotham CYang FPu XSarma APadilla L(2022)Transparent Practices for Quantitative Empirical ResearchExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3503760(1-5)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3503760
Vatavu RWobbrock J(2022)Clarifying Agreement Calculations and Analysis for End-User Elicitation StudiesACM Transactions on Computer-Human Interaction10.1145/347610129:1(1-70)Online publication date: 7-Jan-2022
https://dl.acm.org/doi/10.1145/3476101
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations