skip to main content
research-article

Plan Early, Revise More: Effects of Goal Setting and Perceived Role of the Feedback Provider on Feedback Seeking Behavior

Published: 22 April 2021 Publication History

Abstract

Receiving feedback on preliminary work allows content creators to gain insight and improve outcomes. However, a lack of commitment for gathering feedback and experiencing evaluation apprehension can delay feedback seeking. In this paper, we operationalize goal setting theory for planning feedback goals and test the effects on feedback seeking and revision. In an online experiment, participants (N=245) wrote an initial story after planning feedback goals (or not), submitted the story for feedback at a time of their choice, and revised the story based on feedback received. Participants anticipated feedback from a supervisor or peer to induce different levels of evaluation apprehension. We found that participants who planned proximal feedback goals sought feedback when their stories were less developed and revised the stories more after receiving feedback compared to when participants planned distant goals. Additionally, participants who anticipated feedback from a supervisor, regardless of goal planning, improved the quality of their stories the most. We did not find that goal setting or the provider's role affected evaluation apprehension. Our findings indicate that content creators should be guided to plan proximal feedback goals to encourage sharing of early drafts of creative work and receive feedback from someone in a position of higher perceived power to foster the most revision and improvement on those drafts.

References

[1]
Louise Arnold, Carolyn K. Shue, Barbara Kritt, Shiphra Ginsburg, and David T. Stern. 2005. Medical students' views on peer assessment of professionalism. Journal of General Internal Medicine, Vol. 20, 9 (sep 2005), 819--824. https://doi.org/10.1111/j.1525--1497.2005.0162.x
[2]
S Ashford. 2003. Reflections on the Looking Glass: A Review of Research on Feedback-Seeking Behavior in Organizations. Journal of Management, Vol. 29, 6 (dec 2003), 773--799. https://doi.org/10.1016/S0149-2063(03)00079-5
[3]
Susan J Ashford and L.L. Cummings. 1983. Feedback as an individual resource: Personal strategies of creating information. Organizational Behavior and Human Performance, Vol. 32, 3 (dec 1983), 370--398. https://doi.org/10.1016/0030-5073(83)90156-3
[4]
SUSAN J. ASHFORD and L. L. CUMMINGS. 1985. Proactive feedback seeking: The instrumental use of the information environment. Journal of Occupational Psychology, Vol. 58, 1 (mar 1985), 67--79. https://doi.org/10.1111/j.2044-8325.1985.tb00181.x
[5]
Albert Bandura and Daniel Cervone. 1983. Self-evaluative and self-efficacy mechanisms governing the motivational effects of goal systems. Journal of Personality and Social Psychology, Vol. 45, 5 (1983), 1017--1028. https://doi.org/10.1037/0022-3514.45.5.1017
[6]
Albert Bandura and Dale H Schunk. 1981. Cultivating competence, self-efficacy, and intrinsic interest through proximal self-motivation. Journal of Personality and Social Psychology, Vol. 41, 3 (1981), 586--598. https://doi.org/10.1037/0022--3514.41.3.586
[7]
Aditya Bharadwaj, Pao Siangliulue, Adam Marcus, and Kurt Luther. 2019. Critter. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19. ACM Press, New York, New York, USA, 1--12. https://doi.org/10.1145/3290605.3300769
[8]
Julia Cambre, Scott Klemmer, and Chinmay Kulkarni. 2018. Juxtapeer. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--13. https://doi.org/10.1145/3173574.3173868
[9]
Kwangsu Cho and Charles MacArthur. 2010. Student revision with peer and expert reviewing. Learning and Instruction, Vol. 20, 4 (2010), 328--338. https://doi.org/10.1016/j.learninstruc.2009.08.006
[10]
Patrick A. Crain and Brian P. Bailey. 2017. Share Once or Share Often?. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition - C&C '17. ACM Press, New York, New York, USA, 80--92. https://doi.org/10.1145/3059454.3059476
[11]
D. De Stobbeleir, K. E. M., Ashford, S. J., & Buyens. 2011. Self-regulation of creativity at work: The role of feedback-seeking behavior in creative performance. Academy of Management Journal, Vol. 54, 4 (2011), 811--831.
[12]
Steven P Dow, Anand Kulkarni, Scott R Klemmer, Bjö rn Hartmann, and Stanford Hci Group. 2012. Shepherding the crowd yields better work. Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work - CSCW '12 (2012), 1013. https://doi.org/10.1145/2145204.2145355
[13]
Donald B. Fedor, Walter D. Davis, John M. Maslyn, and Kieran Mathieson. 2001. Performance improvement efforts in response to negative feedback: the roles of source power and recipient self-esteem. Journal of Management, Vol. 27, 1 (feb 2001), 79--97. https://doi.org/10.1177/014920630102700105
[14]
Eureka Foong, Steven P Dow, Brian P Bailey, and Elizabeth M Gerber. 2017. Online Feedback Exchange. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 4454--4467. https://doi.org/10.1145/3025453.3025791
[15]
Steve Graham, Karen R Harris, and Charles Macarthur. 2018. Self-regulation and writing. In Handbook of Self-Regulation of Learning and Performance 2 ed.), Dale H. Schunk and Jeffrey A. Greene (Eds.). Routledge, New York, NY, USA, Chapter 9, 138--152.
[16]
Emily Harburg, Daniel Rees Lewis, Matthew Easterday, and Elizabeth M. Gerber. 2018. CheerOn. ACM Transactions on Computer-Human Interaction, Vol. 25, 6 (dec 2018), 1--46. https://doi.org/10.1145/3241043
[17]
John Hattie and Helen Timperley. 2007. The Power of Feedback. Review of Educational Research, Vol. 77, 1 (2007), 81--112. https://doi.org/10.3102/003465430298487
[18]
Peter A Heslin, Jay B Carson, and Don Vandewalle. 2007. Practical applications of goal setting theory to performance management. February 2016 (2007), 1--15.
[19]
Catherine M Hicks, Vineet Pandey, C Ailie Fraser, and Scott Klemmer. 2016. Framing Feedback. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 458--469. https://doi.org/10.1145/2858036.2858195
[20]
Julie Hui, Amos Glenn, Rachel Jue, Elizabeth Gerber, and Steven Dow. 2015. Using Anonymity and Communal Efforts to Improve Quality of Crowdsourced Feedback. The Third AAAI Conference on Human Computation and Crowdsourcing (HCOMP-15) (2015), 72--82. https://www.aaai.org/ocs/index.php/HCOMP/HCOMP15/paper/viewFile/11580/11428
[21]
Julie S Hui, Elizabeth M Gerber, and Steven P Dow. 2014. Crowd-based design activities. In Proceedings of the 2014 conference on Designing interactive systems - DIS '14. ACM Press, New York, New York, USA, 875--884. https://doi.org/10.1145/2598510.2598538
[22]
Christopher Hundhausen, Anukrati Agrawal, Dana Fairbrother, and Michael Trevisan. 2009. Integrating pedagogical code reviews into a CS 1 course. ACM SIGCSE Bulletin, Vol. 41, 1 (mar 2009), 291. https://doi.org/10.1145/1539024.1508972
[23]
Avraham N. Kluger and Angelo DeNisi. 1996. The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, Vol. 119, 2 (1996), 254--284. https://doi.org/10.1037/0033--2909.119.2.254
[24]
Avraham N. Kluger and Angelo DeNisi. 2015. Creating creativity: user interfaces for supporting innovation. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, Vol. 44, 1 (2015), 487--515. https://doi.org/10.1145/2702123.2702525
[25]
Yasmine Kotturi and McKayla Kingston. 2019. Why do Designers in the "Wild" Wait to Seek Feedback until Later in their Design Process?. In Proceedings of the 2019 on Creativity and Cognition. ACM, New York, NY, USA, 541--546. https://doi.org/10.1145/3325480.3326580
[26]
Markus Krause, Tom Garncarz, Jiao Jiao Song, Elizabeth M. Gerber, Brian P. Bailey, and Steven P. Dow. 2017. Critique style guide: Improving crowdsourced design feedback with a natural language model. Conference on Human Factors in Computing Systems - Proceedings, Vol. 2017-May, May 2018 (2017), 4627--4639. https://doi.org/10.1145/3025453.3025883
[27]
Sneha R. Krishna Kumaran, Deana C. McDonagh, and Brian P. Bailey. 2017. Increasing Quality and Involvement in Online Peer Feedback Exchange. Proceedings of the ACM on Human-Computer Interaction, Vol. 1, CSCW (2017), 1--18. https://doi.org/10.1145/3134698
[28]
Chinmay E. Kulkarni, Michael S. Bernstein, and Scott R. Klemmer. 2015. PeerStudio. In Proceedings of the Second (2015) ACM Conference on Learning @ Scale - L@S '15. ACM Press, New York, New York, USA, 75--84. https://doi.org/10.1145/2724660.2724670
[29]
Edwin A. Locke. 1966. Relationship of Task Success to Satisfaction: Further Replication. Psychological Reports, Vol. 19, 3_suppl (dec 1966), 1132--1132. https://doi.org/10.2466/pr0.1966.19.3f.1132
[30]
Edwin A Locke. 1969. Purpose without Consciousness: A Contradiction. Psychological Reports, Vol. 25, 3 (dec 1969), 991--1009. https://doi.org/10.2466/pr0.1969.25.3.991
[31]
Edwin A Locke and Gary P Latham. 2002. Building a practically useful theory of goal setting and task motivation: A 35-year odyssey. American Psychologist, Vol. 57, 9 (2002), 705--717. https://doi.org/10.1037/0003-066X.57.9.705
[32]
Kurt Luther, Jari-lee Tolentino, Wei Wu, Amy Pavel, Brian P Bailey, Maneesh Agrawala, Bjö rn Hartmann, and Steven P Dow. 2015. Structuring, Aggregating, and Evaluating Crowdsourced Design Critique. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW '15. ACM Press, New York, New York, USA, 473--485. https://doi.org/10.1145/2675133.2675283
[33]
Mark Matthews, Elizabeth Murnane, and Jaime Snyder. 2017. Quantifying the Changeable Self: The Role of Self-Tracking in Coming to Terms With and Managing Bipolar Disorder. Human-Computer Interaction, Vol. 32, 5--6 (2017), 413--446. https://doi.org/10.1080/07370024.2017.1294983
[34]
Mary L. McHugh. 2012. Interrater reliability: the kappa statistic. Biochem Med (Zagreb), Vol. 22, 3 (2012), 276--282.
[35]
Gary E. McPherson, Peter Miksza, and Paul Evans. 2017. Self-Regulated Learning in Music Practice and Performance. In Handbook of Self-Regulation of Learning and Performance. Routledge, 181--193. https://doi.org/10.4324/9781315697048-12
[36]
Mark Meyers. 2014. March First Page Picture Prompt. https://kathytemean.wordpress.com/2014/03/14/free-fall-friday-editor-announced/
[37]
Hamideh Mozaffari. 2013. An Analytical Rubric for Assessing Creativity in Creative Writing. Theory and Practice in Language Studies, Vol. 3, 12 (2013), 2214--2219. https://doi.org/10.4304/tpls.3.12.2214-2219
[38]
Sean Munson and Sunny Consolvo. 2012. Exploring Goal-setting, Rewards, Self-monitoring, and Sharing to Motivate Physical Activity. In Proceedings of the 6th International Conference on Pervasive Computing Technologies for Healthcare. IEEE, 25--32. https://doi.org/10.4108/icst.pervasivehealth.2012.248691
[39]
Jasper O'Leary, Holger Winnemö ller, Wilmot Li, Mira Dontcheva, and Morgan Dixon. 2018. Charrette. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--11. https://doi.org/10.1145/3173574.3174109
[40]
Tracey Papinczak, Louise Young, and Michele Groves. 2007. Peer Assessment in Problem-Based Learning: A Qualitative Study. Advances in Health Sciences Education, Vol. 12, 2 (feb 2007), 169--186. https://doi.org/10.1007/s10459-005-5046-6
[41]
Wei Peng and Gary Hsieh. 2012. The influence of competition, cooperation, and player relationship in a motor performance centered computer game. Computers in Human Behavior, Vol. 28, 6 (nov 2012), 2100--2106. https://doi.org/10.1016/j.chb.2012.06.014
[42]
Babak Raji, Martin Tenpierik, and Andy van den Dobbelsteen. 2017. Early-Stage Design Considerations for the Energy-Efficiency of High-Rise Office Buildings. Sustainability, Vol. 9, 4 (apr 2017), 623. https://doi.org/10.3390/su9040623
[43]
Shalini T. Reddy, Matthew H. Zegarek, H. Barrett Fromme, Michael S. Ryan, Sarah-Anne Schumann, and Ilene B. Harris. 2015. Barriers and Facilitators to Effective Feedback: A Qualitative Analysis of Data From Multispecialty Resident Focus Groups. Journal of Graduate Medical Education, Vol. 7, 2 (jun 2015), 214--219. https://doi.org/10.4300/JGME-D-14-00461.1
[44]
Kelly A Rocca. 2010. Student Participation in the College Classroom: An Extended Multidisciplinary Literature Review. Communication Education, Vol. 59, 2 (apr 2010), 185--213. https://doi.org/10.1080/03634520903505936
[45]
D. Royce Sadler. 1989. Formative assessment and the design of instructional systems. Instructional Science, Vol. 18, 2 (1989), 119--144. https://doi.org/10.1007/BF00117714
[46]
Jessica Schroeder, Ravi Karkar, Natalia Murinova, James Fogarty, and Sean A. Munson. 2019. Examining Opportunities for Goal-Directed Self-Tracking to Support Chronic Condition Management. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 3, 4 (dec 2019), 1--26. https://doi.org/10.1145/3369809
[47]
Manya Sleeper, Alessandro Acquisti, Lorrie Faith Cranor, Patrick Gage Kelley, Sean A. Munson, and Norman Sadeh. 2015. I Would Like To..., I Shouldn't..., I Wish I.... In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW '15. ACM Press, New York, New York, USA, 1058--1069. https://doi.org/10.1145/2675133.2675193
[48]
Henry L. Tosi, Edwin A. Locke, and Gary P. Latham. 1991. A Theory of Goal Setting and Task Performance. The Academy of Management Review, Vol. 16, 2 (apr 1991), 480. https://doi.org/10.2307/258875
[49]
Yaacov Trope and Efrat Neter. 1994. Reconciling competing motives in self-evaluation: The role of self-control in feedback seeking. Journal of Personality and Social Psychology, Vol. 66, 4 (1994), 646--657. https://doi.org/10.1037/0022-3514.66.4.646
[50]
Jeffrey B. Vancouver and Elizabeth Wolfe Morrison. 1995. Feedback Inquiry: The Effect of Source Attributes and Individual Differences. Organizational Behavior and Human Decision Processes, Vol. 62, 3 (jun 1995), 276--285. https://doi.org/10.1006/obhd.1995.1050
[51]
Don VandeWalle. 2003. A goal orientation model of feedback-seeking behavior. Human Resource Management Review, Vol. 13, 4 (dec 2003), 581--604. https://doi.org/10.1016/j.hrmr.2003.11.004
[52]
Vimal Viswanathan and Julie Linsey. 2011. Design Fixation in Physical Modeling: An Investigation on the Role of Sunk Cost. In Volume 9: 23rd International Conference on Design Theory and Methodology; 16th Design for Manufacturing and the Life Cycle Conference, Vol. 9. ASMEDC, 119--130. https://doi.org/10.1115/DETC2011-47862
[53]
Vimal K. Viswanathan and Julie S. Linsey. 2013. Role of Sunk Cost in Engineering Idea Generation: An Experimental Investigation. Journal of Mechanical Design, Vol. 135, 12 (dec 2013), 1--12. https://doi.org/10.1115/1.4025290
[54]
Helen Wauck, Yu-Chun Yen, Wai-Tat Fu, Elizabeth Gerber, Steven P Dow, and Brian P Bailey. [n.d.]. From in the Class or in the Wild? Peers Provide Better Design Feedback Than External Crowds. ([n.,d.]). https://doi.org/10.1145/3025453.3025477
[55]
Jane R. Williams, Corey E. Miller, Lisa A. Steelman, and Paul E. Levy. 1999. Increasing feedback seeking in public contexts: It takes two (or more) to tango. Journal of Applied Psychology, Vol. 84, 6 (1999), 969--976. https://doi.org/10.1037/0021-9010.84.6.969
[56]
Y. Wayne Wu and Brian P. Bailey. 2017. Bitter Sweet or Sweet Bitter?. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 137--147. https://doi.org/10.1145/3059454.3059458
[57]
Y. Wayne Wu and Brian P. Bailey. 2018. Soften the Pain, Increase the Gain. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (nov 2018), 1--20. https://doi.org/10.1145/3274455
[58]
Anbang Xu, Shih-Wen Huang, and Brian Bailey. 2014. Voyant. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing - CSCW '14. ACM Press, New York, New York, USA, 1433--1444. https://doi.org/10.1145/2531602.2531604
[59]
Yu-chun Grace Yen, Steven P Dow, Elizabeth Gerber, and Brian P Bailey. 2016. Social Network, Web Forum, or Task Market?. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS '16. ACM Press, New York, New York, USA, 773--784. https://doi.org/10.1145/2901790.2901820
[60]
Yu-Chun Grace Yen, Steven P. Dow, Elizabeth Gerber, and Brian P. Bailey. 2017. Listen to Others, Listen to Yourself. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 158--170. https://doi.org/10.1145/3059454.3059468
[61]
Yu-chun Grace Yen, Joy O Kim, and Brian P Bailey. 2020. Decipher: An Interactive Visualization Tool for Interpreting Unstructured Design Feedback from Multiple Providers. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376380
[62]
Alvin Yuan, Kurt Luther, Markus Krause, Sophie Isabel Vennix, Steven P Dow, and Bjö rn Hartmann. 2016. Almost an Expert: The Effects of Rubrics and Expertise on Perceived Value of Crowdsourced Design Critiques. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing - CSCW '16. ACM Press, New York, New York, USA, 1003--1015. https://doi.org/10.1145/2818048.2819953
[63]
Barry J Zimmerman. 1990. Self-Regulated Learning and Academic Achievement: An Overview. Educational Psychologist, Vol. 25, 1 (jan 1990), 3--17. https://doi.org/10.1207/s15326985ep2501_2 arxiv: arXiv:1011.1669v3
[64]
Barry J. Zimmerman and Adam R. Moylan. 2009. Self-Regulation: where metacognition and motivation intersect. In Handbook of Metacognition in Education, Douglas J. Hacker, John Dunlosky, and Arthur C Graesser (Eds.). Routledge, New York, New York, USA, Chapter 16, 299--315.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction
Proceedings of the ACM on Human-Computer Interaction  Volume 5, Issue CSCW1
CSCW
April 2021
5016 pages
EISSN:2573-0142
DOI:10.1145/3460939
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 April 2021
Published in PACMHCI Volume 5, Issue CSCW1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. creative work
  2. evaluation apprehension
  3. formative feedback
  4. iteration
  5. self-regulation

Qualifiers

  • Research-article

Funding Sources

  • NSF

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)60
  • Downloads (Last 6 weeks)6
Reflects downloads up to 08 Feb 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media