skip to main content
10.1145/3597503.3639585acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
research-article
Open access

Shedding Light on Software Engineering-specific Metaphors and Idioms

Published: 12 April 2024 Publication History

Abstract

Use of figurative language, such as metaphors and idioms, is common in our daily-life communications, and it can also be found in Software Engineering (SE) channels, such as comments on GitHub. Automatically interpreting figurative language is a challenging task, even with modern Large Language Models (LLMs), as it often involves subtle nuances. This is particularly true in the SE domain, where figurative language is frequently used to convey technical concepts, often bearing developer affect (e.g., 'spaghetti code). Surprisingly, there is a lack of studies on how figurative language in SE communications impacts the performance of automatic tools that focus on understanding developer communications, e.g., bug prioritization, incivility detection. Furthermore, it is an open question to what extent state-of-the-art LLMs interpret figurative expressions in domain-specific communication such as software engineering. To address this gap, we study the prevalence and impact of figurative language in SE communication channels. This study contributes to understanding the role of figurative language in SE, the potential of LLMs in interpreting them, and its impact on automated SE communication analysis. Our results demonstrate the effectiveness of fine-tuning LLMs with figurative language in SE and its potential impact on automated tasks that involve affect. We found that, among three state-of-the-art LLMs, the best improved fine-tuned versions have an average improvement of 6.66% on a GitHub emotion classification dataset, 7.07% on a GitHub incivility classification dataset, and 3.71% on a Bugzilla bug report prioritization dataset.

References

[1]
R. Giora and O. Fein, "On understanding familiar and less-familiar figurative language," Journal of Pragmatics, vol. 31, no. 12, pp. 1601--1618, 1999.
[2]
L. Zhang, Y. Sun, H. Song, W. Wang, and G. Huang, "Detecting anti-patterns in java ee runtime system model," in Proceedings of the Fourth Asia-Pacific Symposium on Internetware. USA: ACM, 2012.
[3]
G. L. Steele, "Macaroni is better than spaghetti," in Proceedings of the 1977 Symposium on Artificial Intelligence and Programming Languages. USA: ACM, 1977, p. 60--66.
[4]
Z. Kövecses, "Emotion concepts: Social constructionism and cognitive linguistics," in The verbal communication of emotions. Psychology Press, 2002, pp. 117--132.
[5]
F. M. P. del Arco, M. D. Molina-González, L. A. Ureña-López, and M.-T. Martín-Valdivia, "Integrating implicit and explicit linguistic phenomena via multi-task learning for offensive language detection," Knowledge-Based Systems, vol. 258, p. 109965, 2022.
[6]
I. Ferreira, J. Cheng, and B. Adams, "The "shut the f**k up" phenomenon: Characterizing incivility in open source code review discussions," Proc. ACM Hum.-Comput. Interact., vol. 5, no. CSCW2, oct 2021.
[7]
D. Tiwari, T. Toady, M. Monperrus, and B. Baudry, "With great humor comes great developer engagement," ArXiv, vol. abs/2312.01680, 2023.
[8]
N. Novielli, F. Calefato, F. Lanubile, and A. Serebrenik, "Assessment of off-the-shelf se-specific sentiment analysis tools: An extended replication study," Empirical Softw. Engg., vol. 26, no. 4, jul 2021.
[9]
N. Novielli, F. Calefato, D. Dongiovanni, D. Girardi, and F. Lanubile, "Can we use se-specific sentiment analysis tools in a cross-platform setting?" in 2020 IEEE/ACM 17th International Conference on MSR. USA: IEEE Computer Society, may 2020, pp. 158--168.
[10]
M. M. Imran, Y. Jain, P. Chatterjee, and K. Damevski, "Data augmentation for improving emotion recognition in software engineering communication," in Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering. USA: ACM, 2023.
[11]
Z. Chen, Y. Cao, H. Yao, X. Lu, X. Peng, H. Mei, and X. Liu, "Emoji-powered sentiment and emotion detection from software developers' communication data," ACM TOSEM, vol. 30, no. 2, pp. 1--48, 2021.
[12]
X. Chen, C. Chen, D. Zhang, and Z. Xing, "Sethesaurus: Wordnet in software engineering," IEEE Transactions on Software Engineering, vol. 47, no. 9, pp. 1960--1979, 2019.
[13]
C. Chen, Z. Xing, and X. Wang, "Unsupervised software-specific morphological forms inference from informal discussions," in 2017 IEEE/ACM 39th ICSE. USA: IEEE Computer Society, may 2017, pp. 450--461.
[14]
C. V. Alexandru, J. J. Merchante, S. Panichella, S. Proksch, H. C. Gall, and G. Robles, "On the usage of pythonic idioms," in Proceedings of the 2018 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software. USA: ACM, 2018, p. 1--11.
[15]
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, "BERT: Pre-training of deep bidirectional transformers for language understanding," in Proceedings of the 2019 Conference of the NAACL: Human Language Technologies. Minneapolis, Minnesota: ACL, Jun. 2019, pp. 4171--4186.
[16]
Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi, D. Chen, O. Levy, M. Lewis, L. Zettlemoyer, and V. Stoyanov, "Roberta: A robustly optimized bert pretraining approach," ArXiv, vol. abs/1907.11692, 2019.
[17]
A. Ciborowska and K. Damevski, "Fast changeset-based bug localization with bert," in Proceedings of the 44th ICSE. USA: ACM, 2022, p. 946--957.
[18]
M. Ciniselli, N. Cooper, L. Pascarella, D. Poshyvanyk, M. D. Penta, and G. Bavota, "An empirical study on the usage of BERT models for code completion," in 18th IEEE/ACM International Conference on MSR. Madrid, Spain: IEEE, 2021, pp. 108--119.
[19]
B. Lin, F. Zampetti, G. Bavota, M. Di Penta, M. Lanza, and R. Oliveto, "Sentiment analysis for software engineering: How far can we go?" in Proceedings of the 40th ICSE. USA: ACM, 2018, p. 94--104.
[20]
O. Sghaier and H. Sahraoui, "A multi-step learning approach to assist code review," in 2023 IEEE International Conference on SANER. USA: IEEE Computer Society, mar 2023, pp. 450--460.
[21]
T. Zhang, B. Xu, F. Thung, S. Haryono, D. Lo, and L. Jiang, "Sentiment analysis for software engineering: How far can pre-trained transformer models go?" in 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME). USA: IEEE Computer Society, oct 2020, pp. 70--80.
[22]
J. Sarker, A. Turzo, and A. Bosu, "A benchmark study of the contemporary toxicity detectors on software engineering interactions," in 2020 27th Asia-Pacific Software Engineering Conference (APSEC). USA: IEEE Computer Society, dec 2020, pp. 218--227.
[23]
C. Su, F. Fukumoto, X. Huang, J. Li, R. Wang, and Z. Chen, "DeepMet: A reading comprehension paradigm for token-level metaphor detection," in Proceedings of the Second Workshop on Figurative Language Processing. Online: ACL, Jul. 2020, pp. 30--39.
[24]
G. Gamage, D. D. Silva, A. Adikari, and D. Alahakoon, "A bert-based idiom detection model," in 15th International Conference on Human System Interaction. Melbourne, Australia: IEEE, 2022, pp. 1--5.
[25]
J. Briskilal and C. Subalalitha, "An ensemble model for classifying idioms and literal texts using bert and roberta," Information Processing & Management, vol. 59, no. 1, p. 102756, 2022.
[26]
W. Song, S. Zhou, R. Fu, T. Liu, and L. Liu, "Verb metaphor detection via contextual relation learning," in Proceedings of the 59th Annual Meeting of the ACL and the 11th IJCNLP. Online: ACL, Aug. 2021, pp. 4240--4251.
[27]
K. Stowe, P. Utama, and I. Gurevych, "IMPLI: Investigating NLI models' performance on figurative language," in Proceedings of the 60th Annual Meeting of the ACL. Dublin, Ireland: ACL, May 2022, pp. 5375--5388.
[28]
S. R. Bowman, G. Angeli, C. Potts, and C. D. Manning, "A large annotated corpus for learning natural language inference," in Proceedings of the 2015 Conference on EMNLP. Lisbon, Portugal: ACL, Sep. 2015, pp. 632--642.
[29]
S. R. Bowman, J. Palomaki, L. Baldini Soares, and E. Pitler, "New protocols and negative results for textual entailment data collection," in Proceedings of the 2020 Conference on EMNLP. Online: ACL, Nov. 2020, pp. 8203--8214.
[30]
S. M. Mohammad, "9 - sentiment analysis: Detecting valence, emotions, and other affectual states from text," in Emotion Measurement, H. L. Meiselman, Ed. United Kingdom: Woodhead Publishing, 2016, pp. 201--237.
[31]
A. v. d. Oord, Y. Li, and O. Vinyals, "Representation learning with contrastive predictive coding," ArXiv, vol. abs/1807.03748, 2018.
[32]
P. Chatterjee, K. Damevski, and L. L. Pollock, "Automatic extraction of opinion-based q&a from online developer chats," in 43rd IEEE/ACM International Conference on Software Engineering, ICSE 2021. Madrid, Spain: IEEE, 2021, pp. 1260--1272.
[33]
B. Lin, N. Cassee, A. Serebrenik, G. Bavota, N. Novielli, and M. Lanza, "Opinion mining for software development: A systematic literature review," ACM Trans. Softw. Eng. Methodol., vol. 31, no. 3, mar 2022.
[34]
W.-Y. Wang, C.-H. Wu, and J. He, "Clebpi: Contrastive learning for bug priority inference," Information and Software Technology, vol. 164, p. 107302, 2023.
[35]
Y. Tian, D. Lo, X. Xia, and C. Sun, "Automated prediction of bug report priority using multi-factor analysis," Empirical Software Engineering, vol. 20, no. 5, pp. 1354--1383, 10 2015.
[36]
Q. Umer, H. Liu, and Y. Sultan, "Emotion based automated priority prediction for bug reports," IEEE Access, vol. 6, pp. 35 743--35 752, 2018.
[37]
Q. Umer, H. Liu, and I. Illahi,"Cnn-based automatic prioritization of bug reports," IEEE Transactions on Reliability, vol. 69, no. 4, pp. 1341--1354, 2019.
[38]
A. Murgia, P. Tourani, B. Adams, and M. Ortu, "Do developers feel emotions? an exploratory analysis of emotions in software artifacts," in Proceedings of the 11th Working Conference on MSR. USA: ACM, 2014, p. 262--271.
[39]
E. Biswas, M. Karabulut, L. Pollock, and K. Vijay-Shanker, "Achieving reliable sentiment analysis in the software engineering domain using bert," in 2020 IEEE ICSME. USA: IEEE Computer Society, oct 2020, pp. 162--173.
[40]
Y. Nie, A. Williams, E. Dinan, M. Bansal, J. Weston, and D. Kiela, "Adversarial NLI: A new benchmark for natural language understanding," in Proceedings of the 58th Annual Meeting of the ACL. Online: ACL, Jul. 2020, pp. 4885--4901.
[41]
T. Chakrabarty, A. Saakyan, D. Ghosh, and S. Muresan, "FLUTE: Figurative language understanding through textual explanations," in Proceedings of the 2022 Conference on EMNLP. Abu Dhabi, United Arab Emirates: ACL, Dec. 2022, pp. 7139--7159.
[42]
P. Group, "Mip: A method for identifying metaphorically used words in discourse," Metaphor and Symbol, vol. 22, no. 1, pp. 1--39, 2007.
[43]
E.-L. Do Dinh, H. Wieland, and I. Gurevych, "Weeding out conventionalized metaphors: A corpus of novel metaphor annotations," in Proceedings of the 2018 Conference on EMNLP. Brussels, Belgium: ACL, Oct.-Nov. 2018, pp. 1412--1424.
[44]
J. Zhou, H. Gong, and S. Bhat, "PIE: A parallel idiomatic expression corpus for idiomatic sentence generation and paraphrasing," in Proceedings of the 17th Workshop on Multiword Expressions (MWE 2021). Online: ACL, Aug. 2021, pp. 33--48.
[45]
H. Haagsma, J. Bos, and M. Nissim, "MAGPIE: A large corpus of potentially idiomatic expressions," in Proceedings of the Twelfth Language Resources and Evaluation Conference. Marseille, France: European Language Resources Association, May 2020, pp. 279--287.
[46]
OpenAI, "Gpt-4 technical report," ArXiv, vol. abs/2303.08774, 2023.
[47]
F. Gilardi, M. Alizadeh, and M. Kubli, "Chatgpt outperforms crowd workers for text-annotation tasks," Proceedings of the National Academy of Sciences, vol. 120, no. 30, p. e2305016120, 2023.
[48]
F. Huang, H. Kwak, and J. An, "Is chatgpt better than human annotators? potential and limitations of chatgpt in explaining implicit hate speech," in Companion Proceedings of the ACM Web Conference 2023. USA: ACM, 2023, p. 294--297.
[49]
J. Kocoń, I. Cichecki, O. Kaszyca, M. Kochanek, D. Szydło, J. Baran, J. Bielaniewicz, M. Gruza, A. Janz, K. Kanclerz, A. Kocoń, B. Koptyra, W. Mieleszczenko-Kowszewicz, P. Miłkowski, M. Oleksy, M. Piasecki, Łukasz Radliński, K. Wojtasik, S. Woźniak, and P. Kazienko, "Chatgpt: Jack of all trades, master of none," Information Fusion, vol. 99, p. 101861, 2023.
[50]
T. Chakrabarty, D. Ghosh, A. Poliak, and S. Muresan, "Figurative language in recognizing textual entailment," in Findings of the ACL: ACL-IJCNLP 2021. Online: ACL, Aug. 2021, pp. 3354--3361.
[51]
Z. Lan, M. Chen, S. Goodman, K. Gimpel, P. Sharma, and R. Soricut, "Albert: A lite bert for self-supervised learning of language representations," ArXiv, vol. abs/1909.11942, 2019.
[52]
H. Batra, N. S. Punn, S. K. Sonbhadra, and S. Agarwal, "Bert-based sentiment analysis: A software engineering perspective," in Database and Expert Systems Applications: 32nd International Conference, DEXA 2021. Berlin, Heidelberg: Springer-Verlag, 2021, p. 138--148.
[53]
R. Mao, Q. Liu, K. He, W. Li, and E. Cambria, "The biases of pre-trained language models: An empirical study on prompt-based sentiment analysis and emotion detection," IEEE Trans. Affect. Comput., vol. 14, no. 3, pp. 1743--1753, 2023.
[54]
Z. Feng, D. Guo, D. Tang, N. Duan, X. Feng, M. Gong, L. Shou, B. Qin, T. Liu, D. Jiang, and M. Zhou, "CodeBERT: A pre-trained model for programming and natural languages," in Findings of the ACL: EMNLP 2020. Online: ACL, Nov. 2020, pp. 1536--1547.
[55]
N. Reimers and I. Gurevych, "Sentence-BERT: Sentence embeddings using Siamese BERT-networks," in Proceedings of the 2019 Conference on EMNLP-IJCNLP. Hong Kong, China: ACL, Nov. 2019, pp. 3982--3992.
[56]
M. M. Imran, A. Ciborowska, and K. Damevski, "Automatically selecting follow-up questions for deficient bug reports," in 18th IEEE/ACM International Conference on Mining Software Repositories. Madrid, Spain: IEEE, 2021, pp. 167--178.
[57]
K. Ethayarajh, "How contextual are contextualized word representations? Comparing the geometry of BERT, ELMo, and GPT-2 embeddings," in Proceedings of the 2019 Conference on EMNLP-IJCNLP. Hong Kong, China: ACL, Nov. 2019, pp. 55--65.
[58]
H. Yan, L. Gui, W. Li, and Y. He, "Addressing token uniformity in transformers via singular value transformation," in Proceedings of the 38th Conference on Uncertainty in Artificial Intelligence, vol. 180. Eindhoven, The Netherlands: PMLR, 2022, pp. 2181--2191.
[59]
L. B. Godfrey and M. S. Gashler, "A continuum among logarithmic, linear, and exponential functions, and its potential to improve generalization in neural networks," in 2015 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K). USA: IEEE Computer Society, nov 2015, pp. 481--486.
[60]
W. H. Gomaa, A. A. Fahmy et al., "A survey of text similarity approaches," international journal of Computer Applications, vol. 68, no. 13, pp. 13--18, 2013.
[61]
N. Cliff, "Dominance statistics: Ordinal analyses to answer ordinal questions." Psychological Bulletin, vol. 114, pp. 494--509, 1993.
[62]
S. Mohammad, E. Shutova, and P. Turney, "Metaphor as a medium for emotion: An empirical study," in Proceedings of the Fifth Joint Conference on Lexical and Computational Semantics. Germany: ACL, Aug. 2016, pp. 23--33.
[63]
D. Graziotin, X. Wang, and P. Abrahamsson, "Do feelings matter? on the correlation of affects and the self-assessed productivity in software engineering," J. Softw. Evol. Process, vol. 27, no. 7, p. 467--487, jul 2015.
[64]
N. Raman, M. Cao, Y. Tsvetkov, C. Kästner, and B. Vasilescu, "Stress and burnout in open source: Toward finding, understanding, and mitigating unhealthy interactions," in Proceedings of the ACM/IEEE 42nd ICSE: NIER. USA: ACM, 2020, p. 57--60.
[65]
D. Graziotin, F. Fagerholm, X. Wang, and P. Abrahamsson, "On the unhappiness of software developers," in Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering. USA: ACM, 2017, p. 324--333.
[66]
N. Novielli, D. Girardi, and F. Lanubile, "A benchmark study on sentiment analysis for software engineering research," in Proceedings of the 15th International Conference on MSR. USA: ACM, 2018, p. 364--375.
[67]
C. Sun, X. Qiu, Y. Xu, and X. Huang, "How to fine-tune bert for text classification?" in Chinese Computational Linguistics. Cham: Springer International Publishing, 2019, pp. 194--206.
[68]
Z. Ke, H. Xu, and B. Liu, "Adapting BERT for continual learning of a sequence of aspect sentiment classification tasks," in Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Online: ACL, Jun. 2021, pp. 4746--4755.
[69]
A. Chiorrini, C. Diamantini, A. Mircoli, and D. Potena, "Emotion and sentiment analysis of tweets using BERT," in Proceedings of the Workshops of the EDBT/ICDT 2021 Joint Conference, ser. CEUR Workshop Proceedings, vol. 2841. Nicosia, Cyprus: CEUR-WS.org, 2021.
[70]
E. Liu, C. Cui, K. Zheng, and G. Neubig, "Testing the ability of language models to interpret figurative language," in Proceedings of the 2022 Conference of the NAACL: Human Language Technologies. Seattle, United States: ACL, Jul. 2022, pp. 4437--4452.
[71]
T. Chen, S. Kornblith, M. Norouzi, and G. Hinton, "A simple framework for contrastive learning of visual representations," in International conference on machine learning. PMLR, 2020, pp. 1597--1607.
[72]
I. Ferreira, B. Adams, and J. Cheng, "How heated is it? understanding github locked issues," in 2022 IEEE/ACM 19th International Conference on Mining Software Repositories. USA: IEEE Computer Society, may 2022, pp. 309--320.
[73]
Z. Botev and A. Ridder, "Variance reduction," Wiley statsRef: Statistics reference online, pp. 1--6, 2017.
[74]
N. S. Suhaimi, Z. Othman, and M. R. Yaakub, "Comparative analysis between macro and micro-accuracy in imbalance dataset for movie review classification," in Proceedings of Seventh International Congress on Information and Communication Technology. Singapore: Springer Nature Singapore, 2023, pp. 83--93.
[75]
Y. Tian, D. Lo, and C. Sun, "Drone: Predicting priority of reported bugs by multi-factor analysis," in 2013 IEEE International Conference on Software Maintenance (ICSM). USA: IEEE Computer Society, sep 2013, pp. 200--209.
[76]
J. Dominic, C. Ritter, and P. Rodeghero, "Onboarding bot for newcomers to software engineering," in 2020 IEEE/ACM International Conference on Software and System Processes (ICSSP). USA: IEEE Computer Society, jun 2020, pp. 91--94.
[77]
I. d. F. Junior, S. Marczak, R. Santos, C. Rodrigues, and H. Moura, "C2m: a maturity model for the evaluation of communication in distributed software development," Empirical Software Engineering, vol. 27, no. 7, p. 188, 2022.
[78]
R. Joseph, T. Liu, A. B. Ng, S. See, and S. Rai, "NewsMet: A 'do it all' dataset of contemporary metaphors in news headlines," in Findings of the Association for Computational Linguistics: ACL 2023. Toronto, Canada: ACL, Jul. 2023, pp. 10 090--10 104.
[79]
K. Hilton, A. Siami Namin, and K. S. Jones, "Metaphor identification in cybersecurity texts: a lightweight linguistic approach," SN Applied Sciences, vol. 4, no. 2, p. 60, 2022.
[80]
U. Naseem, J. Kim, M. Khushi, and A. G. Dunn, "Robust identification of figurative language in personal health mentions on twitter," IEEE Transactions on Artificial Intelligence, vol. 4, no. 2, pp. 362--372, 2022.
[81]
T. Wijesiriwardene, A. Sheth, V. L. Shalin, and A. Das, "Why do we need neurosymbolic ai to model pragmatic analogies?" IEEE Intelligent Systems, vol. 38, no. 5, pp. 12--16, 2023.
[82]
S. R. Fussell and M. M. Moss, "Figurative language in emotional communication," in Social and cognitive approaches to interpersonal communication. Psychology Press, 2014, pp. 113--141.
[83]
A. Esmaeilzadeh and K. Taghva, "Text classification using neural network language model (nnlm) and bert: An empirical comparison," in Intelligent Systems and Applications, K. Arai, Ed. Cham: Springer International Publishing, 2022, pp. 175--189.
[84]
Z. Liu, S.-h. Lei, Y.-l. Guo, and Z.-a. Zhou, "The interaction effect of online review language style and product type on consumers' purchase intentions," Palgrave Communications, vol. 6, no. 1, p. 11, 2020.
[85]
A. Kronrod and S. Danziger, ""Wii Will Rock You!" The Use and Effect of Figurative Language in Consumer Reviews of Hedonic and Utilitarian Consumption," Journal of Consumer Research, vol. 40, no. 4, pp. 726--739, 07 2013.
[86]
D. R. Recupero, M. Alam, D. Buscaldi, A. Grezka, and F. Tavazoee, "Frame-based detection of figurative language in tweets [application notes]," IEEE Comput. Intell. Mag., vol. 14, no. 4, pp. 77--88, 2019.
[87]
L. Weitzel, R. C. Prati, and R. F. Aguiar, The Comprehension of Figurative Language: What Is the Influence of Irony and Sarcasm on NLP Techniques? Cham: Springer International Publishing, 2016, pp. 49--74.
[88]
E. Shutova, "Models of metaphor in nlp," in Proceedings of the 48th Annual Meeting of the ACL. USA: ACL, 2010, p. 688--697.
[89]
Y. Hao and T. Veale, "An ironic fist in a velvet glove: Creative mis-representation in the construction of ironic similes," Minds and Machines, vol. 20, pp. 635--650, 2010.
[90]
J. Peng and A. Feldman, "Automatic idiom recognition with word embeddings," in Information Management and Big Data. Cham: Springer International Publishing, 2017, pp. 17--29.
[91]
M. S. McGlone, "Conceptual metaphors and figurative language interpretation: Food for thought?" Journal of Memory and Language, vol. 35, no. 4, pp. 544--565, 1996.
[92]
T. Veale and Y. Hao, "A fluid knowledge representation for understanding and generating creative metaphors," in Proceedings of the 22nd International Conference on Computational Linguistics (Coling 2008). Manchester, UK: Coling 2008 Organizing Committee, Aug. 2008, pp. 945--952.
[93]
J. H. Martin, "A corpus-based analysis of context effects on metaphor comprehension," Trends in Linguistics Studies and Monographs, vol. 171, p. 214, 2006.
[94]
B. Liu, Sentiment Analysis - Mining Opinions, Sentiments, and Emotions. Cambridge, United Kingdom: Cambridge University Press, 2015.
[95]
M. Munezero, C. Montero, E. Sutinen, and J. Pajunen, "Are they different? affect, feeling, emotion, sentiment, and opinion detection in text," IEEE Transactions on Affective Computing, vol. 5, no. 02, pp. 101--111, apr 2014.
[96]
P. Chatterjee, K. Damevski, N. A. Kraft, and L. Pollock, "Automatically identifying the quality of developer chats for post hoc use," ACM TOSEM, vol. 30, no. 4, jul 2021.
[97]
N. Novielli, F. Calefato, and F. Lanubile, "A gold standard for emotion annotation in stack overflow," in Proceedings of the 15th International Conference on Mining Software Repositories. USA: ACM, 2018, p. 14--17.
[98]
A. Sajadi, K. Damevski, and P. Chatterjee, "Interpersonal trust in oss: Exploring dimensions of trust in github pull requests," in 2023 IEEE/ACM 45th International Conference on Software Engineering: NIER. USA: IEEE Computer Society, may 2023, pp. 19--24.
[99]
Z. Chen, Y. Cao, X. Lu, Q. Mei, and X. Liu, "Sentimoji: An emoji-powered learning approach for sentiment analysis in software engineering," in Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. USA: ACM, 2019, p. 841--852.
[100]
M. R. Islam and M. F. Zibran, "Leveraging automated sentiment analysis in software engineering," in Proceedings of the 14th International Conference on Mining Software Repositories, J. M. González-Barahona, A. Hindle, and L. Tan, Eds. Buenos Aires, Argentina: IEEE Computer Society, 2017, pp. 203--214.
[101]
I. Ferreira, A. Rafiq, and J. Cheng, "Incivility detection in open source code review and issue discussions," Journal of Systems and Software, p. 111935, 2023.
[102]
F. A. Acheampong, H. Nunoo-Mensah, and W. Chen, "Transformer models for text-based emotion detection: A review of bert-based approaches," Artif. Intell. Rev., vol. 54, no. 8, p. 5789--5829, dec 2021.
[103]
J. Sarker, "Identification and mitigation of toxic communications among open source software developers," in Proceedings of the 37th ICSE. USA: ACM, 2023.
[104]
O. Chaparro, J. Florez, U. Singh, and A. Marcus, "Reformulating queries for duplicate bug report detection," in 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER). USA: IEEE Computer Society, feb 2019, pp. 218--229.
[105]
O. Chaparro, J. Lu, F. Zampetti, L. Moreno, M. Di Penta, A. Marcus, G. Bavota, and V. Ng, "Detecting missing information in bug descriptions," in Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering. USA: ACM, 2017, p. 396--407.
[106]
L. A. F. Gomes, R. da Silva Torres, and M. L. Côrtes, "Bug report severity level prediction in open source software: A survey and research opportunities," Information and Software Technology, vol. 115, pp. 58--78, 2019.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICSE '24: Proceedings of the IEEE/ACM 46th International Conference on Software Engineering
May 2024
2942 pages
ISBN:9798400702174
DOI:10.1145/3597503
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

In-Cooperation

  • Faculty of Engineering of University of Porto

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 April 2024

Check for updates

Qualifiers

  • Research-article

Conference

ICSE '24
Sponsor:

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 316
    Total Downloads
  • Downloads (Last 12 months)316
  • Downloads (Last 6 weeks)45
Reflects downloads up to 06 Jan 2025

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media