skip to main content
10.1145/3375462.3375478acmotherconferencesArticle/Chapter ViewAbstractPublication PageslakConference Proceedingsconference-collections
research-article

Perceptions and expectations about learning analytics from a brazilian higher education institution

Published: 23 March 2020 Publication History

Abstract

Several tools to support learning processes based on educational data have emerged from research on Learning Analytics (LA) in the last few years. These tools aim to support students and instructors in daily activities, and academic managers in making institutional decisions. Although the adoption of LA tools is spreading, the field still needs to deepen the understanding of the contexts where learning takes place, and of the views of the stakeholders involved in implementing and using these tools. In this sense, the SHEILA framework proposes a set of instruments to perform a detailed analysis of the expectations and needs of different stakeholders in higher education institutions, regarding the adoption of LA. Moreover, there is a lacuna in research on stakeholders' expectations from LA outside the Global North. Therefore, this paper reports on the findings of the application of interviews and focus groups, based on the SHEILA framework, with students and teaching staff from a Brazilian public university, to investigate their perceptions of the potential benefits and risks of using LA in higher education in the country. Findings indicate that there is a high interest in using LA for improving the learning experience, in particular, being able to provide personalized feedback, to adapt teaching practices to students' needs, and to make evidence-based pedagogical decisions. From the analysis of these perspectives, we point to opportunities for using LA in Brazilian higher education.

References

[1]
Ángel F Agudo-Peregrina, Santiago Iglesias-Pradas, Miguel Ángel Conde-González, and Ángel Hernández-García. 2014. Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning. Computers in human behavior 31 (2014), 542--550.
[2]
Kimberly E. Arnold, Grace Lynch, Daniel Huston, Lorna Wong, Linda Jorn, and Christopher W. Olsen. 2014. Building Institutional Capacities and Competencies for Systemic Learning Analytics Initiatives. In Proceedings of the Fourth International Conference on Learning Analytics And Knowledge. ACM, 257--260.
[3]
Simon Buckingham Shum, Ágnes Sándor, Rosalie Goldsmith, Xiaolong Wang, Randall Bass, and Mindy McWilliams. 2016. Reflecting on reflective writing analytics: Assessment challenges and iterative evaluation of a prototype tool. In Proceedings of the sixth international conference on learning analytics & knowledge. ACM, 213--222.
[4]
Shane Dawson, Oleksandra Poquet, Cassandra Colvin, Tim Rogers, Abelardo Pardo, and Dragan Gasevic. 2018. Rethinking Learning Analytics Adoption Through Complexity Leadership Theory. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge. ACM, 236--244.
[5]
Mollie Dollinger and Jason M. Lodge. 2018. Co-creation Strategies for Learning Analytics. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge. ACM, 97--101.
[6]
Henrique Lemos Dos Santos, Cristian Cechinel, João Batista Carvalho Nunes, and Xavier Ochoa. 2017. An initial review of learning analytics in Latin America. In Latin American Conference on Learning Technologies (LACLO). IEEE, 1--9.
[7]
Hendrik Drachsler and Wolfgang Greller. 2016. Privacy and Analytics: It's a DELICATE Issue a Checklist for Trusted Learning Analytics. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge. ACM, 89--98.
[8]
Taciana Pontual Falcao, Rafael Ferreira, Rodrigo Lins Rodrigues, Juliana Diniz, and Dragan Gasevic. 2019. Students' Perceptions about Learning Analytics in a Brazilian Higher Education Institution. In 2019 IEEE 19th International Conference on Advanced Learning Technologies (ICALT), Vol. 2161. IEEE, 204--206.
[9]
Rebecca Ferguson. 2012. Learning analytics: drivers, developments and challenges. International Journal of Technology Enhanced Learning 4, 5/6 (2012), 304--317.
[10]
Rebecca Ferguson, Leah Macfadyen, Doug Clow, Belinda Tynan, Shirley Alexander, and Shane Dawson. 2014. Setting Learning Analytics in Context: Overcoming the Barriers to Large-Scale Adoption. 1, 3 (2014), 120--144.
[11]
Dragan Gašević, Shane Dawson, and George Siemens. 2015. Let's not forget: Learning analytics are about learning. TechTrends 59, 1 (2015), 64--71.
[12]
Dragan Gašević. 2018. Include us all! Directions for adoption of learning analytics in the global south. In Learning analytics for the global south, Cher Ping Lim and Victoria L. Tinio (Eds.). Foundation for Information Technology Education and Development., Quezon City, Philippines, 1--22.
[13]
Joel A. Howell, Lynne D. Roberts, Kristen Seaman, and David C. Gibson. 2018. Are We on Our Way to Becoming a "Helicopter University"? Academics' Views on Learning Analytics. 23, 1 (2018), 1--20.
[14]
Jelena Jovanović, Dragan Gašević, Shane Dawson, Abelardo Pardo, Negin Mirriahi, et al. 2017. Learning analytics to unveil learning strategies in a flipped classroom. The Internet and Higher Education 33, 4 (2017), 74--85.
[15]
Phillip Long, George Siemens, Gráinne Conole, and Dragan Gasevic (Eds.). 2011. Proceedings of the 1st International Conference on Learning Analytics and Knowledge. ACM.
[16]
Jorge Maldonado-Mahauad, Isabel Hilliger, Tinne De Laet, Martijn Millecamp, Katrien Verbert, Xavier Ochoa, and Mar Pérez-Sanagustín. 2018. The LALA Project: Building Capacity to Use Learning Analytics to Improve Higher Education in Latin America. In Proceedings of the 8th international learning analytics & knowledge conference. 630--637.
[17]
Farshid Marbouti and Alyssa Friend Wise. 2016. Starburst: a new graphical interface to support purposeful attention to others' posts in online discussions. Educational Technology Research and Development 64, 1 (2016), 87--113.
[18]
Andino Maseleno, Noraisikin Sabani, Miftachul Huda, Roslee Ahmad, Kamarul Azmi Jasmi, and Bushrah Basiron. 2018. Demystifying learning analytics in personalised learning. International Journal of Engineering & Technology 7, 3 (2018), 1124--1129.
[19]
Meghan Oster, Steven Lonn, Matthew D. Pistilli, and Michael G. Brown. 2016. The Learning Analytics Readiness Instrument. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (LAK '16). ACM, 173--182.
[20]
Abelardo Pardo, Jelena Jovanovic, Shane Dawson, Dragan Gašević, and Negin Mirriahi. 2017. Using learning analytics to scale the provision of personalised feedback. British Journal of Educational Technology (2017).
[21]
Lynne D Roberts, Joel A Howell, Kristen Seaman, and David C Gibson. 2016. Student attitudes toward learning analytics in higher education:"The fitbit version of the learning world". Frontiers in psychology 7 (2016), 1959.
[22]
Paula Elizabeth Nogueira Sales and Rosemary Dore. 2015. Vocational education and training: An overview of dropout studies in Brazil. Perspectives on Community Practices: Living and Learning in Community (2015), 270.
[23]
Mar Perez Sanagustin, Isabel Hilliger, Jorge Maldonado, Ronald Perez, Luis Ramirez, Pedro J. Munoz-Merino, Yi-Shan Tsai, Margarita Ortiz, Tom Broos, Miguel Zuniga-Prieto, Eliana Sheihing, and Alexander Whitelock-Wainright. 2019. LALA Framework. Technical Report. Pontificia Universidad Catalica de Chile, Santiago, Chile. 138 pages.
[24]
Niall Sclater. 2016. Developing a Code of Practice for Learning Analytics. Journal of Learning Analytics 3, 1 (2016), 16--42.
[25]
George Siemens. 2013. Learning analytics: The emergence of a discipline. American Behavioral Scientist 57, 10 (2013), 1380--1400.
[26]
George Siemens, Shane Dawson, and Grace Lynch. 2013. Improving the quality and productivity of the higher education sector: policy and strategy for systems-level deployment of learning analytics. (2013), 35 pages.
[27]
João Silva, Jorge Luis Cavalcanti Ramos, Rodrigo Rodrigues, Hugo Souza, Fernando da Fonseca de Souza, and Alex Sandro Gomes. 2016. Uma abordagem para integração do Moodle com o framework Shiny para Learning Analytics. In Anais dos Workshops do Congresso Brasileiro de Informática na Educação, Vol. 5. 930.
[28]
Yi-Shan Tsai and Dragan Gasevic. 2017. Learning analytics in higher education---challenges and policies: a review of eight learning analytics policies. In Proceedings of the seventh international learning analytics & knowledge conference. ACM, 233--242.
[29]
Yi-Shan Tsai, Dragan Gašević, Alexander Whitelock-Wainwright, Pedro J. Muñoz-Merino, Pedro M. Moreno-Marcos, Aarón Rubio Fernández, Carlos Delgado Kloos, Maren Scheffel, Ioana Jivet, Hendrik Drachsler, Kairit Tammets, Adolfo Ruiz Calleja, and Kaire Kollom. 2018. SHEILA: Supporting higher education to integrate learning analytics. Technical Report. University of Edinburgh, Edinburgh, United Kingdom. 43 pages.
[30]
Yi-Shan Tsai, Pedro Manuel Moreno-Marcos, Ioana Jivet, Maren Scheffel, Kairit Tammets, Kaire Kollom, and Dragan Gaševic. 2018. The SHEILA Framework: Informing Institutional Strategies and Policy Processes of Learning Analytics. Journal of Learning Analytics 5, 3 (2018), 5--20.
[31]
Yi-Shan Tsai, Oleksandra Poquet, Dragan Gašević, Shane Dawson, and Abelardo Pardo. 2019. Complexity leadership in learning analytics: Drivers, challenges and opportunities. British Journal of Educational Technology (2019).
[32]
Katrien Verbert, Erik Duval, Joris Klerkx, Sten Govaerts, and José Luis Santos. 2013. Learning analytics dashboard applications. American Behavioral Scientist 57, 10 (2013), 1500--1509.
[33]
John Young and Enrique Mendizabal. 2009. Helping researchers become policy entrepreneurs: how to develop engagement strategies for evidence-based policymaking. Overseas Development Institute 53 (2009).

Cited By

View all

Index Terms

  1. Perceptions and expectations about learning analytics from a brazilian higher education institution

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      LAK '20: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge
      March 2020
      679 pages
      ISBN:9781450377126
      DOI:10.1145/3375462
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 23 March 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. higher education institutions
      2. human factors
      3. learning analytics
      4. qualitative research

      Qualifiers

      • Research-article

      Conference

      LAK '20

      Acceptance Rates

      LAK '20 Paper Acceptance Rate 80 of 261 submissions, 31%;
      Overall Acceptance Rate 236 of 782 submissions, 30%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)30
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 03 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)A shared lens around sensemaking in learning analytics: What activity theory, definition of a situation and affordances can offerBritish Journal of Educational Technology10.1111/bjet.13435Online publication date: 23-Jan-2024
      • (2024)Investigating the Potential and Challenges of Learning Analytics Tools in Brazilian Education Through Developer InsightsIEEE Access10.1109/ACCESS.2024.338617512(62834-62849)Online publication date: 2024
      • (2023)Survey of recent research topics on effective use of communication tools in higher education2023 46th MIPRO ICT and Electronics Convention (MIPRO)10.23919/MIPRO57284.2023.10159793(710-715)Online publication date: 22-May-2023
      • (2023)Learning Analytics Framework Applied to Training ContextTechnology and Innovation in Learning, Teaching and Education10.1007/978-3-031-22918-3_9(110-130)Online publication date: 1-Jan-2023
      • (2022)A Penny for your Thoughts: Students and Instructors’ Expectations about Learning Analytics in BrazilLAK22: 12th International Learning Analytics and Knowledge Conference10.1145/3506860.3506886(186-196)Online publication date: 21-Mar-2022
      • (2022)A Scenario-based Exploration of Expected Usefulness, Privacy Concerns, and Adoption Likelihood of Learning AnalyticsProceedings of the Ninth ACM Conference on Learning @ Scale10.1145/3491140.3528271(48-59)Online publication date: 1-Jun-2022
      • (2021)Subversive Learning AnalyticsLAK21: 11th International Learning Analytics and Knowledge Conference10.1145/3448139.3448210(639-645)Online publication date: 12-Apr-2021
      • (2021)Briefing and Geovisualizing on International Practices of Learning Analytics in Higher Education2021 International Conference on Advanced Learning Technologies (ICALT)10.1109/ICALT52272.2021.00109(342-344)Online publication date: Jul-2021
      • (2021)Aligning Expectations About the Adoption of Learning Analytics in a Brazilian Higher Education InstitutionArtificial Intelligence in Education10.1007/978-3-030-78270-2_31(173-177)Online publication date: 12-Jun-2021

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media