research-article

Structural validation and cross-cultural robustness of the European Cyberbullying Intervention Project Questionnaire

Authors:

Rosario Del Rey,

José A. Casas,

Rosario Ortega-Ruiz,

Anja Schultze-Krumbholz,

Herbert Scheithauer,

Vassilis Barkoukis,

Haralambos Tsorbatzoudis,

Antonella Brighi,

Annalisa Guarini,

Jacek Pyżalski,

Piotr PlichtaAuthors Info & Claims

Computers in Human Behavior, Volume 50, Issue C

Pages 141 - 147

https://doi.org/10.1016/j.chb.2015.03.065

Published: 01 September 2015 Publication History

Abstract

Cyberbullying is a dynamic relationship between the aggressor and the victim.Establishing the prevalence of cyberbullying is difficult due to the instruments used.The instrument validated integrates the traditional bullying characteristics.Differences in prevalence of cyberbullying among countries using a single instrument. During the last decade, cyberbullying has become an increasing concern which has been addressed by diverse theoretical and methodological approaches. As a result there is a debate about its nature and rigorously validated assessment instruments have not yet been validated. In this context, in the present study an instrument composed of 22 items representing the different types of behaviours and actions that define cyberbullying has been structurally validated and its cross-cultural robustness has been calculated for the two main dimensions: cyber-victimization and cyber-aggression. To this end, 5679 secondary school students from six European countries (Spain, Germany, Italy, Poland, United Kingdom, and Greece) were surveyed through this self-report questionnaire which was designed based on previously existing instruments and the most relevant conceptual elements. Exploratory and confirmatory factor analyses were conducted and the global internal consistency was computed for the instrument and its two dimensions. Identical factor structures were found across all of the six subsamples. The results contribute to existing research by providing an instrument, the European Cyberbullying Intervention Project Questionnaire, which has been structurally validated in a wide sample from six different countries and that is useful to evaluate psycho-educative interventions against cyberbullying.

References

[1]

M. Arsène, J.-P. Raynaud, Cyberbullying and child and adolescent psychopathology: Current state of knowledge, Neuropsychiatrie de l'Enfance et de l'Adolescence, 62 (2014) 249-256.

[2]

J. Baek, L.M. Bullock, Cyberbullying: A cross-cultural perspective, Emotional and Behavioural Difficulties, 19 (2014) 226-238.

[3]

D.L. Bandalos, Factors influencing cross-validation of confirmatory factor analysis models, Multivariate Behavioral Research, 28 (1993) 351-374.

[4]

P.M. Bentler, Factor simplicity index and transformations, Psychometrika, 42 (1977) 277-295.

[5]

P.M. Bentler, D.G. Bonett, Significance tests and goodness of fit in the analysis of covariance structures, Psychological Bulletin, 88 (1980) 588-606.

[6]

S. Berne, A. Frisén, A. Schultze-Krumbholz, H. Scheithauer, K. Naruskov, P. Luik, Cyberbullying assessment instruments: A systematic review, Aggression and Violent Behavior, 18 (2013) 320-334.

[7]

K.A. Bollen, Structural equations with latent variables, Wiley, New York, 1989.

[8]

Brighi, A., Ortega, R., Pyzalski, J., Scheithauer, H., Smith, P. K., Tsormpatzoudis, H., et al. (2012). European cyberbullying intervention project questionnaire - ECIPQ Unpublished questionnaire}. Retrieved from bullyingandcyber.net.

[9]

M.W. Browne, R. Cudeck, Alternative ways of assessing model fit, in: Testing structural equation models, Sage, Newbury Park, CA, 1993, pp. 111-135.

[10]

B.M. Byrne, Structural equation modeling with Eqs: Basic concepts, applications, and programming, Routledge, 2006.

[11]

B.M. Byrne, T.L. Campbell, Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure: A look beneath the surface, Journal of Cross-Cultural Psychology, 30 (1999) 555-574.

[12]

E. Calvete, I. Orue, A. Estévez, L. Villardón, P. Padilla, Cyberbullying in adolescents: Modalities and aggressors' profile, Computers in Human Behavior, 26 (2010) 1128-1135.

[13]

J.A. Casas, R. Del Rey, R. Ortega-Ruiz, Bullying and cyberbullying: Convergent and divergent predictor variables, Computers in Human Behavior, 29 (2013) 580-587.

[14]

F. Dehue, Cyberbullying research: New perspectives and alternative methodologies. Introduction to the Special Issue, Journal of Community & Applied Social Psychology, 23 (2013) 1-6.

[15]

A.G. Dempsey, M.L. Sulkowski, R. Nichols, E.A. Storch, Differences between peer victimization in cyber and physical settings and associated psychosocial adjustment in early adolescence, Psychology in the Schools, 46 (2009) 962-972.

[16]

A.H. Den Hamer, E.A. Konijn, Adolescents' Media exposure may increase their cyberbullying behavior: A longitudinal study, Journal of Adolescent Health, 56 (2015) 203-208.

[17]

J.J. Dooley, J. Py¿alski, D. Cross, Cyberbullying versus face-to-face bullying, Zeitschrift für Psychologie/Journal of Psychology, 217 (2009) 182-188.

[18]

Drabowicz, T. P. (2012). Digital Inequalities as Class Inequalities? A comparison of youth in advanced societies in-and outside Europe. European University Institute, Florence. Retrieved from http://hdl.handle.net/1814/23751.

[19]

J. Fenaughty, N. Harré, Factors associated with young people's successful resolution of distressing electronic harassment, Computers & Education, 61 (2013) 242-250.

Digital Library

[20]

D.B. Flora, P.J. Curran, An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data, Psychological Methods, 9 (2004) 466-491.

[21]

D.B. Flora, E.J. Finkel, V.A. Foshee, Higher order factor structure of a self-control test: Evidence from confirmatory factor analysis with polychoric correlations, Educational and Psychological Measurement, 63 (2003) 112-127.

[22]

G.D. Floros, K.E. Siomos, V. Fisoun, E. Dafouli, D. Geroukalis, Adolescent online cyberbullying in Greece: The impact of parental online security practices, bonding, and online impulsiveness, The Journal of School Health, 83 (2013) 445-453.

[23]

M. Gámez-Guadix, I. Orue, P.K. Smith, E. Calvete, Longitudinal and reciprocal relations of cyberbullying with depression, substance use, and problematic internet use among adolescents, Journal of Adolescent Health, 53 (2013) 446-452.

[24]

P. Gradinger, D. Strohmeier, C. Spiel, Traditional bullying and cyberbullying: Identification of risk groups for adjustment problems, Zeitschrift Für Psychologie/Journal of Psychology, 217 (2009) 205-213.

[25]

J.L. Greif, M.J. Furlong, The assessment of school bullying, Journal of School Violence, 5 (2006) 33-50.

[26]

C.M. Guckin, P.K. Cummins, C.A. Lewis, F2f and cyberbullying among children in Northern Ireland: Data from the Kids Life and Times Surveys, Psychology, Society & Education, 2 (2010) 83-96.

[27]

Heirman, W., & Walrave, M. (2008). Assessing concerns and issues about the mediation of technology in cyberbullying. Retrieved from <http://ir.anet.ua.ac.be/irua/handle/10067/731800151162165141>.

[28]

F.P. Holgado-Tello, S. Chacón-Moscoso, I. Barbero-García, E. Vila-Abad, Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables, Quality & Quantity, 44 (2010) 153-166.

[29]

K.G. Jöreskog, On the estimation of polychoric correlations and their asymptotic covariance matrix, Psychometrika, 59 (1994) 381-389.

[30]

Jöreskog, K. G., & Sörbom, D. (2012). Lisrel 9.1. Skokie: Scientific Software International, Inc. Retrieved from <http://www.ssicentral.com/lisrel/>.

[31]

S.B. Låftman, B. Modin, V. Östberg, Cyberbullying and subjective health. A large-scale study of students in Stockholm, Sweden, Children and Youth Services Review, 35 (2013) 112-119.

[32]

D.M. Law, J.D. Shapka, J.F. Domene, M.H. Gagné, Are cyberbullies really bullies? An investigation of reactive and proactive online aggression, Computers in Human Behavior, 28 (2012) 664-672.

[33]

D.M. Law, J.D. Shapka, S. Hymel, B.F. Olson, T. Waterhouse, The changing face of bullying: An empirical comparison between traditional and internet bullying and victimization, Computers in Human Behavior, 28 (2012) 226-232.

[34]

U. Lorenzo-Seva, A factor simplicity index, Psychometrika, 68 (2003) 49-60.

[35]

U. Lorenzo-Seva, P.J. Ferrando, FACTOR: A computer program to fit the exploratory factor analysis model, Behavior Research Methods, 38 (2006) 88-91.

[36]

T. Malti, D. Ribeaud, M. Eisner, Effectiveness of a universal school-based social competence program: The role of child characteristics and economic factors, International Journal of Conflict and Violence, 6 (2012) 249-259.

[37]

E. Menesini, A. Nocentini, Cyberbullying definition and measurement, Zeitschrift für Psychologie/Journal of Psychology, 217 (2009) 230-232.

[38]

E. Menesini, A. Nocentini, P. Calussi, The measurement of cyberbullying: Dimensional structure and relative item severity and discrimination, Cyberpsychology, Behavior, and Social Networking, 14 (2011) 267-274.

[39]

K.L. Modecki, J. Minchin, A.G. Harbaugh, N.G. Guerra, K.C. Runions, Bullying prevalence across contexts: A meta-analysis measuring cyber and traditional bullying, Journal of Adolescent Health, 55 (2014) 602-611.

[40]

M. de los Á. Morata-Ramírez, F.P. Holgado-Tello, Construct validity of likert scales through confirmatory factor analysis: A simulation study comparing different methods of estimation based on pearson and polychoric correlations, International Journal of Social Science Studies, 1 (2013) 54-61.

[41]

C.R. Müller, J. Pfetsch, A. Ittel, Ethical media competence as a protective factor against cyberbullying and cybervictimization among German school students, Cyberpsychology, Behavior and Social Networking, 17 (2014) 644-651.

[42]

A. Nocentini, J. Calmaestra, A. Schultze-Krumbholz, H. Scheithauer, R. Ortega, E. Menesini, Cyberbullying: Labels, behaviours and definition in three European countries, Australian Journal of Guidance and Counselling, 20 (2010) 129-142.

[43]

U. Olsson, Maximum likelihood estimation of the polychoric correlation coefficient, Psychometrika, 44 (1979) 443-460.

[44]

D. Olweus, Bullying at school: What we know and what we can do, Blackwell, Oxford, UK, Cambridge, USA, 1993.

[45]

D. Olweus, Cyberbullying: An overrated phenomenon?, European Journal of Developmental Psychology, 9 (2012) 520-538.

[46]

D. Olweus, School bullying: Development and some important challenges, in: Annual review of clinical psychology, Vol. 9, Annual Reviews, Palo Alto, 2013, pp. 751-780.

[47]

D. Olweus, Sweden, in: The nature of school bullying: A cross-national perspective, Routledge, London & New York, 1999, pp. 7-27.

[48]

S. Perren, L. Corcoran, H. Cowie, F. Dehue, D. Garcia, C. Mc Guckin, Tackling cyberbullying: Review of empirical evidence regarding successful responses by students, parents, and schools, International Journal of Conflict and Violence, 6 (2012) 283-293.

[49]

S. Perren, J. Dooley, T. Shaw, D. Cross, Bullying in school and cyberspace: Associations with depressive symptoms in Swiss and Australian adolescents, Child and Adolescent Psychiatry and Mental Health, 4 (2010) 28.

[50]

J.L. Pettalia, E. Levin, J. Dickinson, Cyberbullying: Eliciting harm without consequence, Computers in Human Behavior, 29 (2013) 2758-2765.

[51]

C.D. Pornari, J. Wood, Peer and cyber aggression in secondary school students: The role of moral disengagement, hostile attribution bias, and outcome expectancies, Aggressive Behavior, 36 (2010) 81-94.

[52]

J. Pyzalski, From cyberbullying to electronic aggression: Typology of the phenomenon, Emotional and Behavioural Difficulties, 17 (2012) 305-317.

[53]

R.A. Sabella, J.W. Patchin, S. Hinduja, Cyberbullying myths and realities, Computers in Human Behavior, 29 (2013) 2703-2711.

[54]

A. Satorra, P.M. Bentler, A scaled difference chi-square test statistic for moment structure analysis, Psychometrika, 66 (2001) 507-514.

[55]

R. Slonje, P.K. Smith, Cyberbullying: Another main type of bullying?, Scandinavian Journal of Psychology, 49 (2008) 147-154.

[56]

R. Slonje, P.K. Smith, A. Frisén, The nature of cyberbullying, and strategies for prevention, Computers in Human Behavior, 29 (2013) 26-32.

[57]

P.K. Smith, C. Del Barrio, R. Tokunaga, Definitions of bullying and cyberbullying: How useful are the terms?, in: Principles of cyberbullying research: Definition, methods, and measures, Routledge, New York & London, 2013, pp. 64-86.

[58]

P.K. Smith, F. Thompson, J. Davidson, Cyber safety for adolescent girls: bullying, harassment, sexting, pornography, and solicitation, Current Opinion in Obstetrics and Gynecology, 26 (2014) 360-365.

[59]

The science of self-report: Implications for research and practice, in: The science of self-report: Implications for research and practice, Psychology Press, London, 1999.

[60]

R.S. Tokunaga, Following you home from school: A critical review and synthesis of research on cyberbullying victimization, Computers in Human Behavior, 26 (2010) 277-287.

Digital Library

[61]

Tynes, C.A. Rose, D.R. Williams, The development and validation of the Online Victimization Scale for Adolescents, Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 4 (2010) 1-15.

[62]

H. Vandebosch, K. Van Cleemput, Defining cyberbullying: A qualitative research into the perceptions of youngsters, CyberPsychology & Behavior, 11 (2008) 499-503.

[63]

A.M. Vivolo-Kantor, B.N. Martell, K.M. Holland, R. Westby, A systematic review and content analysis of bullying and cyber-bullying measurement strategies, Aggression and Violent Behavior, 19 (2014) 423-434.

[64]

T. Völlink, C.A. Bolman, F. Dehue, N.C. Jacobs, Coping with cyberbullying: Differences between victims, bully-victims and children not involved in bullying, Journal of Community and Applied Social Psychology, 23 (2013) 7-24.

[65]

W. Wu, S.G. West, A.B. Taylor, Evaluating model fit for growth curve models: Integration of fit indices from SEM and MLM frameworks, Psychological Methods, 14 (2009) 183-201.

[66]

A. Yang, C. Salmivalli, Different forms of bullying and victimization: Bully-victims versus bullies and victims, European Journal of Developmental Psychology, 10 (2013) 723-738.

[67]

M.L. Ybarra, K.J. Mitchell, How risky are social networking sites? A comparison of places online where youth sexual solicitation and harassment occurs, Pediatrics, 121 (2008) e350-e357.

[68]

M.L. Ybarra, K.J. Mitchell, J.D. Korchmaros, National trends in exposure to and experiences of violence on the internet among children, Pediatrics, 128 (2011) e1376-e1386.

Cited By

Bührer SKoban KMatthes J(2024)The WWW of digital hate perpetrationComputers in Human Behavior10.1016/j.chb.2024.108321159:COnline publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.chb.2024.108321
Camacho ASmith POrtega-Ruiz RRomera E(2023)Joint trajectories of cyberbullying perpetration and victimizationComputers in Human Behavior10.1016/j.chb.2023.107924148:COnline publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1016/j.chb.2023.107924
Virgara JWhitten T(2023)A systematic literature review of the longitudinal risk factors associated with juvenile cyber-devianceComputers in Human Behavior10.1016/j.chb.2022.107613141:COnline publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1016/j.chb.2022.107613
Show More Cited By

Recommendations

Parental mediation, cyberbullying, and cybertrolling

Researchers are concerned with identifying the risk and protective factors associated with adolescents' involvement in cyberharassment. One such factor is parental mediation of children's electronic technology use. Little attention has been given to how ...
Pathological narcissism, cyberbullying victimization and offending among homosexual and heterosexual participants in online dating websites

Homosexual individuals are exposed to high levels of victimization. However, no studies have examined personality risk factors for cyberbullying victimization and offending among this population. This study investigated the relationships between ...
Prevalence of cyberbullying and predictors of cyberbullying perpetration among Korean adolescents

This study aimed to investigate the prevalence of cyberbullying and factors in cyberbullying perpetration with a national sample of 4000 adolescents selected through multi-stage cluster sampling. The respondents were 2166 boys (54.1%) and 1834 girls (...

Comments

Information & Contributors

Information

Published In

cover image Computers in Human Behavior

Computers in Human Behavior Volume 50, Issue C

September 2015

626 pages

ISSN:0747-5632

Issue’s Table of Contents

Copyright © Elsevier Ltd.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 September 2015

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bührer SKoban KMatthes J(2024)The WWW of digital hate perpetrationComputers in Human Behavior10.1016/j.chb.2024.108321159:COnline publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.chb.2024.108321
Camacho ASmith POrtega-Ruiz RRomera E(2023)Joint trajectories of cyberbullying perpetration and victimizationComputers in Human Behavior10.1016/j.chb.2023.107924148:COnline publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1016/j.chb.2023.107924
Virgara JWhitten T(2023)A systematic literature review of the longitudinal risk factors associated with juvenile cyber-devianceComputers in Human Behavior10.1016/j.chb.2022.107613141:COnline publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1016/j.chb.2022.107613
Aparisi DDelgado BBo R(2023)Latent profiles of cyberbullying among university students and its relationship with social anxiety and aggressivenessEducation and Information Technologies10.1007/s10639-023-11725-528:10(13269-13285)Online publication date: 24-Mar-2023
https://dl.acm.org/doi/10.1007/s10639-023-11725-5
Lan MLaw NPan Q(2022)Effectiveness of anti-cyberbullying educational programsComputers in Human Behavior10.1016/j.chb.2022.107200130:COnline publication date: 1-May-2022
https://dl.acm.org/doi/10.1016/j.chb.2022.107200
Bullo ASchulz P(2022)Do peer and parental norms influence media content-induced cyber aggression?Computers in Human Behavior10.1016/j.chb.2021.107136129:COnline publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1016/j.chb.2021.107136
Graf DYanagida TRunions KSpiel C(2022)Why did you do that? Differential types of aggression in offline and in cyberbullyingComputers in Human Behavior10.1016/j.chb.2021.107107128:COnline publication date: 1-Mar-2022
https://dl.acm.org/doi/10.1016/j.chb.2021.107107
Schunk FZeh FTrommsdorff G(2022)Cybervictimization and well-being among adolescents during the COVID-19 pandemicComputers in Human Behavior10.1016/j.chb.2021.107035126:COnline publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1016/j.chb.2021.107035
Piccoli VCarnaghi AGrassi MStragà MBianchi M(2020)Cyberbullying through the lens of social influenceComputers in Human Behavior10.1016/j.chb.2019.09.001102:C(260-273)Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.1016/j.chb.2019.09.001
Tomczyk Ł(2020)Skills in the area of digital safety as a key component of digital literacy among teachersEducation and Information Technologies10.1007/s10639-019-09980-625:1(471-486)Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.1007/s10639-019-09980-6
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents