Sensory, cognitive, and sensorimotor learning effects in recognition memory for music
Pages 1111 - 1126
Abstract
Recent research suggests that perception and action are strongly interrelated and that motor experience may aid memory recognition. We investigated the role of motor experience in auditory memory recognition processes by musicians using behavioral, ERP, and neural source current density measures. Skilled pianists learned one set of novel melodies by producing them and another set by perception only. Pianists then completed an auditory memory recognition test during which the previously learned melodies were presented with or without an out-of-key pitch alteration while the EEG was recorded. Pianists indicated whether each melody was altered from or identical to one of the original melodies. Altered pitches elicited a larger N2 ERP component than original pitches, and pitches within previously produced melodies elicited a larger N2 than pitches in previously perceived melodies. Cortical motor planning regions were more strongly activated within the time frame of the N2 following altered pitches in previously produced melodies compared with previously perceived melodies, and larger N2 amplitudes were associated with greater detection accuracy following production learning than perception learning. Early sensory N1 and later cognitive P3a components elicited by pitch alterations correlated with predictions of sensory echoic and schematic tonality models, respectively, but only for the perception learning condition, suggesting that production experience alters the extent to which performers rely on sensory and tonal recognition cues. These findings provide evidence for distinct time courses of sensory, schematic, and motoric influences within the same recognition task and suggest that learned auditory-motor associations influence responses to out-of-key pitches.
References
[1]
Bamiou, D. E., Musiek, F. E., & Luxon, L. M. (2003). The insula (Island of Reil) and its role in auditory processing: Literature review. Brain Research Reviews, 42, 143-154.
[2]
Besson, M., & Faita, F. (1995). An event-related potential (ERP) study of musical expectancy: Comparison of musicians with nonmusicians. Journal of Experimental Psychology: Human Perception and Performance, 21, 1278-1296.
[3]
Bharucha, J. J. (1987). Music cognition and perceptual facilitation: A connectionist framework. Music Perception, 5, 1-30.
[4]
Bigand, E., Delbé, C., Poulin-Charronnat, B., Leman, M., & Tillmann, B. (2014). Empirical evidence for musical syntax processing? Computer simulations reveal the contribution of auditory short-term memory. Frontiers in Systems Neuroscience, 8, 1-27.
[5]
Bigand, E., Poulin, B., Tillmann, B., Madurell, F., & D'Adamo, D. A. (2003). Sensory versus cognitive components in harmonic priming. Journal of Experimental Psychology: Human Perception and Performance, 29, 159.
[6]
Brattico, E., Tervaniemi, M., Näätänen, R., & Peretz, I. (2006). Musical scale properties are automatically processed in the human auditory cortex. Brain Research, 1117, 162-174.
[7]
Brown, R. M., Chen, J. L., Hollinger, A., Penhune, V. B., Palmer, C., & Zatorre, R. J. (2013). Repetition suppression in auditory-motor regions to pitch and temporal structure in music. Journal of Cognitive Neuroscience, 25, 313-328.
[8]
Brown, R. M., & Palmer, C. (2012). Auditory-motor learning influences auditory memory for music. Memory & Cognition, 40, 567-578.
[9]
Collins, T., Tillmann, B., Barrett, F. S., Delbé, C., & Janata, P. (2014). A combined model of sensory and cognitive representations underlying tonal expectations in music: From audio signals to behavior. Psychological Review, 121, 33-65.
[10]
Deiber, M. P., Ibanez, V., Honda, M., Sadato, N., Raman, R., & Hallett, M. (1998). Cerebral processes related to visuomotor imagery and generation of simple finger movements studied with positron emission tomography. Neuroimage, 7, 73-85.
[11]
Dodson, C. S., & Schacter, D. L. (2001). "If I had said it I would have remembered it": Reducing false memories with a distinctiveness heuristic. Psychonomic Bulletin & Review, 8, 155-161.
[12]
Donchin, E., & Coles, M. G. (1988). Is the P300 component a manifestation of context updating?. Behavioral and Brain Sciences, 11, 357-374.
[13]
Draganski, B., & May, A. (2008). Training-induced structural changes in the adult human brain. Behavioural Brain Research, 192, 137-142.
[14]
Fiebach, C. J., & Schubotz, R. I. (2006). Dynamic anticipatory processing of hierarchical sequential events: A common role for Broca's area and ventral premotor cortex across domains?. Cortex, 42, 499-502.
[15]
Finney, S. A. (1997). Auditory feedback and musical keyboard performance. Music Perception, 15, 153-174.
[16]
Fogassi, L., Ferrari, P. F., Gesierich, B., Rozzi, S., Chersi, F., & Rizzolatti, G. (2005). Parietal lobe: From action organization to intention understanding. Science, 308, 662-667.
[17]
Folstein, J. R., & Van Petten, C. (2008). Influence of cognitive control and mismatch on the N2 component of the ERP: A review. Psychophysiology, 45, 152-170.
[18]
Friedman, D., Cycowicz, Y. M., & Gaeta, H. (2001). The novelty P3: An event-related brain potential (ERP) sign of the brain's evaluation of novelty. Neuroscience & Biobehavioral Reviews, 25, 355-373.
[19]
Fuchs, M., Kastner, J., Wagner, M., Hawes, S., & Ebersole, J. S. (2002). A standardized boundary element method volume conductor model. Clinical Neurophysiology, 113, 702-712.
[20]
Gates, A., & Bradshaw, J. L. (1974). Effects of auditory feedback on a musical performance task. Perception & Psychophysics, 16, 105-109.
[21]
Gathercole, S. E., & Conway, M. A. (1988). Exploring long-term modality effects: Vocalization leads to best retention. Memory & Cognition, 16, 110-119.
[22]
Gehring, W. J., Liu, Y., Orr, J. M., & Carp, J. (2012). The error-related negativity (ERN/Ne). In S. J. Luck & E. S. Kappenman (Eds.), Oxford handbook of event-related potential components (pp. 231-291). Oxford: Oxford University Press.
[23]
Goodbody, S. J., & Wolpert, D. M. (1998). Temporal and amplitude generalization in motor learning. Journal of Neurophysiology, 79, 1825-1838.
[24]
Hannon, E. E., & Trainor, L. J. (2007). Music acquisition: Effects of enculturation and formal training on development. Trends in Cognitive Sciences, 11, 466-472.
[25]
Haslinger, B., Erhard, P., Altenmüller, E., Schroeder, U., Boecker, H., & Ceballos-Baumann, A. O. (2005). Transmodal sensorimotor networks during action observation in professional pianists. Journal of Cognitive Neuroscience, 17, 282-293.
[26]
Huron, D., & Parncutt, R. (1993). An improved model of tonality perception incorporating pitch salience and echoic memory. Psychomusicology: Music, Mind & Brain, 12, 154-171.
[27]
Janata, P. (1995). ERP measures assay the degree of expectancy violation of harmonic contexts in music. Journal of Cognitive Neuroscience, 7, 153-164.
[28]
Jurcak, V., Tsuzuki, D., & Dan, I. (2007). 10/20, 10/10, and 10/5 systems revisited: Their validity as relative head-surface-based positioning systems. Neuroimage, 34, 1600-1611.
[29]
Koelsch, S. (2009). Music syntactic processing and auditory memory: Similarities and differences between ERAN and MMN. Psychophysiology, 46, 179-190.
[30]
Koelsch, S., & Jentschke, S. (2010). Differences in electric brain responses to melodies and chords. Journal of Cognitive Neuroscience, 22, 2251-2262.
[31]
Koelsch, S., Jentschke, S., Sammler, D., & Mietchen, D. (2007). Untangling syntactic and sensory processing: An ERP study of music perception. Psychophysiology, 44, 476-490.
[32]
Krohn, K. I., Brattico, E., Välimäki, V., & Tervaniemi, M. (2007). Neural representations of the hierarchical scale pitch structure. Music Perception, 24, 281-296.
[33]
Krumhansl, C. L., & Kessler, E. J. (1982). Tracing the dynamic changes in perceived tonal organization in a spatial representation of musical keys. Psychological Review, 89, 334-368.
[34]
Lahav, A., Saltzman, E., & Schlaug, G. (2007). Action representation of sound: Audiomotor recognition network while listening to newly acquired actions. Journal of Neuroscience, 27, 308-314.
[35]
Lancaster, J. L., Woldorff, M. G., Parsons, L. M., Liotti, M., Freitas, C. S., Rainey, L., et al. (2000). Automated Talairach atlas labels for functional brain mapping. Human Brain Mapping, 10, 120-131.
[36]
Lappe, C., Herholz, S. C., Trainor, L. J., & Pantev, C. (2008). Cortical plasticity induced by short-term unimodal and multimodal musical training. Journal of Neuroscience, 28, 9632-9639.
[37]
Large, E. W. (1993). Dynamic programming for the analysis of serial behaviors. Behavior Research Methods, Instruments, & Computers, 25, 238-241.
[38]
Leman, M. (2000). An auditory model of the role of short-term memory in probe-tone ratings. Music Perception, 17, 481-509.
[39]
Lerdahl, F., & Jackendoff, R. (1983). An overview of hierarchical structure in music. Music Perception, 2, 229-252.
[40]
Liberman, A. M., & Mattingly, I. G. (1985). The motor theory of speech perception revised. Cognition, 21, 1-36.
[41]
Lotze, M., Montoya, P., Erb, M., Hülsmann, E., Flor, H., Klose, U., et al. (1999). Activation of cortical and cerebellar motor areas during executed and imagined hand movements: An fMRI study. Journal of Cognitive Neuroscience, 11, 491-501.
[42]
Loui, P., Wu, E. H., Wessel, D. L., & Knight, R. T. (2009). A generalized mechanism for perception of pitch patterns. Journal of Neuroscience, 29, 454-459.
[43]
MacDonald, P. A., & MacLeod, C. M. (1998). The influence of attention at encoding on direct and indirect remembering. Acta Psychologica, 98, 291-310.
[44]
MacLeod, C. M., Gopie, N., Hourihan, K. L., Neary, K. R., & Ozubko, J. D. (2010). The production effect: Delineation of a phenomenon. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 671-685.
[45]
Maidhof, C., Vavatzanidis, N., Prinz, W., Rieger, M., & Koelsch, S. (2010). Processing expectancy violations during music performance and perception: An ERP study. Journal of Cognitive Neuroscience, 22, 2401-2413.
[46]
Malfait, N., Gribble, P. L., & Ostry, D. J. (2005). Generalization of motor learning based on multiple field exposures and local adaptation. Journal of Neurophysiology, 93, 3327-3338.
[47]
Marmel, F., Perrin, F., & Tillmann, B. (2011). Tonal expectations influence early pitch processing. Journal of Cognitive Neuroscience, 23, 3095-3104.
[48]
Marmel, F., & Tillmann, B. (2009). Tonal priming beyond tonics. Music Perception, 26, 211-221.
[49]
Marmel, F., Tillmann, B., & Delbé, C. (2010). Priming in melody perception: Tracking down the strength of cognitive expectations. Journal of Experimental Psychology: Human Perception and Performance, 36, 1016.
[50]
Mathias, B., Palmer, C., Perrin, F., & Tillmann, B. (2015). Sensorimotor learning enhances expectations during auditory perception. Cerebral Cortex, 25, 2238-2254.
[51]
Mazziotta, J., Toga, A., Evans, A., Fox, P., Lancaster, J., Zilles, K., et al. (2001). A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM). Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 356, 1293-1322.
[52]
Miranda, R. A., & Ullman, M. T. (2007). Double dissociation between rules and memory in music: An event-related potential study. Neuroimage, 38, 331-345.
[53]
Mobascher, A., Brinkmeyer, J., Warbrick, T., Musso, F., Wittsack, H. J., Stoermer, R., et al. (2009). Fluctuations in electrodermal activity reveal variations in single trial brain responses to painful laser stimuli: A fMRI/EEG study. Neuroimage, 44, 1081-1092.
[54]
Näätänen, R., Paavilainen, P., Rinne, T., & Alho, K. (2007). The mismatch negativity (MMN) in basic research of central auditory processing: A review. Clinical Neurophysiology, 118, 2544-2590.
[55]
Näätänen, R., & Picton, T. W. (1986). N2 and automatic versus controlled processes. Electroencephalography and Clinical Neurophysiology Supplement, 38, 169-186.
[56]
Näätänen, R., & Picton, T. (1987). The N1 wave of the human electric and magnetic response to sound: A review and an analysis of the component structure. Psychophysiology, 24, 375-425.
[57]
Näätänen, R., & Winkler, I. (1999). The concept of auditory stimulus representation in cognitive neuroscience. Psychological Bulletin, 125, 826-859.
[58]
Olbrich, S., Mulert, C., Karch, S., Trenner, M., Leicht, G., Pogarell, O., et al. (2009). EEG-vigilance and BOLD effect during simultaneous EEG/fMRI measurement. Neuroimage, 45, 319-332.
[59]
Oostenveld, R., & Praamstra, P. (2001). The five percent electrode system for high-resolution EEG and ERP measurements. Clinical Neurophysiology, 112, 713-719.
[60]
Osnes, B., Hugdahl, K., Hjelmervik, H., & Specht, K. (2012). Stimulus expectancy modulates inferior frontal gyrus and premotor cortex activity in auditory perception. Brain and Language, 121, 65-69.
[61]
Ozubko, J. D., Hourihan, K. L., & MacLeod, C. M. (2012). Production benefits learning: The production effect endures and improves memory for text. Memory, 20, 717-727.
[62]
Palmer, C. (1997). Music performance. Annual Review of Psychology, 48, 115-138.
[63]
Pascual-Marqui, R. D. (2002). Standardized low-resolution brain electromagnetic tomography (sLORETA): Technical details. Methods & Findings in Experimental & Clinical Pharmacology, 24D, 5-12.
[64]
Patel, S. H., & Azzam, P. N. (2005). Characterization of N200 and P300: Selected studies of the event-related potential. International Journal of Medical Sciences, 2, 147-154.
[65]
Pau, S., Jahn, G., Sakreida, K., Domin, M., & Lotze, M. (2013). Encoding and recall of finger sequences in experienced pianists compared with musically naive controls: A combined behavioral and functional imaging study. Neuroimage, 64, 379-387.
[66]
Pizzagalli, D., Pascual-Marqui, R. D., Nitschke, J. B., Oakes, T. R., Larson, C. L., Abercrombie, H. C., et al. (2001). Anterior cingulate activity as a predictor of degree of treatment response in major depression: Evidence from brain electrical tomography analysis. American Journal of Psychiatry, 158, 405-415.
[67]
Polich, J. (2007). Updating P300: An integrative theory of P3a and P3b. Clinical Neurophysiology, 118, 2128-2148.
[68]
Poulin-Charronnat, B., Bigand, E., & Koelsch, S. (2006). Processing of musical syntax tonic versus subdominant: An event-related potential study. Journal of Cognitive Neuroscience, 18, 1545-1554.
[69]
Rauschecker, J. P. (2011). An expanded role for the dorsal auditory pathway in sensorimotor control and integration. Hearing Research, 271, 16-25.
[70]
Regnault, P., Bigand, E., & Besson, M. (2001). Different brain mechanisms mediate sensitivity to sensory consonance and harmonic context: Evidence from auditory event-related brain potentials. Journal of Cognitive Neuroscience, 13, 241-255.
[71]
Rinne, T., Särkkä, A., Degerman, A., Schröger, E., & Alho, K. (2006). Two separate mechanisms underlie auditory change detection and involuntary control of attention. Brain Research, 1077, 135-143.
[72]
Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169-192.
[73]
Rorden, C. (2007). MRICroN.
[74]
Rugg, M. D., & Coles, M. G. (1995). Electrophysiology of mind: Event-related brain potentials and cognition. New York: Oxford University Press.
[75]
Sammler, D., Novembre, G., Koelsch, S., & Keller, P. E. (2013). Syntax in a pianist's hand: ERP signatures of "embodied" syntax processing in music. Cortex, 49, 1325-1339.
[76]
Schönwiesner, M., Novitski, N., Pakarinen, S., Carlson, S., Tervaniemi, M., & Näätänen, R. (2007). Heschl's gyrus, posterior superior temporal gyrus, and mid-ventrolateral prefrontal cortex have different roles in the detection of acoustic changes. Journal of Neurophysiology, 97, 2075-2082.
[77]
Schröger, E., & Wolff, C. (1998). Behavioral and electrophysiological effects of task-irrelevant sound change: A new distraction paradigm. Cognitive Brain Research, 7, 71-87.
[78]
Schubotz, R. I. (2007). Prediction of external events with our motor system: Towards a new framework. Trends in Cognitive Sciences, 11, 211-218.
[79]
Tekman, H. G., & Bharucha, J. J. (1998). Implicit knowledge versus psychoacoustic similarity in priming of chords. Journal of Experimental Psychology: Human Perception and Performance, 24, 252-260.
[80]
Tervaniemi, M., Huotllainen, M., Bratiico, E., Ilmoniemi, R. J., Reinlkainen, K., & Alho, K. (2003). Event-related potentials to expectancy violation in musical context. Musicae Scientiae, 7, 241-261.
[81]
Tillmann, B., Bharucha, J. J., & Bigand, E. (2000). Implicit learning of tonality: A self-organizing approach. Psychological Review, 107, 885-913.
[82]
Wilson, M., & Knoblich, G. (2005). The case for motor involvement in perceiving conspecifics. Psychological Bulletin, 131, 460-473.
[83]
Wolpert, D. M., Goodbody, S. J., & Husain, M. (1998). Maintaining internal representations: The role of the human superior parietal lobe. Nature Neuroscience, 1, 529-533.
[84]
Zatorre, R. J., Chen, J. L., & Penhune, V. B. (2007). When the brain plays music: Auditory-motor interactions in music perception and production. Nature Reviews Neuroscience, 8, 547-558.
- Sensory, cognitive, and sensorimotor learning effects in recognition memory for music
Recommendations
Sensory-motor gating and cognitive control by the brainstem cholinergic system
Computational models of neuromodulationAs an essential component of ascending activating systems, cholinergic neurons with diffuse projections are supposed to be involved in the regulation of cognitive processes such as attention, consciousness, learning, and memory. As for the role of ...
Top-down activation of spatiotopic sensory codes in perceptual and working memory search
A critical requirement of an efficient cognitive system is the selection and prioritization of relevant information. This occurs when selecting specific items from our sensory inputs, which then receive preferential status at subsequent levels of ...
Effects of working memory demand on neural mechanisms of motor response selection and control
Inhibitory control commonly recruits a number of frontal regions: pre-supplementary motor area pre-SMA, frontal eye fields FEFs, and right-lateralized posterior inferior frontal gyrus IFG, dorsal anterior insula DAI, dorsolateral prefrontal cortex DLPFC,...
Comments
Information & Contributors
Information
Published In
Publisher
MIT Press
Cambridge, MA, United States
Publication History
Published: 01 August 2016
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 28 Dec 2024