Research Group Computational Auditory Perception

Human brains have an enormous capacity to adapt to their environment. Brain plasticity relies on our ability to construct complex internal representations and to apply them to predict and act according to changing conditions in the world. Focusing largely on the auditory modality, the Jacoby Research Group  explores the roles of experience and exposure in creating and affecting our perception of the world. Using novel methodologies including massive online experiments, transmission chains, and cross-cultural research we aim to characterize the ways in which people from diverse backgrounds internalize and process external conditions. Studying such differences and similarities can help us better ascertain the interaction of nature and nurture in generating individual sensory experiences.

The group comprises three main areas of inquiry:

  • Characterizing internal representations with massive online experiments: Harnessing techniques from Bayesian perception and machine learning techniques (such as transmission chains and Monte Carlo Markov Chain with People) to the investigation of foundational questions in psychophysics, this area of research explores the geometry of internal representations of complex perceptual spaces.

  • Computational music cognition: Using corpus analysis, syntax modeling, causal analysis, and behavioral experiments, this branch of the project investigates latent structures in musical performance, works, and improvisation.
  • Cross-cultural auditory perception: this branch of the project integrates elements from neuroscience, psychology, cultural anthropology, and ethnomusicology with the aim of significantly increasing our knowledge about the role of experience in determining auditory perception.


 

 

Characterizing the Geometry of Internal Representations using Massive Online Experiments in Audition and Vision

Our auditory and visual memory systems encode information selectively due to limited resources, resulting in systematic distortions and biases. Understanding these biases allows us to characterize the latent geometry of our mind, namely, to better understand how the external world is mapped onto internal representations.

more

Global Survey of Rhythm Representation

Over the past few years, cross-cultural comparative work has made various claims about the universality of aspects of music, aesthetic preferences, and emotion (Fritz 2009, Brown & Jordania 2013, Savage et al. 2015). However, recent work suggests that features that were previously regarded as universal...

more

Latent Structure in Music

Combining methodologies from machine learning and deep learning, music information retrieval, and information theory, this project aims to create tools to analyze and extract latent structure and syntax in music in order to answer fundamental questions pertaining to meter, scale structures and harmony.

more

Cultural Foundations of Auditory Perception

Over 90% of psychology experiments between 2003-2007 were conducted on WEIRD subjects, hailing from Western, Educated, Industrialized, Rich, and Democratic societies (Arnett 2008). Henrich et al. (2010) have argued that these populations constitute an extremely biased sample across several critical dimensions, manifested in paradigms from basic visual and spatial perception to social cognition.

more

 

 

News

Study on cross-cultural music perception published in Current Biology

[more]

The Jacoby Research Group (Computational Auditory Perception) has a number of positions for highly motivated and skilled researchers whose interests align with the foci of the group.

[more]

 

 

 

 


Deutsches Haus Auditorium, NYU

Organizers: Elizabeth Magulis, Nori Jacoby and Patrick Savage Max Planck — NYU Center for Language, Music and Emotion (CLaME) (New York, USA), Deutsches Haus Auditorium, NYU [more]


Online Event

Presenter: Thomas Mark Kaplan / Queen Mary University of London [more]


Online Event

We are presenting a symposium at this year’s Virtual Convention of the American Psychological Association. You are invited to watch our talks online and to join us for some live... [more]

 

 

Press

Catch the Deutschlandfunk interview here.

[more]

Catch the SRF interview here (starts at 10'28)

[more]

Catch the CBC interview on "As it Happens" here (starting at 18'18)

[more]

Activities


organized by the TEMPoral Organization of Speech (TEMPOS) research cluster at the Max Planck Institute for Psycholinguistics in Nijmegen, The Netherlands. [more]


Harrison presents "Reward prediction: An explanation for musical pleasure?" at Cognition and Neuroscience Group, Goldsmiths College, University of London [more]


Jacoby will present three projects at the Timing Research Forum's second meeting in Queretaro, Mexico. [more]

Contact

Nori Jacoby

Dr. Nori Jacoby

Research Group Computational Auditory Perception

Research Group Leader

+49 69 8300479-820

E-Mail

Diana Gleiß

Diana Gleiß

Research Groups

Assistant

+49 69 8300479-801

E-Mail

Team

Peter Harrison

Dr. Peter Harrison

Research Group Computational Auditory Perception

Researcher

+49 69 8300479-822

E-Mail

Raja Marjieh

Raja Marjieh

Research Group Computational Auditory Perception

Lab manager

+49 69 8300479-821

E-Mail

Ofer Tchernichovski

Ofer Tchernichovski

Research Group Computational Auditory Perception

Visiting Researcher

E-Mail

Manuel Anglada-Tort

Dr. Manuel Anglada-Tort

Research Group Computational Auditory Perception

Researcher

+49 69 8300479-820

E-Mail

Luke Poeppel

Luke Poeppel

Research Group Computational Auditory Perception

Researcher

+49 69 8300479-823

E-Mail

Biweekly Seminar

Human & Machine Intelligence