Event

Vocal Vibrations

LocationLe Laboratoire Cambridge DescriptionVOCAL VIBRATIONS is Le Laboratoire Cambridge's exciting opening exhibition. Composer and invent…

Friday — Sunday
October 31, 2014 —
March 22, 2015
Event

Vocal Vibrations at Le Laboratoire

LocationLe Laboratoire, Paris DescriptionVocal Vibrations, an original installation and design, invites the public to discover the relation…

Friday — Monday
March 28, 2014 —
September 29, 2014
Project

Vocal Vibrations

Expressive Performance for Body-Mind WellbeingThe Vocal Vibrations music is now available for exclusive download from Bowers & Wilkins.…

Article

SENSITIVE SCIENCE: vocal vibrations

« Vocal Vibrations » is an installation which invites the public to discover the relationship between sound vibrations stimulated by voice …

Publication

Vocal Vibrations: A Multisensory Experience of the Voice

Holbrow, C., Jessop, E., Kleinberger R. NIME’14, June 30 – July 03, 2014, Goldsmiths, University of London, UK

Article

MIT exhibits let the body hum in a vocal meditation

Hum, and sound buzzes through your lips. Sing, and it vibrates through your head and body.Sing at “Vocal Vibrations,” the musical installat…

Person

Elena Jessop

Person

Charles Holbrow

Former Research Assistant

Person

Rebecca Kleinberger

Former Postdoctoral Associate

Publication

The Body Parametric: Abstraction of Vocal and Physical Expression in Performance

Nattinger, E. J. "The Body Parametric: Abstraction of Vocal and Physical Expression in Performance"

Publication

Single fibre enables acoustic fabrics via nanometre-scale vibrations

Yan, W., Noel, G., Loke, G., Meiklejohn, E., Khiduyev, T., Marion, J., Rui, G., Lin, J., Cherston, J., Saharasbudhe, A., Wilbert, J., Wicaksono, I., Hoyt, R.W., Missakian, A., Zhu, L., Ma, C., Joannopoulos, J., and Fink, Y. Single fibre enables acoustic fabrics via nanometre-scale vibrations. Nature (2022). https://doi.org/10.1038/s41586-022-04476-9

Publication

The Vocal Augmentation and Manipulation Prosthesis (VAMP): A Conducting-Based Gestural Controller for Vocal Performance

Jessop, E.

Publication

Good Vibrations: Modal Dynamics for Graphics and Animation

A.P. Pentland, J. Williams

Project

Perceiving Emotional Affect in Vocalizations

The ability to display and perceive emotion is a key component in intelligent behavior. Emotion helps to guide both human and animal behavi…

Publication

Personalized Modeling of Real-World Vocalizations from Nonverbal Individuals

Narain, J.*, Johnson, K.T.*, Ferguson, C., O’Brien, A., Talkar, T., Zhang, Y., Wofford, P., Quatieri, T., Picard, R.W.,Maes, P., "Personalized Modeling of Real-World Vocalizations from Nonverbal Individuals," Proceedings of the International Conference on Multimodal Interaction (ICMI), Utrecht, Netherlands, October 2020. (*Co-first authors/Equal contribution)

Event

Talk: Prof. Jeffrey Cohn on automated analysis and synthesis of facial and vocal expressions

LocationMIT Media Lab, E14-493 DescriptionComputational behavioral science is making significant efforts in analysis and understanding of n…

Friday
January 27, 2012
Project

Vocal Augmentation and Manipulation Prosthesis (VAMP)

The Vocal Augmentation and Manipulation Prosthesis (VAMP) is a gesture-based, wearable controller for live-time vocal performance. This con…

Publication

Transfer Learning with Real-World Nonverbal Vocalizations from Minimally Speaking Individuals

Narain, J., Johnson, K., Quatieri, T., Picard, R., and Maes, P. “Transfer Learning with Real-World Vocalizations from Minimally Speaking Individuals”. Workshop in Interpretable ML in Healthcare at International Conference on Machine Learning. July 2021.

Project

Analysis and Synthesis of Pulsed Vocalizations by Killer Whales

Despite many studies of marine mammal vocalizations, there is no generally accepted theory of sound production by whales or dolphins, and o…

Publication

Nonverbal Vocalizations as Speech: Characterizing Natural-Environment Audio from Nonverbal Individuals with Autism

Narain, J.*, Johnson, K.T.*, O’Brien, A., Wofford, P., Maes, P., Picard, R.W. "Nonverbal Vocalizations as Speech: Characterizing Natural-Environment Audio from Nonverbal Individuals with Autism," Proceedings of the Workshop on Laughter and Other Nonverbal Vocalisations, Bielefeld, Germany, October 2020. (*Co-first authors/Equal contribution)

Publication

Social Signaling: Predicting the Outcome of Job Interviews from Vocal Tone and Prosody

Vikrant Soman, Anmol Madan

Project

VocalCords: Exploring Tactile Interaction with the Singing Voice

The close relationship between touch, gesture, and sound plays a critical role in expressive musical performance. Many acoustic instruments…

Article

What it means to be counted: MIT art project aims to capture Ogden’s vocal diversity

“A Counting,” an art project from the Poetic Justice group, invites people to call in and count to 100 in their native language.

Person

Judith C. Brown

Former Visiting Scientist

Post

Tod Machover: IAMM keynote talk links

​ Some links to accompany a talk on “Possible Futures for Music and Medicine.”

Person

Tod Machover

Muriel R. Cooper Professor of Music and Media; Academic Head, Program in Media Arts and Sciences

Person

Barry L. Vercoe

Professor Emeritus

Person

Max Addae

Former Research Assistant

Article

Art installation uses sound as self-reflection

Most art galleries have a “look, don’t touch” policy, maintaining the barrier between exhibit and observer, but not the new installation at…

Group

Advancing Wellbeing

In contributing to the digital revolution, the Media Lab helped fuel a society where increasing numbers of people are obese, sedentary, and…

Group

Opera of the Future

The Opera of the Future group (formerly known as Hyperinstruments) explores concepts and techniques to help advance the future of musical c…

Post

Arnav Kapur wins “Use it!” Lemelson-MIT Student Prize

Congratulations, Arnav!

Post

Max Addae wins first place in the 2024 Guthman Musical Instrument Competition

Addae received the award for VocalCords, which was developed as part of his master's thesis at the Media Lab.

Publication

AttentivU: An EEG-Based Closed-Loop Biofeedback System for Real-Time Monitoring and Improvement of Engagement for Personalized Learning

Nataliya Kosmyna, Pattie Maes. AttentivU: An EEG-Based Closed-Loop Biofeedback System for Real-Time Monitoring and Improvement of Engagement for Personalized Learning. Sensors 2019, 19, 5200.

Project

Commalla: Communication for All

​Interested in learning more about the Commalla project?  Fill out this form! 

Article

A fabric that “hears” your heart's sounds

Inspired by the human ear, a new acoustic fabric converts audible sounds into electrical signals.

Project

Corsetto: AI-empowered Modular Robotic Garment for Capture and Entrainment of Breathing Techniques

​This work is recently submitted as a Full Paper to ACM CHI 2023.Corsetto is a full stack system design and platform for upper-body haptics…

Group

Music, Mind and Machine

The Music, Mind and Machine group is working towards bridging the gap between the current generation of audio technologies and those that w…

Publication

Augmenting Natural Communication in Nonverbal Individuals with Autism

Johnson, K.T.* & Narain, J.*, Maes, P., Picard, R.W., "Augmenting Natural Communication in Nonverbal Individuals with Autism," International Society for Autism Research (INSAR), Seattle, Washington, May 2020. (*Co-first authors/equal contribution)

Event

Rébecca Kleinberger Dissertation Defense

Vocal Connection: Rethinking the voice as a medium for personal, interpersonal, and interspecies understanding

Monday
December 16, 2019
2:00pm — 4:00pm ET
Post

Death and the Powers released on CD

The themes and concerns of Death and the Powers seem even more relevant and resonant than when the opera premiered a decade ago.

Project

Sonic enrichment at the zoo

This project is a collaboration between the MIT Media Lab and the San Diego Zoo to design and build interactive sonic enrichment systems fo…

Article

Wireless communication breaks through water-air barrier

Underwater sonar signals cause vibrations that can be decoded by an airborne receiver

Article

Rébecca Kleinberger, From DJ Macaw to Video-Flocking: Leveraging audio technology for animal’s social and cognitive enrichment

Alum Rébecca Kleinberger discusses her work at the intersection of new technology, animal-computer interaction, and the sonic environment.

Event

IN TENSE DIMENSIONS: A Song Cycle for Voice & Live Electronics by Max Addae

In Tense Dimensions is the premiere live performance of VocalCords, a stretch-sensor based voice controller/processor I have been deve…

Group

Synthetic Characters

The Synthetic Characters group works to create creatures whose behavior, form, and underlying architecture not only inform our understandin…

Project

Robot Expressiveness Affects Children's Learning

Prior research with preschool children has established that book reading, especially when children are encouraged to actively process the s…

Project

RF-SCG: Contactless heart recording

RF-SCG is a new system that can capture seismocardiogram (SCG) recordings without requiring any contact with the human body. Such an u…

Article

The body electric

What if wearable and implantable devices could harvest energy from the heat, sweat or vibrations of the wearer?

Project

Augmented Reality Livecoding

Char Stiles debuted "Fastest Integer Multiplier" at Amant Gallery's "For Your Reference." This performance used a custom tool CARL&nbs…

Article

Sense and sensorbility: the book that lets you feel your protagonist's pain

"It's straight out of the pages of science fiction: a 'wearable' book, which uses temperature controls and lighting to mimic the experience…

Project

Harmony in Precarity

By Po-Hao ChiHow could microgravity/hypergravity shape our perceptual experience of listening with weightlessness? How can we seek to explo…

Video

#45 FaceSense

People express and communicate their mental states—such as emotions, thoughts, and desires—through facial expressions, vocal nuances, gestu…

Publication

A Negotiation Analyzer

Alex 'Sandy' Pentland, Jared Curhan, J. Khilnani, M. Martin, N. Eagle, R.Caneel, A. Madan

Publication

Proto-conversations with an anthropomorphic robot

C. Breazeal

Publication

Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data

Narain, J.*, Johnson, K.T.*, Picard, R.W., Maes, P. "Zero-Shot Transfer Learning to Enhance Communication for Minimally Verbal Individuals with Autism using Naturalistic Data," NeurIPS Workshop on AI for Social Good, December 2019. (*Co-first authors/Equal contribution)

Publication

A cutaneous mechanoneural interface for neuroprosthetic feedback

S. Srinivasan, S., M. Herr, H. A cutaneous mechanoneural interface for neuroprosthetic feedback. Nat Biomed Eng (2021). https://doi.org/10.1038/s41551-020-00669-7

Project

MAIA

Low-cost, modular, open source, and portable bio-reactor for urban bio-sensor development.

Article

Before humans ate chickens, we treasured them as exotic pets

"The Weirdest Thing I Learned This Week" dives into research by alum Rébecca Kleinberger showing that parrots seem to enjoy video chats.

Publication

Towards Sociable Robots

C. Breazeal

Publication

Emotive Qualities in Lip Synchronized Robot Speech

C. Breazeal