• Login
  • Register

Work for a Member company and need a Member Portal account? Register here with your company email address.

Project

Developing Symbiotic Virtuosity: AI-augmented Musical Instruments and Their Use in Live Music Performances

This project seeks to explore and further develop the concept of "Symbiotic Virtuosity," where artificial intelligence (AI) and human music…

Project

MIT Kumbhathon: A City-Stack Powered by Decentralized AI

​A City-Stack Powered by Decentralized AIOverviewMIT Kumbhathon, hosted at the MIT Media Lab, is pioneering a revolutionary approach t…

Project

Multimodal AI for New Dimensions in Education

Our research focuses on expanding the use of multimodal AI in education beyond the common modalities of text and speech. We're exploring ho…

Project

Deep Reinforcement Learning for Autonomous UAVs (AUAVs)

Many tasks are not easily defined and/or too complex for supervised machine learning approaches. For these reasons, a technique known as&nb…

Project

Fiducial Marker-Based Navigation for Autonomous UAVs (AUAVs)

Depending on the operational environment of an autonomous system, a great deal of perceptual uncertainty may be introduced to an object det…

Project

Domain Randomization & Synthetic Data Generation for AUAVs - Reducing Perceptual Uncertainty of Sim2Real Navigation

Navigation for autonomous UAVS (unmanned aerial vehicles) is a complex problem and physical field testing of associated tasks introduces a …

Project

Unmanned Aerial Vehicle (UAV) Pilot Simulator

With the advent of real-time photorealism (RTPR), virtual environments are now able to achieve higher degrees of engagement than ever befor…

Project

Emotion Navigation

Before automobiles were invented and widely adopted, animals like horses were the most common mode of transportation. While this change bro…

Project

Dyadic Affect in Multimodal Interaction - Parent to Child (DAMI-P2C) Dataset

Audio-visual data set containing around 21.6 hours of parent-child interaction during story reading.The DAMI-P2C dataset consists of audio-…

Project

Data Acquisition via Experimental Design for Data Markets

The acquisition of training data is crucial for machine learning applications. Data markets can increase the supply of data, particularly i…

Project

The Atlas of Opportunity

The Atlas of Opportunity is a platform that allows communities to derive insights from their own data. The tool was created in collabo…

Project

Crowdsourcing purchase histories

We crowdsourced and published a first-of-its-kind open dataset that contains Amazon purchase histories, spanning 2018 to 2022, from more th…

Project

CommunityLM

CommunityLM is a research program from MIT Center for Constructive Communication (CCC) and MIT Media Lab. We are devoted to developing soci…

Project

Voice Anonymization

Spoken language is an information-rich medium that combines words with various paralinguistic information such as emotion and prosody. In d…

Project

Leveraging artificial intelligence for the assessment of severity of depressive symptoms

Project

Zero-Power Oceans Internet of Things

Our Oceans IoT technologies enable new applications in climate and ecological monitoring, aquaculture, energy, and robotic navigation.&nbsp…

Project

Latent Lab

Latent Lab - Navigating Innovation: Interactive Data Exploration & InspirationLatent Lab is an AI-driven, graphical knowledge expl…

Project

Light Sculptures

This project transforms light into glass sculptures.  I developed a software systems to capture photographs of sunlight moving th…

Project

Ancestral Storytelling: Movement and Memory

Ancestral Storytelling: Movement + Memory embodies motion capture techniques for an interactive and immersive movement and sonic healing pe…

Project

Life-Nanomachine Synergism

For details and recent updates visit:  https://web.mit.edu/deblina-sarkar/Nanoelectronics has the potential to enable radical too…

Project

2D Spintronic and Neuromorphic Devices for Sustainable Artificial Intelligence

2D Spintronic and Neuromorphic Devices for Sustainable Artificial Intelligence

Project

Brain Switch

The Brain Switch is a real-time, closed-loop brain-computer system allowing for real-time correspondence of simple user needs to a caretake…

Project

Living Knitwork Pavilion

One of the highlighted projects merging technology with the beauty and craftsmanship of fine arts, the Living Knitwork Pavilion recently re…

Project

WatchThis: A Wearable Point-and-Ask Interface powered by Vision-Language Models for Contextual Queries

This paper introduces WatchThis, a novel wearable device that enables natural language interactions with real-world objects and environment…

Project

Interdocker: Frame-Based Protein-Protein Docking

Modeling protein-protein interactions is a necessary step for elucidating the mechanisms behind fundamental biological processes. Recent ad…

Project

Technology for Resilient Youth: Fostering emotional expression and social connectedness amongst at-risk young adults

​We are working to design healing socio-digital interventions with and for youth who have experienced developmental trauma, or chronic stre…

Project

Cinema Cybernetics

In the contemporary media landscape dominated by discourse surrounding AI-generated content, this project inverts the paradigm by examining…

Project

A Unified Language for Sensors

This project's vision is to unify sensors and signals from diverse domains, including physical, health, weather, and more, into a common la…

Project

Tokenization of Continuous Time Series Data for Multimodal Learning

This project focuses on developing a robust framework for processing continuous sensor data using change point detection, tokenization, and…

Project

Universal High-Modality Learning for Healthcare

 Multimodal learning emerged as a promising frontier in artificial intelligence, offering innovative approaches to harnessing the inhe…

Project

Axol

A distributed sensing system for managing water resources in informal communities.

Project

Humanizing Agent-Based Models (h - ABM)

Humanizing Agent-Based Models (h-ABM) emerges as a pioneering technique to simulate real-world behaviors, aiming to seamlessly bridge …

Project

Open Dance Lab: Digital Platform for Examining, Experimenting, and Evolving Intangible Cultural Data

We propose a computational approach to preserve traditional dance as living cultural heritage, exploring the use of technology to capture k…

Project

Programmable Patch for On-Skin Electrical Drug Delivery

The project aims to develop a programmable smart patch for delivering substances, that could improve cognition (e.g., caffeine, the in…

Project

Bitcoin Security in Absence of Block Rewards

In 2016, a research paper by Carlsten et. al proposed a specific type of mining attack that could occur once block subsidies disappear call…

Project

Scaling Privacy Preserving Payments in a Centralized Digital Currency

This project is working on understanding and implementing privacy preserving payments in CBDC. After surveying privacy techniques from cryp…

Project

Robot mediated multi-person interaction for optimal social-emotional experience

This project explores multi-person conversation flow, likening it to a dance where participants must coordinate their steps effectively. Ef…

Project

Improving Dialogue Agents (LLMs) with Multimodal Feedback

We propose an approach for aligning an LLM- based dialogue agent for long-term social dialogue, where there is only a single global score g…

Project

Improving OpenCBDC resilience through smart contract runtime hardening and privacy-preserving limits

There are some security risks in PArSEC as is – namely, embedding a general-purpose language exposes the system and Lua smart contracts hav…

Project

Evaluating the Practical Privacy of Whirlpool CoinJoins

Bitcoin is the leading public permissionless digital currency. Bitcoin uses a public ledger to achieve strong security properties and doubl…

Project

Application of Programmability to Commercial Banking and Payments with Onyx by JP Morgan

This paper provides an overview of blockchain technology and smart contracts and explains how they enable multiple parties to deploy and ex…

Project

Preserving Privacy in CBDC with Deutsche Bundesbank

We are conducting collaborative research on design and engineering options for a hypothetical central bank digital currency. The work may i…

Project

SpaceDock: Operationally Relevant Task for Broad Deployment in Spaceflight

Assessing and understanding operationally-relevant performance is key to helping ensure safety in complex, dynamic environments. Two curren…

Project

Voice to Insights

​During constituency listening processes (CLPs; e.g., town halls), leaders hear directly from community members about their needs and inter…

Project

AVP-EEG

 Enhancing Apple Vision Pro headset with brain sensing capabilities via non-invasive brain sensing (Electroencephalography - EEG)…

Project

Theme | Social Intelligence

How can we make embodied agents have multimodal conversation with individual and group users that is not only natural, but also relational,…

Project

Theme | Health + Wellness

An embodied virtual agent is a promising oracle for delivering appropriate just-in time interventions. We aim to build a system and design …

Project

Theme | AI Literacy

We seek to empower everyone to become conscientious consumers, ethical engineers, creative problem solvers, and informed advocates for resp…

Project

Bitcoin Core's migration to the CMake buildsystem

The DCI’s Bitcoin Core developers have been reviewing and guiding Hennadii Stepanov's work to migrate to the CMake buildsystem, which was m…

Project

Theme | Creativity & Learning

We are building autonomous agents that are socially and emotionally saturated in single-person (child-robot) or multi-party (child-parent-r…

Project

Co-designing Generative AI for Healthy Aging

The rapid advancement of Generative AI (GenAI) technologies presents new opportunities to support daily living for older adults. This proje…

Project

A Model and Estimation of Bitcoin Transaction Fees

Bitcoin miners compete to earn a block reward by applying hashrate to solve a puzzle set by the code. Equilibrium hashrate is a function of…

Project

A Taxonomy and Annotation Tool for Common Social Reasoning

We posit that robots in human-robot interaction, despite differences in embodiment, roles and tasks, require a common set of social reasoni…

Project

Look to Hear

Sound is a powerful force, capable of enriching our lives and disrupting them in equal measure. Unwanted sonic interference intrudes upon o…

Project

Theme | Responsible AI

We create and employ ethical design frameworks to work towards equitable and inclusive HRI research and technologies.

Project

Your Brain on ChatGPT

This research explores the effects of LLM use on the brain. In one of the studies we recorded brain activity of 55 participants while …

Project

Theme | Interfaces + Platforms

Our research group designs various hardware and software platforms that can be used to do scientific experiments or implement a particular …

Project

GenAI For Personalized Animations

A new way to help people with neurodivergence to manage emotion regulation and understand their stress response.Participants describe their…

Project

Interactive Storybooks for Early AI Literacy

Children today are more digitally connected than ever before, with increasing exposure to tablets, social media, and smartphones. As techno…

Project

Graph RAG as Human Choice Model: Building a Data-Driven Simulation Framework with LLM Agents

The study of human behavior in urban environment is an important field in city sciences. However, it's usually not easy to collect behavior…

Project

CityFlow: An Advanced Case-based Design System Integrated with Expert Workflow and LLM Retriever

CityFlow is a versatile tool that allows users to design, evaluate, and visualize urban solutions through an llm-integrated, case-based sys…