Designing Systems for Cognitive Augmentation

White BM, Stankovic A, Thoolen S, Kosmyna N, Ivkovic V, Strangman G. Sensory-based alterations and countermeasures in spaceflight and spaceflight analogs. Aerosp Med Hum Perform. 2025; 96(7):556–568. DOI: 10.3357/AMHP.6584.2025

Pecukonis M, Hickey Townsend P, Sarnie L, Jafari C, Kosmyna N, Protyasha N, Williamson J, Yuditskaya S, Maes P, Quatieri TF, McDougle CJ, Mody M and Nowinski L (2025) Fine motor skills predict expressive, but not receptive, language abilities in minimally verbal autistic adults. Front. Lang. Sci. 4:1619744. doi: 10.3389/flang.2025.1619744

Haojun Zhuang, Dünya Baradari, Nataliya Kosmyna, Arnav Balyan, Constanze Albrecht, Stephanie Chen, and Pattie Maes. "Detecting Reading-Induced Confusion Using EEG and Eye Tracking." arXiv preprint arXiv:2508.14442 (2025).

Nathan W Whitmore, Samantha W.T. Chan, Abigail Dulski, Anita Podrug, Nelson Hidalgo, Nnamdi Obi, Varun K. Viswanath, Michael S. Freedman, Viswam Nathan, Pattie Maes. "Slow wave stimulation using a smartwatch improves sleep quality." bioRxiv 2025.07.28.666762; doi: https://doi.org/10.1101/2025.07.28.666762

Dünya Baradari, Nataliya Kosmyna, Oscar Petrov, Rebecah Kaplun, and Pattie Maes. 2025. NeuroChat: A Neuroadaptive AI Chatbot for Customizing Learning Experiences. In Proceedings of the 7th ACM Conference on Conversational User Interfaces (CUI '25). Association for Computing Machinery, New York, NY, USA, Article 57, 1–21. https://doi.org/10.1145/3719160.3736623

Nataliya Kosmyna, Eugene Hauptmann, Ye Tong Yuan, Jessica Situ, Xian-Hao Liao, Ashly Vivian Beresnitzky, Iris Braunstein, and Pattie Maes. "Your brain on chatgpt: Accumulation of cognitive debt when using an ai assistant for essay writing task." arXiv preprint arXiv:2506.08872 (2025).

Shekar, S., Pataranutaporn, P., Sarabu, C., Cecchi, G. A., & Maes, P. (2025). People Overtrust AI-Generated Medical Advice despite Low Accuracy. NEJM AI, AIoa2300015.

Pataranutaporn, P., Archiwaranguprok, C., Chan, S. W., Loftus, E., & Maes, P. (2025, April). Synthetic human memories: Ai-edited images and videos can implant false memories and distort recollection. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (pp. 1-20).

Dünya Baradari, Tejaswi Polimetla, and Pattie Maes. 2025. Data-Driven AI Avatars for Valuation in Dating Scenarios. In Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA '25). Association for Computing Machinery, New York, NY, USA, Article 169, 1–13. https://doi.org/10.1145/3706599.3719833

Pataranutaporn, P., Archiwaranguprok, C., Chan, S. W., Loftus, E., & Maes, P. (2025, March). Slip Through the Chat: Subtle Injection of False Information in LLM Chatbot Conversations Increases False Memory Formation. In Proceedings of the 30th International Conference on Intelligent User Interfaces (pp. 1297-1313).

Cathy Mengying Fang, Auren R. Liu, Valdemar Danry, Eunhae Lee, Samantha W.T Chan, Pat Pataranutaporn, Pattie Maes, Jason Phang, Michael Lampe, Lama Ahmad, and Sandhini Agarwal. How AI and Human Behaviors Shape Psychosocial Effects of Chatbot Use: A Longitudinal Controlled Study, 2025.

Jason Phang, Michael Lampe, Lama Ahmad, Sandhini Agarwal, Cathy Mengying Fang, Auren R Liu, Valdemar Danry, Eunhae Lee, Pat Pataranutaporn, and Pattie Maes. Investigating affective use and emotional well-being on chatgpt, 2025

Baradari, Dünya, Nataliya Kosmyna, Oscar Petrov, Rebecah Kaplun, and Pattie Maes. 2025. “NeuroChat: A Neuroadaptive AI Chatbot for Customizing Learning Experiences.” arXiv [Cs.HC]. arXiv. http://arxiv.org/abs/2503.07599.

V. Danry, E. Villa, S. Chan and P. Maes, "ReLive: Walking into Virtual Reality Spaces from Video Recordings of One's Past Can Increase the Experiential Detail and Affect of Autobiographical Memories," in IEEE Transactions on Visualization and Computer Graphics, doi: 10.1109/TVCG.2025.3549845.

Natasha Maniar, Samantha W.T. Chan, Wazeer Zulfikar, Scott Ren, Christine Xu, and Pattie Maes. "MemPal: Leveraging Multimodal AI and LLMs for Voice-Activated Object Retrieval in Homes of Older Adults." In Proceedings of the 30th International Conference on Intelligent User Interfaces (IUI '25). Association for Computing Machinery, New York, NY, USA, 993–1015. https://doi.org/10.1145/3708359.37

Cherep, Manuel, and Nikhil Singh. "Contrastive Learning from Synthetic Audio Doppelgängers." International Conference on Learning Representations (ICLR)

Danry, V., Guzelis, C., Huang, L., Gershenfeld, N., & Maes, P. (2024). From Words to Worlds: Exploring Generative 3D Models in Design and Fabrication. 3D Printing and Additive Manufacturing.

Fang, C. M., Danry, V., Whitmore, N., Bao, A., Hutchison, A., Pierce, C., & Maes, P. (2024). PhysioLLM: Supporting Personalized Health Insights with Wearables and Large Language Models. arXiv preprint arXiv:2406.19283.

Liu, Auren R., Pat Pataranutaporn, and Pattie Maes. “Chatbot Companionship: A Mixed-Methods Study of Companion Chatbot Usage Patterns and Their Relationship to Loneliness in Active Users.” arXiv [Cs.HC], 2024. https://doi.org/10.48550/ARXIV.2410.21596.

L. Xia, C. D. Vázquez, T. Aikawa and P. Maes, "Inner Child: The Role of VR Child Avatars in Improving Adult Language Learning," 2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Bellevue, WA, USA, 2024, pp. 469-472, doi: 10.1109/ISMAR-Adjunct64951.2024.00136.

N. Kosmyna, K. El Adl and M. Kim, "Wearable Pair of EEG, EOG and fNIRS Glasses for Cognitive Workload Detection," 2024 IEEE 20th International Conference on Body Sensor Networks (BSN), Chicago, IL, USA, 2024, pp. 1-4, doi: 10.1109/BSN63547.2024.10780518.

Fang, C. M., Chwalek, P., Kuang, Q., & Maes, P. (2024, October). WatchThis: A Wearable Point-and-Ask Interface powered by Vision-Language Models for Contextual Queries. In Adjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (pp. 1-4).

M. Kim, S. Pei, S. Singh, S. Brook, and N. Kosmyna, "Privacy-Preserving Eye Movement Classification with Camera-Free, Non-Invasive EOG-EEG Glasses," 2024 IEEE 20th International Conference on Body Sensor Networks (BSN), Chicago, IL, USA, 2024, pp. 1-4, doi: 10.1109/BSN63547.2024.10780485.

Baradari, Dünya, Harry Han, Julia Xia, and Carey Ann Strelecki. 2024. “Beyond Imagination: Leveraging Generative AI to Enhance Learning through Story World Analogies.” In 2024 IEEE Frontiers in Education Conference (FIE), 1–8. IEEE. https://doi.org/10.1109/fie61694.2024.10892813.

Manuel Cherep*, Nikhil Singh*, and Pattie Maes. "Superficial Alignment, Subtle Divergence, and Nudge Sensitivity in LLM Decision-Making." NeurIPS 2024 Workshop on Behavioral Machine Learning.

Luke Mo*, Manuel Cherep*, Nikhil Singh*, Quinn Langford, and Pattie Maes. Articulatory Synthesis of Speech and Diverse Vocal Sounds via Optimization. In Audio Imagination: NeurIPS 2024 Workshop AI-Driven Speech, Music, and Sound Generation.

Chan, S. W. T., Liu, A. R., Ostrowski, A. K., Vaidya, M., Brady, S., Yoquinto, L., D’Ambrosio, L., Zulfikar, W., Maniar, N., Patskanick, T., Leong, J., Kosmyna, N., Coughlin, J., & Maes, P. (2024). Co-designing Generative AI Technologies with Older Adults to Support Daily Tasks. An MIT Exploration of Generative AI. https://doi.org/10.21428/e4baedd9.4f2a95fc

Chan, S., Pataranutaporn, P., Suri, A., Zulfikar, W., Maes, P., & Loftus, E. F. (2024). Conversational AI Powered by Large Language Models Amplifies False Memories in Witness Interviews. arXiv preprint arXiv:2408.04681.

Guenther, S., Kosmyna, N. & Maes, P. Image classification and reconstruction from low-density EEG. Sci Rep 14, 16436 (2024). https://doi.org/10.1038/s41598-024-66228-1

Zulfikar, W., Protyasha, N., Canales, C., Patel, H., Williamson, J., Sarnie, L., Nowinski, L., Kosmyna, N., Townsend, P., Yuditskaya, S. and Talkar, T., 2024. Analyzing Speech Motor Movement using Surface Electromyography in Minimally Verbal Adults with Autism Spectrum Disorder. arXiv preprint arXiv:2407.08877.

Wazeer Deen Zulfikar, Samantha Chan, and Pattie Maes. 2024. Memoro: Using Large Language Models to Realize a Concise Interface for Real-Time Memory Augmentation. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24). Association for Computing Machinery, New York, NY, USA, Article 450, 1–18. https://doi.org/10.1145/3613904.3642450

Wazeer Deen Zulfikar, Samantha Chan, and Pattie Maes. 2024. Memoro: Using Large Language Models to Realize a Concise Interface for Real-Time Memory Augmentation. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24). Association for Computing Machinery, New York, NY, USA, Article 450, 1–18. https://doi.org/10.1145/3613904.3642450

Joanne Leong, Pat Pataranutaporn, Valdemar Danry, Florian Perteneder, Yaoli Mao, and Pattie Maes. 2024. Putting Things into Context: Generative AI-Enabled Context Personalization for Vocabulary Learning Improves Learning Motivation. In CHI'24. May 11-16, 2024, Honolulu, HI, USA. ACM, New York NY, USA, 15 pages. https://doi.org/10.1145/3544548.3581039

De La Torre, F., Fang, C. M., Huang, H., Banburski-Fahey, A., Amores Fernandez, J., & Lanier, J. (2024, May). Llmr: Real-time prompting of interactive worlds using large language models. In Proceedings of the CHI Conference on Human Factors in Computing Systems (pp. 1-22).

Fang, C. M., Huang, L., Kuang, Q., Lieberman, Z., Maes, P., & Ishii, H. (2024, May). An Accessible, Three-Axis Plotter for Enhancing Calligraphy Learning through Generated Motion. In Proceedings of the CHI Conference on Human Factors in Computing Systems (pp. 1-11).

Fang, C. M., Zieliński, K., Maes, P., Paradiso, J., Blumberg, B., & Kjærgaard, M. B. (2024). Enabling Waypoint Generation for Collaborative Robots using LLMs and Mixed Reality. arXiv preprint arXiv:2403.09308.

Valdemar Danry, Laura Chicos, Matheus Fonseca, Ishraki Kazi, and Pattie Maes. 2024. Synthetic Visual Sensations: Augmenting Human Spatial Awareness with a Wearable Retinal Electric Stimulation Device. In The Augmented Humans International Conference (AHs 2024), April 4–6, 2024, Melbourne, VIC, Australia. ACM, New York, NY, USA, 13 pages. https://doi.org/10.1145/3652920.3652932

Nataliya Kosmyna and Eugene Hauptmann "Are you still watching? Assessing internal and external attention in AR using wearable brain sensing glasses", Proc. SPIE 12913, Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) V, 1291310 (12 March 2024); https://doi.org/10.1117/12.3023316

Pataranutaporn, P., Mano, P., Bhongse-Tong, P., Chongchadklang, T., Archiwaranguprok, C., Hantrakul, L., Eaimsa-ard, J., Maes, P., & Klunchun, P. (2024). Human-AI co-dancing: Evolving cultural heritage through collaborative choreography with generative virtual characters. In Proceedings of the 9th International Conference on Movement and Computing (Article 14, pp. 1-10). Association for Computing

Nathan Whitmore*, Samantha Chan*, Jingru Zhang, Patrick Chwalek, Sam Chin, and Pattie Maes. 2024. Improving Attention Using Wearables via Haptic and Multimodal Rhythmic Stimuli. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24), May 11–16, 2024, Hon- olulu, HI, USA. ACM, New York, NY, USA, 14 pages. https://doi.org/10.1145/ 3613904.3642256 (*equal contribution)

Kosmyna N, Hauptmann E, Hmaidan Y. A Brain-Controlled Quadruped Robot: A Proof-of-Concept Demonstration. Sensors. 2024; 24(1):80. https://doi.org/10.3390/s24010080

Pillis, D., Pataranutaporn, P., Maes, P., & Sra, M. (2024). AI comes out of the closet: Using AI-Generated Virtual Characters to Help Individuals Practice LGBTQIA+ Advocacy. In Proceedings of the 29th International Conference on Intelligent User Interfaces

Nataliya Kosmyna, Daniel Hails, Eugene Hauptmann, Christopher Markus, Zoe Lee, Gun Bolukbasi and Minsol Kim. "Using Wearable Brain Sensing Glasses during Zero-G Flight for Hyperscanning: Preliminary Study," AIAA 2023-4656. ASCEND 2023. October 2023.

Leong, Joanne, et al. "Social Wormholes: Exploring Preferences and Opportunities for Distributed and Physically-Grounded Social Connections." Proceedings of the ACM on Human-Computer Interaction 7.CSCW2 (2023): 1-29.

Pataranutaporn, P., Liu, R., Finn, E. et al. Influencing human–AI interaction by priming beliefs about AI can increase perceived trustworthiness, empathy and effectiveness. Nat Mach Intell (2023). https://doi.org/10.1038/s42256-023-00720-7

Vujic, Angela, Shreyas Nisal, and Pattie Maes. "Joie: a Joy-based Brain-Computer Interface (BCI)." Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. 2023.

Bernal, Guillermo, Malika Chhibber, Mradul Bhatnagar, Urvil Jivani, Nelson Hidalgo, Anthony Levasseur, and Pattie Maes. 2023. Fascia Ecosystem: A Step Forward in Sleep Engineering and Research. 45th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC’23), no. Sydney Australia, (July )

Bernal, Guillermo, Malika Chhibber, Mradul Bhatnagar, Urvil Jivani, Nelson Hidalgo, Anthony Levasseur, and Pattie Maes. Pioneering Remote Sleep Research: A Comparative Study of Sleep Stage Parameters in Diverse Datasets for Enhanced Interventions. SLEEP 2023, the 37th Annual Meeting of the Associated Professional Sleep Societies, LLC (APSS), June 6, 2023.

Morris, C., Liu, P., Riecke, B. E., & Maes, P. (2023). InExChange: Fostering Genuine Social Connection through Embodied Breath Sharing in Mixed Reality. Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, Article Article 459. https://doi.org/10.1145/3544549.3583917

Valdemar Danry, Pat Pataranutaporn, Yaoli Mao, and Pattie Maes. 2023. Don’t Just Tell Me, Ask Me: AI Systems that Intelligently Frame Explanations as Questions Improve Human Logical Discernment Accuracy over Causal AI explanations. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, Article 352, 1–13.

Leong, Joanne. "Using Generative AI to Cultivate Positive Emotions and Mindsets for Self-Development and Learning." XRDS: Crossroads, The ACM Magazine for Students 29.3 (2023): 52-56.

Amores Fernandez, J., Mehra, N., Rasch, B., & Maes, P. (2023). Olfactory Wearables for Mobile Targeted Memory Reactivation. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery.

Pataranutaporn, P., Danry, V., Blanchard, L., Thakral, L., Ohsugi, N., Maes, P., & Sra, M. (2023, March). Living memories: Ai-generated characters as digital mementos. In Proceedings of the 28th International Conference on Intelligent User Interfaces (pp. 889-901).

Joanne Leong, Florian Perteneder, Muhender Raj Rajvee, and Pattie Maes. 2023. “Picture the Audience...”: Exploring Private AR Face Filters for Online Public Speaking. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), April 23–28, 2023, Hamburg, Germany. ACM, New York, NY, USA, 13 pages. https://doi.org/10.1145/3544548.3581039

Horowitz*, A.H., Esfahany*, K., Gálvez, T.V. et al. Targeted dream incubation at sleep onset increases post-sleep creative performance. Sci Rep 13, 7319 (2023). https://doi.org/10.1038/s41598-023-31361-w

Jain A, Schoeller F, Horowitz A, Hu X, Yan G, Salomon R and Maes P (2023) Aesthetic chills cause an emotional drift in valence and arousal. Front. Neurosci. 16:1013117. doi: 10.3389/fnins.2022.1013117

Jain, A., Maes, P., Sra, M. (2023). Adaptive Virtual Neuroarchitecture. In: Simeone, A., Weyers, B., Bialkova, S., Lindeman, R.W. (eds) Everyday Virtual and Augmented Reality. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-031-05804-2_9

P. Tandon et al., "Txt2Vid: Ultra-Low Bitrate Compression of Talking-Head Videos via Text," in IEEE Journal on Selected Areas in Communications, 2022, doi: 10.1109/JSAC.2022.3221953.

Jain, A., Schoeller, F., Zhang, E., & Maes, P. (2022, November). Frisson: Leveraging Metasomatic Interactions for Generating Aesthetic Chills. In Proceedings of the 2022 International Conference on Multimodal Interaction (pp. 148-158).

Joanne Leong, Olivia Seow, Cathy Mengying Fang, Benny J. Tang, Rajan Vaish, and Pattie Maes. 2022. Wemoji: Towards Designing Complementary Communication Systems in Augmented Reality. In The Adjunct Publication of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22 Adjunct), October 29-November 2, 2022, Bend, OR, USA. ACM, New York, NY, USA, 3 pages.