• Login
  • Register

Work for a Member company and need a Member Portal account? Register here with your company email address.

Project

Emotional Self Voice

Copyright

Mengying Cathy Fang

Mengying Cathy Fang

Emotions, shaped by past experiences, significantly influence decision-making and goal pursuit. Traditional cognitive-behavioral techniques for personal development rely on mental imagery to envision ideal selves, but may be less effective for individuals who struggle with visualization. This paper introduces Emotional Self-Voice (ESV), a novel system combining emotionally expressive language models and voice cloning technologies to render customized responses in the user's own voice. We investigate the potential of ESV to nudge individuals towards their ideal selves in a study with 60 participants. Across all three conditions (ESV, text-only, and mental imagination), we observed an increase in resilience, confidence, motivation, and goal commitment, but the ESV condition was perceived as uniquely engaging and personalized. We discuss the implications of designing generated self-voice systems as a personalized behavioral intervention for different scenarios.

Copyright

Mengying Cathy Fang, Jocelyn Shen

The Emotional Self Voice (ESV) system renders emotionally expressive ideal-self responses to difficult situations in the user's own voice using emotionally expressive language models and voice cloning technologies. Left: in the example of an individual facing the failure to achieve a goal, he hears his ideal self speaking to himself in his voice, acknowledging the setbacks and reframing the failure as an opportunity to learn. Right: in another example of the individual struggling to keep up with a personal habit, she hears her ideal self speaking with her voice, embodying the habit as her identity as a form of motivation.