Human emotions can be difficult to read.
But this Artificial Intelligence program analyzes facial expressions to provide a snapshot of a person's mental wellbeing.
Multisense detects various facial and vocal attributes including eye gaze, eyebrow movement, and intonation, using computer vision, language processing and other algorithms.
Through a 5 minute interview with a doctor or a virtual human, the program can provide insights to help doctors diagnose their patients.
"We reach this initial stage, which was, we wanted to know is, is this, uh, is it possible to receive behavioral markers? Can computer quantify? And the good news is we've seen many of them. We have now about 25 of these behavior markers for depression. For example, anxiety for PTSD and either for suicidal ideation and uh, for psychosis."
Using AI to detect and analyze human emotions is a niche field called affective computing that's expected to grow into a 40 billion dollar market by 2022, growing at an average pace of 43 percent a year.
The possibilities range from mood tracking apps and mental wellness chatbots, that help users become aware of their emotions, to learning tools for children with autism to help them develop emotional intelligence.
Brainleap Technologies for instance, helps children with autism or ADHD to improve their concentration through computer games.
Eye gaze detectors determine the level of focus.
"Being able to pay attention to things in their periphery and shift attention appropriately that's about a 35 percent Improvement and inhibitory control. There is actually a 65 percent improvement. And that's the skill that's going to allow them to stay focused on whatever they're working on without getting easily distracted by other things going on around them."
Adding AI to the equation would help customize attention enhancing activities for each individual, allowing meaningful progress.
Wearable devices powered by A.I. are also providing something of a sixth sense.
A smart wristband developed by an MIT spin-off helps users regulate their mood by adjusting their body temperature.
"We create different waveforms. Those are the algorithms dictating reading temperature from skin, and how fast and the differential from that we how much we should deliver in terms of those on up sensations to maintain that perception of cooling and warming."
As AI continues to evolve, not only in terms of simple intelligence, but also human sensibilities, it could help us become smarter and more mindful of our emotional well-being.
Oh Soo-young, Arirang News, Pittsburgh.