GoKawiilSign up to see the future, today Can’t-miss innovations from the bleeding edge of science and tech Email address Sign Up Thank you!
Meta patented AI tech that constantly analyzes your voice and surroundings in order to detect your emotional state. Finally, exactly what we were all asking for: Meta being granted constant access to our offline lives.
As first caught by Patentlyze, a patent published on July 2 describes a system that records all the user’s “audible communications” and combines it with “contextual factors” like “time of day, location, user activity, or digital interaction.” Audio may be “transcribed, and an emotional-state machine learning model may interpret verbal and nonverbal cues to determine emotional indicators.”
In other words, the system listens to you and everything you do, combines it with other data, and feeds it all to a mood-predicting AI.
“The system increases the precision and reliability of emotional inference by aligning multimodal sensor inputs on synchronized timelines, which creates a novel data structure that supports richer emotional analysis,” reads the patent. “These combined features deliver a technical improvement in automated audio interpretation, enabling continuous emotional monitoring on everyday devices.”
According to the patent, the goal of this extraordinarily intrusive system would be to better tailor users’ workouts to their emotional state, as “personal trainers cannot provide the level of precision in guidance, such as correcting a pose and/or body movement,” as well as Meta’s imagined device could.
It’s not surprising to see Meta pitch this kind of surveillance technology as a fitness device. Health-tracking wearables have become wildly popular, despite the extraordinary amount of physical data about individual consumers they collect and store.
The key difference in Meta’s case, is that rather than crunch biological metrics, it’s an AI-powered fly-on-the-wall attempting to measure a person’s emotional state by listening in on the world around them, and possibly then connecting that information to all other available data.
“The AI assistant may listen to a user(s) at predefined times to hear various types of communication, such as sighs, laughter, and/or the tone(s) of a voice(s),” reads the patent. “The AI assistant may use these inputs to quantify the user’s emotional state or generate other insights about the user.”
The patent also discusses connecting audio inputs to information like when a user takes their medicine, proposing that “the AI assistant may take multiple inputs in addition to audio inputs (e.g., of a user’s voice) to provide a summary of emotional trends based on various inputs (e.g., a happier emotional state associated with a particular time of day or at a time when medication is taken, etc.)”
... continue reading