Voice Tonality

What is Voice Tonality?

Voice tonality is the way a person speaks to someone. Essentially, it’s how you sound when you say words out loud.

Voice Tonality in Decode

It is the process of studying users' emotions and behaviour using their voices. Speech carries both verbal and non-verbal information, which makes it very dense information. Voice is the only modality to carry such enormous amounts of information about human behaviour.

Using Decode, you can detect multiple cues from voice, such as:

  • Speech(verbal data)
  • Emotion
  • Confidence or Nervousness

 At the fundamental level, we can extract the following datapoint from speech for each second: 

  • Happy
  • Sad
  • Fear
  • Surprise
  • Neutral
  • Angry
  • Disgust

Apart from emotions, confidence is also calculated for each second.

Decode Voice Tonality Metrics

We give these three metrics using voice data

  • Positive Emotion: This is calculated as the percentage of the time speakers in the entire meeting felt positive emotions.
  • Negative Emotion: The percentage of the time negative emotions were felt by speakers in the meeting.
  • Confidence: The percentage of the time speakers felt confident while they spoke. This can come from our confidence model or taking low-intensity positive valence emotions from the emotion model as well based on the circumplex model.

Note:  Silence is removed in these calculations, and the base is always the total amount of time people used to speak. In summary of Decode, however, the positive and negative emotions are also calculated from face data if a face video is available, and then a weighted sum is given as the final AI metric.

Speaker Phase Metrics

This Gantt chart shows the sequence of speaker participation in the meeting.

Per Person Conversation Metrics

It gives an insight into how a particular speaker participated in the meeting. The number of filler words he used and what was his participation in the entire meeting. The longest Monologue talks about the maximum amount of time he spoke at a stretch.

Speaker Tonality Gant Chart

This visualization shows the journey of users in terms of tonality. We can see the entire meeting timeline and the segments where positive, negative, or confident emotions were felt.