Facial biomarkers

Smile intensity

Mean of mouthSmileLeft and mouthSmileRight across face frames (an AU12 proxy).

Key
smileIntensityMean
Unit
0–1
RDoC domain
Positive valence systems
For the sample
0.2025 0–1

Method

MediaPipe Face Landmarker blendshapes, computed on the device.

Quality gate

At least 10 s of frames with a detected face. Below the gate the value is null and the reason is listed in the response's quality flags.

How the engine reads it

In Positive valence systems, with lower values than the person's own baseline read as concern, at full weight. Fewer and weaker smiles.

Published associations

ConditionIn the conditionEvidence
Depression↓lowerreplicatedGirard JM, Cohn JF, Mahoor MH, et al; Scherer S, Stratou G, Mahmoud M, et al; Fiquer JT, Moreno RA, Brunoni AR, et al
Anxiety~mixednot gradedScherer S, Stratou G, Mahmoud M, et al; Davies H, Wolz I, Leppanen J, et al
Post-traumatic stress↓lowersingle studyScherer S, Stratou G, Mahmoud M, et al
Schizophrenia spectrum↓lowersingle studyGaebel W, Wölwer W

Group-level findings from the literature, never a diagnosis. Compare a person with themselves over time.

References

  1. 1.Google AI Edge. MediaPipe Face Landmarker: 478 landmarks and 52 blendshape scores. developers.google.com/edge/mediapipe/solutions/vision/face_landmarker
  2. 2.Apple Developer Documentation. ARFaceAnchor.BlendShapeLocation. developer.apple.com/documentation/arkit/arfaceanchor/blendshapelocation
  3. 3.Girard JM, Cohn JF, Mahoor MH, et al. Nonverbal social withdrawal in depression: evidence from manual and automatic analyses. Image Vis Comput 2014;32(10):641-647. doi.org/10.1016/j.imavis.2013.12.007
  4. 4.Scherer S, Stratou G, Mahmoud M, et al. Automatic behavior descriptors for psychological disorder analysis. IEEE FG 2013. doi.org/10.1109/FG.2013.6553789
  5. 5.Fiquer JT, Moreno RA, Brunoni AR, et al. What is the nonverbal communication of depression? Assessing expressive differences between depressive patients and healthy volunteers during clinical interviews. J Affect Disord 2018;238:636-644. doi.org/10.1016/j.jad.2018.05.071
  6. 6.Davies H, Wolz I, Leppanen J, et al. Facial expression to emotional stimuli in non-psychotic disorders: a systematic review and meta-analysis. Neurosci Biobehav Rev 2016;64:252-271. doi.org/10.1016/j.neubiorev.2016.02.015
  7. 7.Gaebel W, Wölwer W. Facial expressivity in the course of schizophrenia and depression. Eur Arch Psychiatry Clin Neurosci 2004;254:335-342. doi.org/10.1007/s00406-004-0510-5

Measure it on your own data.

Sandbox today. Production under agreement.

Or make a first request with the sandbox key.