Meta-PerSER: Few-Shot Listener Personalized Speech Emotion Recognition via Meta-learning

Interspeech

Liang-Yeh Shen, Shi-Xin Fang, Yi-Cheng Lin, Huang-Cheng Chou, Hung-yi Lee

Proc. Interspeech 2025 , 136–140 , 2025

Abstract

This paper introduces Meta-PerSER, a novel meta-learning framework that personalizes Speech Emotion Recognition (SER) by adapting to each listener’s unique way of interpreting emotion. Conventional SER systems rely on aggregated annotations, which often overlook individual subtleties and lead to inconsistent predictions. In contrast, Meta-PerSER leverages a Model-Agnostic Meta-Learning (MAML) approach enhanced with Combined-Set Meta-Training, Derivative Annealing, and per-layer per-step learning rates, enabling rapid adaptation with only a few labeled examples. By integrating robust representations from pre-trained self-supervised models, our framework first captures general emotional cues and then fine-tunes itself to personal annotation styles. Experiments on the IEMOCAP corpus demonstrate that Meta-PerSER significantly outperforms baseline methods in both seen and unseen data scenarios, highlighting its promise for personalized emotion recognition.

BibTeX

@inproceedings{shen2025metaperser,
  title = {Meta-PerSER: Few-Shot Listener Personalized Speech Emotion Recognition via Meta-learning},
  author = {Shen, Liang-Yeh and Fang, Shi-Xin and Lin, Yi-Cheng and Chou, Huang-Cheng and Lee, Hung-yi},
  booktitle = {Proc. Interspeech 2025},
  year = {2025},
  pages = {136--140},
  doi = {10.21437/Interspeech.2025-832},
}

← All publications