Assessing the Alignment of Audio Representations with Timbre Similarity Ratings Psychoacoustical so-called "timbre spaces" map perceptual similarity ratings of instrument sounds onto low-dimensional embeddings via multidimensional scaling, but suffer from scalability issues and a...

🎶 New paper alert!
Do AI audio embeddings *hear* timbre like we do?
➡️ Benchmarked 18 reps vs 2.6 K human ratings (21 datasets)
🏅 Style embeddings from CLAP & our sound-matching model are best aligned!
Paper: arxiv.org/abs/2507.07764
#ISMIR2025 #MIR #AudioAI #SonyCSLMusic

We also show that our IC estimates can help predict EEG measurements. 💆‍♀️

Surprisal can be used for segment boundary detection and to simulate the information processing of a listener. 🎶 🧠

📜 Link to the paper: arxiv.org/pdf/2501.07474

Model weights are soon to come! 🏋️

💫✨ #SonyCSLMusic 💫✨