Published in Under review, 2022
AV Transformer for voice separation
Recommended citation: Juan F. Montesinos, Venkatesh S. Kadandale, Gloria Haro (2022). "VoViT: Low Latency Graph-based Audio-Visual Voice Separation Transformerreview https://arxiv.org/abs/2203.04099
Published in Under review, 2022
Transformer for AV synchronization
Recommended citation: Venkatesh S. Kadandale, Juan F. Montesinos, Gloria Haro (2022). "VocaLiST: An Audio-Visual Synchronisation Model for Lips and VoicesReview https://arxiv.org/abs/2204.02090
Published in BMVC 2021, 2021
Graph CNN for singing voice separation
Recommended citation: Juan F. Montesinos, Venkatesh S. Kadandale, Gloria Haro (2021). "A cappella: Audio-visual Singing Voice SeparationBMVC 21 https://arxiv.org/abs/2104.09946
Published in S&S CVPR21, 2021
Audiovisual singing voice separation
Recommended citation: Venkatesh S. Kadandale,Juan F. Montesinos, Gloria Haro (2021). "Estimating Individual A Cappella Voices in Music Videos with Singing FacesS6S CVPR21 https://sightsound.org/papers/2021/Venkatesh_Shenoy_Kadandale_Estimating_Individual_A_Cappella_Voices_in_Music_Videos_with_Singing_Faces.pdf
Published in IEEE MMSP 2020, 2020
Weighted losses applied to a Multi-channel U-Net
Recommended citation: Venkatesh Shenoy, Juan F. Montesinos, Gloria Haro, Emilia Gómez (2020). "Multi-channel U-Net for Music Source Separation." IEEE MMSP2020 1. https://arxiv.org/pdf/2003.10414.pdf
Published in IEEE MMSP2020, 2020
Audiovisual Dataset of musicians playing different instruments. Openpose skeleton provided framewise
Recommended citation: Juan F. Montesinos, Olga Slizovskaia, Gloria Haro (2020). "Solos: A Dataset for Audio-Visual Music Source Separation and Localization" IEEE MMSP 2020 1. https://arxiv.org/pdf/2006.07931.pdf