🎨 Art2Mus: Artwork-to-Music Generation via Visual Conditioning and Large-Scale Cross-Modal Alignment 🎶

🎨 Art2Mus: Artwork-to-Music Generation via Visual Conditioning and Large-Scale Cross-Modal Alignment 🎶

Ivan Rinaldi and Matteo Mendula and Nicola Fanelli and Florence Levé and Matteo Testi and Giovanna Castellano and Gennaro Vessio
Music generation has advanced markedly through multimodal deep learning, enabling models to synthesize audio from text and, more recently, from images. However, existing image-conditioned systems suff...
Generative AI, Conditioned Music Generation, Multimodal Deep Learning
🖐🏻 Handscribe: A Gloss-Free Framework for Sign Language Translation and Gloss Sequence Generation 🤌🏻

🖐🏻 Handscribe: A Gloss-Free Framework for Sign Language Translation and Gloss Sequence Generation 🤌🏻

📰 Journal Paper
📍 CVIU
Emanuele Colonna and Ivan Rinaldi and David Landi and Gennaro Vessio and Giovanna Castellano
Sign language translation systems traditionally rely on intermediate gloss representations to bridge the gap between visual input and written language output. However, manual gloss annotation is costl...
Sign Language Translation, SlowFast Network, Large Language Models, Accessibility Technologies
🖼️ Art2Mus: Bridging Visual Arts and Music through Cross-Modal Generation 🎵