Review of OpenSource Music Maker AI system Heartbeat MULA 

HeartMuLa: A Family of Open Sourced Music Foundation Models

HeartMuLa is a family of open sourced music foundation models including:

1. HeartMuLa: a music language model that generates music conditioned on lyrics and tags with multilingual support including but not limited to English, Chinese, Japanese, Korean and Spanish.
2. HeartCodec: a 12.5 hz music codec with high reconstruction fidelity;
3. HeartTranscriptor: a whisper-based model specifically tuned for lyrics transcription; Check this page for its usage.
4. HeartCLAP: an audio–text alignment model that establishes a unified embedding space for music descriptions and cross-modal retrieval.

Github: https://github.com/HeartMuLa/heartlib?

Want to learn how to set this up yourself? Join our community of members just like you learning how to work with AI in real world applications for business, education and life.

CLAIM YOUR PLACE IN THE WORLD NOW

JOIN NOW!