Recent advances in generative AI have made music generation a prominent research focus. However, many neural-based models rely on large datasets, raising concerns about copyright infringement and high-performance costs. In contrast, we propose MusicAIR, an innovative multimodal AI music generation framework powered by a novel algorithm-driven symbolic music core, effectively mitigating copyright infringement risks. The music core algorithms connect critical lyrical and rhythmic information to automatically derive musical features, creating a complete, coherent melodic score solely from the lyrics. The MusicAIR framework facilitates music generation from lyrics, text, and images. The generated score adheres to established principles of music theory, lyrical structure, and rhythmic conventions. We developed Generate AI Music (GenAIM), a web tool using MusicAIR for lyric-to-song, text-to-music, and image-to-music generation. In our experiments, we evaluated AI-generated music scores produced by the system using both standard music metrics and innovative analysis that compares these compositions with original works. The system achieves an average key confidence of 85%, outperforming human composers at 79%, and aligns closely with established music theory standards, demonstrating its ability to generate diverse, human-like compositions. As a co-pilot tool, GenAIM can serve as a reliable music composition assistant and a possible educational composition tutor while simultaneously lowering the entry barrier for all aspiring musicians, which is innovative and significantly contributes to AI for music generation.
翻译:生成式人工智能的最新进展使音乐生成成为一个重要的研究焦点。然而,许多基于神经网络的模型依赖大规模数据集,引发了关于版权侵权和高性能成本的担忧。相比之下,我们提出了MusicAIR,这是一种创新的多模态AI音乐生成框架,由新颖的算法驱动符号音乐核心提供支持,有效降低了版权侵权风险。该音乐核心算法连接关键的歌词和节奏信息,自动推导音乐特征,仅从歌词中创建完整、连贯的旋律乐谱。MusicAIR框架支持从歌词、文本和图像生成音乐。生成的乐谱遵循既定的音乐理论原则、歌词结构和节奏惯例。我们开发了Generate AI Music(GenAIM),这是一个使用MusicAIR进行歌词到歌曲、文本到音乐和图像到音乐生成的网络工具。在我们的实验中,我们使用标准音乐指标和创新的分析方法评估了系统生成的AI音乐乐谱,将这些作品与原创作品进行比较。该系统实现了平均85%的调性置信度,优于人类作曲家的79%,并与既定的音乐理论标准紧密契合,展示了其生成多样化、类人作品的能力。作为一种协同工具,GenAIM可以作为一个可靠的音乐创作助手和潜在的教育作曲导师,同时降低所有有抱负的音乐家的入门门槛,这在AI音乐生成领域具有创新性并做出了重要贡献。