{"id":3171,"date":"2024-07-31T03:54:13","date_gmt":"2024-07-31T07:54:13","guid":{"rendered":"https:\/\/wizardwalk.com\/newblather\/?p=3171"},"modified":"2024-07-31T03:54:13","modified_gmt":"2024-07-31T07:54:13","slug":"mixing-my-own-music-with-ai","status":"publish","type":"post","link":"https:\/\/wizardwalk.com\/newblather\/?p=3171","title":{"rendered":"Mixing my own music with AI"},"content":{"rendered":"<p><a href=\"https:\/\/suno.com\/\">Suno AI<\/a> has an &#8220;upload audio&#8221; feature, allowing users to upload up to 60 seconds of their own content to be extended by the AI. So earlier this month I had some fun feeding it 45-60 clips of my own music and having the AI write lyrics and turn the clips into choir songs. It&#8217;s interesting to hear how the AI uses the melodies, chord progressions, and orchestrations provided in its own creations. The lyrics are a bit amateurish, but serviceable; I was too lazy to write my own. I&#8217;m calling the project <em>Hannifin x AI<\/em>. Here&#8217;s the first installment, based on my classic piece &#8220;Hour by Hour&#8221;; the first 60 seconds are from the original piece, while the rest is AI-generated.<\/p>\n<p><iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/UEH7CAbFe0k?si=0nhNiOriTzL_ETot\" title=\"YouTube video player\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>I did the same with 18 other of my pieces. Some things I noticed:<\/p>\n<ul>\n<li>The AI works best with simple 8-bar melodies, or 4-bar phrases. It doesn&#8217;t seem to &#8220;parse&#8221; weirder phrase structures very well.<\/li>\n<li>It&#8217;s not very good at extended the input instrumentally, in my opinion; it quickly starts to sound too repetitive. Having it produce lyrics and turning the music into a song seems to work better. (Melodic repetition seems easier to bear with alternating lyrics.)<\/li>\n<li>If you want the AI to generate the voice of a choir, feeding it music from the louder, more energetic and melodic parts of a piece seem to work better, especially if it features a prominent string section. Otherwise you&#8217;re more likely to get a soloist, and the music it generates is less likely to sound like a natural continuation of the music you provide.<\/li>\n<li>For whatever reason, some tracks just seem to work better than others; maybe it depends on how &#8220;familiar&#8221; the AI is with the melodic and harmonic patterns? For some tracks, it gave me some pleasant results right away. Other times I had to roll the dice over and over to get something acceptable.<\/li>\n<\/ul>\n<p>There were some pieces I tried for which I could not get any output that I was happy with, including\u00a0<em>The King&#8217;s Assassin<\/em>,\u00a0<em>The Moon Dreamed By<\/em>, and <em>On the Edge of a Dream<\/em>. And there was one track, <em>Silver Moon Waltz<\/em>, for which I got a couple songs I was pleased with. Anyway, I&#8217;m done trying for now.<\/p>\n<p>As for the video above, I made it with Blender 4.2, which took a little time figuring out, mostly with various tutorials on YouTube. I&#8217;m not completely satisfied with the results. What&#8217;s supposed to be &#8220;dust&#8221; looks perhaps too much like snow and moves a bit too fast, and the text looks a bit weird. Turns out trying to create a sort of &#8220;drop shadow&#8221; effect on text in Blender is pretty much impossible; I had to sort of fake it with compositing cheats, and I&#8217;m not sure I did the best job. (I could&#8217;ve just put the text on the background picture and used an image editor to create the drop shadow, but I wanted the animated frequency bars to have it too.) Also, the text might be a bit too bright, but I blame that on the VR display I get with <em>Immersed<\/em> in the Meta Quest 3.<\/p>\n<p>I&#8217;ll upload the other 19 songs I created soon!<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Suno AI has an &#8220;upload audio&#8221; feature, allowing users to upload up to 60 seconds of their own content to be extended by the AI. So earlier this month I had some fun feeding it 45-60 clips of my own music and having the AI write lyrics and turn the [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true},"categories":[7,203,83,89],"tags":[845,336,861],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p7gI4B-P9","_links":{"self":[{"href":"https:\/\/wizardwalk.com\/newblather\/index.php?rest_route=\/wp\/v2\/posts\/3171"}],"collection":[{"href":"https:\/\/wizardwalk.com\/newblather\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wizardwalk.com\/newblather\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wizardwalk.com\/newblather\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/wizardwalk.com\/newblather\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3171"}],"version-history":[{"count":2,"href":"https:\/\/wizardwalk.com\/newblather\/index.php?rest_route=\/wp\/v2\/posts\/3171\/revisions"}],"predecessor-version":[{"id":3173,"href":"https:\/\/wizardwalk.com\/newblather\/index.php?rest_route=\/wp\/v2\/posts\/3171\/revisions\/3173"}],"wp:attachment":[{"href":"https:\/\/wizardwalk.com\/newblather\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3171"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wizardwalk.com\/newblather\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3171"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wizardwalk.com\/newblather\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3171"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}