Long gone are the days of Musenet, an AI midi generator by OpenAI in 2019 for a blog post, later shutdown in early 2023. It used GPT-2 for its basic architecture. But it's been 5 years: we've gone from AI that can barely make coherent sentences, to AI that knows every library in every programming language and can write anything for you; with decent accuracy.

The current model architecture of KobiMusic is GPT-2, which is very old, so although I can't spend millions of dollars, I'll spend probably a couple hundred bucks on cloud gpus to retrain the AI using something more recent (probably either qwen-1.5 or a small adaptation of the llama architecture)

Anyways, with all that said, the update will probably not be until sometime next month unfortunately. My old laptop GPU died, so i had to get a laptop. Fortunately, the data is all intact since it was just the GPU that crapped out on me. I currently have access to my external drive, which has all of the data i need to actually train the new models, so i can do that in the meantime. Though I am still working on transferring all of the build stuff that i need to be able to build the software, since that is on the internal drive.

Also update from the future, I just got a $50 grant from runpod for free with no strings attached so check them out if you like machine learning stuff, i have tried alot of services and they are, in fact, probably the best.