Spaces:
Runtime error
Error
I would be grateful if you restart the Space and fix the error, thanks in advance!
The error still persists. Is this Space gone forever or something?
Anyone know any free alternative?
Anyone know any free alternatives?
There are no good/practical free alternatives that I know of. It is much more practical to just use a paid service.
But I do know of one, which i have been using, Google Collab. I mentioned it on another thread, and while I don't mean to spam (or advertise this shit), I feel like it could be of use to some people, and the extra visibility might help those people.
I have been using a modification of this notebook to make my merges (12B models) ever since this space died. So I know from experience that it works, despite being so constrained. Def not for everyone.
It is not good, but it is "free" (it costs your time, and might force you to make concessions in the merge's design)
https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing
The merge itself won't take long, but downloading the files into the notebook will take hours, depending on their size and service load.
From what I've seen, it takes about 20 minutes to download each 24-gigabyte-sized model (12B models, for example), so to download 4 it would take about 80 minutes, and that is before the merge even happens, which would also require a few mins)
Usually, you have about an hour of service per day (within about 24 hours), which might not be enough for most mergers, HOWEVER, If you use it only once every two to three days (yeah, 48 to 72 hours), you will have up to 3~ hours of service (the free daily time "stacks up" if unused, but only up to about 3 hours of service), which should be enough for most sensibly sized merges.
I recommend using the TPU runtime. It has something like 300 gigs of RAM and 200 gigs of storage.
Maybe the merge would be faster on a GPU, but it's a moot point; merge time is not a problem here, download time is. So stick to TPU where you at least have a lot of storage and RAM.
Hope this helps. Good luck.
And if anyone knows of any BETTER and FREE alternative to Collab, please let everyone know!
UPDATE: Collab doesnt allow MergeKit to run on it anymore, so disregard this. I felt I should mention that.
So yeah, no free alternative at all.
What an age to live in. Everything was so perfect until they had to ruin it all.
hey all i find this altranative. hhave a look
https://www.kaggle.com/code/eugeniokukes/llm-merge-kit-create-your-own-model/notebook
If you install "pip install mcp==1.12.4" in Colab, then MergeKit plus or minus works.
But now HuggingFace has introduced a download restriction https://huggingface.co/docs/hub/storage-limits.
usually up to 5TB for impactful work
That is, if not "as useful to the community as possible", then you will only have 5 terabytes.
Если в Colab установить "pip install mcp==1.12.4", тогда MergeKit плюс-минус, работает.
Но сейчас HuggingFace ввели ограничение на загрузку https://huggingface.co/docs/hub/storage-limits.
usually up to 5TB for impactful work
То есть если не "as useful to the community as possible" тогда у тебя будет только 5 терабайт.
for the past 3 months i been using Kaggle's TPU enviroment instead.
for now, it just works.
tho, i have a rousing suspicion that will change, which would be... quite sad, to say the least.
This code here is ready to use as is, just change the token and username.
oh, and be SURE to change your notebook to private before that.
You will have about 130 GB of storage and 130 GB of ram with this, also up to 9 hours per session. Most sensible merges will be done within 20~ minutes tho.
also, you might want to change the default license on the readme template.
According to Kaggle, there for pip you need to enable an Internet connection, in space, and I can't confirm the phone number, so this is not an option. Only if you don't understand it separately by mail.
And so in Colab normally merdzhit that I can, but I can't put anything in the account due to the fact that I already have much more than 5 terabytes in general access.
По Kaggle, там для pip нужно включить интернет соединение, в пространстве, а я не могу подтвердить номер телефона, так что это не вариант. Только если отдельно по почте не разбираться.
А так в Colab нормально мерджить то я могу, но я ничего не могу в аккаунт выложить из-за того что у меня уже сильно больше чем 5 терабайт в общем доступе.
@DreadPoor man you have made my day. thanks a lot for gifting this wonderful notebook please take love from me. ❤️🔥❤️🔥❤️🔥💕💕💕💕💕💕💕💕💕
@DreadPoor i am only getting 40GB disk space though. I clicked copy and edit notebook and then i pressed share button and saelected private but still getting only 40GB disk space
@DreadPoor I just view the code and now I know. its a brilieant idaea to use /dev/shm as kaggle gives the huge ram we can store models in ram lol. i get it now thanks a lot mate
@zelk12
I am not sure I understand... sorry.
Do you mean this here on Hugging Face?
It shouldn't affect your ability to download from Hugging Face, but just the ability to upload to it.
And if that is the case... yeah, i don't think there is much that can be done about it, aside from maybe deleting some stuff, unfortunately.
if it's about limits on Colab, i... don't know of any limits, aside from their hardware and runtime quota (time).
i am getting you are having issues making an account on Kaggle? or maybe issues configuring it?
i dont remember now, but i think you should be able to log into Kaggle using a Google account, which should streamline the process somewhat.
Check these too, once you are in:
i am not sure i can be of any further help to anyone. Sorry, I am just a goober.
i wish you luck tho.
Guys, here is a fully alternative in Kaggle. This one has ui just like Merget GUI. Please use it, and I hope it helps others. I want services like this to be free so creative people can practice their creativity. I used AI to help me code here. Please use it just like @DreadPoor said; this is a modified version of his notebook.
Here is some small info
Just copy and edit the notebook and make it private. Select TPU, and you are good to go... run the cell, you will see ui input boxes in the output. Use them and press the start merging button.
You can hide the code and show only the output 😄. cheers🥂
Kaggle notebook: https://www.kaggle.com/code/modaitrainer/interactive-mergekit-pro