Spaces:

---

arcee-ai

/

mergekit-gui

like 288

Sleeping

The error still persists. Is this Space gone forever or something?

Anyone know any free alternative?

Anyone know any free alternatives?

There are no good/practical free alternatives that I know of. It is much more practical to just use a paid service.

But I do know of one, which i have been using, Google Collab. I mentioned it on another thread, and while I don't mean to spam (or advertise this shit), I feel like it could be of use to some people, and the extra visibility might help those people.

I have been using a modification of this notebook to make my merges (12B models) ever since this space died. So I know from experience that it works, despite being so constrained. Def not for everyone.
It is not good, but it is "free" (it costs your time, and might force you to make concessions in the merge's design)

https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing

The merge itself won't take long, but downloading the files into the notebook will take hours, depending on their size and service load.

From what I've seen, it takes about 20 minutes to download each 24-gigabyte-sized model (12B models, for example), so to download 4 it would take about 80 minutes, and that is before the merge even happens, which would also require a few mins)

Usually, you have about an hour of service per day (within about 24 hours), which might not be enough for most mergers, HOWEVER, If you use it only once every two to three days (yeah, 48 to 72 hours), you will have up to 3~ hours of service (the free daily time "stacks up" if unused, but only up to about 3 hours of service), which should be enough for most sensibly sized merges.

I recommend using the TPU runtime. It has something like 300 gigs of RAM and 200 gigs of storage.
Maybe the merge would be faster on a GPU, but it's a moot point; merge time is not a problem here, download time is. So stick to TPU where you at least have a lot of storage and RAM.

Hope this helps. Good luck.

And if anyone knows of any BETTER and FREE alternative to Collab, please let everyone know!

UPDATE: Collab doesnt allow MergeKit to run on it anymore, so disregard this. I felt I should mention that.

So yeah, no free alternative at all.