vluz

HateLLM will be a smash. /s

If at all true this would be world-changing news.

Lovely! I'll go read the code as soon as I have some coffee.

Don't trust brave, never will.

Goddammit! Don't tell that one, I use it to impress random people at parties.

Messing around with system python/pip and newly installed versions till all was broken and then looking at documentation.
This was way back on the 00's and I'm still ashamed on how fast completely I messed it up.

Me with four open cli terminals righ now:
https://i.kym-cdn.com/photos/images/original/001/617/650/91a.jpg

Oh my Gwyn, this comment section is just amazing.

I got cancelled too and chose Hetzner instead. Will not do business with a company that can't get their filters working decently.

Got one more for you: https://gossip.ink/
I use it via a docker/podman container I've made for it: https://hub.docker.com/repository/docker/vluz/node-umi-gossip-run/general

Absolutely stellar write up. Thank you!

I have a couple of questions.
Imagine I have a powerful consumer gpu card to trow at this solution, 4090ti for the sake of example.
- How many containers can share one physical card, taking into account total vram memory will not be exceeded?
- How does one virtual gpu look like in the container? Can I run standard stuff like PyTorch, Tensorflow, and CUDA stuff in general?

That's wonderful to know! Thank you again.
I'll follow your instructions, this implementation is exactly what I was looking for.

Just figured out there are 10 places called Lisbon dotted around the US, according to the search.

DS1 to DS3, I lost count of the hours.

Well done!