Iirc it can run anything llama.cpp can because it just uses that under the hood.
Iirc it can run anything llama.cpp can because it just uses that under the hood.
Ok. I haven't tried it so I'll take your word for it. I'm just offering an easier alternative since the topic was "getting started"
There's also llamafile, super simple: download and run it.