Hey, I'm new to GitHub!

LinearArray@programming.dev to Programmer Humor@programming.dev – 1229 points –
299

You are viewing a single comment

That’s how it feels with alot of self-hosted AI stuff now. Even the youtube videos out there that start off with, “Hey guys, I’m gonna show you this super simple, easy way you can run your own self-hosted LLM. First pull up terminal…” and proceeds to spend a half-hour going over some kind of basic coding and cloning repos that’s still way above my head. Is it Git? Is it python? Is it both, what the fuck is going on? I just wanted an uncensored AI model that will generate My Little Pony furry porn, not a master-class in writing a bunch of seemingly random nonsensical commands.

Step 1) Download the LLM with git

Well, fuck we should have known that this requires a masters in computering. Dude these comands are easy, literally copy and paste. The instructions are literally handholding you to run it and thats still to complicated. Also who makes furry porn with a Large Language Model?

You made me chuckle. But let's all agree that learning to use git is a ball ache and isn't very intuitive. Throw repositories into the mix and lay people just aren't gonna get it. I think using git should be taught in highschool IT classes though, most people will never use it, but it will massively help those who do need to learn it.

Frequently repos say "git clone [repo url]" which i think is enough for most people to copy and paste. I'm a programmer and usually I just click things in my IDE to do git work for me so I'll agree its not an easy thing to use.

We NEED a rated R season 3 and that bitch will give me the script! ...

... /s

Just install stable diffusion via command line and download the models and Loras from civitai. It's really that simple.

I gotchu

LM studio

Thank me later. If you wanted the drawing shit then like that other guy said install Automatic1111

Yeah, I've been messing around with LM Studio for a few weeks/months now and compared to the alternatives, that's about the easiest thing out there. Setup through Command Line seems to be the norm outside of that. I was just messing around with trying to install the ChromaDB plugin for LM Studio and ran into that issue of the command line again. Like I don't know if they're talking about just the generic Windows Command Line program, if Git needs to be installed, is it in a python environment or does python need installed, and the guides I've tried going through seem to just skip over these basic steps and just assume you already know exactly what they're talking about, that seems like a regular thing, just not enough preliminary explanation.

Like, I've had some experience with coding over the years in various languages, but I'm used to a certain amount of hand-holding for basic guides, something like, "You'll need this installed from here, go ahead and load up this thing, blah blah blah." In most of the tutorials I've been seeing for anything related to LLMs or AI image generators or whatever, there's just rarely any acknowledgement of complete newbies to the process, it's just assumed you know everything they're talking about already. I realize it's alot of copy/pasting and it's pretty straight-forward, but it feels like many guides are just glossing over really basic need-to-know info.

That's cause it changes all the time, so it's very hard to maintain these things. Literally every day a new paradigm shift comes out kinda