I'm increasingly unhappy with the limits on AI text generation and I have heard that it's not that hard to do it on a laptop oneself. What is the best path forward?
I saw Generative AI for Beginners from Microsoft on GitHub. I've looked at https://fmhy.pages.dev/ai but I'm not sure what I'm really looking for.
I write fiction, and I want a chatbot that will function like chat gpt3.5, but not shut down if things get bloody or sexy, as they so often do.
You know ready, aim, fire? I'm in the AIM stage.
You are viewing a single comment
I would look into NovelAI for writing, it's quite specifically for that. It's a paid servicd similar to chatgpt, but it's uncensored and private.
You can run your own lightweight LLM on a laptop but the output will be useless. Good output requires big boy compute.
If you do want to run it on your own hardware, look into Ollama. There's also options to run your own LLM in the cloud with a not too difficult process for non-techies.
Frankly, id find the right LLM for your needs and just pay for it per month, maybe novelai, maybe something else, but chatgpt is not great for creative fiction.
I got a little TOO MUCH involvement from NovelAI. I guess I want suggestion help, idea spitball help, but it's specialized what I'm looking for.
I want my ai to stay on the shelf with my thesaurus until I'm ready to use it.
What does too much involvement mean? As someone looking to get into this myself I'm curious about your experience.
The two things that stand out to me are
Creating backstories, characterizations, etc etc etc. All that stuff they tell you to do in novel writing class that sometimes you might do, or if you're me you don't.
The AI likes to just start writing narratively, taking on the job of crafting words. That's not what I'M looking for. I want a sounding board to bounce ideas off, suggest alternative directions, possible motives, help me brainstorm.
Point two has always been a problem for me, because they tell me I'm autistic. All I know is I have some coping mechanisms I've had to use over the years. It wasn't really a thing when I was a kid. But I don't see alternatives very well. So having an outside entity suggest things that hadn't occurred to me gives me more choice in plot lines and decision points. I write ok alone. But I'm excited to see what ai can help me do.
Interesting, im vaguely interested in this too. i have half of a world written that i want to turn into a game maybe (probably not but, amhaving fun) I have the hardware to turn what i have into an embedding for an open model, and the hardware to run it. So that's the way i would go about it, though i can't advocate for how helpful it would be (yet)