Well, here's my first post on the fediverse!
Background in IT and server administration here. I however do not know much about the intricacies of the fediverse, but am interested in learning. Here's my two cents based on a background of LAMP stacks for web hosting.
The required space would likely scale and vary greatly depending on how much content is hosted locally. Assuming minimum space similar to a basic LAMP server it'd likely have starting space requirements of less than 1GB. If local content is primarily text/links to content hosted elsewhere it would take a lot to drastically change that space requirement. Image hosting can vary greatly depending on size, quality, and number of images. Video hosting is an absolute space hog even at fairly low resolutions by today's standards.
Bandwidth requirements would scale similar to storage requirements.
Other specs would also start very low if fediverse requirements are similar to a LAMP stack. Cores are typically more important than core speed in web server hosting as each request will try to use a separate core, but doesn't need much processing power to provide that request since the server isn't actually rendering anything.
Likewise, you shouldn't need much memory on a web host. Will scale with the number of scripts running on the host but I suspect that shouldn't be many unless you're also running moderation bots, but those should ideally be run on a different server instance.
That said, I'd also be curious to hear from other people that have experience with the fediverse though and other recommended specs to potentially host an instance.
If anyone has other questions I'm happy to try to help :)
The
activity
table is also used to deduplicate incoming federation data, so instead of truncating it, I'd suggest deleting rows after a certain amount of time.For my personal instance, I set up a cron to delete entries older than 3 days, and my db is only ~500MB with a few weeks of content! I also haven't seen any duplicated posts or comments. Even with Lemmy's retries, 3 days seems to be long enough before dropping rows from that table.
Could you share the cron/script you use to do this? I'm interested in hosting my own Lemmy at some point, and having a script for that cleanup would be hugely helpful for me.
Definitely! I'm hosting in Kubernetes so I won't post the full thing, but here's the actual command that I run hourly. Make sure to replace the values for
database
,username
, andpassword
.Awesome, that was just as straightforward as I was hoping it was, thanks! I am more familiar with MySQL as I haven't used Postgres a ton but SQL is SQL after all lol
You're welcome! Makes sense. They're somehow so similar yet so different lol
I'll have to try this later. Thanks for the tip!
Can you help me set this up also or share the script I would run to do this? Many thanks.
Sure! My script will look a little different since I'm hosting Lemmy in Kubernetes, but basically you will want to run the following command hourly. Make sure to replace the values for
database
,username
, andpassword
.Thank you :)
You're welcome!
Hi - can you help me set this up or share the script that you use to do this? Many thanks :)
This is a great idea, thank you!
How are you keeping your
pictrs
directory so small?Mine is at about 5GB after two weeks with just a single user. š¬
Haha, I don't know xP.
Just checked and it has only one image.
Did you configure the pictrs API keys for Lemmy and for pictrs?
If they're not configured then I could see Lemmy not even using pictrs.
Ohh!!
That's what's happening, I haven't uploaded any pictures so I didn't noticed, aside from that I'm not sure what are the other use cases of pictrs
Don't quote me on it but I think it, besides handling image uploads, caches thumbnails for link posts.
I also have around 3GB used for
pictrs
and Iām not really sure the best way to see what all content is in there.Yeah I haven't uploaded any images on my instance myself. So none of those images are mine. Might do some reading tomorrow and see if there's any mention of this in the past on other communities. It's not an emergency but I'm curious.
That's strange. Please let me know what you find out.
I had found an old post which indicates that post thumbnails are cached. So I guess there's that.
In case you didn't see it, the OP of this thread realized they didn't setup their
pictrs
API key.. so I guess it's possible to omit that and lemmy should still work. Not sure about the downsides.