What are your must-have selfhosted services?
Always enjoyed scrolling though these posts, figured I'd give it a go here:
What are your must-have selfhosted services?
Some of mine:
-
Adguard Home - Add blocker
-
Adguard Home Sync - sync multiple adguard instances
-
Bookstack - documentation
-
BorgMatic - config driven backup
-
Change Detection - monitor websites for changes, prices for example.
-
FreshRSS - RSS reader
-
Home Assistant - home automation
-
KitchenOwl - groceries
-
Rclone - sync backups to remote storage
-
Traefik - reverse proxy
-
Vikunja - todo list
-
Wireguard Easy - VPN
Didn't see Paperless in these comments yet. Great way to never again search for documents, bills, receipts, warranties, manuals, etc cetera ad nauseam.
I installed paperless a couple of months ago, and then needed a document from it this week, for the first time. Standing at my front door, with a contractor waiting, I retrieved a contract in about ten seconds.
I will never stop using this software.
Link: Paperless-NG (Github)
Other than the obvious of being selfhosted, how does it compare to google drive for search/recall etc
I find it very useful due to its automatic assignment of various labels, categories and etc.
These assignments mean very little work for me to keep things tidy. Icrn use labels etc for filtering so it is extremely fast to find JUST the documents I want.
Paired with a small, fast duplex document scanner, it's incredibly convenient. Almost any kind of document I get in, just gets thrown into a scanner, and then into a box - no sorting.
Syncthing - No introduction needed. Couldn't live without it.
Healthchecks.io (you can self host this) - Dead man's switch monitoring for all my automation. Most of my automated scripts hit up a Healthchecks endpoint when they run, and if they fail to hit the endpoint on a regular schedule I get notified. Mandatory for my anxiety.
I have a network drive that I put all my documents on. Would using syncthing have a better workflow than that?
It depends on what your workflow/usecase for putting documents on the drive currently is. Syncthing is usually intended to be put on two separate devices, and then a folder on each device gets synchronized - meaning you have a folder of your documents on each device. Is there any reason not to just mount the network drive's folder and drag the documents in that way?
Yeah, that's how I do it now. I just mount the network drive on each PC and they can all access the same files. I'm just wondering if there's a usecase that syncthing has that my workflow doesn't that I just can't think of because I haven't used it.
Yeah I wouldn't bother. It intends for you to have a duplicate copy on every device, which is probably not what you want. Syncthing is really good for things like synchronizing notes, calendars, password databases, music, etc to your devices. Things that you want to access in both places, but that are usually disconnected from each other from time to time.
Oh, got it. That makes sense. Thanks for the info!
One of my favorites is Whoogle, a simple Google search proxy. It accepts search requests and forwards them to Google anonymously, then strips out the AMP links and tracking. There's even an option for it to use Tor so your IP address changes frequently.
Whoogle vs SearXng in your experience?
I used both, I ended up settling on searxng because Whoogle seemed to be unable to retain my settings. Might be something with my cookie configuration, but searxng has no problem remembering my preferences. If that is not a problem for you then they are comparable; Whoogle is pretty simple to get going and works well, searxng is slightly more complicated to set up (but not that much with docker) but has a ton more features.
I looked into SearX but didn't need all the extra features it has
All of the public instances seem to be rate limited and not return any results. Take it you don't get that issue self-hosting it?
Correct. And it's such a tiny, simple Docker install you could theoretically run it locally instead of a server.
Does your server have to be accessible from the internet or is it enough that it can go out to make the request? Just asking because I am keeping my setup in our intranet, no access from outside my home.
Yep, it just needs outbound connectivity. I run mine on an intranet like you, with VPN access for when I'm not at home.
After looking at other's lists I think I am missing a good document server. Emby isn't the best music and photo server so I could look at improving that, but it has been good enough for those purposes that I haven't felt like going to the trouble of installing anything else.
Highly recommend ditching emby for jellyfin!!
I bought both Plex and Emby. I started with Plex but had some technical issues related to my machine having multiple IP addresses so I switched to Emby. I tried Jellyfin before switching to Emby but it wasn't as capable as Plex or Emby (at least at the time) and I wanted something with some commercial support behind it. I have been pretty satisfied with Emby, but do wish it would get requested features added in a much more timely manner.
Thank you for taking the time to link everything and formatting the post
Under Proxmox, I have the following running currently:
**As LXC Containers: **
As a VM
The rest is all docker on the host OS which is Debian 12, this is not my complete list but the most used ones in my world:
Protected by Authentik's SSO
You may wonder why I am using Zitadel and Authentik, I first started with Zitadel, and moved to Authentik, but am evaluating both. They both have their positives. So far Authentik has been the most useful for me. And about the two password managers, I use Vaultwarden as it supports everything I need including Passkey support. My step daughter who is an adult is disabled so having an easier password like Psono makes it easier for her.
How has your experience been with the wyze cameras? Do you still need to be a wyze subscriber?
I'm not a Wyze subscriber and just use the cams for monitoring. The Wyze Cam Pan 3 so far has been quite amazing with low light full color pics whereas my Pan Cam 2 is just black and white in same low light.
With the bridge, you can pipe the feed it provides to Shinobi or another DVR which reads RTSP, RTMP or HLS feeds and saves them to your storage for full time recording so you don't need the subscription. You do have to login to your Wyze account for the bridge to work though but that's fine with me.
Any specific reason you're running Proxmox? Why not run everything in containers with one VM for HA? Why LXCs?
Can't speak for OP but I can say that I switched to proxmox from just running docker and services native. Proxmox offers a lot of flexibility, you can do snapshots, build many different LXC containers very easily, to keep things separate or have better control over resource usage. Also I run mine in a 3 node cluster so I can do live migration of VMs and pretty quick migrations of LXC containers. This all allows me to run my services with little to no downtime and have redundancy.
Sounds like the precursor to kubernetes and docker swarm!
Because, for Home Assistant, I moved it from Raspberry Pi 4 to a KVM and found it faster. I use Proxmox for that which I found to play nicer with it than just setting up a Debian Server and spinning up a KVM via QEMU on a desktop. I've been there and had issues over time. As for why LXC's they are smaller and the only ones I use are from https://tteck.github.io/Proxmox/ which makes them super simple to set up and run!
Immich for photos (the only proper Google photos alternative) Nextcloud for storing documents and photos (read by immich). Jellyfin to replace Plex.
PiHole
According to my continued survival on the planet, none.
Not all of us are so lucky. I was hospitalized for 3 weeks until I was able to get my PiHole back up. I was nearly a goner.
hahaha
Jellyfin
Syncthing.
Nextcloud, after setting it up it gives me everything I love about Google and Apple's cloud services without the privacy invasion or any of the other cons. And I even find it more stable and less buggy. 10/10
Same for me. But there is work involved in the maintenance, there are awkward transitions at times with PHP migrations. But I would not go back to Google. I have tons of storage space without having to pay the associated service fees at the cost of slower speeds.
My whole infrastructure is designed so that my homeserver is expendable.
Therefore my most important tool is Syncthing. It is decentral, which is awesome for uptime and reducing dependance on a single point of failure. My server is configured as the "introducer" node for convenience.
I try to find file-based applications, such as KeePassXC or Obsidian, whenever I can so that I can sync as much as possible with Syncthing.
Therefore there is (luckily) not much left to host and all of it is less critical:
So the worst thing that can happen when my server fails is: I need to import my OPML to a cloud provider and I loose syncing for some less important stuff and my homepage is not accessible.
Since I just rebuilt my server, I can confirm that I managed a whole week without it just fine. Thank you very much, Syncthing!
Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I've seen in this thread:
~ | High Availability HTTP | Hypertext Transfer Protocol, the Web IP | Internet Protocol LXC | Linux Containers NAS | Network-Attached Storage PiHole | Network-wide ad-blocker (DNS sinkhole) Plex | Brand of media server package SSH | Secure Shell for remote terminal access SSO | Single Sign-On VPN | Virtual Private Network nginx | Popular HTTP server
11 acronyms in this thread; the most compressed thread commented on today has 9 acronyms.
[Thread #285 for this sub, first seen 17th Nov 2023, 17:05] [FAQ] [Full list] [Contact] [Source code]
PiHole - blocking ads Home Assistant - home automation, smart lighting & more Nginx Proxy Manager - easy reverse proxying Lemmy - here we are, on Lemmy Immich - Google photos replacement Motioneye - for putting video streams into home assistant and getting motion detection WyzeBridge - connecting my Wyze doorbells to Motioneye Doods2 - quick to set up object/person recognition for video and camera streams
I often see wireguard and adguard or pihole mentioned. There's a service that provides a combination of wireguard and pihole in 1 docker compose file and has a web interface for wireguard clients (wgeasy) called wirehole. Been using our for 2 years or so, very happy with it.
In my opinion the most elegant solution for an ad blocking VPN.
I think a lot of people run opnsense, pfsense or similar.
So, run some sort of DNS blacklist on their home network, and wireguard into their home network
Nextcloud and jellyfin
Immich for image sharing and backup
Readeef for RSS reader
Blocky for dns
Jellyfin for multimedia streaming
Syncthing, Gitea, jellyfin (with arr stack), audiobookshelf, Kavita.
Wow Change Detection seems like a much better alternative to curling a webpage and using grep to search for particular elements... :/
It's easy to set up and use, I'd recommend it.
Pfsense, Bitwarden, NAS running Debian, Kubernetes cluster. I have plans to expand And add more services when I get some of my newer hardware online.
Currently running
Home assistant is high on my todo list right after i set up my new proxmox host
XMPP server and a basic WebDAV server.
My own Forgejo is nice to have.
Can someone tell me the difference between Wireguard vs Wireguard Easy?
I already have Wireguard installed, so I just wanted to know if I should switch.
Wireguard-easy is plain old wireguard with with a nice web interface for management, that's all.
Thanks, I'll switch when I get my RaspPi5 for sure.
A proxy to go to blocked sites (which is pretty much my justification for paying the price), potentially some obfuscating solution later if shit hits the fan. An IRC bouncer (what I actually get the most use of). A hobby website. An XMPP server. Mumble in case I ever have friends to play video games with.
I like Keepass - Password manager housed in an encrypted database. (dont' lose your master password)
I can't live without my Nextcloud + Email server. Having all my personal files, contacts, email, calendar, and other personal information immediately accessible synced and backed up with a single app on any device or platform I want to use, is a dream come true, and I get to do it without any Big Tech, avoiding their lock-in and privacy invasion and without any fees or limits beyond my own hardware.
OpenVPN is how I can access it from anywhere in the world, so that gets an honorable mention too.
Baby Buddy for tracking my kid's... Everything.
+1!!
Before the baby arrived I wondered how this could be useful, now that the baby is here this is indispensable. So glad I have this.
I’ve been playing with this and am wondering if you know how to log specific medicine like Tylenol and stuff like that.
I've used the ability to add "notes". Looks like you can add tags for organizing too.
I hardly ever see people talking about Pocketbase in threads like these, but as a dev I love it
Pocketbase is amazing.
For everyone else:
Realtime database
Authentication
File storage
Admin dashboard
What do you use it for and why do you like it over other databases
You don't hear a lot of talk because it's SQLite with a thin layer added on top (an SDK and some Oauth modules). You can achieve the same in 5 minutes with SQLite and a few NPM modules.
Vaultwarden AdGuardHome + Sync Jellyfin + FinAmp + Supersonic Linkding + Linkding Injector LLDAP Calibre-web + Kobo
Vaultwarden Jellyfin Sonarr Radarr Jacket
My personal setup:
I have been playing with some other tools, but these are the most important for me.
So the scanner saves the file in SMB-share(s), then Paperless(-xng) will automatically process it?
Maybe Paperless, with an LLM API integration to chat with the documents, using the power of referring to and verifying against Paperless' concrete results, would be somehow useful.
Edit: Oh, this is already being discussed on their GitHub. Of course it is!
You are right with the first part. It only takes three clicks to scan a doc and have it available.
As for me, I'm not interest in sending my documents to open AI. But it would definitely offer some nice functions.
You wouldn't have to. There are plenty of well-performing open-source models that work with an API similar to the Open AI standard, with which you can simply substitute OpenAI models by using a different URL and API-key.
You can run these models in the cloud, either selfhosted or "as a service".
Or you can run them locally on high-end consumer-grade hardware, some even on smartphones, and the models are only getting smaller and more performant with very frequent advancements regarding training, tuning and prompting. Some of these open-source models are already claiming to be outperforming GPT-4 in some regards, so this solution seems viable too.
Hell, you can even build and automate your own specialized agents in collaborating "crews" using frameworks, and so much more...
Though, I'm unsure if the LLM functionality should be integrated into Paperless, or rather implemented by calling the Paperless API from the LLM agent. I see how both ways could fit some specific uses.
Some features like a "tl,dr" bot would probably not even need high end hardware, because it does not matter if it takes ten minutes for a summary.
Features like a chat bot do not belong into paperless IMO.
True, that's a good take. Tl;dr for the masses! Do you think an internal or external tl;dr bot would be embraced by the Paperless community?
It could either process the (entire or selected) collection, adding the new tl;dr entries to the files "behind the scenes", just based on some general settings/prompt to optimize for the desired output – or it could do the work on-demand on a per-document basis, either based on the general settings or custom settings, though this could be a flow-breaking bottleneck in situations where the hardware isn't powerful enough to keep up with you. However, that only seems like a temporary problem to me, since hardware, LLMs etc. will keep advancing and getting more powerful/efficient/cheap/noice.
Right – but, opposingly to that, Paperless definitely do belong into some chatbots!
I think more "intelligence" in parsing the documents would be well-received. Just as OCR is fundamental to paperless, AI features could be the next step forward. Automatically extract the relevant positions of e.g. a bill, understand the document (and select the correct date, not my birthday) and apply correct tags to new documents.
Definitely!
Yes, I think that's the way to go. If the paperless-ngx team doesn't believe in following that path, someone else will probably fork the project and do it, or build something with similar capabilities "from scratch". Then, it'll be interesting to see what's coming forth of open-source models with capabilites similar to GPT-4Vision.... . . . . 🤯
For me it's gotta be Portainer, Vaultwarden, and Tailscale. Everything else (FreshRSS, Heimdall, Paperless) is just cream.
+1 for Tailscale. It's a vital piece of the system for me now.
What makes it so useful? Is it just remote access if you're away from your pc, or what do you use it for?
Tailscale is an overlay network, like a traditional VPN, but with very little config needed to get everything connected. You can use their managed lighthouse and management servers or run your own with Headscale.
Basically you just login to tailscale on all your devices and they get a LAN connection piped over the Internet without opening ports or needing to manage any infrastructure.
You dont need to expose any ports and the setup is really easy.
And you use the vaultwarden setup where letsencrypt certificates are done via dns challenge?
Basically that's how I use it, just a secure VPN tunnel to my home hosted stuff while I'm out. Painless to set up.
My current list is: AdGuardHome, Bazaar, Change Detection, CloudTube, Excaldraw, Filesbrowser, Ghost, Golink (Tailscale), IT Tools, Libreddit, Lidarr, Memos, mStream, Nginx Proxy Manager, OliveTin, OpenBooks, Overseerr, PairDrop, Pigallery, Pingvin Share, Plex, Prowlarr, qBittorrent, Radarr, Sonarr, Statping, Stirling PDF, Syncthing, Tautulli, Unmanic, Whoogle, WikiJS, YoutubeDL-Material
This one? https://github.com/CorentinTh/it-tools
Yes, that's the one. Sorry I didn't include links
Sandstorm
A bunch of random thought... If anyone has any brief tips...
I'm going to dive into borgmatic soon.
Is it possible to back up PCs on the same network?
I think I'm looking to do 2 things... Have my main PC synced to a backup drive. Nightly? So I can DD to a new drive if I mess some up on my PC. I'd like to be able to do this with my omv server too.
The other is just backing up nas storage and docker.
Borg seemed like a good option for some of that but I'm not sure about the usable syncing of a full system.
Also wireguard... Right now I use a VPN subscription and run apps through gluetun... Instead of using my vpns meshnet I use tailscale for outside the home access. So I guess my question is, could I set up wireguard and use that instead of tailscale? My main reason is to find a way other family could utilize the nas and gluetun VPN connection.
There's so much planning that goes into this stuff. Finding the right apps and then the workflow... 🥴
In the end I want to host cloud storage and photo sharing for family, as well as maybe let them stream my media. Have the cloud storage, and my personal storage backed up. And possible let family utilize my subscription VPN if possible.
You can sync easily to another device on the same network via ssh for example. You can also call a script automatically after the backup has been created and do your custom stuff in there.
I'm really liking borgmatic myself as a wrapper for Borg.
EDIT: I don't have experience doing full OS backups. I only make backups of specific directories.
Borg is great for backups.
To recover a running system you would normally use snapshots but backups. You want something like Timeshift, which integrates with the boot system and lets you boot into a previous snapshot if you mess up your install. You can also use a specialized filesystem like btrfs which has a built-in, more efficient method of doing snapshots.
By Darwin I had not heard of wg-easy before. That is indeed easier than my setup. Thank you.
MythTV for the AV ... Volumio too, but, not upgrading that to v3.
Not seen radicale mentioned here...
I was an early adopter of OwnCloud and then switched to Nextcloud and, well, just gave up with it... no-one edits documents on it, we don't look at photos on it, but we did use a shared calendar... so I ditched that, installed radicale and been much happier (ie less admin time, more life time)
Also running syncthing from our phones to a home built NAS and a tablet in the kitchen as the NextCloud photo upload was (still is?) broken.
I run Arch btw
Home Assistant of course... MotionEye in a Pi Zero...
And it's all behind a pfSense box with DNS and GeoIP blockers installed.
Oh, and EmonCMS for my SolarPV.
I don't know if you were trying to be funny but that got a smirk out of me.
+1 mythtv. It distributes OTA TV to kodi all over the house.
I run Radicale, got all my calendars, contacts, tasks/reminders and even notes on it. It's a great CalDAV & CardDAV server. Lightweight too, and backup is super simple since each thing is a plain text file. Been using it with DAVx5 on the phone and it works perfectly.
What do you use on your phone for Tasks?
OpenTasks is great, but hasn't had an update in 3 years, but jtx Board is unclear and massive overkill for me
I use Calengoo, it's a calendar app that supports both events and tasks in the same app.
But it depends on how you mean tasks, for me they're strictly reminders for "do thing at time". I don't use them for shopping lists or notes or things like that.
piped and libreddit, also i'd like to host my own simplex server
libreddit is dead though...
Is libreddit dead if you self host and don't make enough requests to end up rate limited?
I've been using libreddit on my synology nas, with the FF extension LibRedirect to redirect all reddit URLs to my local libreddit. It's been working well since the Redditpocolypse. I don't really use reddit often, so it might get used a few times a week if I'm searching for something.
Interesting.
For now, my old 3rd party reddit apps on Android still work with the simple workaround of being a mod (of my own hidden subreddit), since some mods needed 3rd party apps to do their work, so, apparently, reddit kept it open for all mod accounts.
works still fine, especially self-hosted
Oh cool. I thought the API changes broke it
Last time I checked, I had >30 containers running. 🙆
Do you like any of them more than others?
I respect all of them equally