Official Xbox series controllers are relatively cheap for their quality (~40 dollars on sale) and there is an official Xbox dongle that allows for the connection of I think up to 8 controllers with a pairing button. I have not tested this configuration extensively but I think the dongle handles a lot of the logic so it should work better with worse drivers. Also when setting up everything one must just press the pairing button on the dongle and on each controller to get everything setup.
I have personally gone the VPN route with wireguard. Right now I have it setup so that all of my servers connect to my wireguard server on the VPS. Then I simply either just point my reverse proxy at the wireguard IP address or setup a forwarding rule in IP tables. Also try to get a VPS that is located close as it will reduce the ping times if that is important to you. I also recommend that you keep services which you only need to like ssh not forwarded and either use tailscale or wireguard to connect when you need to. With regards to the switch it is theoretically possible to setup a special access point with port forwarding through a VPN but it is much more complicated. It might be easier to accomplish this with a more traditional VPN service as some providers specifically cater to individuals looking to use a VPN for online play.