I’ve been digging into the rabbit hole for a few months. Been switching to Linux, FOSS everything I can, trying to go to smaller sites, the least dubious social media, VPN, trusted mail, etc etc

But lately I’ve been in a rough state mentally (I say lately but it’s always been with me) and having GPT guide me and being able to just dictate what I think helps me a lot on various levels, for various reasons.
But at this point, using ChatGPT with a mic, isn’t this basically cancelling every effort I’ve made? (using it in the first place anyway) I’m weak and it helps me, should I just throw my efforts out of the window and just say I don’t care about privacy anymore and use whatever everyone uses? (on one hand, I’ve found alternatives for almost everything, so I could keep on using those, but also, again, if I keep on using GPT on a regular basis, this is probably the worst threat the future has to offer in termes of privacy, so…I’m lost)

    • swelter_spark@reddthat.comEnglish
      4·
      3 days ago

      Llamacpp, Koboldcpp, and TabbyAPI are also popular local backends for local AI. SillyTavern or RisuAi are good frontends for a chat/RP style experience. Or LM Studio for a simple, all in one solution.

    • Facebones@reddthat.com
      6·
      3 days ago

      I actually got it to run reasonably on a mini PC in a docker container, but my setup also lets me use CPU power as a psuedo GPU.

    • AkashicOwl@lemmy.worldOP
      21·
      3 days ago

      I have been suggested to self host in the past. But as I’m concerned for ecology, and let’s be a honest, a bit of my money too, I’ve thought that self hosting, meaning having the PC always on, was not a good thing. So I left the dilemma in this state, not knowing how “bad” this would actually be in terms of electric consumption, and if it was worth the trade with privacy or not.

      • swab148@lemm.ee
        4·
        3 days ago

        That’s pretty dependant on hardware. If you host small stuff , like a pihole or something, that can be done relatively cheaply, by using a micro-PC or a Raspberry Pi. Some services don’t need to be always-on either, you only need stuff all the time if it’s mission-critical, otherwise you can turn stuff on and off as necessary, for power-saving purposes. Self-hosting doesn’t necessitate a huge rack and switches, or even your big gaming rig, my favorite thing to do with old laptops is throw Debian on it and find something I’d like to self-hosting from this list.