• 0 Posts
  • 69 Comments
Joined 1 year ago
cake
Cake day: December 7th, 2023

help-circle
  • Welcome to Lemmy!

    For me the first Linux distribution I used was Ubuntu 8.04 - though I never had installed it on physical hardware, just a VM - VirtualBox IIRC (that didn’t occur till Ubuntu 8.10). I was in my early teenage years and had discovered Linux and found it interesting, I used the WUBI tool to install it through Windows and updated the bootloader to keep Windows as the default (with a one second timeout) since it was the family computer, I think my family would’ve shat their pants if they randomly rebooted the PC and was greeted with Linux heh.

    Though a few years later on an old secondary family laptop (it was the “someone else is using the other computer” spare/backup) that was running Vista, it had gotten so buggy and bogged down that I installed Kubuntu for my family and they happily used that until eventually that laptop was retired. It never got them to really look into permanently switching to Linux, but I think that’s more than fine - I’ve never been one to “proselytize” Linux: If it is the right tool for you, fantastic - if not, no hard feelings is how I see it. In the aforementioned case, it was the better tool over the bogged down and buggy Vista.

    As for nowadays, its CachyOS on my desktop (I’m not married to it, but its been working alright for me for about a year now), SteamOS on my Deck, Fedora on my secondary laptop (an old intel macbook), and then Bazzite on my ROG Ally. Windows is still installed on a secondary drive on my desktop, but I very rarely have to boot into it.



  • Not to my knowledge, no*. Though it’s been a while since I looked into it.

    * Outside of running them inside a Windows VM on Linux, but that has its own issues. Especially if you use any of the CC apps that need GPU acceleration. It can definitely be done, but I’d argue most people are not going to want to go through the effort and rather just use Windows directly.





  • Ah, I thought this was in regards to AFK tracking when discord isn’t focused (which this plugin still won’t fix due to the mentioned Wayland restrictions) - I didn’t realize that it still didn’t work even when discord was focused, which is strange.

    I’ve been using Vesktop since screen share wasn’t working on Wayland, and it already seems to do what this plugin does hence my confusion.



  • Primarily I use Arch on my desktop (and by proxy, my Steam Deck which runs SteamOS), which is what I’ve landed on after a ton of distro hopping. The idea of Atomic distros catches my eyes, but for me in its present state there are too many steps needed in order to make deeper changes (for example, installing a kernel module) - but I quite like SteamOS on my Deck since I know it will always be in a “consistent” state, for example.

    On servers I run a mix of Rocky Linux and Debian.







  • Hmm, gotcha. I just tried out a fresh copy of text-gen-webui and it seems like the latest version is borked with ROCM (I get the CUDA error: invalid device function error).

    My next recommendation then would be LM Studio which to my knowledge can still output an OpenAI compatible API endpoint to be used in SillyTavern - I’ve used it in the past before and I didn’t even need to run it within Distrobox (I have all of the ROCM stuff installed locally, but I generally run most of the AI stuff in distrobox since it tends to require an older version of Python than Arch is currently using) - it seems they’ve recently started supporting running GGUF models via Vulkan, which I assume probably doesn’t require the ROCM stuff to be installed perhaps?

    Might be worth a shot, I just downloaded the latest version (the UI has definitely changed a bit since I last used it) and just grabbed a copy of the Gemma model and ran it, and it seemed to work without an issue for me directly on the host.

    The advanced configuration settings no longer seem to directly mention GPU acceleration like it used to, however I can see it utilizing GPU resources in nvtop currently, and the speed it was generating at (the one in my screenshot was 83 tokens a second) couldn’t have possibly been done on the CPU so it seems to be fine on my side.