- 79 Posts
- 125 Comments
4·3 months agoMy (docker based) configuration:
Software stack: Linux > Docker Container > Nvidia Runtime > Open WebUI > Ollama > Llama 3.1
Hardware: i5-13600K, Nvidia 3070 ti (8GB), 32 GB RAM
Docker: https://docs.docker.com/engine/install/
Nvidia Runtime for docker: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html
Open WebUI: https://docs.openwebui.com/
No, but the “AI” option available on Mozilla Lab tab in settings allows you to integrate with self-hosted LLM.
I have this setup running for a while now.
BTW, Lab option works better privacy wise (than Add-on) if you have LLM running locally, IMO.
Even they choose to do so in future, usually there always is a about:config entry to disable it.
It’s an add-on, not something baked-in the browser. It’s not on your property at the first place, unless you choose to install it 🙂
In such scenario you need to host your choice of LLM locally.
I came here to tell my tiny Raspberry pi 4 consumes ~10 watt, But then after noticing the home server setup of some people and the associated power consumption, I feel like a child in a crowd of adults 😀
Remember NOT to store any private data or login to any account as this VM is not hosted on your system.
Use this server just to test out distros quickly.
If you just want to try a Linux distro out, you may use https://distrosea.com/
2·4 months agoit’s just more configurable
That’s an understatement 😄 The amount of configuration KDE offers is mindbogglingly to me. Again, UX and degree of configuration are very subjective matters.
You may try immutable OS like NixOS. Modern-day kernel has way better hardware support than earlier days.
1·4 months agoSame for me, but via Cloudflare tunnel. No need to expose your system to world unless that is what you want.
On Ubuntu, only the server version of driver is available at this point.
nvidia-dkms-565-server-open
nvidia-dkms-565-server
Variable refresh rate (VRR) allows your display to match the framerate of an image source, such as a game — and doing so prevents screen tearing. Support for VRR has been added to the cosmic-comp compositor and Displays Settings. You can set VRR to be either always on or automatic, which will enable VRR for fullscreen content.
1·4 months agoSomeone gagged the AI before it could complete that sentence 😜
If you just want to “try it out” and not planning to store any private data then you may try this:
I miss my computer’s performance being held hostage by “Active Protection” feature of Virus scanner!
Flatpak version is not v3 optimized, I think.
It is 🙂
This is just an add-on BTW. It’s completely up to you to decide if you need this.