Introduction: The Setup – VIDEO COMMING SOON
After moving from Ubuntu with Mate Desktop to Mint LTS, we pulled out the existing scripts, improved the entire setup, and made significant improvements to the GUI. The goal was to get Ollama AI running smoothly on a Dell T7500 with NVIDIA GTX 1650.
Challenges Faced
1. Scripts Not Executing as Expected
Problem:
After switching from Ubuntu to Mint LTS, the scripts didn’t execute properly. Missing dependencies, permission issues – you name it, we hit it.
Solution:
We ensured that YAD, cURL, and jq were installed correctly. Permissions were cleaned up, and the scripts were made executable. Once all that was in place, everything executed as expected, kinda.
Implementation: Custom Bash Scripts for Interaction
1. Starting and Stopping Ollama
To get Ollama to run without glitches, we split the scripts into smaller parts for better readability and efficiency. Now, starting and stopping Ollama is a breeze, and we’re in full control of its operation.
2. Interacting with the AI
Interacting with Ollama AI is smooth. We updated the script that sends queries to the Ollama API to ensure proper communication between the AI and the system, making everything much more seamless.
GUI Integration with YAD
We didn’t want to be stuck in the terminal forever, so we created a simple GUI using YAD. The GUI makes interacting with Ollama more intuitive and user-friendly, while still maintaining all the power of the underlying bash scripts.
The Machines: Oracle and Oblivion
Oracle
-
Role: Oracle is a machine for research, web tasks, and experiments. It doesn’t handle AI workloads, but it’s essential for testing configurations and setting up new environments.
-
Setup: Oracle was set up with a clean install of Mint LTS after we ditched the 2-year-old, corrupted Arch Linux installation. It’s now purely functional, built for testing and experimentation.
Oblivion
-
Role: Oblivion, the Dell T7500 with NVIDIA GTX 1650, is dedicated to running Ollama AI tasks.
-
Setup: Oblivion was also set up with Mint LTS after we cleaned up the mess from its previous Ubuntu installation with Mate Desktop. It’s now fully focused on AI tasks, with everything optimized for performance.
Conclusion: AI, Tweaked and Tuned
Both Oracle and Oblivion now run Mint LTS, and the systems are running smoothly. While Oblivion is handling Ollama AI tasks, Oracle is providing the necessary environment for ongoing testing and experimentation. The system is now stable, with a smooth, streamlined setup for BOSSAI to work on other ubuntu based machines if wanted. Plus the GUI looks much better.
Consideration
-
Debian with XFCE/Openbox or AntiX will give the lightest, most customizable setup.