Introduction: The Setup – VIDEO COMMING SOON

After moving from Ubuntu with Mate Desktop to Mint LTS, we pulled out the existing scripts, improved the entire setup, and made significant improvements to the GUI. The goal was to get Ollama AI running smoothly on a Dell T7500 with NVIDIA GTX 1650.

---

Challenges Faced

1. Scripts Not Executing as Expected

Problem:

After switching from Ubuntu to Mint LTS, the scripts didn’t execute properly. Missing dependencies, permission issues – you name it, we hit it.

Solution:

We ensured that YAD, cURL, and jq were installed correctly. Permissions were cleaned up, and the scripts were made executable. Once all that was in place, everything executed as expected, kinda.

---

Implementation: Custom Bash Scripts for Interaction

1. Starting and Stopping Ollama

To get Ollama to run without glitches, we split the scripts into smaller parts for better readability and efficiency. Now, starting and stopping Ollama is a breeze, and we’re in full control of its operation.

2. Interacting with the AI

Interacting with Ollama AI is smooth. We updated the script that sends queries to the Ollama API to ensure proper communication between the AI and the system, making everything much more seamless.

---

GUI Integration with YAD

We didn’t want to be stuck in the terminal forever, so we created a simple GUI using YAD. The GUI makes interacting with Ollama more intuitive and user-friendly, while still maintaining all the power of the underlying bash scripts.

---

The Machines: Oracle and Oblivion

Oracle

• Role: Oracle is a machine for research, web tasks, and experiments. It doesn’t handle AI workloads, but it’s essential for testing configurations and setting up new environments.

• Setup: Oracle was set up with a clean install of Mint LTS after we ditched the 2-year-old, corrupted Arch Linux installation. It’s now purely functional, built for testing and experimentation.

Oblivion

• Role: Oblivion, the Dell T7500 with NVIDIA GTX 1650, is dedicated to running Ollama AI tasks.

• Setup: Oblivion was also set up with Mint LTS after we cleaned up the mess from its previous Ubuntu installation with Mate Desktop. It’s now fully focused on AI tasks, with everything optimized for performance.

---

Conclusion: AI, Tweaked and Tuned

Both Oracle and Oblivion now run Mint LTS, and the systems are running smoothly. While Oblivion is handling Ollama AI tasks, Oracle is providing the necessary environment for ongoing testing and experimentation. The system is now stable, with a smooth, streamlined setup for BOSSAI to work on other ubuntu based machines if wanted. Plus the GUI looks much better.

---

Consideration

• Debian with XFCE/Openbox or AntiX will give the lightest, most customizable setup.