A programmer has developed a terminal assistant powered by an open-source llms hosted locally for a customized and always ready-to-go assistant like a desktop Jarvis.
The development process involved getting the Ollama server running locally, preparing the program to run on a dedicated terminal session, and programming the llm client and its interactions.
Different models were tried for the assistant, with qwen3 of 8b and 14b parameters providing the best results.
Future enhancements include improving memory between sessions, more system interaction, and compatibility with other operating systems.