Skip to content
local-ai

Solutions catalogue

The tools that make local AI work: inference engines, desktop apps, coding assistants, RAG frameworks, and more. Every entry carries an honest weaknesses list, whatever its commercial relationship with us.

3 solutions.

  • llama.cpp

    Inference enginesOpen source

    The inference engine that much of the local AI ecosystem is built on. A C/C++ implementation that runs GGUF models efficiently across CPU, CUDA, Metal, Vulkan, and more, with fine control over how inference behaves.

    macOSWindowsLinux

  • LM Studio

    Desktop appsProprietary

    A polished desktop app for discovering, downloading, and chatting with local models through a graphical interface. A good fit if you would rather not touch a command line, with a built-in local server for connecting other tools.

    macOSWindowsLinux

  • Ollama

    Desktop appsOpen source

    The fastest route to a working local model. Ollama wraps llama.cpp with simple model management, a one-line pull-and-run workflow, and a local API that many other tools speak to. The usual first recommendation for newcomers.

    macOSWindowsLinuxDocker