Skip to content
local-ai

Model catalogue

Models you can run on your own hardware, with plain-English licence classifications, approximate memory requirements, and honest strengths and weaknesses. Filtering and search arrive with the interactive catalogue; for now, everything is grouped by type below.

3 models.

  • Llama 3.2 3B Instruct

    Meta · Text generation · 3B

    A small 3-billion-parameter model that runs on almost anything, including laptops without a dedicated GPU. Capable for its size at summarising, rewriting, and simple assistant tasks, and a good first model to try.

    Permitted with conditionsfrom ~2.2GBTiny
    GGUFMLX

  • Llama 3.3 70B Instruct

    Meta · Text generation · 70B

    Meta's 70-billion-parameter instruction-tuned model, delivering performance close to their much larger 405B model at a fraction of the hardware cost. A strong general-purpose choice if you have the VRAM for it.

    Permitted with conditionsfrom ~43GBLarge
    GGUFMLX

  • Qwen2.5-Coder 7B Instruct

    Alibaba · Code · 7B

    Alibaba's code-specialised 7B model, strong at code completion and generation well beyond what its size would suggest. A practical choice for a local coding assistant on a mid-range GPU, and permissively licensed.

    Commercial use permittedfrom ~4.7GBTiny
    GGUFMLX