Skip to content
local-ai

What can I run?

Pick your hardware, or enter how much memory you have, and see which models in our catalogue fit, at the best quantisation each allows. Everything runs in your browser; nothing is sent anywhere.

Model type

2 models fit in 12GB.

Text generation

  • Llama 3.2 3B Instruct

    3B
    Best fitFP16
    Approx. VRAM~6.5GB / 12GB
    Workable — some headroomPermitted with conditions

Code