LLM Finder

Match local LLMs to your GPU. Filter by VRAM + use case, then copy the download command.

8 GB12 GB16 GB24 GB48 GB80 GB
allcodingchatresearchcreativemath

15 models fit 16GB for creative

Data powered by llmfit ↗

Qwen2.5-32B-Instruct

32Bq2_K • 13.6GB

Family: Qwen

Estimated speed: 21-31 tok/s

Context: 33k

License: Apache-2.0

chatcodingresearchmathcreative
ollama pull qwen2.5:32b

Gemma-2-27B-Instruct

27Bq3_K_M • 15GB

Family: Gemma

Estimated speed: 18-28 tok/s

Context: 8k

License: Gemma Terms

chatcodingresearchcreativemath
ollama pull gemma2:27b

Yi-1.5-34B-Chat

34Bq2_K • 14.4GB

Family: Yi

Estimated speed: 20-30 tok/s

Context: 33k

License: Apache-2.0

chatresearchcreativemath
ollama pull yi:34b

Mistral-Nemo-12B-Instruct

12Bq8_0 • 16GB

Family: Mistral

Estimated speed: 21-31 tok/s

Context: 128k

License: Apache-2.0

chatcodingcreative
ollama pull mistral-nemo:12b

Gemma-2-9B-Instruct

9Bq8_0 • 12.4GB

Family: Gemma

Estimated speed: 30-40 tok/s

Context: 8k

License: Gemma Terms

chatresearchcreative
ollama pull gemma2:9b

Command-R-7B

7Bq8_0 • 10.1GB

Family: Cohere

Estimated speed: 36-46 tok/s

Context: 128k

License: CC-BY-NC

researchchatcreative
ollama pull command-r:7b

Llama-3.1-8B-Instruct

8Bq8_0 • 11.2GB

Family: Llama

Estimated speed: 33-43 tok/s

Context: 131k

License: Llama 3.1 Community

chatresearchcreative
ollama pull llama3.1:8b

Dolphin-2.9.2-Qwen2-7B

7Bq8_0 • 10.1GB

Family: Dolphin

Estimated speed: 36-46 tok/s

Context: 33k

License: Apache-2.0

chatcreativecoding
ollama pull dolphin3:8b

Yi-1.5-9B-Chat

9Bq8_0 • 12.4GB

Family: Yi

Estimated speed: 31-41 tok/s

Context: 33k

License: Apache-2.0

chatresearchcreative
ollama pull yi:9b

Llama-3-8B-Instruct

8Bq8_0 • 11.2GB

Family: Llama

Estimated speed: 34-44 tok/s

Context: 8k

License: Llama 3 Community

chatcreative
ollama pull llama3:8b

OpenChat-3.6-8B

8Bq8_0 • 11.2GB

Family: OpenChat

Estimated speed: 34-44 tok/s

Context: 8k

License: Apache-2.0

chatcreative
ollama pull openchat:8b

OpenHermes-2.5-Mistral-7B

7Bq8_0 • 10.1GB

Family: Nous

Estimated speed: 37-47 tok/s

Context: 33k

License: Apache-2.0

chatcreative
ollama pull openhermes

Zephyr-7B-beta

7Bq8_0 • 10.1GB

Family: Zephyr

Estimated speed: 38-48 tok/s

Context: 33k

License: MIT

chatcreative
ollama pull zephyr:7b

Llama-3.2-3B-Instruct

3Bfp16 • 9.1GB

Family: Llama

Estimated speed: 43-53 tok/s

Context: 131k

License: Llama 3.2 Community

chatcreative
ollama pull llama3.2:3b

Gemma-2-2B-Instruct

2Bfp16 • 6.9GB

Family: Gemma

Estimated speed: 51-61 tok/s

Context: 8k

License: Gemma Terms

chatcreative
ollama pull gemma2:2b