LLM Finder

Match local LLMs to your GPU. Filter by VRAM + use case, then copy the download command.

GPU VRAM

8 GB 12 GB 16 GB 24 GB 48 GB 80 GB

Use Case

all coding chat research creative math

27 models fit 16GB for coding

Data powered by llmfit ↗

Qwen2.5-Coder-32B-Instruct

32Bq2_K • 13.6GB

Family: Qwen

Estimated speed: 20-30 tok/s

Context: 33k

License: Apache-2.0

codingchatmathresearch

ollama pull qwen2.5-coder:32b

DeepSeek-Coder-33B-Instruct

33Bq2_K • 14GB

Family: DeepSeek

Estimated speed: 20-30 tok/s

Context: 16k

License: DeepSeek License

codingchatmath

ollama pull deepseek-coder:33b

Command-R-35B

35Bq2_K • 14.8GB

Family: Cohere

Estimated speed: 18-28 tok/s

Context: 128k

License: CC-BY-NC

researchchatcoding

ollama pull command-r:35b

Qwen2.5-32B-Instruct

32Bq2_K • 13.6GB

Family: Qwen

Estimated speed: 21-31 tok/s

Context: 33k

License: Apache-2.0

chatcodingresearchmathcreative

ollama pull qwen2.5:32b

Gemma-2-27B-Instruct

27Bq3_K_M • 15GB

Family: Gemma

Estimated speed: 18-28 tok/s

Context: 8k

License: Gemma Terms

chatcodingresearchcreativemath

ollama pull gemma2:27b

DeepSeek-R1-Distill-Qwen-14B

14Bq5_K_M • 12.9GB

Family: DeepSeek

Estimated speed: 24-34 tok/s

Context: 33k

License: MIT

mathresearchcoding

ollama pull deepseek-r1:14b

CodeLlama-34B-Instruct

34Bq2_K • 14.4GB

Family: CodeLlama

Estimated speed: 21-31 tok/s

Context: 16k

License: Llama 2 Community

codingmath

ollama pull codellama:34b

Phi-4-14B-Instruct

14Bq5_K_M • 12.9GB

Family: Phi

Estimated speed: 25-35 tok/s

Context: 128k

License: MIT

codingmathresearchchat

ollama pull phi4:14b

Qwen2.5-Coder-14B-Instruct

14Bq5_K_M • 12.9GB

Family: Qwen

Estimated speed: 25-35 tok/s

Context: 33k

License: Apache-2.0

codingchatmath

ollama pull qwen2.5-coder:14b

Phi-3-medium-128k-instruct

14Bq5_K_M • 12.9GB

Family: Phi

Estimated speed: 25-35 tok/s

Context: 131k

License: MIT

codingchatresearchmath

ollama pull phi3:medium

StarCoder2-15B-Instruct

15Bq5_K_M • 13.7GB

Family: StarCoder

Estimated speed: 24-34 tok/s

Context: 16k

License: OpenRAIL-M

codingmath

ollama pull starcoder2:15b

Mistral-Nemo-12B-Instruct

12Bq8_0 • 16GB

Family: Mistral

Estimated speed: 21-31 tok/s

Context: 128k

License: Apache-2.0

chatcodingcreative

ollama pull mistral-nemo:12b

Qwen2.5-14B-Instruct

14Bq5_K_M • 12.9GB

Family: Qwen

Estimated speed: 26-36 tok/s

Context: 33k

License: Apache-2.0

chatcodingresearchmath

ollama pull qwen2.5:14b

DeepSeek-R1-Distill-Qwen-7B

7Bq8_0 • 10.1GB

Family: DeepSeek

Estimated speed: 33-43 tok/s

Context: 33k

License: MIT

mathresearchcoding

ollama pull deepseek-r1:7b

Qwen2.5-Coder-7B-Instruct

7Bq8_0 • 10.1GB

Family: Qwen

Estimated speed: 35-45 tok/s

Context: 33k

License: Apache-2.0

codingchat

ollama pull qwen2.5-coder:7b

CodeLlama-13B-Instruct

13Bq5_K_M • 12.1GB

Family: CodeLlama

Estimated speed: 30-40 tok/s

Context: 16k

License: Llama 2 Community

codingmath

ollama pull codellama:13b

DeepSeek-Coder-6.7B-Instruct

6.7Bq8_0 • 9.7GB

Family: DeepSeek

Estimated speed: 37-47 tok/s

Context: 16k

License: DeepSeek License

codingchat

ollama pull deepseek-coder:6.7b

Dolphin-2.9.2-Qwen2-7B

7Bq8_0 • 10.1GB

Family: Dolphin

Estimated speed: 36-46 tok/s

Context: 33k

License: Apache-2.0

chatcreativecoding

ollama pull dolphin3:8b

Qwen2.5-7B-Instruct

7Bq8_0 • 10.1GB

Family: Qwen

Estimated speed: 37-47 tok/s

Context: 33k

License: Apache-2.0

chatcodingresearchmath

ollama pull qwen2.5:7b

CodeGemma-7B-Instruct

7Bq8_0 • 10.1GB

Family: Gemma

Estimated speed: 37-47 tok/s

Context: 8k

License: Gemma Terms

codingchat

ollama pull codegemma:7b

WizardLM-2-7B

7Bq8_0 • 10.1GB

Family: WizardLM

Estimated speed: 37-47 tok/s

Context: 33k

License: Llama 2 Community

chatcoding

ollama pull wizardlm2:7b

StarCoder2-7B-Instruct

7Bq8_0 • 10.1GB

Family: StarCoder

Estimated speed: 37-47 tok/s

Context: 16k

License: OpenRAIL-M

coding

ollama pull starcoder2:7b

CodeLlama-7B-Instruct

7Bq8_0 • 10.1GB

Family: CodeLlama

Estimated speed: 38-48 tok/s

Context: 16k

License: Llama 2 Community

coding

ollama pull codellama:7b

Phi-4-mini-instruct

3.8Bfp16 • 10.9GB

Family: Phi

Estimated speed: 37-47 tok/s

Context: 128k

License: MIT

chatcodingresearch

ollama pull phi4-mini

Phi-3-mini-4k-instruct

3.8Bfp16 • 10.9GB

Family: Phi

Estimated speed: 38-48 tok/s

Context: 4k

License: MIT

chatcoding

ollama pull phi3:mini

StarCoder2-3B-Instruct

3Bfp16 • 9.1GB

Family: StarCoder

Estimated speed: 43-53 tok/s

Context: 16k

License: OpenRAIL-M

coding

ollama pull starcoder2:3b

Qwen2.5-3B-Instruct

3Bfp16 • 9.1GB

Family: Qwen

Estimated speed: 44-54 tok/s

Context: 33k

License: Apache-2.0

chatcodingresearch

ollama pull qwen2.5:3b