LLM Finder

Match local LLMs to your GPU. Filter by VRAM + use case, then copy the download command.

8 GB12 GB16 GB24 GB48 GB80 GB
allcodingchatresearchcreativemath

16 models fit 24GB for math

Data powered by llmfit ↗

Qwen2.5-Coder-32B-Instruct

32Bq4_K_M • 22.3GB

Family: Qwen

Estimated speed: 19-29 tok/s

Context: 33k

License: Apache-2.0

codingchatmathresearch
ollama pull qwen2.5-coder:32b

Yi-1.5-34B-Chat

34Bq4_K_M • 23.6GB

Family: Yi

Estimated speed: 18-28 tok/s

Context: 33k

License: Apache-2.0

chatresearchcreativemath
ollama pull yi:34b

Qwen2.5-32B-Instruct

32Bq4_K_M • 22.3GB

Family: Qwen

Estimated speed: 20-30 tok/s

Context: 33k

License: Apache-2.0

chatcodingresearchmathcreative
ollama pull qwen2.5:32b

Phi-4-14B-Instruct

14Bq8_0 • 18.3GB

Family: Phi

Estimated speed: 31-41 tok/s

Context: 128k

License: MIT

codingmathresearchchat
ollama pull phi4:14b

Phi-3-medium-128k-instruct

14Bq8_0 • 18.3GB

Family: Phi

Estimated speed: 32-42 tok/s

Context: 131k

License: MIT

codingchatresearchmath
ollama pull phi3:medium

Qwen2.5-Coder-14B-Instruct

14Bq8_0 • 18.3GB

Family: Qwen

Estimated speed: 32-42 tok/s

Context: 33k

License: Apache-2.0

codingchatmath
ollama pull qwen2.5-coder:14b

DeepSeek-R1-Distill-Llama-8B

8Bfp16 • 20.1GB

Family: DeepSeek

Estimated speed: 28-38 tok/s

Context: 33k

License: MIT

mathresearchchat
ollama pull deepseek-r1:8b

Qwen2.5-14B-Instruct

14Bq8_0 • 18.3GB

Family: Qwen

Estimated speed: 33-43 tok/s

Context: 33k

License: Apache-2.0

chatcodingresearchmath
ollama pull qwen2.5:14b

Gemma-2-27B-Instruct

27Bq5_K_M • 23.5GB

Family: Gemma

Estimated speed: 22-32 tok/s

Context: 8k

License: Gemma Terms

chatcodingresearchcreativemath
ollama pull gemma2:27b

DeepSeek-R1-Distill-Qwen-14B

14Bq8_0 • 18.3GB

Family: DeepSeek

Estimated speed: 34-44 tok/s

Context: 33k

License: MIT

mathresearchcoding
ollama pull deepseek-r1:14b

DeepSeek-Coder-33B-Instruct

33Bq4_K_M • 23GB

Family: DeepSeek

Estimated speed: 25-35 tok/s

Context: 16k

License: DeepSeek License

codingchatmath
ollama pull deepseek-coder:33b

Qwen2.5-7B-Instruct

7Bfp16 • 17.9GB

Family: Qwen

Estimated speed: 37-47 tok/s

Context: 33k

License: Apache-2.0

chatcodingresearchmath
ollama pull qwen2.5:7b

CodeLlama-34B-Instruct

34Bq4_K_M • 23.6GB

Family: CodeLlama

Estimated speed: 28-38 tok/s

Context: 16k

License: Llama 2 Community

codingmath
ollama pull codellama:34b

DeepSeek-R1-Distill-Qwen-7B

7Bfp16 • 17.9GB

Family: DeepSeek

Estimated speed: 40-50 tok/s

Context: 33k

License: MIT

mathresearchcoding
ollama pull deepseek-r1:7b

StarCoder2-15B-Instruct

15Bq8_0 • 19.5GB

Family: StarCoder

Estimated speed: 39-49 tok/s

Context: 16k

License: OpenRAIL-M

codingmath
ollama pull starcoder2:15b

CodeLlama-13B-Instruct

13Bq8_0 • 17.1GB

Family: CodeLlama

Estimated speed: 47-57 tok/s

Context: 16k

License: Llama 2 Community

codingmath
ollama pull codellama:13b