LLM Finder

Match local LLMs to your GPU. Filter by VRAM + use case, then copy the download command.

GPU VRAM

8 GB 12 GB 16 GB 24 GB 48 GB 80 GB

Use Case

all coding chat research creative math

22 models fit 80GB for creative

Data powered by llmfit ↗

Qwen2.5-72B-Instruct

72Bq5_K_M • 60.4GB

Family: Qwen

Estimated speed: 61-71 tok/s

Context: 33k

License: Apache-2.0

chatcodingresearchmathcreative

ollama pull qwen2.5:72b

Llama-3.3-70B-Instruct

70Bq5_K_M • 58.8GB

Family: Llama

Estimated speed: 65-75 tok/s

Context: 131k

License: Llama 3.3 Community

chatcodingresearchcreativemath

ollama pull llama3.3:70b

Nous-Hermes-2-Mixtral-8x7B-DPO

46.7B MoEq8_0 • 57.3GB

Family: Nous

Estimated speed: 70-80 tok/s

Context: 33k

License: Apache-2.0

chatcreativecoding

ollama pull nous-hermes2-mixtral

Llama-3.1-70B-Instruct

70Bq5_K_M • 58.8GB

Family: Llama

Estimated speed: 66-76 tok/s

Context: 131k

License: Llama 3.1 Community

chatresearchcreativemath

ollama pull llama3.1:70b

Yi-1.5-34B-Chat

34Bfp16 • 77.3GB

Family: Yi

Estimated speed: 22-32 tok/s

Context: 33k

License: Apache-2.0

chatresearchcreativemath

ollama pull yi:34b

Qwen2.5-32B-Instruct

32Bfp16 • 72.9GB

Family: Qwen

Estimated speed: 33-43 tok/s

Context: 33k

License: Apache-2.0

chatcodingresearchmathcreative

ollama pull qwen2.5:32b

Mistral-Nemo-12B-Instruct

12Bfp16 • 28.9GB

Family: Mistral

Estimated speed: 141-151 tok/s

Context: 128k

License: Apache-2.0

chatcodingcreative

ollama pull mistral-nemo:12b

Mixtral-8x22B-Instruct

141B MoEq5_K_M • 75.2GB

Family: Mistral

Estimated speed: 31-41 tok/s

Context: 66k

License: Apache-2.0

chatcodingresearchcreativemath

ollama pull mixtral:8x22b

WizardLM-2-8x22B

141B MoEq5_K_M • 75.2GB

Family: WizardLM

Estimated speed: 31-41 tok/s

Context: 66k

License: Llama 2 Community

chatcodingresearchcreative

ollama pull wizardlm2:8x22b

Gemma-2-27B-Instruct

27Bfp16 • 61.9GB

Family: Gemma

Estimated speed: 63-73 tok/s

Context: 8k

License: Gemma Terms

chatcodingresearchcreativemath

ollama pull gemma2:27b

Command-R-7B

7Bfp16 • 17.9GB

Family: Cohere

Estimated speed: 171-181 tok/s

Context: 128k

License: CC-BY-NC

researchchatcreative

ollama pull command-r:7b

Mixtral-8x7B-Instruct

46.7B MoEq8_0 • 57.3GB

Family: Mistral

Estimated speed: 76-86 tok/s

Context: 33k

License: Apache-2.0

chatcodingresearchcreative

ollama pull mixtral:8x7b

Dolphin-2.9.2-Qwen2-7B

7Bfp16 • 17.9GB

Family: Dolphin

Estimated speed: 171-181 tok/s

Context: 33k

License: Apache-2.0

chatcreativecoding

ollama pull dolphin3:8b

Yi-1.5-9B-Chat

9Bfp16 • 22.3GB

Family: Yi

Estimated speed: 161-171 tok/s

Context: 33k

License: Apache-2.0

chatresearchcreative

ollama pull yi:9b

Llama-3-8B-Instruct

8Bfp16 • 20.1GB

Family: Llama

Estimated speed: 167-177 tok/s

Context: 8k

License: Llama 3 Community

chatcreative

ollama pull llama3:8b

OpenHermes-2.5-Mistral-7B

7Bfp16 • 17.9GB

Family: Nous

Estimated speed: 172-182 tok/s

Context: 33k

License: Apache-2.0

chatcreative

ollama pull openhermes

Llama-3.1-8B-Instruct

8Bfp16 • 20.1GB

Family: Llama

Estimated speed: 167-177 tok/s

Context: 131k

License: Llama 3.1 Community

chatresearchcreative

ollama pull llama3.1:8b

Zephyr-7B-beta

7Bfp16 • 17.9GB

Family: Zephyr

Estimated speed: 173-183 tok/s

Context: 33k

License: MIT

chatcreative

ollama pull zephyr:7b

Gemma-2-9B-Instruct

9Bfp16 • 22.3GB

Family: Gemma

Estimated speed: 162-172 tok/s

Context: 8k

License: Gemma Terms

chatresearchcreative

ollama pull gemma2:9b

OpenChat-3.6-8B

8Bfp16 • 20.1GB

Family: OpenChat

Estimated speed: 169-179 tok/s

Context: 8k

License: Apache-2.0

chatcreative

ollama pull openchat:8b

Llama-3.2-3B-Instruct

3Bfp16 • 9.1GB

Family: Llama

Estimated speed: 200-210 tok/s

Context: 131k

License: Llama 3.2 Community

chatcreative

ollama pull llama3.2:3b

Gemma-2-2B-Instruct

2Bfp16 • 6.9GB

Family: Gemma

Estimated speed: 209-219 tok/s

Context: 8k

License: Gemma Terms

chatcreative

ollama pull gemma2:2b