Hermes 4.3 36B Q4_K_M GGUF for Docker Model Runner (chat)

Mellum2-12B-A2.5B-Instruct Q8_0 GGUF for Docker Model Runner (chat)

Mistral-Small-3.2-24B-Instruct Q4_K_M GGUF for Docker Model Runner (vision)

Holo 3.1 35B-A3B Q4_K_M GGUF for Docker Model Runner (vision)

Mellum2.1-12B-A2.5B-Thinking Q4_K_M GGUF for Docker Model Runner (chat)

Q4_K_M GGUF of a MedGemma health-chat fine-tune for local, private clinical AI prototyping.

LFM2.5-8B-A1B Q4_K_M GGUF for Docker Model Runner (chat)

Unlimited-OCR Q8_0 GGUF for Docker Model Runner (OCR)

GLM-Z1-9B-0414 Q4_K_M GGUF for Docker Model Runner (chat)

EmbeddingGemma 2 F16 GGUF for Docker Model Runner (embeddings)

MiMo-V2.6-Distill-Qwen-9B Q4_K_M GGUF for Docker Model Runner (chat)

Bonsai-27B Q1_0 GGUF for Docker Model Runner (vision)

On-device Android agent that picks the next UI action. 2B, 1.3 GB.

Phi-4-mini-instruct Q4_K_M GGUF for Docker Model Runner (chat)

Qwen3Guard-Gen-8B Q4_K_M GGUF for Docker Model Runner (safety classifier)

multilingual-e5-large F16 GGUF for Docker Model Runner (embeddings)

AllThatToon webtoon image model (DDUF, fp16)