Fuzzball v4.3 Ships 11 Preset LLMs for Self-Hosted GPU Serving
Global – – October 12, 2026 -- Fuzzball v4.3 adds a vLLM catalog entry and eleven validated model presets that serve a large language model from a pool of replicas on NVIDIA or AMD GPUs, behind an OpenAI-compatible endpoint.
Eleven presets come with GPU count, context size and vLLM arguments already set
The generic vLLM entry serves a HuggingFace model from a single catalog command. The eleven presets cover GPT-OSS 20B and 120B, Ministral 3 8B and 14B, Qwen3-Coder 30B and Next 80B, Nemotron 3 Nano and Super, Mistral Medium 3.5, Llama 4 Scout and Gemma 4 31B. Each has its GPU fit and serving arguments validated per model.
Users can accept the preset values or override them. In one example, a persistent volume keeps the downloaded checkpoint between starts, and MaxReplicas is raised to eight so the pool can grow under load.