Skip to main content

CIQ Fuzzball 4.3 Launches Private LLM Inference in a Few Clicks

Image
CIQ Fuzzball 4.3 Launches Private LLM Inference in a Few Clicks

United States – October 12, 2026 -- CIQ's Fuzzball 4.3 lets users launch large language models for inference in a few clicks, drawing on a catalog of nearly a dozen preconfigured LLMs that can run on an organization's own HPC cluster or in the cloud.

Fuzzball 4.3 removes manual setup for LLM serving

Users pick a model from the workflow catalog and interact with it through a browser or command line client. Fuzzball scales model services up or down with demand and provides a durable endpoint for access.

Earlier versions required more work for any model missing from the catalog. Users had to write a Fuzzfile, determine the model's compute requirements, sometimes by trial and error, and find a way to reach an autoscaled node pool without a single endpoint. Version 4.3 removes most of those steps.

Data sovereignty drives demand for self-hosted AI

Organizations increasingly want generative AI without sending proprietary code or sensitive information to an external model provider. Fuzzball 4.3 lets them host models on infrastructure they control. David Godlove, CIQ's technical product writer, said customers have asked for this capability repeatedly and that the release makes it easier to use AI while keeping data sovereignty.

Fuzzball adds on-premises features as AI workloads grow

Fuzzball was designed from the start to run on premises and in the cloud, but its early capabilities reflected its engineering team's cloud experience. CIQ has since added easier volume management and intelligent job scheduling for on-premises environments. The platform now also supports a growing range of AI model training and inference workloads.

The interface is layered. New users can run a catalog template in a few clicks, open it in the graphical workflow editor for finer control, or edit the underlying Fuzzfile in YAML.

Godlove has been at CIQ for nearly five years and sits on its leadership team. He trained as a neuroscientist at Vanderbilt University and completed postdoctoral work at the National Institutes of Health, where he later supported the Biowulf supercomputer as a staff scientist. He also contributed to Singularity, the container platform founded by CIQ CEO Gregory Kurtzer, which later became Apptainer.

Published by
fairsonline_team
Industries
Company
Products
News Type