Skip to main content

CIQ: Linux 6.18 Loads AI Model Weights 33.8% Faster

Image
CIQ: Linux 6.18 Loads AI Model Weights 33.8% Faster

Santa Clara – October 12, 2026 -- CIQ says model loading ran 33.8 percent faster on Linux 6.18 than on a kernel frozen at general availability, based on its own benchmarks of the same workload. The company is pitching the result for RLC Pro AI, its Enterprise Linux distribution for GPU infrastructure.

CIQ's argument is that AI hardware and frameworks move faster than the operating system beneath them. NVIDIA advances the hardware, CUDA the toolkit and PyTorch the framework. An enterprise kernel, by design, trails by an average of twelve to eighteen months. RLC Pro AI ships Linux 6.18, the latest production and long-term GPU drivers, and the CUDA toolkit together, validated as one stack.

Peer-to-peer and RDMA paths still depend on the kernel, CIQ says

CIQ rejects the idea that GPU peer-to-peer transfers, RDMA and direct device-to-device access bypass the operating system. These are kernel features, and the kernel manages the resources and data path. A new accelerator driver must stay compatible with the ABI of a given kernel version, and some features exist only in recent kernels. That can decide whether hardware runs at all, before speed is considered.

vLLM issue shows a 102 GiB shard stalling workers for over an hour

vLLM issue #40988 documents the cost of a readahead window not sized for the workload. Three of eight workers stalled for more than an hour on a 102 GiB shard, reading 30 to 50 MB/s from NVMe that could deliver far more. Each rank issued roughly 13,000 scattered reads that default readahead never coalesced. vLLM fixed it with an application-side prefetch strategy. CIQ argues a kernel that sizes readahead for large model files fixes it once per node, for every serving engine on it.

Scheduler starvation turns into tail latency for inference servers

vLLM's tuning documentation says the engine core process "runs a busy loop and is particularly sensitive to CPU starvation." A published trace measured that process descheduled for two and a half seconds in the worst case. Agentic pipelines are most exposed, because orchestration, tool calls and retrieval load the CPU while a cold path still needs a fast first token. Linux 6.18 lets operators load a custom scheduler tuned for inference, while a 5.14 kernel keeps the general-purpose default.

Linux 6.18 adds atomic writes, 16K block sizes and per-container GPU memory caps

Atomic writes at the filesystem level let a database drop its double-write buffer and commit once. Block sizes match the 16K-native geometry of current NVMe drives, and buffered I/O preserves the page cache while a training job streams a dataset. Training checkpoints drain at 50 to 200 GB/s in the large sequential pattern these changes target.

KV cache spilling from GPU memory to host DRAM and NVMe also depends on filesystem behavior. LMCache documents that its direct I/O alignment is set by the filesystem block size, and NIXL exposes an io_uring switch. Linux 6.18 also compiles in the dmem cgroup controller, which caps device memory per container. CIQ says this gives platform teams an enforced ceiling on shared GPU nodes and gives finance teams a basis for chargeback.

CIQ Linux Kernel 6.18 tracks upstream long-term support through December 2028

The CIQ Linux Kernel (CLK) 6.18 follows the upstream 6.18 series rather than a frozen snapshot kept alive by backports. It is the newest branch on the kernel.org long-term list, with upstream maintenance projected through December 2028. As of September 2026, that list is 6.18, 6.12, 6.6, 6.1, 5.15 and 5.10. Several kernels with higher version numbers have already reached upstream end of life and were never designated long-term.

CIQ patches CLK directly and ships it between distribution releases, so accelerator support does not wait for the next minor release. Minors open roughly twice a year, and merged enablement can sit in a development stream until one does. CIQ says tracking a single upstream branch lets its engineers validate each update against the Enterprise Linux userspace along a shorter dependency chain than a multi-year backport tree allows.

RLC Pro AI is available through CIQ Portal and the AWS, Microsoft Azure and Google Cloud marketplaces, as installer ISOs, cloud images and OCI container images. The author will be at the AI Infra Summit, September 15-17, at the Santa Clara Convention Center.

Published by
fairsonline_team
Industries
Company
Products
News Type