LLM-Compressor v0.14.0 ships Triton GPTQ kernel with 15x speedup
vLLM's LLM-Compressor released v0.14.0, adding a Triton-based GPTQ quantization kernel roughly 15x faster end-to-end, with layer batching reaching about 30x on some MoE workloads. It also adds a Triton MSE observer grid-search kernel (~10x faster), expanded iMatrix/MSE observers for NVFP4, REAP DDP expert pruning, and model-free PTQ improvements.
Sources and evidence
Summary last validated Sep 29, 2026
Reader actions
Report an issue
Use this for an incorrect summary, wrong source, duplicate story, or wrong category. Submissions are private and do not change the story automatically.
Related coverage
- open source
NVIDIA Details Five-Step Workflow for SimReady Robotics Assets
NVIDIA published a five-step workflow for converting CAD assets into SimReady robotics simulation assets using Omniverse libraries, SimReady Foundation specifications, and agentic NVIDIA skills. The process covers configuring and validating materials, collision geometry, joints, and physics properties beyond simple OpenUSD geometry conversion, preparing assets before robot behavior testing.
- open source
PyTorch adds Spyre as native device via torch-spyre
PyTorch's blog details how Spyre becomes a native PyTorch device. The integration connects PyTorch's existing device, allocator, stream, and compiler abstractions through torch-spyre to the Spyre runtime and firmware. PrivateUse1 is used to give Spyre a real device registration within PyTorch.
- open source
trycua/cua computer-use agent repo hits 28,733 stars on GitHub Trending
The open-source trycua/cua repository appeared on GitHub Trending at rank 10 on 2026-10-08, with 28,733 stars, 2,039 forks, and 228 stars gained that day. Written in Rust, it provides drivers, cross-OS fleets, and benchmarks for training, evaluating, and generating data for computer-use agents across macOS and Windows.
- open source
manaflow-ai/cmux Ghostty-based macOS terminal for AI coding agents trends on GitHub
manaflow-ai/cmux, an open-source Ghostty-based macOS terminal with vertical tabs and notifications for AI coding agents, appeared on GitHub Trending on 2026-10-08 at rank 9. The Swift project targets multitasking, organization, and programmability, and has 27,830 stars and 2,461 forks, with 44 stars gained that day.
- open source
LangChain releases langchain-huggingface 1.2.3 with token repr fix
LangChain published langchain-huggingface 1.2.3. The release hides the huggingfacehub_api_token from repr output, adds torch.accelerator for device-agnostic device count detection, removes the retired IPEX backend, and bumps dependencies including transformers, sentence-transformers, langgraph-sdk, and fsspec.