vLLM-Gaudi v0.30.0 adds GLM-5.2-FP8 and Nemotron-H FP8 support on Intel Gaudi
vLLM-Gaudi v0.30.0, based on vLLM v0.30.0, supports Intel Gaudi Software v1.24.2 with PyTorch 2.13. It adds GLM-5.2-FP8 with DeepSeek Sparse Attention and Nemotron-H FP8 with quantization-aware Mamba, improves Qwen3.5/3.6 MoE low-batch generation, fixes long-context RoPE accuracy, and reduces decode warmup memory.
Sources and evidence
Summary last validated Oct 12, 2026
Reader actions
Report an issue
Use this for an incorrect summary, wrong source, duplicate story, or wrong category. Submissions are private and do not change the story automatically.
Related coverage
- open source
Headroom hits GitHub Trending with token-compression library for LLM inputs
The headroomlabs-ai/headroom repository appeared on GitHub Trending on October 20, 2026, ranked seventh with 76,297 stars and 5,924 forks. The Python project compresses tool outputs, logs, files, and RAG chunks before they reach an LLM, claiming 20% fewer tokens for coding agents and 60-95% fewer for JSON with the same answers. It ships as a library, proxy, and MCP server.
- open source
NVIDIA Shows Mamba-2 Forward Pass Kernels in CUDA Tile Python DSL
NVIDIA published a developer blog demonstrating high-performance Mamba-2 forward pass kernels written in CUDA Tile (cuTile), its Python-based DSL and parallel programming model for NVIDIA GPUs. cuTile abstracts thread- and warp-level scheduling behind tile-centric primitives, letting developers write GPU kernels in Python while compiler optimizations handle low-level hardware details automatically.
- open source
PyTorch Helion integrates NVIDIA CompileIQ for compiler controls
PyTorch's blog describes how Helion, its tool for writing GPU kernels in PyTorch-native Python with an autotuner, now incorporates NVIDIA CompileIQ to add compiler controls. The post frames this as a two-layer search approach, pairing Helion's autotuning with CompileIQ's compiler-level controls.
- open source
stablyai/orca hits GitHub Trending for running fleets of coding agents
stablyai/orca appeared on GitHub Trending on October 18, 2026, ranked 8th with 95,392 stars and 6,109 forks, gaining 830 stars that day. The TypeScript repository lets users run coding agents such as Grok Bot and Claude Code on their own subscriptions across desktop, mobile, and remote runtime.
- open source
akitaonrails/ai-memory Tops GitHub Trending for Agent Memory
The Rust repository akitaonrails/ai-memory appeared on GitHub Trending on October 18, 2026, at rank 6 with 9,912 stars, 716 forks, and 178 stars gained that day. Its description says it provides long-term memory for agent coding CLIs and enables handoff between different agent vendors.