NVIDIA Megatron Core Adds Bitwise-Deterministic Pretraining at Scale
NVIDIA published a developer blog describing how to scale bitwise-deterministic pretraining with NVIDIA Megatron Core. The post says bitwise determinism makes large-scale pretraining easier to debug, validate, and resume reproducibly, especially for trillion-parameter models trained across thousands of GPUs where parallelism, low-precision computation, and distributed checkpointing complicate failure reproduction and fix validation.
Sources and evidence
Summary last validated Oct 9, 2026
Reader actions
Report an issue
Use this for an incorrect summary, wrong source, duplicate story, or wrong category. Submissions are private and do not change the story automatically.
Related coverage
- agents
NVIDIA Highlights Developers Using Frontier AI Agents With Omniverse Libraries
NVIDIA published a blog post describing how developers combine frontier AI models with NVIDIA Omniverse libraries to build simulation applications. The post says developers direct AI agents to assemble assets, connect physics and rendering, and verify scene behavior, supporting work such as exploring scenarios, investigating failures and improving designs.
- open source
NVIDIA Details Five-Step Workflow for SimReady Robotics Assets
NVIDIA published a five-step workflow for converting CAD assets into SimReady robotics simulation assets using Omniverse libraries, SimReady Foundation specifications, and agentic NVIDIA skills. The process covers configuring and validating materials, collision geometry, joints, and physics properties beyond simple OpenUSD geometry conversion, preparing assets before robot behavior testing.
- agents
NVIDIA KGMON Team Places Second in KDD Cup 2026 Data Agents Competition
NVIDIA's KGMON team placed second in the KDD Cup 2026 Data Agents competition. The team built a system around making an agent's harness smaller, clearer, and easier to verify. The competition required agents to answer natural-language questions across heterogeneous sources including databases, CSV and JSON files, prose documents, PDFs, and briefing videos.
- industry
Gears of War: E-Day Launches on GeForce NOW
Gears of War: E-Day arrives on GeForce NOW this week, letting members stream Marcus Fenix and Dom Santiago's first battle against the Locust Horde with GeForce RTX-powered performance. NVIDIA also announced that Fire TV users will soon be able to purchase GeForce NOW memberships directly through the platform.
- open source
PyTorch adds Spyre as native device via torch-spyre
PyTorch's blog details how Spyre becomes a native PyTorch device. The integration connects PyTorch's existing device, allocator, stream, and compiler abstractions through torch-spyre to the Spyre runtime and firmware. PrivateUse1 is used to give Spyre a real device registration within PyTorch.