Hugging Face details tokenizers v1 release candidate performance
Hugging Face published benchmarks for the release candidate of tokenizers v1, an upcoming version it says is often tens of times faster than v0.23. The library keeps the same token IDs, API, vocabulary and merge ranks as v0.23. IBM, NVIDIA and the ExecuTorch team contributed patches and hardware testing.
Sources and evidence
Attributed quotes
“In this article, we look at what makes v1 faster than v0.23, often by tens of times.”
“v1 will produce the same token IDs as v0.23.”
Summary last validated Sep 28, 2026
Reader actions
Report an issue
Use this for an incorrect summary, wrong source, duplicate story, or wrong category. Submissions are private and do not change the story automatically.
Related coverage
- open source
NVIDIA Details Five-Step Workflow for SimReady Robotics Assets
NVIDIA published a five-step workflow for converting CAD assets into SimReady robotics simulation assets using Omniverse libraries, SimReady Foundation specifications, and agentic NVIDIA skills. The process covers configuring and validating materials, collision geometry, joints, and physics properties beyond simple OpenUSD geometry conversion, preparing assets before robot behavior testing.
- open source
PyTorch adds Spyre as native device via torch-spyre
PyTorch's blog details how Spyre becomes a native PyTorch device. The integration connects PyTorch's existing device, allocator, stream, and compiler abstractions through torch-spyre to the Spyre runtime and firmware. PrivateUse1 is used to give Spyre a real device registration within PyTorch.
- open source
manaflow-ai/cmux Ghostty-based macOS terminal for AI coding agents trends on GitHub
manaflow-ai/cmux, an open-source Ghostty-based macOS terminal with vertical tabs and notifications for AI coding agents, appeared on GitHub Trending on 2026-10-08 at rank 9. The Swift project targets multitasking, organization, and programmability, and has 27,830 stars and 2,461 forks, with 44 stars gained that day.
- open source
trycua/cua computer-use agent repo hits 28,733 stars on GitHub Trending
The open-source trycua/cua repository appeared on GitHub Trending at rank 10 on 2026-10-08, with 28,733 stars, 2,039 forks, and 228 stars gained that day. Written in Rust, it provides drivers, cross-OS fleets, and benchmarks for training, evaluating, and generating data for computer-use agents across macOS and Windows.
- open source
LangChain releases langchain-huggingface 1.2.3 with token repr fix
LangChain published langchain-huggingface 1.2.3. The release hides the huggingfacehub_api_token from repr output, adds torch.accelerator for device-agnostic device count detection, removes the retired IPEX backend, and bumps dependencies including transformers, sentence-transformers, langgraph-sdk, and fsspec.