Transformers adds GGUF support to run llama.cpp quants locally
Hugging Face added GGUF support to Transformers, letting users load llama.cpp-quantized checkpoints from the Hub via from_pretrained and generate locally. The implementation reuses llama.cpp's ggml kernels through the kernels library to approach its performance, initially targeting Apple Silicon and the Qwen3.5 architecture. GGUF packages weights, tokenizer metadata, and optional chat templates in one file.
Sources and evidence
Attributed quotes
“This is where we are right now. And i'm not gonna lie it feels pretty magical. Qwen3.6 27B running inside of Pi coding agent via Llama.cpp on the MacBook Pro”
Summary last validated Sep 28, 2026
Reader actions
Report an issue
Use this for an incorrect summary, wrong source, duplicate story, or wrong category. Submissions are private and do not change the story automatically.
Related coverage
- open source
NVIDIA Details Five-Step Workflow for SimReady Robotics Assets
NVIDIA published a five-step workflow for converting CAD assets into SimReady robotics simulation assets using Omniverse libraries, SimReady Foundation specifications, and agentic NVIDIA skills. The process covers configuring and validating materials, collision geometry, joints, and physics properties beyond simple OpenUSD geometry conversion, preparing assets before robot behavior testing.
- open source
PyTorch adds Spyre as native device via torch-spyre
PyTorch's blog details how Spyre becomes a native PyTorch device. The integration connects PyTorch's existing device, allocator, stream, and compiler abstractions through torch-spyre to the Spyre runtime and firmware. PrivateUse1 is used to give Spyre a real device registration within PyTorch.
- open source
trycua/cua computer-use agent repo hits 28,733 stars on GitHub Trending
The open-source trycua/cua repository appeared on GitHub Trending at rank 10 on 2026-10-08, with 28,733 stars, 2,039 forks, and 228 stars gained that day. Written in Rust, it provides drivers, cross-OS fleets, and benchmarks for training, evaluating, and generating data for computer-use agents across macOS and Windows.
- open source
manaflow-ai/cmux Ghostty-based macOS terminal for AI coding agents trends on GitHub
manaflow-ai/cmux, an open-source Ghostty-based macOS terminal with vertical tabs and notifications for AI coding agents, appeared on GitHub Trending on 2026-10-08 at rank 9. The Swift project targets multitasking, organization, and programmability, and has 27,830 stars and 2,461 forks, with 44 stars gained that day.
- open source
LangChain releases langchain-huggingface 1.2.3 with token repr fix
LangChain published langchain-huggingface 1.2.3. The release hides the huggingfacehub_api_token from repr output, adds torch.accelerator for device-agnostic device count detection, removes the retired IPEX backend, and bumps dependencies including transformers, sentence-transformers, langgraph-sdk, and fsspec.