Baseten Joins Hugging Face Inference Providers

PyTorch details session-aware agentic inference with NVIDIA Dynamo

PyTorch published a blog post describing session-aware agentic inference with NVIDIA Dynamo. It explains that agentic workloads differ from single-turn chat: an agent session can include a large initial prefill, repeated model calls, and parallel subagents, changing the traffic an inference server handles.

AWS details multi-team GPU sharing on SageMaker HyperPod

AWS published a reference architecture for sharing one Amazon SageMaker HyperPod EKS cluster across multiple teams. It uses AWS IAM Identity Center for authentication, per-team SageMaker Domains and Kubernetes namespaces for isolation, HyperPod Task Governance for fairness, and namespace-level cost allocation for chargeback.

MIT's Christina Delimitrou targets data center energy efficiency

MIT Associate Professor Christina Delimitrou is rethinking how large cloud computing systems operate to reduce the environmental impact of data centers. Her work focuses on making these facilities more energy efficient as their environmental threat grows.

Amazon Quick and Bedrock Knowledge Bases add real-time document-level access control for RAG

AWS published guidance on enforcing document-level access controls for enterprise RAG using Amazon Quick and Amazon Bedrock Knowledge Bases. The approach verifies user permissions directly with authoritative sources such as SharePoint, Google Drive, and Confluence at query time, rather than relying on pre-indexed permission copies, so answers only draw on documents each user is authorized to see.

Liquid AI releases d1-3B and d1-omni-600M open decision models for edge

Liquid AI released two open decision models: d1-3B and experimental d1-omni-600M. d1-3B scores 48.57 on Decision Index 0.2.1, topping sub-10B models and Decider 35B-A3B, and answers in 16 ms on NVIDIA Jetson AGX Thor. d1-omni-600M handles text with image or audio. Both are built on Liquid Foundation Models.