AWS Introduces Agent Evaluation Metric for Multi-Turn Conversations
AWS published a blog post introducing the Agent Evaluation Metric (AEM), a decomposable, turn-level method for measuring agent quality in multi-turn conversations. Applied first to correctness, AEM identifies the specific turn where an agent failure originated and distinguishes it from later turns that merely inherited the error, addressing gaps in single-turn evaluation.
Sources and evidence
Summary last validated Sep 10, 2026
Reader actions
Report an issue
Use this for an incorrect summary, wrong source, duplicate story, or wrong category. Submissions are private and do not change the story automatically.
Related coverage
- agents
NVIDIA Highlights Developers Using Frontier AI Agents With Omniverse Libraries
NVIDIA published a blog post describing how developers combine frontier AI models with NVIDIA Omniverse libraries to build simulation applications. The post says developers direct AI agents to assemble assets, connect physics and rendering, and verify scene behavior, supporting work such as exploring scenarios, investigating failures and improving designs.
- agents
BlockRun and Incarna use Amazon Bedrock AgentCore payments for per-inference agent billing
Amazon Bedrock AgentCore payments lets AI agents pay for services on demand with infrastructure-enforced spending limits. Incarna's agents pay BlockRun for model inference one request at a time over x402, reducing the work of adding x402 payment support from months to days, according to an AWS Machine Learning Blog post.
- agents
NVIDIA KGMON Team Places Second in KDD Cup 2026 Data Agents Competition
NVIDIA's KGMON team placed second in the KDD Cup 2026 Data Agents competition. The team built a system around making an agent's harness smaller, clearer, and easier to verify. The competition required agents to answer natural-language questions across heterogeneous sources including databases, CSV and JSON files, prose documents, PDFs, and briefing videos.
- infrastructure
AWS details multi-team GPU sharing on SageMaker HyperPod
AWS published a reference architecture for sharing one Amazon SageMaker HyperPod EKS cluster across multiple teams. It uses AWS IAM Identity Center for authentication, per-team SageMaker Domains and Kubernetes namespaces for isolation, HyperPod Task Governance for fairness, and namespace-level cost allocation for chargeback.
- models
Anthropic's Claude Haiku 5.5 launches on Amazon Bedrock and Claude Platform on AWS
Claude Haiku 5.5 is now available on Amazon Bedrock and Claude Platform on AWS. Anthropic says it is the fastest, most efficient model in the Claude 5.5 family, built for subagents and high-volume, cost-sensitive work, and costs roughly 75% less than Claude Haiku 4.5 for most tasks.