Meta Uses Idle Inference Capacity to Improve Ads Recommendations
Meta detailed a system that uses idle inference capacity across its fleet to enhance ads recommendations. Two elasticity levers let ads recommendation work expand into opportunistic capacity without hurting baseline performance. The engineering post describes how the system was designed and is operated at Meta's scale.
Sources and evidence
Summary last validated Oct 12, 2026
Reader actions
Report an issue
Use this for an incorrect summary, wrong source, duplicate story, or wrong category. Submissions are private and do not change the story automatically.
Related coverage
- infrastructure
Barcelona Supercomputing Center Opens AI Factory Accelerator to Spanish Startups
The Barcelona Supercomputing Center's AI Factory Accelerator Programme is now in full operation after a pilot phase, giving startups access to sovereign compute, technical support and training across industries. Many participating companies are also members of the NVIDIA Inception program for startups, and as of today some gain expanded access.
- infrastructure
AWS opens SageMaker Studio to new users via simplified sign-up
AWS now lets new Amazon SageMaker AI customers reach a fully configured SageMaker Studio environment in a few steps. Users can sign up with an existing Amazon, Apple, GitHub, or Google identity, with no advanced AWS account or credit card required for most customers, plus $100 in AWS Free Tier credits.
- infrastructure
SageMaker JumpStart adds over 100 models from 30 providers in 2026
Amazon SageMaker JumpStart onboarded more than 100 new models from 30 providers in the first three quarters of 2026, AWS said in a year-to-date review. The recap also covers JumpStart enhancements including a simplified Model Hub, pre-configured deployment options, and Hugging Face deep link integration.
- infrastructure
Cloudflare cuts AI code reviewer inference bill 68% with prompt caching and model routing
Cloudflare said its AI code reviewer's cost per run doubled, prompting an investigation into token usage. The company used prompt caching and intelligent model routing to cut its inference bill by 68% while speeding up reviews, according to a Cloudflare blog post.
- infrastructure
Deepgram ports Nova-3 speech-to-text to AWS Trainium2 for batch inference
Deepgram worked with the AWS Forward Deployed Engineering team to port its Nova-3 speech-to-text model to AWS Trainium2 for offline batch inference. The work covered porting to the AWS Neuron stack, kernel-level tuning, and a data-parallel Rust runtime, with reported throughput and cost results for batch transcription.