ai-devtools —

Presentation: Batch Intelligence at Scale: Cost-Efficient Multi-Agent LLM Workflows with Built-In Resilience

InfoQ Homepage Presentations Batch Intelligence at Scale: Cost-Efficient Multi-Agent LLM Workflows with Built-In Resilience Aditya Mulik explains how Walmart Global Tech deployed multi-agent LLM workflows across 4,700 stores for nightly batch inventory forecasting.

Presentation: Batch Intelligence at Scale: Cost-Efficient Multi-Agent LLM Workflows with Built-In Resilience

He discusses tackling production hurdles - schema violations, cross-department data mismatches, and network drops - via MCP grounding and loop agents, while slashing cloud inference costs from $100k+ to $10k per month shifting from PTUs to pay-as-you-go. Aditya Mulik is a Senior Software Engineer at Walmart Global Tech specializing in large-scale distributed systems and platform engineering, with deep expertise in deploying scalable and resilient solutions. He has led the development of microservices architectures and production LLM systems, enabling high-throughput applications serving millions of requests.

He also contributes to open source. QCon AI is a practitioner-led event focused entirely on the engineering discipline required to scale these workloads safely. It provides direct access to the architectural playbooks and failure metrics that peer organizations use in production.

I work as a senior software engineer at Walmart Global Tech. The problem I want to walk you through today is one which all retailers are wrestling with right now, which is inventory accuracy.

Earlier coverage

Reported by infoq.com.

ai-devtoolscloud

Related coverage

Elsewhere in this edition