8 billion tokens a day forced AT&T to rethink AI orchestration — and cut costs by 90%

AT&T rethought AI orchestration due to 8 billion daily tokens, resulting in a 90% cost savings. They built a multi-agent stack with large language models directing smaller agents. This approach improved latency and response times, with small language models proving as accurate as large ones.