AI Cost Control

Get third-party AI API costs under control

In this session, experts will cover strategies to reduce unnecessary token usage, from runtime monitoring and intelligent routing to better API design and governance.

As AI becomes ubiquitous across programming stacks and business user workflows, an unsettling reality is emerging: heavy token usage is ballooning AI costs. Calls to backend large language model (LLM) APIs are rarely monitored in a fine-grained way and are often inefficiently orchestrated, leading to unnecessary token usage and rising costs.

In this hour-long discussion, we’ll bring in API community experts to explore what IT leaders can do to get a handle on rising AI costs. We’ll cover runtime methods, such as analytics and monitoring, as well as architectures for intelligent routing, semantic caching, and more. We’ll also discuss design-time optimizations such as more intentional API design and governance approaches that reduce unnecessary waste.

The LiveCast will feature Derrig Gilling, VP & GM, API Platform at WSO2, and previously co-founder and CEO of Moesif, which was recently acquired by WSO2. It will also feature Emmanuel Paraskakis, CEO of Level 250, a product management consultancy specializing in API strategy. Bill Doerrfeld, tech journalist and Editor in Chief at Nordic APIs, will moderate the discussion and audience Q and A. The panel discussion will be recorded over Zoom and published to YouTube shortly after the event.

About Nordic APIs LiveCasts
Nordic APIs LiveCasts are free to attend through Zoom registration. Attendees are welcome to ask questions in real time. We’ll post the recorded session to YouTube shortly after the event.