New open-source AI Cost Firewall tool helps developers reduce API spending by caching semantic requests to OpenAI-compatible services

AI Cost Firewall is an OpenAI-compatible gateway that implements semantic caching to minimize redundant API calls and reduce costs

The tool is available as open-source code on GitHub under the vcal-project organization

Designed to work as a drop-in proxy between applications and LLM providers, compatible with OpenAI's API format

Helps teams optimize their AI infrastructure spending without modifying existing application code