Platform · Fast-moving · Intermediate
AI gateway
A proxy layer between applications and model providers that handles routing, keys, caching, limits and logging.
What AI gateway is
A gateway centralises the operational concerns of model access so individual applications do not each reimplement them.
How it works
Applications call the gateway with a standard interface; it authenticates, applies budgets and rate limits, routes to the chosen provider, retries or fails over, caches, and records usage per team or feature.
Why it matters
It is how organisations control AI spend and switch providers without touching application code.
Common uses
- →Cost control and attribution
- →Provider failover
- →Central audit logging
- →Key management
Strengths
- ✓One control point
- ✓Vendor flexibility
Watch for
- ✓Adds a hop of latency
- ✓Single point of failure if unreplicated
Continue exploring
More in this collection
Browse all AI Technology