
Lightport accepts OpenAI-compatible requests, transforms them for the target provider, and returns the response. It supports 77 total providers including OpenAI, Anthropic, Azure OpenAI, Google Gemini, Vertex AI, Bedrock, Cohere, Mistral, Groq, Deepseek, Together AI, Fireworks, and Ollama.
The gateway implements request/response transformation only—retries, secret management, caching, rate limiting, and other operational concerns are explicitly non-goals and are better handled at a higher abstraction layer. It started as a fork of Portkey AI Gateway, since fixed numerous bugs, added integration tests for every provider, and continues to actively maintain the gateway as it directly powers Glama.
Supported endpoints include POST /v1/chat/completions, POST /v1/completions, and POST /v1/responses (+ GET, DELETE, input_items). The gateway runs on http://localhost:8787 and accepts provider specification via the x-lightport-provider header along with credentials passed via Authorization or provider-specific headers.
Ask the AI about this article →
For example, today's edition would include:
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. Q&As are published on this page for other readers too.
Phonely Ltd. launched Alma, a large language AI model built for voice agents and trained on over 10 million re…
Aranya Inc., a startup founded last year, launched today with $11 million in funding
CBTS Technology Solutions LLC launched Forge Agents, a platform that turns a plain-language job description in…
Imec CEO Patrick Vandenameele said at SEMICON Taiwan 2026 that the Belgian research center is broadening its c…

Alphabet's AI Overviews now reach over 2.5 billion monthly users through Google Search, and its ad business ge…

Sarah O’Connor's book 'We Are Not Machines' explores how mechanization and AI have transformed the workforce…
