AIToday

Lightport, a lightweight AI gateway forked from Portkey, makes LLM providers OpenAI-compatible by transforming requests and responses.

Hacker NewsApr 27, 20262 min read
Lightport, a lightweight AI gateway forked from Portkey, makes LLM providers OpenAI-compatible by transforming requests and responses.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  1. Lightport accepts OpenAI-compatible requests, transforms them for the target provider, and returns the response. It supports 77 total providers including OpenAI, Anthropic, Azure OpenAI, Google Gemini, Vertex AI, Bedrock, Cohere, Mistral, Groq, Deepseek, Together AI, Fireworks, and Ollama.

  2. The gateway implements request/response transformation only—retries, secret management, caching, rate limiting, and other operational concerns are explicitly non-goals and are better handled at a higher abstraction layer. It started as a fork of Portkey AI Gateway, since fixed numerous bugs, added integration tests for every provider, and continues to actively maintain the gateway as it directly powers Glama.

  3. Supported endpoints include POST /v1/chat/completions, POST /v1/completions, and POST /v1/responses (+ GET, DELETE, input_items). The gateway runs on http://localhost:8787 and accepts provider specification via the x-lightport-provider header along with credentials passed via Authorization or provider-specific headers.

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →