Bifrost is a software gateway that sits between an application and many AI model providers, letting it send requests to dozens of AI services through one connection. It is aimed at developers and IT teams who build or run AI-powered applications and want to manage several AI providers, API keys, and costs in one place.
Has 3 of 7
How many people bookmarked its code on GitHub. It shows how popular it is, not how good it is or how well it replaces the app.
How hard it is to start using it. Easy: install it like a normal app, or use it in your browser. Advanced: you run it on your own server, use the command line, or it is a tool for developers.
Its code changed within the last year, so someone is still looking after it.
Does the whole job.
Ordered by how fully it replaces the app, Verified, setup and, when there are enough, people's votes.
LiteLLM is a free, open source tool that lets a team send requests to more than 100 AI language models through one connection, using one common format. It is aimed at programmers and IT staff who build AI apps or run AI access for an organization.
Has 3 of 7
How many people bookmarked its code on GitHub. It shows how popular it is, not how good it is or how well it replaces the app.
How hard it is to start using it. Easy: install it like a normal app, or use it in your browser. Advanced: you run it on your own server, use the command line, or it is a tool for developers.
Its code changed within the last year, so someone is still looking after it.
Does the whole job.
Ordered by how fully it replaces the app, Verified, setup and, when there are enough, people's votes.
Portkey Gateway is a free tool that sends one program's AI requests to many different AI model providers through a single connection, and it keeps track of API keys and usage. It is aimed at software developers who build apps that use AI models.
Has 3 of 7
How many people bookmarked its code on GitHub. It shows how popular it is, not how good it is or how well it replaces the app.
How hard it is to start using it. Easy: install it like a normal app, or use it in your browser. Advanced: you run it on your own server, use the command line, or it is a tool for developers.
Its code changed within the last year, so someone is still looking after it.
Does the whole job.
Ordered by how fully it replaces the app, Verified, setup and, when there are enough, people's votes.
Claude Code Router is a program that runs on your own computer and acts as a single connection point for AI coding assistants like Claude Code and Codex. It lets you set up several AI model providers in one place, switch between them, and see logs of what each request did.
Has 1 of 7 · Hosted for you ✗
How many people bookmarked its code on GitHub. It shows how popular it is, not how good it is or how well it replaces the app.
How hard it is to start using it. Easy: install it like a normal app, or use it in your browser. Advanced: you run it on your own server, use the command line, or it is a tool for developers.
Its code changed within the last year, so someone is still looking after it.
Does part of the job.
Ordered by how fully it replaces the app, Verified, setup and, when there are enough, people's votes.
None of these match. Try another device.
Help me choose
I want to pick an open-source replacement for Cloudflare AI Gateway. Below is a list from Open Source Everything (CC BY-SA 4.0), in the order its website shows it. The order is a starting point, not a verdict.
- Bifrost: Bifrost is a software gateway that sits between an application and many AI model providers, letting it send requests to dozens of AI services through one connection. It is aimed at developers and IT teams who build or run AI-powered applications and want to manage several AI providers, API keys, and costs in one place. [Advanced setup; runs on a server you set up; replaces fully; Apache-2.0; https://github.com/maximhq/bifrost]
- LiteLLM: LiteLLM is a free, open source tool that lets a team send requests to more than 100 AI language models through one connection, using one common format. It is aimed at programmers and IT staff who build AI apps or run AI access for an organization. [Advanced setup; runs on a server you set up; replaces fully; MIT; https://github.com/BerriAI/litellm]
- Portkey Gateway: Portkey Gateway is a free tool that sends one program's AI requests to many different AI model providers through a single connection, and it keeps track of API keys and usage. It is aimed at software developers who build apps that use AI models. [Advanced setup; runs on a server you set up; replaces fully; MIT; https://github.com/Portkey-AI/gateway]
- claude-code-router: Claude Code Router is a program that runs on your own computer and acts as a single connection point for AI coding assistants like Claude Code and Codex. It lets you set up several AI model providers in one place, switch between them, and see logs of what each request did. [Advanced setup; Windows · Mac · Linux; replaces partly; MIT; https://github.com/musistudio/claude-code-router]
Setup rating: "Easy setup" means you can install it like a normal app, use it in a browser. "Advanced setup" means you must run it on your own server or use the command line, or it is a tool for developers.
Full details: https://opensourceeverything.org/data/groups/ai-gateways.json
Before recommending anything, ask me these three questions (one at a time, in plain words): 1) Which device or devices will I use it on (Windows, Mac, Linux, Android, iPhone)? 2) How comfortable am I with technical setup: only installing apps from a store, happy to follow a step-by-step guide, or comfortable with servers and the command line? 3) What is my budget: free only, or willing to pay for hosting or support? Then recommend one to three projects from this list only, and for each say why, using how fully it replaces the app, its setup rating, and the devices it runs on. If nothing on the list fits me, say so plainly instead of stretching.
Before you build
Read the list of open-source projects at https://opensourceeverything.org/data/groups/ai-gateways.json. Compare it with my project or idea below. Tell me which projects overlap, what I could reuse instead of rewriting, and what mine does that none of them do.
My project or idea:
