Pool the Free Tiers of 29 AI Providers Behind One Endpoint
How to pool the free tiers of 29 AI providers behind one endpoint, and never hit a rate limit again
What this actually is
Every serious AI lab now hands out a free tier. A few million tokens a month here, a few thousand requests a day there. On its own each one is a toy, which is why most developers sign up for one, hit a wall, and go pay for a plan.
FreeLLMAPI is an MIT licensed proxy that stacks them. You add the free keys you already qualify for, and it serves all of them behind a single OpenAI compatible endpoint. Point any OpenAI client at your local server and it routes transparently across whichever providers you have added.
- Repo: github.com/tashfeenahmed/freellmapi
- 18,265 stars, MIT licence, TypeScript
- 29 free providers, 251 model families, 358 free model endpoints
- Roughly 4 billion tokens per month of listed free capacity
- Keys are AES-256-GCM encrypted at rest and decrypted in memory per request
Keep reading
Free, for an email.
Unlocks 7 more sections, the document version, and every other guide on the site, for free. Enter your email once to keep reading.
19,000+ follow where these guides come from.No spam. Unsubscribe in one click.