Developer / Business / AI / APIs / Open Source / bloomberg / Tetrate / News

Bloomberg’s Platform Engineers team up with Tetrate to build and open source a new AI Gateway

Streamlined authentication, monitoring of LLM use across multiple models? Holy Terminal, Batman, why buy it when build it and open-source it never went out of fashion.

By Edward Targett

Updated Oct 11, 2024 4:51 PM / Published Oct 9, 2024 11:35 AM 4 min read

Bloomberg’s Platform Engineers team up with Tetrate to build and open source a new AI Gateway — Deeply realistic artist's illustration of the project courtesy of ChatGPT.

A platform engineering team at Bloomberg has teamed up with Tetrate, a cloud-native application networking specialist, to start building a fully open-source “AI Gateway” that can sit in front of multiple LLMs and handle authentication, rate limiting and other features for enterprise teams – they are building this around the open source Envoy Gateway.

The two aim to open-source a minimum viable product (MVP) with three key functions ahead of the Kubecon conference in mid-November.

This content is for members only

Already have an account? Sign in

Add The Stack on Google

Edward Targett

Ed is a co-founder of The Stack. He previously edited Computer Business Review. He has also covered energy markets. He started his journalism career on local papers. He left school at 15 and has made a living asking "but why?" ever since.