TensorZero

What is TensorZero?

TensorZero is an open-source stack for industrial-grade LLM applications.

It unifies an LLM gateway, observability, optimization, evaluation, and experimentation.

Why are you building TensorZero?

Our goal is to enable LLM applications to learn from real-world experience.

The current offering is the first step towards that vision: a data and learning flywheel that enables a feedback loop for optimizing LLM applications — turning production data into smarter, faster, and cheaper models.

Is TensorZero production-ready?

Yes. Here’s a case study: Automating Code Changelogs at a Large Bank with LLMs

How much does TensorZero cost?

Nothing. TensorZero is 100% self-hosted and open-source. There are no paid features.

How do I get started?

Check out our GitHub repository and our Quick Start.

The Quick Start takes you from a vanilla OpenAI wrapper to a production-ready LLM application with observability and fine-tuning in just 5 minutes.

How can I ask questions or share feedback?

Reach out on Slack, Discord, or GitHub.

Do you offer enterprise support?

Yes, at no cost. Email us at hello@tensorzero.com to set up a dedicated support Slack channel for your team.

Who is building TensorZero?

Our technical team includes a former Rust compiler maintainer, machine learning researchers (Stanford, CMU, Oxford, Columbia) with thousands of citations, and the chief product officer of a decacorn startup.

We’re backed by the same investors as leading open-source projects (e.g. ClickHouse, CockroachDB) and AI labs (e.g. OpenAI, Anthropic).

Can I contribute? Are you hiring?

We welcome open-source contributions. We’re also hiring in NYC.