Introduction
Frequently Asked Questions
Learn more about TensorZero: how it works, why we built it, and more.
Next steps?
The Quickstart shows it’s easy to set up an LLM application with TensorZero.
If you want to dive deeper, the Tutorial teaches how to build a simple chatbot, an email copilot, a weather RAG system, and a structured data extraction pipeline.Questions?
Ask us on Slack or Discord.Using TensorZero at work?
Email us at [email protected] to set up a Slack or Teams channel with your team (free).Work with us.
We’re hiring in NYC.
We’d also welcome open-source contributions!
Technical
Why is the TensorZero Gateway a proxy instead of a library?
Why is the TensorZero Gateway a proxy instead of a library?
TensorZero’s proxy pattern makes it agnostic to the application’s tech stack, isolated from the business logic, more composable with other tools, and easy to deploy and manage.Many engineers are (correctly) wary of marginal latency from such a proxy, so we built the gateway from the ground up with performance in mind.
In Benchmarks, it achieves sub-millisecond P99 latency overhead under extreme load.
This makes the gateway fast and lightweight enough to be unnoticeable even in the most demanding LLM applications, especially if deployed as a sidecar container.
How is the TensorZero Gateway so fast?
How is the TensorZero Gateway so fast?
Why did you choose ClickHouse as TensorZero's analytics database?
Why did you choose ClickHouse as TensorZero's analytics database?
ClickHouse is open source, extremely fast, and versatile.
It supports diverse storage backends, query patterns, and data types, including vector search (which will be important for upcoming TensorZero features).
From the start, we designed TensorZero to be easy to deploy but able to grow to massive scale.
ClickHouse is the best tool for the job.
Project
Who is behind TensorZero?
Who is behind TensorZero?
We’re a small technical team based in NYC. Work with us →
Founders
Viraj Mehta (CTO) recently completed his PhD from CMU, with an emphasis on reinforcement learning for LLMs and nuclear fusion, and previously worked in machine learning at KKR and a fintech startup; he holds a BS in math and an MS in computer science from Stanford.Gabriel Bianconi (CEO) was the chief product officer at Ondo Finance ($20B+ valuation in 2024) and previously spent years consulting on machine learning for companies ranging from early-stage tech startups to some of the largest financial firms; he holds BS and MS degrees in computer science from Stanford.How is TensorZero licensed?
How is TensorZero licensed?
How does TensorZero make money?
How does TensorZero make money?
We don’t.We’re lucky to have investors who are aligned with our long-term vision, so we’re able to focus on building and snooze this question for a while.We’re inspired by companies like Databricks and ClickHouse.
One day, we’ll launch a managed service that further streamlines LLM engineering, especially in enterprise settings, but open source will always be at the core of our business.