Skip to main content

TensorZero Docs home page

tensorzero/tensorzero
tensorzero/tensorzero

Documentation
Blog
Slack
Discord

Introduction

Overview
Quickstart
Vision & Roadmap
Frequently Asked Questions

Gateway

Overview
Call any LLM
Create a prompt template
Generate embeddings
Tutorial
Batch Inference
Episodes
Inference Caching
Inference-Time Optimizations
Metrics & Feedback
Multimodal Inference
Retries & Fallbacks
Streaming Inference
Tool Use (Function Calling)
Benchmarks
Clients
Configuration Reference
Data Model

Optimization

Overview

Evaluations

Overview

Experimentation

Run A/B tests

Deployment

Deploy the TensorZero Gateway
Deploy the TensorZero UI
Deploy ClickHouse (optional)
Optimize latency and throughput

Operations

Manage credentials (API keys)
Organize your configuration
Export OpenTelemetry traces
Export Prometheus metrics
Extend TensorZero

404

Page Not Found

We couldn't find the page.. Maybe you were looking for one of these pages below?

Inference-Time Optimizations Overview Inference Caching

Assistant

Responses are generated using AI and may contain mistakes.