TensorZero UI Deployment Guide

The TensorZero UI is a self-hosted web application that streamlines the use of TensorZero with features like observability and optimization. It’s easy to get started with the TensorZero UI.

See the TensorZero Gateway Deployment Guide for more details on how to deploy the gateway and ClickHouse database.

Setup

To use the TensorZero UI, you only need your ClickHouse database URL (TENSORZERO_CLICKHOUSE_URL) and TensorZero Gateway URL (TENSORZERO_GATEWAY_URL). Optionally, you can also provide credentials for fine-tuning APIs.

Credentials for Fine-tuning

The TensorZero UI integrates with model providers like OpenAI to streamline workflows like fine-tuning. To use these features, you need to provide credentials for the relevant model providers as environment variables. You don’t need to provide credentials if you’re not using the fine-tuning features for those providers. The supported fine-tuning providers and their required credentials (environment variables) are:

Provider	Required Credentials
Fireworks AI	`FIREWORKS_ACCOUNT_ID` `FIREWORKS_API_KEY`
OpenAI	`OPENAI_API_KEY`
Together AI	`TOGETHER_API_KEY`
GCP Vertex	GCP account credentials

We’re planning to add support for more fine-tuning providers in the near future.

Optional Environment Variables

The TensorZero UI supports the following optional environment variables. You can set TENSORZERO_UI_CONFIG_PATH to a custom path to the TensorZero configuration file. When using the official Docker image, this value defaults to /app/config/tensorzero.toml. For certain uncommon scenarios (e.g. IPv6), you can also customize HOST inside the UI container. See the Vite documentation for more details.

Deployment

The TensorZero UI is available on Docker Hub as tensorzero/ui.

Running with Docker Compose (Recommended)

You can easily run the TensorZero UI using Docker Compose:

services:
  ui:
    image: tensorzero/ui
    # Mount your configuration folder (e.g. tensorzero.toml) to /app/config
    volumes:
      - ./config:/app/config:ro
    # Add your environment variables the .env file
    env_file:
      - ${ENV_FILE:-.env}
    # Publish the UI to port 4000
    ports:
      - "4000:4000"
    restart: unless-stopped

Make sure to create a .env file with the relevant environment variables.For more details, see the example docker-compose.yml file in the GitHub repository.

Running with Docker (Recommended)

Alternatively, you can launch the UI directly with the following command:

docker run \
    --volume ./config:/app/config:ro \
    --env-file ./.env \
    --publish 4000:4000 \
    tensorzero/ui

Make sure to create a .env file with the relevant environment variables.

Running with Kubernetes (k8s) and Helm

Building from source

Introduction

Gateway

Optimization

Evaluations

UI

TensorZero UI Deployment Guide

Setup

Credentials for Fine-tuning

Optional Environment Variables

Deployment

Introduction

Gateway

Optimization

Evaluations

UI

​Setup

​Credentials for Fine-tuning

​Optional Environment Variables

​Deployment

Setup

Credentials for Fine-tuning

Optional Environment Variables

Deployment