Learn how to use TensorZero with Fireworks AI LLMs: open-source gateway, observability, optimization, evaluations, and experimentation.
fireworks::model_name
to use a Fireworks model with TensorZero, unless you need advanced features like fallbacks or custom credentials.
You can use Fireworks models in your TensorZero variants by setting the model
field to fireworks::model_name
.
For example:
model_name
in the inference request to use a specific Fireworks model, without having to configure a function and variant in TensorZero.
FIREWORKS_API_KEY
environment variable before running the gateway.
You can customize the credential location by setting the api_key_location
to env::YOUR_ENVIRONMENT_VARIABLE
or dynamic::ARGUMENT_NAME
.
See the Credential Management guide and Configuration Reference for more information.
docker compose up
.