Learn how to use TensorZero with GCP Vertex AI Gemini LLMs: open-source gateway, observability, optimization, evaluations, and experimentation.
gcp_vertex_gemini::model_name
to use a GCP Vertex AI Gemini model with TensorZero if you don’t need advanced features like fallbacks or custom credentials:
gcp_vertex_gemini::projects/<PROJECT_ID>/locations/<REGION>/publishers/google/models/<MODEL_ID>
gcp_vertex_gemini::projects/<PROJECT_ID>/locations/<REGION>/endpoints/<ENDPOINT_ID>
GCP_VERTEX_CREDENTIALS_PATH
environment variable.
You can customize the credential location by setting the credential_location
to env::YOUR_ENVIRONMENT_VARIABLE
.
See the Credential Management guide and Configuration Reference for more information.
docker compose up
.