Back to Tensorzero

Guide: Batch Inference

examples/guides/batch-inference/README.md

2026.4.1511 B
Original Source

Guide: Batch Inference

This directory contains the code for the Batch Inference guide.

Running the Example

  1. Launch the TensorZero Gateway and Postgres database:
bash
docker compose up
  1. Start a batch inference job:
bash
sh start_batch.sh
  1. Poll the status of the batch inference job using the batch_id returned by the start_batch.sh script:
bash
sh poll_batch.sh 00000000-0000-0000-0000-000000000000