Guide: Batch Inference

This directory contains the code for the Batch Inference guide.

Running the Example

1. Launch the TensorZero Gateway and Postgres database:

docker compose up

2. Start a batch inference job:

sh start_batch.sh

3. Poll the status of the batch inference job using the batch_id returned by the start_batch.sh script:

sh poll_batch.sh 00000000-0000-0000-0000-000000000000