google-vertex-tools (Google Vertex Tools)

Example configurations for testing Google Vertex AI models with function calling and tool callbacks.

You can run this example with:

bash

npx promptfoo@latest init --example google-vertex-tools
cd google-vertex-tools

Purpose

This example demonstrates how to use Vertex AI models with:

Install the Google Auth Library:
sh
```
npm install google-auth-library
```
Enable the Vertex AI API in your Google Cloud project
Configure your Google Cloud project:
sh
```
gcloud config set project PROJECT_ID
```
Set up authentication using one of these methods:
- Authenticate with your Google account:
  sh
```
gcloud auth application-default login
```
- Use a machine with an authorized service account
- Use service account credentials file:
  1. Download your service account JSON
  2. Set the credentials path:
    sh
```
export GOOGLE_APPLICATION_CREDENTIALS=/path/to/credentials.json
```

This example includes two different approaches:

Uses external tool definitions and validates function calls without execution:

Demonstrates actual function execution with local callbacks:

promptfooconfig-callback.js - JavaScript configuration with inline tools and callbacks
Includes local function implementation for adding numbers

Basic tool declaration example:
sh
```
promptfoo eval -c promptfooconfig.yaml
```

Function callback example:

promptfoo eval -c promptfooconfig-callback.js

Basic example: Validates that the model correctly calls the weather function with proper parameters
Callback example: Actually executes the addition function and validates the computed results