SpacetimeDB vs PostgreSQL — AI App Generation Benchmark

Sequential upgrade · L1–L11 · 13 feature groups · Claude Sonnet 4.6 · Chat app

Load data:📁 Open folder… 📄 Open file…

Runs found✕

Scanning…

📊

No run loaded

Click 📁 Open folder… to select the llm-sequential-upgrade/ directory — the viewer will find all METRICS_DATA*.json files inside and list them for selection.

Or click 📄 Open file… to load a single file directly.

Total Cost

—

SpacetimeDB

—

PostgreSQL

Total Bugs

—

SpacetimeDB

—

PostgreSQL

Fix Sessions

—

SpacetimeDB

—

PostgreSQL

Final LOC (hand-written)

—

SpacetimeDB

—

PostgreSQL

Total Time

—

SpacetimeDB

—

PostgreSQL

Fix Success (1st attempt)

—

SpacetimeDB

—

PostgreSQL

SpacetimeDB

PostgreSQL

Upgrade Cost per Level ($)

Fix Cost per Level ($)

Fix costs attributed to the level where the bug was introduced.

Total Cost per Level — Upgrade + Fix ($)

Cumulative Cost over Levels ($)

Bugs Found per Level

Cumulative Bugs over Levels

Lines of Code over Levels (hand-written, excl. generated bindings)

Backend LOC over Levels

Frontend LOC over Levels

Upgrade Duration per Level (seconds)

Output Tokens per Upgrade