Back to Cherry Studio

Cancelled local inference stops before the next request starts

v2-refactor-temp/docs/breaking-changes/2026-09-07-local-inference-cancellation.md

2.0.13565 B
Original Source

What changed

Cancelling an active local embedding or OCR request waits for its inference process to exit before starting the next request for that capability. Requests cancelled while still queued are skipped without stopping the active request.

Why this matters to the user

Cancelled work cannot overlap the next request's use of the same native model resources. After cancelling an active request, the next request reloads the model and may take longer to start; downloaded model files are not removed.

What the user should do

Nothing — automatic.