Back to Agent Zero

call_llm.py DOX

helpers/call_llm.py.dox.md

2.02.2 KB
Original Source

call_llm.py DOX

Purpose

  • Own the call_llm.py helper module.
  • This module wraps LiteLLM/model calls with examples, streaming, and extension hooks.
  • Keep this file-level DOX profile synchronized with call_llm.py because this directory is intentionally flat.

Ownership

  • call_llm.py owns the runtime implementation.
  • call_llm.py.dox.md owns durable notes about responsibilities, contracts, side effects, and verification for that implementation.
  • Classes:
  • Example (TypedDict)
  • Top-level functions:
  • async call_llm(system: str, model: BaseChatModel | BaseLLM, message: str, examples: list[Example]=..., callback: Callable[[str], None] | None=...)

Runtime Contracts

  • Helper modules own reusable framework APIs and must preserve public callers unless all callers, tests, and docs are updated together.
  • Update this file whenever public functions, classes, persistence behavior, path/security assumptions, side effects, or cross-module contracts change.
  • Observed side-effect areas: model calls.
  • Imported dependency areas include: langchain.prompts, langchain.schema, langchain_core.language_models.chat_models, langchain_core.language_models.llms, langchain_core.messages, typing.

Key Concepts

  • Important called helpers/classes observed in the source: ChatPromptTemplate.from_messages, FewShotChatMessagePromptTemplate, few_shot_prompt.format, chain.astream, HumanMessage, AIMessage, SystemMessage, callback.
  • Keep request/response, tool, or helper semantics documented here at the same time as source changes.

Work Guidance

  • Preserve public helper APIs used by core code and plugins unless every caller is updated.
  • Keep path, auth, secret, persistence, network, and subprocess behavior explicit and bounded.
  • Prefer adding cohesive helper functions here only when behavior is reused across modules.

Verification

  • Run targeted tests for changed helper behavior; run security regressions for auth, filesystem, WebSocket, tunnel, upload, or secret-handling helpers.
  • No direct test reference was found by name search; choose the nearest behavioral test or perform a focused smoke check.

Child DOX Index

No child DOX files.