.. _llm-ref:

Large Language Model (LLM) API

.. currentmodule:: ray.data.llm

LLM processor builder

.. autosummary:: :nosignatures: :toctree: doc/

~build_processor

Processor

.. autosummary:: :nosignatures: :toctree: doc/

~Processor

Processor configs

.. autosummary:: :nosignatures: :template: autosummary/class_without_autosummary_noinheritance.rst :toctree: doc/

~ProcessorConfig
~HttpRequestProcessorConfig
~vLLMEngineProcessorConfig
~SGLangEngineProcessorConfig

.. _stage-configs-ref:

Stage configs

.. autosummary:: :nosignatures: :template: autosummary/class_without_autosummary_noinheritance.rst :toctree: doc/

~ChatTemplateStageConfig
~TokenizerStageConfig
~DetokenizeStageConfig
~PrepareMultimodalStageConfig