Back to Ray

Large Language Model (LLM) API

doc/source/data/api/llm.rst

1.13.1903 B
Original Source

.. _llm-ref:

Large Language Model (LLM) API

.. currentmodule:: ray.data.llm

LLM processor builder

.. autosummary:: :nosignatures: :toctree: doc/

~build_processor

Processor

.. autosummary:: :nosignatures: :toctree: doc/

~Processor

Processor configs

.. autosummary:: :nosignatures: :template: autosummary/class_without_autosummary_noinheritance.rst :toctree: doc/

~ProcessorConfig
~HttpRequestProcessorConfig
~vLLMEngineProcessorConfig
~SGLangEngineProcessorConfig

.. _stage-configs-ref:

Stage configs

.. autosummary:: :nosignatures: :template: autosummary/class_without_autosummary_noinheritance.rst :toctree: doc/

~ChatTemplateStageConfig
~TokenizerStageConfig
~DetokenizeStageConfig
~PrepareMultimodalStageConfig