Back to Pathway

Pathway LLM Extension Pack

python/pathway/xpacks/llm/README.md

0.30.1383 B
Original Source

Pathway LLM Extension Pack

This XPack contains Pathway functions useful in building data processing pipelines involving LLM models:

  1. pathway-compatible wrappers (UDFs) for popular AI and language modeling tasks, such as:
  • document parsing
  • text embedding
  • LLM API calls
  1. ready-made document processing pipelines for popular tasks:
  • document indexing