Back to Pathway

Pathway + AG2 Sample Document

examples/projects/ag2-multiagent-rag/data/sample.md

0.30.11.1 KB
Original Source

Pathway + AG2 Sample Document

This is a sample document for testing the AG2 multi-agent RAG example with Pathway.

About Pathway

Pathway is a Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG. It uses a high-performance Rust engine under the hood, providing multithreading and multiprocessing capabilities.

Key features of Pathway include:

  • Real-time document indexing and re-indexing
  • Support for various data sources (Kafka, S3, GDrive, PostgreSQL, and more)
  • Built-in LLM integration with the xpacks.llm module
  • VectorStoreServer for serving document embeddings via REST API
  • Automatic handling of document updates without manual re-indexing

About AG2

AG2 (formerly AutoGen) is a multi-agent conversation framework that enables multiple AI agents to collaborate on complex tasks. It has 500K+ monthly PyPI downloads, 4,300+ GitHub stars, and 400+ contributors.

Key features of AG2 include:

  • Multi-agent conversations with GroupChat
  • Tool registration for agents via decorator pattern
  • Support for various LLM providers
  • Flexible agent orchestration and conversation management