Back to Autogpt

Exa Contents

docs/integrations/block-integrations/exa/contents.md

0.6.442.6 KB
Original Source

Exa Contents

<!-- MANUAL: file_description -->

Blocks for retrieving and extracting content from web pages using Exa's contents API.

<!-- END MANUAL -->

Exa Contents

What it is

Retrieves document contents using Exa's contents API

How it works

<!-- MANUAL: how_it_works -->

This block retrieves full content from web pages using Exa's contents API. You can provide URLs directly or document IDs from previous searches. The API supports live crawling to fetch fresh content and can extract text, highlights, and AI-generated summaries.

The block supports subpage crawling to gather related content and offers various content retrieval options including full text extraction, relevant highlights, and customizable summary generation. Results are formatted for easy use with LLMs.

<!-- END MANUAL -->

Inputs

InputDescriptionTypeRequired
urlsArray of URLs to crawl (preferred over 'ids')List[str]No
ids[DEPRECATED - use 'urls' instead] Array of document IDs obtained from searchesList[str]No
textRetrieve text content from pagesboolNo
highlightsText snippets most relevant from each pageHighlightSettingsNo
summaryLLM-generated summary of the webpageSummarySettingsNo
livecrawlLivecrawling options: never, fallback (default), always, preferred"never" | "fallback" | "always" | "preferred"No
livecrawl_timeoutTimeout for livecrawling in millisecondsintNo
subpagesNumber of subpages to crawlintNo
subpage_targetKeyword(s) to find specific subpages of search resultsstr | List[str]No
extrasExtra parameters for additional contentExtrasSettingsNo

Outputs

OutputDescriptionType
errorError message if the request failedstr
resultsList of document contents with metadataList[ExaSearchResults]
resultSingle document content resultExaSearchResults
contextA formatted string of the results ready for LLMsstr
request_idUnique identifier for the requeststr
statusesStatus information for each requested URLList[ContentStatus]
cost_dollarsCost breakdown for the requestCostDollars

Possible use case

<!-- MANUAL: use_case -->

Content Aggregation: Retrieve full article content from multiple URLs for analysis or summarization.

Competitive Research: Crawl competitor websites to extract product information, pricing, or feature details.

Data Enrichment: Fetch detailed content from URLs discovered through Exa searches to build comprehensive datasets.

<!-- END MANUAL -->