Back to Scrapling

Scrapling Examples

agent-skill/Scrapling-Skill/examples/README.md

0.4.71.7 KB
Original Source

Scrapling Examples

These examples scrape quotes.toscrape.com - a safe, purpose-built scraping sandbox - and demonstrate every tool available in Scrapling, from plain HTTP to full browser automation and spiders.

All examples collect all 100 quotes across 10 pages.

Quick Start

Make sure Scrapling is installed:

bash
pip install "scrapling[all]>=0.4.7"
scrapling install --force

Examples

FileToolTypeBest For
01_fetcher_session.pyFetcherSessionPython - persistent HTTPAPIs, fast multi-page scraping
02_dynamic_session.pyDynamicSessionPython - browser automationDynamic/SPA pages
03_stealthy_session.pyStealthySessionPython - stealth browserCloudflare, fingerprint bypass
04_spider.pySpiderPython - auto-crawlingMulti-page crawls, full-site scraping

Running

Python scripts:

bash
python examples/01_fetcher_session.py
python examples/02_dynamic_session.py  # Opens a visible browser
python examples/03_stealthy_session.py # Opens a visible stealth browser
python examples/04_spider.py           # Auto-crawls all pages, exports quotes.json

Escalation Guide

Start with the fastest, lightest option and escalate only if needed:

get / FetcherSession
  └─ If JS required → fetch / DynamicSession
       └─ If blocked → stealthy-fetch / StealthySession
            └─ If multi-page → Spider