Storage backend

Colly has an in-memory storage backend to store cookies and visited URLs, but it can be overwritten by any custom storage backend which implements colly/storage.Storage.

Existing Storage Backends

In-Memory Backend

The default backend of Colly. Use collector.SetStorage() to override.

Redis backend

See redis example for details.

boltdb backend

SQLite3 backend

MongoDB backend

PostgreSQL backend