Karim shoair 5edd203076 feat(browsers): Include open Shadow DOM content in the response HTML. ...

Solves #440

2026-09-13 23:30:08 +03:00

..

__init__.py

test: add tests for the spiders system

2026-01-19 03:46:00 +02:00

test_cache.py

fix(spiders): keep the request meta on cached responses (#419)

2026-08-23 21:58:21 +03:00

test_checkpoint.py

test: add tests for the spiders system

2026-01-19 03:46:00 +02:00

test_engine.py

feat(spiders): Auto throttle based on website speed/protection

2026-07-26 22:54:36 +03:00

test_feed.py

feat(spiders): Add XML/CSV feed templates + docs

2026-08-09 20:44:12 +03:00

test_force_stop_checkpoint.py

feat(spiders): Auto throttle based on website speed/protection

2026-07-26 22:54:36 +03:00

test_links.py

fix: honor compound link deny extensions

2026-06-26 10:52:38 +02:00

test_request.py

fix: str(value)

2026-04-30 09:52:34 -04:00

test_result.py

feat(spiders): Add exporters to CSV/XML

2026-07-26 23:13:35 +03:00

test_robotstxt.py

test: align robots request-rate expectation

2026-06-17 21:09:09 +08:00

test_scheduler.py

fix: track in-flight requests by queue counter so duplicate instances are not collapsed

2026-06-23 20:31:28 +00:00

test_session.py

fix: preserve HTTP method across retries in spider session

2026-03-17 00:53:52 +09:00

test_shadow_cache.py

feat(browsers): Include open Shadow DOM content in the response HTML.

2026-09-13 23:30:08 +03:00

test_shopify.py

feat: add a template for Shopify websites

2026-07-12 18:44:11 +03:00

test_site_to_markdown.py

feat(spiders): Adding easy interface for building RAG systems

2026-08-23 16:26:15 +03:00

test_sitemap.py

tests: remove old code and update the rest

2026-05-11 03:30:59 +03:00

test_spider.py

test: update spider check

2026-02-14 02:51:39 +02:00

test_templates.py

tests: remove old code and update the rest

2026-05-11 03:30:59 +03:00

test_throttle.py

feat(spiders): Auto throttle based on website speed/protection

2026-07-26 22:54:36 +03:00