5edd203076
feat(browsers): Include open Shadow DOM content in the response HTML.
...
Solves #440
2026-09-13 23:30:08 +03:00
f164713efa
feat(fetchers): keep browser tabs open and reuse them across requests
...
Browser sessions no longer close a tab after its request is completed. The tab returns to the pool as ready, and the next request reuses it, reapplying its own timeouts, extra headers, and resource/domain routes (after `unroute_all`) so nothing leaks between requests. Tabs that hit an error or got closed by the browser are closed and evicted, and the internal response listener is detached after every request so reused tabs don't stack handlers.
Adds `close_pages()` to all browser sessions to close every open tab; the next request opens a fresh one. `PagePool` gains `get_ready_page`/`remove_page`/`clear` and `PageInfo.mark_ready`, new pages start busy, and the unused `cleanup_error_pages` is removed.
Proxy-rotation contexts keep closing per request. Docs and the agent skill describe the new lifecycle.
2026-08-23 20:28:30 +03:00
6ca35d0448
feat(spiders): Adding easy interface for building RAG systems
2026-08-23 16:26:15 +03:00
9ecffdb42f
fix(cdp): Make browsers accept CDP urls with http protocol
2026-07-26 16:23:00 +03:00
35a83d38c7
docs: clarify stealth init script visibility
2026-06-14 07:43:04 +03:00
835e7ca8c3
docs: update old examples
2026-04-26 02:46:13 +03:00
9af644ef84
docs: improving the code copy-paste experience and use less tokens for the agent skill
2026-04-22 16:52:59 +02:00
158ff04c96
docs: add the new page_setup feature
2026-04-13 04:38:23 +02:00
131b729f22
docs: adding the new features
2026-04-12 18:07:38 +02:00
f756e519f3
docs: update pages with the new changes
2026-04-05 19:40:05 +02:00
1f1e475772
docs: add the browser path to docs
2026-03-30 03:37:38 +02:00
61cda587be
docs: update pages with the XHR feature
2026-03-29 23:12:56 +02:00
73832f9dfe
docs: update the website to reflect the google referer logic
2026-03-09 00:29:54 +02:00
b8b9a7f864
docs: general correction across all the pages
...
Automated. I don't know how I missed all of that!
2026-02-15 03:58:51 +02:00
7b4523af8e
docs: update the titles for all files
2026-02-15 02:35:39 +02:00
c3374bce41
docs: add a note about response body
2026-02-15 01:03:36 +02:00
dee0fd00b8
docs: use more accurate naming for proxy rotation strategy
2026-02-14 23:21:08 +02:00
c6a662eb38
docs(dynamic pages): add an important warning
2026-02-13 18:45:44 +02:00
8902034418
docs: improve wording, style, and use more visual ways
2026-02-11 03:04:35 +02:00
a72886f158
docs: update camoufox instructions for StealthyFetcher
2026-02-10 21:58:08 +02:00
f350800fd7
docs: updating Dynamic websites with protection page and some corrections
2026-02-10 21:48:09 +02:00
dba3e9d53e
docs: updating dynamic websites page and some corrections
2026-02-10 21:23:14 +02:00
8b1704a87e
docs: use better import for ProxyRotator class
2026-02-10 21:20:43 +02:00
8df74dc57b
docs: updating http requests page and some corrections
2026-02-10 19:07:09 +02:00
f25fe64d3c
docs: updating fetcher choosing page and some corrections
2026-02-10 19:01:50 +02:00
db41a6c4b6
docs: update pages with the new media for testing zensical
2026-02-08 20:46:14 +02:00
55ff20c238
docs: update replacing AI article
2025-12-31 18:28:28 +02:00
d4ae6c49c0
docs: update the StealthyFetcher page
2025-12-31 00:22:33 +02:00
a2b5628a73
docs: update DynamicFetcher page
2025-12-29 22:02:01 +02:00
67e8f4d515
docs: update DynamicFetcher page
2025-12-29 20:48:45 +02:00
e1cac0f69f
docs: update requests page
2025-12-29 20:48:32 +02:00
6c25dccb05
docs: updating the Fetcher Basics and the HTTP requests pages
2025-12-28 21:57:21 +02:00
ecb97d3fd6
docs: add docs for timezone_id argument
2025-12-18 01:16:22 +02:00
f84fbe8814
docs: update the renamed argument
2025-11-26 02:12:50 +02:00
026161c8f8
docs: update docs to add file downloading examples
2025-11-10 03:02:41 +02:00
372fc1e051
docs: Style updates and a lot of clarifications
2025-11-09 02:15:43 +02:00
3b5f0470d2
docs: Update docs accordingly and some adjustments
2025-11-08 20:18:58 +02:00
339ec43341
docs: adding separate doc for external browser
2025-10-27 06:32:31 +03:00
13b9a4668c
feat(DynamicSession): New option to add extra browser flags
2025-10-26 16:53:27 +03:00
43db79d1df
docs: adding cloud browser segment
2025-10-25 22:29:07 +03:00
f9eff25e24
docs: update website accordingly
2025-10-12 06:59:20 +03:00
a38b92cc87
feat(Dynamic fetcher): Add additional_args option to customize browser as in StealthyFetcher
2025-10-12 05:07:22 +03:00
4fea8c2e59
docs: Update docs accordingly
2025-10-12 04:51:11 +03:00
8ad7cd6343
docs: Update all pages/docstrings to reflect recent changes
2025-09-29 03:57:40 +03:00
67db865aee
feat(DynamicFetcher): Replace rebrowser with patchright
2025-09-20 00:23:29 +03:00
f604485a09
docs: Update all pages related to last changes
2025-09-14 04:45:56 +03:00
80077953f6
docs: update all pages related to last changes
2025-09-13 04:19:16 +03:00
05a714980d
docs: Update all docstring according to the new changes
2025-09-11 04:13:36 +03:00
e06f8d36db
docs: add init_script new argument
2025-09-02 16:32:19 +03:00
9e9e79d9b0
docs: fixes and adjustments
2025-09-01 06:39:17 +03:00
Karim shoair