5edd203076
feat(browsers): Include open Shadow DOM content in the response HTML.
...
Solves #440
2026-09-13 23:30:08 +03:00
f164713efa
feat(fetchers): keep browser tabs open and reuse them across requests
...
Browser sessions no longer close a tab after its request is completed. The tab returns to the pool as ready, and the next request reuses it, reapplying its own timeouts, extra headers, and resource/domain routes (after `unroute_all`) so nothing leaks between requests. Tabs that hit an error or got closed by the browser are closed and evicted, and the internal response listener is detached after every request so reused tabs don't stack handlers.
Adds `close_pages()` to all browser sessions to close every open tab; the next request opens a fresh one. `PagePool` gains `get_ready_page`/`remove_page`/`clear` and `PageInfo.mark_ready`, new pages start busy, and the unused `cleanup_error_pages` is removed.
Proxy-rotation contexts keep closing per request. Docs and the agent skill describe the new lifecycle.
2026-08-23 20:28:30 +03:00
9ecffdb42f
fix(cdp): Make browsers accept CDP urls with http protocol
2026-07-26 16:23:00 +03:00
835e7ca8c3
docs: update old examples
2026-04-26 02:46:13 +03:00
9af644ef84
docs: improving the code copy-paste experience and use less tokens for the agent skill
2026-04-22 16:52:59 +02:00
158ff04c96
docs: add the new page_setup feature
2026-04-13 04:38:23 +02:00
131b729f22
docs: adding the new features
2026-04-12 18:07:38 +02:00
1f1e475772
docs: add the browser path to docs
2026-03-30 03:37:38 +02:00
61cda587be
docs: update pages with the XHR feature
2026-03-29 23:12:56 +02:00
73832f9dfe
docs: update the website to reflect the google referer logic
2026-03-09 00:29:54 +02:00
7b4523af8e
docs: update the titles for all files
2026-02-15 02:35:39 +02:00
dee0fd00b8
docs: use more accurate naming for proxy rotation strategy
2026-02-14 23:21:08 +02:00
c6a662eb38
docs(dynamic pages): add an important warning
2026-02-13 18:45:44 +02:00
8902034418
docs: improve wording, style, and use more visual ways
2026-02-11 03:04:35 +02:00
dba3e9d53e
docs: updating dynamic websites page and some corrections
2026-02-10 21:23:14 +02:00
db41a6c4b6
docs: update pages with the new media for testing zensical
2026-02-08 20:46:14 +02:00
d4ae6c49c0
docs: update the StealthyFetcher page
2025-12-31 00:22:33 +02:00
a2b5628a73
docs: update DynamicFetcher page
2025-12-29 22:02:01 +02:00
67e8f4d515
docs: update DynamicFetcher page
2025-12-29 20:48:45 +02:00
ecb97d3fd6
docs: add docs for timezone_id argument
2025-12-18 01:16:22 +02:00
026161c8f8
docs: update docs to add file downloading examples
2025-11-10 03:02:41 +02:00
372fc1e051
docs: Style updates and a lot of clarifications
2025-11-09 02:15:43 +02:00
339ec43341
docs: adding separate doc for external browser
2025-10-27 06:32:31 +03:00
13b9a4668c
feat(DynamicSession): New option to add extra browser flags
2025-10-26 16:53:27 +03:00
43db79d1df
docs: adding cloud browser segment
2025-10-25 22:29:07 +03:00
f9eff25e24
docs: update website accordingly
2025-10-12 06:59:20 +03:00
a38b92cc87
feat(Dynamic fetcher): Add additional_args option to customize browser as in StealthyFetcher
2025-10-12 05:07:22 +03:00
4fea8c2e59
docs: Update docs accordingly
2025-10-12 04:51:11 +03:00
8ad7cd6343
docs: Update all pages/docstrings to reflect recent changes
2025-09-29 03:57:40 +03:00
67db865aee
feat(DynamicFetcher): Replace rebrowser with patchright
2025-09-20 00:23:29 +03:00
f604485a09
docs: Update all pages related to last changes
2025-09-14 04:45:56 +03:00
80077953f6
docs: update all pages related to last changes
2025-09-13 04:19:16 +03:00
05a714980d
docs: Update all docstring according to the new changes
2025-09-11 04:13:36 +03:00
e06f8d36db
docs: add init_script new argument
2025-09-02 16:32:19 +03:00
1f87210b93
docs: Add max_pages explanation to DynamicFetcher
2025-08-28 04:36:49 +03:00
31d555687f
docs: update the DynamicFetcher page
2025-08-28 03:59:00 +03:00
ed694f0a79
First version of Scrapling full documentation
2025-04-08 03:44:57 +02:00
Karim shoair