skills/d4vinci__scrapling
1
0
Fork 0
mirror of https://github.com/D4Vinci/Scrapling.git synced 2026-09-14 20:07:02 +08:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 6e644048eb docs(skill): Update skills files with the updates dev Karim shoair 2026-09-13 23:42:28 +03:00
  • 6bbc6e01c5 feat(mcp/cli): Include open Shadow DOM content in the response HTML. Karim shoair 2026-09-13 23:37:56 +03:00
  • 5edd203076 feat(browsers): Include open Shadow DOM content in the response HTML. Karim shoair 2026-09-13 23:30:08 +03:00
  • 20337ba6a5 fix(cli): fix markdown concatenation Karim shoair 2026-09-12 23:18:44 +03:00
  • 2947fca6d4 fix(response): fix markdown concatenation (#432) Yiğit ERDOĞAN 2026-09-12 23:15:07 +03:00
  • 48da61d1ee Updating contribution rules main Karim shoair 2026-09-12 17:59:54 +03:00
  • 3115acab99 docs: update translation buttons Karim shoair 2026-09-11 22:20:26 +03:00
  • a54a23be7a docs: updating a sponsor image Karim shoair 2026-09-11 21:02:58 +03:00
  • 28c3296714 docs: adding a new sponsor Karim shoair 2026-09-04 15:33:23 +03:00
  • 1f40d9b11b docs: moving up a sponsor Karim shoair 2026-09-02 15:09:56 +03:00
  • 196c81ad67 docs: update a sponsor url Karim shoair 2026-09-01 15:38:52 +03:00
  • 458e2a2ac9 docs: removing a sponsor v5-dev Karim shoair 2026-08-25 21:38:48 +03:00
  • 3b11b85eac docs: update a sponsor image Karim shoair 2026-08-24 21:41:06 +03:00
  • 333fa22b7a v0.4.15 (#423) v0.4.15 Karim shoair 2026-08-23 22:43:08 +03:00
  • d04613e52e docs: update the changelog #423 Karim shoair 2026-08-23 22:42:37 +03:00
  • 3e03f78bc0 chore: pump deps up and update stars history image Karim shoair 2026-08-23 22:14:09 +03:00
  • ac18622ea2 fix(static): send the request once when retries is below 1 (#420) Yiğit ERDOĞAN 2026-08-23 22:09:37 +03:00
  • 63cdc99cfd fix(spiders): keep the request meta on cached responses (#419) Yiğit ERDOĞAN 2026-08-23 21:58:21 +03:00
  • 76395b7273 docs: update the intro Karim shoair 2026-08-23 20:31:17 +03:00
  • f164713efa feat(fetchers): keep browser tabs open and reuse them across requests Karim shoair 2026-08-23 20:28:30 +03:00
  • 6c5b691db7 docs: add new ai sub-section with the new changes + add changelog file Karim shoair 2026-08-23 18:00:15 +03:00
  • 6ca35d0448 feat(spiders): Adding easy interface for building RAG systems Karim shoair 2026-08-23 16:26:15 +03:00
  • 6815ca4f4f docs: add a page for the agent skill and restructure the website sections to clearer Karim shoair 2026-08-22 19:32:11 +03:00
  • 6e6373c997 feat(mcp): add two tools to open requests sessions and use them Karim shoair 2026-08-22 19:17:32 +03:00
  • 0cb3e971c9 Merge branch 'main' into dev Karim shoair 2026-08-21 20:28:49 +03:00
  • 4ce0fb1c1a docs: adding a new sponsor Karim shoair 2026-08-21 20:24:35 +03:00
  • 0154400933 docs: updating a sponsor Karim shoair 2026-08-21 19:38:45 +03:00
  • 1181fc6a1f feat(mcp)!: rename get to make_request and add more methods. Karim shoair 2026-08-21 19:26:47 +03:00
  • 93ae0ac9c4 fix(mcp): Set the session proxy to be browser-level argument Karim shoair 2026-08-21 19:25:29 +03:00
  • 73ad18be58 refactor(mcp)!: More reliable structure + new tools Karim shoair 2026-08-21 03:16:17 +03:00
  • d4e121ce7c fix(ai)!: keep session settings on MCP session fetches (#418) Yiğit ERDOĞAN 2026-08-19 23:19:22 +03:00
  • 0003f6444b fix(parser): keep filtering on blank class_ and escape CSS string values (#417) Mrityunjay SIngh 2026-08-20 00:43:14 +05:30
  • 39ecbf0f9a docs: update stars history Karim shoair 2026-08-19 22:04:12 +03:00
  • c0326263b5 fix(stealth): solve Cloudflare challenges regardless of locale + retry cap + fix crashing mid-solve Karim shoair 2026-08-19 21:59:34 +03:00
  • 9376a3d8c4 Merge branch 'main' into dev Karim shoair 2026-08-19 20:23:42 +03:00
  • cb00f1bba8 docs: adding a new sponsor Karim shoair 2026-08-19 20:06:03 +03:00
  • e90875f31f docs: fix missing parts from the updates Karim shoair 2026-08-19 02:03:32 +03:00
  • 029d098c06 fix: require authentication by default for the HTTP transport (#414) Mrityunjay SIngh 2026-08-19 04:26:23 +05:30
  • 0e1e085aa7 build: correcting dep version Karim shoair 2026-08-19 01:54:05 +03:00
  • 1cd938e040 build: pump version and deps Karim shoair 2026-08-19 01:13:30 +03:00
  • 316b6d238c fix(parser): find/find_all with class_ silently miss multi-class elements (#410) Karim shoair 2026-08-19 00:18:12 +03:00
  • 69a2985ada fix(parser): match multi-class elements in find/find_all class_ filter #410 yetval 2026-08-12 00:02:23 -04:00
  • 5d213a2d47 v0.4.14 (#409) v0.4.14 Karim shoair 2026-08-11 01:27:00 +03:00
  • 90c30446ff Merge branch 'main' into dev #409 Karim shoair 2026-08-11 01:09:42 +03:00
  • 2b9d0e2933 style: image size adjustment Karim shoair 2026-08-11 01:07:32 +03:00
  • 2c371e0f2e docs: add stars history manually because of Github API changes Karim shoair 2026-08-11 01:03:00 +03:00
  • 4e0ac98d8c build: pump version and deps Karim shoair 2026-08-11 00:58:50 +03:00
  • 3f32fa9050 docs: re-adding a sponsor Karim shoair 2026-08-11 00:37:19 +03:00
  • 9af7e2796a docs: adding a new sponsor Karim shoair 2026-08-11 00:30:14 +03:00
  • 64bc7007b0 v0.4.13 (#406) v0.4.13 Karim shoair 2026-08-09 22:06:36 +03:00
  • 10c6c8951e perf(mcp): Add more specific instruction to the server-level instructions #406 Karim shoair 2026-08-09 22:05:58 +03:00
  • b2106e6054 docs: add an AI policy for contributions Karim shoair 2026-08-09 21:20:49 +03:00
  • b498fe7ee0 docs: update benchmarks results with the latest numbers Karim shoair 2026-08-09 21:14:53 +03:00
  • fad6893d66 docs: add the new templates to the docs Karim shoair 2026-08-09 20:56:29 +03:00
  • 6e41f335f9 fix(xml template): Be specific about the node type hint Karim shoair 2026-08-09 20:49:28 +03:00
  • 9bbd7c8b25 feat(spiders): Add XML/CSV feed templates + docs Karim shoair 2026-08-09 20:44:12 +03:00
  • f8893d9b58 fix(ai): size the MCP bulk page pools within the validator bounds (#393) Yiğit ERDOĞAN 2026-08-09 20:18:53 +03:00
  • 0f2397c769 feat(mcp): add a scrapling-mcp console shortcut for easier MCP registration Karim shoair 2026-08-09 19:19:52 +03:00
  • 902b617a15 fix(mcp): point the server card website_url at the MCP docs page Karim shoair 2026-08-09 19:05:08 +03:00
  • 0e16c4d471 feat(mcp): add tool annotations, server card metadata, and a tools/list cache hint Karim shoair 2026-08-09 19:01:39 +03:00
  • e90367b7ab feat(mcp): Make tools description shorter and add server-level instructions Karim shoair 2026-08-09 18:36:20 +03:00
  • 346fe9c25c build: pump version and deps Karim shoair 2026-08-09 16:45:55 +03:00
  • e978f8616d fix:(mcp): upgrade mcp server to v2 Karim shoair 2026-08-09 16:29:16 +03:00
  • 2fb5e429f2 fix(browser version): extract current chrome version from playwright package data Karim shoair 2026-08-09 00:41:05 +03:00
  • 39847bd2da docs: removing a sponsor Karim shoair 2026-08-06 16:00:32 +03:00
  • bc0cf7dede docs: typo fix Karim shoair 2026-07-30 17:31:34 +03:00
  • efc0de2936 docs: adding new sponsor Karim shoair 2026-07-30 17:30:17 +03:00
  • 80d78cc362 docs: typo fix Karim shoair 2026-07-27 14:01:05 +03:00
  • 87e010a2e8 docs: fix Karim shoair 2026-07-27 12:38:38 +03:00
  • ebb0dbfdc3 ci: fixes Karim shoair 2026-07-27 12:34:46 +03:00
  • fc96fcc386 v0.4.12 (#388) v0.4.12 Karim shoair 2026-07-26 23:23:21 +03:00
  • 1166ce3368 ci: lock workflows to be triggered by the repo owner alone #388 Karim shoair 2026-07-26 23:19:51 +03:00
  • 0a7fec8f86 feat(spiders): Add exporters to CSV/XML Karim shoair 2026-07-26 23:13:35 +03:00
  • 347db4c76b docs: add the auto throttle option Karim shoair 2026-07-26 23:04:28 +03:00
  • ca51962421 feat(spiders): Auto throttle based on website speed/protection Karim shoair 2026-07-26 22:54:36 +03:00
  • 9526bac808 agent: update the skill with the latest updates Karim shoair 2026-07-26 19:04:48 +03:00
  • 563b134f9e feat(mcp): Add auth to the mcp server and the option to set allowed host Karim shoair 2026-07-26 19:02:16 +03:00
  • 0ca4aeabae docs: Update main pages with the recently added features Karim shoair 2026-07-26 16:40:49 +03:00
  • 9ecffdb42f fix(cdp): Make browsers accept CDP urls with http protocol Karim shoair 2026-07-26 16:23:00 +03:00
  • f293d83fda ci(docker): tag images with the release version on merge (#384) JanRK 2026-07-26 15:03:22 +02:00
  • d08aa90d9e Merge branch 'main' into dev Karim shoair 2026-07-26 16:01:45 +03:00
  • 11cd295d67 fix(stealth): stop forcing en-US so the browser follows the system locale (fixes #381) Karim shoair 2026-07-25 19:07:05 +03:00
  • b5c8963e84 fix(spiders): preserve cookies for browser-engine responses in cache (#379) Karim shoair 2026-07-25 17:34:07 +03:00
  • a5fed0c622 Merge branch 'dev' into fix/cache-drops-browser-cookies #379 Karim shoair 2026-07-25 16:48:55 +03:00
  • 08bed1589d docs: add a badge for the number of docker pulls Karim shoair 2026-07-24 16:39:32 +03:00
  • 259d667a25 build: pump up version Karim shoair 2026-07-24 01:49:50 +03:00
  • 2f400555c3 fix: remove dead fetchall() after INSERT and correct retrieve() error message (#377) Semianchuk Vitalii 2026-07-23 23:48:24 +01:00
  • 1208199c49 perf(parser): make get_all_text() O(nodes) (#378) Karim shoair 2026-07-24 01:29:34 +03:00
  • 9c3fac74ee Merge branch 'dev' into perf/get-all-text-single-pass #378 Karim shoair 2026-07-24 01:29:13 +03:00
  • 3ed4fde93a fix(spiders): preserve cookies for browser-engine responses in cache (#376) Amit Vijapur 2026-07-21 00:38:48 +08:00
  • 07a548362f docs: moving up a sponsor Karim shoair 2026-07-20 16:04:27 +03:00
  • ed0202fe3d perf(parser): skip re-walking nested ignored subtrees when building the ignored set yetval 2026-07-15 23:42:07 -04:00
  • f4fc6a1baa perf(parser): make Selector.get_all_text() O(nodes) by precomputing ignored subtrees yetval 2026-07-15 23:33:32 -04:00
  • 5320319155 docs: updating a sponsor URL Karim shoair 2026-07-15 18:21:18 +03:00
  • 2c647c6be6 ops: Change Docker cache mode from max to min Karim shoair 2026-07-13 15:57:17 +03:00
  • aba2b3a57f v0.4.11 (#374) v0.4.11 Karim shoair 2026-07-12 22:47:11 +03:00
  • 027a7cd95d docs: update docs and skill with the new cli option #374 Karim shoair 2026-07-12 22:32:25 +03:00
  • bea8c71fc3 feat: Add option to set executable path in the CLI Karim shoair 2026-07-12 22:31:51 +03:00
  • b1c250fb29 docs: add a new page for the Shopify template Karim shoair 2026-07-12 18:45:18 +03:00
  • a58fd35fa1 docs: update contribution rules Karim shoair 2026-07-12 18:44:29 +03:00