Commit Graph

797 Commits

Author SHA1 Message Date
Saurav Panda 97d71b84fa added a fix for multi menu dropdown 2026-01-15 10:17:59 -08:00
Saurav Panda 2c06eabf5f Added ax-name fallback for history rerun. 2026-01-06 12:07:10 -08:00
Saurav Panda 1073fc9e7a Merge branch 'main' into rerun-history-add-exp-retry 2025-12-23 20:16:27 -08:00
Saurav Panda 319d0acd45 fixed the edge case for handling max index 2025-12-23 19:29:43 -08:00
Saurav Panda 2f6a18a64e Merge branch 'main' into 3771-feature-request-add-support-for-openai-responses-api-for-azure-openai 2025-12-23 19:28:17 -08:00
Saurav Panda 2aa23f01dc fixed backend_node_id based element counting. 2025-12-23 17:25:38 -08:00
Saurav Panda 0da9457f6b feat: added exp backoff retry and minimum element load 2025-12-23 17:02:28 -08:00
Saurav Panda bb13679f85 feat: remove redundant retry step from history 2025-12-23 16:25:52 -08:00
Saurav Panda 29c9f1a416 feat: add support for openai responses model 2025-12-22 22:16:56 -08:00
Saurav Panda b9c8346499 fix: change max_step_interval to 45s 2025-12-18 16:45:21 -08:00
Saurav Panda 556d1bc022 added BROWSER_USE_DISABLE_EXTENSIONS env var to disable extension 2025-12-17 17:31:46 -08:00
mertunsall 9b894150d5 fix structured output for sandboxes 2025-12-12 15:35:34 -08:00
mertunsall 8c9e3b272c add tests 2025-12-12 14:37:24 -08:00
Mert Unsal 201b990591 Merge branch 'main' into cursor/filter-sensitive-data-in-history-5b05 2025-12-10 16:14:01 -08:00
Cursor Agent 8ba95aefa8 Fix: Filter sensitive data from state messages
This change ensures that sensitive data in action results is filtered before being included in state messages sent to the LLM. This prevents accidental leakage of private information. New tests are added to verify this functionality.

Co-authored-by: mailmertunsal <mailmertunsal@gmail.com>
2025-12-11 00:00:37 +00:00
Cursor Agent 24e276d5f4 Refactor markdown preprocessing and add tests
Co-authored-by: mailmertunsal <mailmertunsal@gmail.com>
2025-12-11 00:00:21 +00:00
Saurav Panda a4e77e2070 Merge branch 'main' into add-ai-step-for-extraction 2025-12-03 09:14:26 -08:00
Saurav Panda d0e181216e feat: added fallback llm support 2025-12-03 18:53:29 +05:30
Saurav Panda 7d2c6dc79e AI: add ai_step to replace extract_content on rerun 2025-12-01 21:34:09 +05:30
Mert Unsal a048d97eab Merge branch 'main' into attempt-fix-real-browser 2025-11-26 13:22:22 -08:00
mertunsall ad1c9b070e fix 2025-11-26 10:33:06 -08:00
mertunsall 84be050ed7 exponential retries improved 2025-11-25 11:18:03 -08:00
mertunsall e00ad12c40 lint 2025-11-22 00:16:09 -08:00
Cursor Agent 444825f307 Checkpoint before follow-up message
Co-authored-by: mailmertunsal <mailmertunsal@gmail.com>
2025-11-22 08:08:44 +00:00
kalil0321 ebfbefcfa9 Merge branch 'main' into attempt-fix-real-browser 2025-11-20 18:42:06 +01:00
Saurav Panda 5e356108f9 feat: added AI summary for rerun task 2025-11-20 21:40:30 +05:30
Saurav Panda d243616550 Updated test_step_interval_calculation() 2025-11-20 18:30:55 +05:30
Saurav Panda 8948c47416 add-variable-substitution-in-rerun 2025-11-20 17:54:32 +05:30
Saurav Panda e57f7ac14f added variable detection from agent history 2025-11-20 14:39:32 +05:30
kalil0321 ac6c7e7a48 Merge branch 'main' into attempt-fix-real-browser 2025-11-20 07:19:00 +01:00
Saurav Panda 8f8713b001 feat: added step_interval calculation for history 2025-11-20 10:28:28 +05:30
kalil0321 73f4138b10 Merge branch 'main' into attempt-fix-real-browser 2025-11-16 11:58:58 +01:00
reformedot 2bfb3497d9 refactor: improve CDP session handling in cua.py and test_frame_hierarchy.py
- Updated the method of obtaining CDP sessions to utilize the public API, enhancing error handling during session retrieval.
- Added exception handling to ensure graceful failure when sessions cannot be created or retrieved, improving robustness in both the main functionality and tests.
2025-11-12 20:35:15 -08:00
reformedot bff596f2e7 refactor: remove target type caching and streamline target retrieval in session management
- Eliminated the caching of target types in SessionManager, simplifying the management of target information.
- Updated various components to directly access target types from the Target objects, enhancing clarity and reducing redundancy.
- Adjusted related methods in BrowserSession, CrashWatchdog, and DomService to reflect the changes in target type retrieval.
2025-11-12 15:19:34 -08:00
Aitor 461d8592b1 Merge branch 'main' into feat/improve-navigation 2025-11-12 04:32:27 +01:00
mertunsall 6a447738da fix tests 2025-11-11 14:31:54 -08:00
reformedot 97deba7bb8 refactor: update agent focus handling and CDP session retrieval to fix tests 2025-11-11 12:57:35 -08:00
kalil0321 da4dc43aa2 Merge branch 'main' into attempt-fix-real-browser 2025-11-04 12:56:36 +01:00
mertunsall 03c9e94dc6 allow reading images such as jpg/png, as well as docx, fixes to the flash system prompt 2025-11-03 16:41:27 -08:00
kalil0321 680c71bdec Merge branch 'main' into attempt-fix-real-browser 2025-11-03 16:21:58 +01:00
Matt Greathouse 663299629d Merge branch 'main' into fix-gemini-schema 2025-11-01 19:23:49 -04:00
matt-greathouse d3f60a76fe Remove stripping of required fields from gemini optimized schema 2025-10-31 15:54:51 -04:00
Gregor Žunič 9c88c5a828 better cloud params 2025-10-30 13:05:41 -07:00
Magnus Müller 1655751f8a Add test for true cross-origin iframe element clicking
- Introduced a new test to verify the ability to click elements inside true cross-origin iframes, specifically targeting external domains like example.com.
- Implemented a fixture to create a browser session with cross-origin iframe support, enhancing the test's reliability and clarity.
- The test checks for the presence of elements from different CDP targets and ensures that at least one element from the cross-origin iframe can be successfully clicked.

This addition aims to improve the coverage of cross-origin iframe interactions in the browser automation framework, ensuring robust functionality in real-world scenarios.
2025-10-27 17:26:02 -07:00
Magnus Müller c3db6cff02 Refactor cross-origin iframe handling in tests and serializer
- Updated the DOMTreeSerializer to remove debug code related to cross-origin iframe detection, enhancing clarity and maintainability.
- Adjusted test cases to replace the cross-origin iframe source with a placeholder (about:blank) for improved test isolation and reliability.
- Updated comments and descriptions in tests to reflect the changes in iframe handling, ensuring accurate documentation of test behavior.

This change aims to streamline the handling of cross-origin iframes in both the serializer and tests, improving overall robustness and maintainability.
2025-10-27 17:19:03 -07:00
Magnus Müller f3c7070506 Refactor cross-origin iframe click test for improved clarity and functionality
- Updated test to verify clicking elements inside iframes in different CDP targets, enhancing the description for better understanding.
- Replaced the previous cross-origin iframe setup with a more controlled iframe content for testing.
- Adjusted assertions to ensure at least one element from the iframe is found, improving test reliability.
- Cleaned up comments and print statements for clarity, ensuring the test accurately reflects its purpose.

This change aims to enhance the robustness and maintainability of tests involving iframe interactions in the browser automation framework.
2025-10-27 17:14:30 -07:00
Magnus Müller c886eacb42 Increase wait time for cross-origin iframe loading in tests
- Updated the sleep duration from 3 to 5 seconds to accommodate potential network delays in CI environments.
- Enhanced the comment to clarify that cross-origin iframe extraction is enabled when getting the DOM state.

This change aims to improve the reliability of tests involving cross-origin iframes by allowing sufficient time for them to load before interaction.
2025-10-27 00:06:29 -07:00
Magnus Müller 3ad835a311 Linter 2025-10-27 00:00:32 -07:00
Magnus Müller 7c61bd4908 Add test for clicking elements inside cross-origin iframes
Verifies that:
- Cross-origin iframe DOM extraction works (finds multiple CDP targets)
- Elements from cross-origin iframes appear in the selector_map
- Elements inside cross-origin iframes can be clicked successfully
- Target/session switching works correctly for cross-origin actions

The test uses example.com as the cross-origin iframe source and
clicks the "Learn more" link inside the iframe to verify end-to-end
functionality.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-26 23:56:23 -07:00
Magnus Müller 04e987df99 Add stacked DOM elements test for complex scenarios
- Introduced a new HTML template for testing stacked DOM elements, including open and closed shadow DOMs, same-origin and cross-origin iframes, and a final button.
- Implemented a test case to validate click functionality through these stacked elements, ensuring that all interactive elements are clickable and that the click counter reflects the expected number of clicks.
- Enhanced the browser session configuration to accommodate a taller window size for better visibility of stacked elements.

This update aims to improve the robustness of DOM interaction tests and ensure comprehensive coverage of complex scenarios in the browser automation framework.
2025-10-26 23:16:06 -07:00