Commit Graph

836 Commits

Author SHA1 Message Date
Nick Sweeting 474476f0ae switch to external bubus lib 2025-06-18 01:41:16 -07:00
Nick Sweeting f35ea5be4d fixes 2025-06-17 22:38:59 -07:00
Nick Sweeting d0ec528802 fixed events 2025-06-17 22:38:59 -07:00
Nick Sweeting aa5e83b44e fix eventbus tests 2025-06-17 14:12:10 -07:00
Nick Sweeting 0b7ada4731 wip 2025-06-17 03:08:03 -07:00
Nick Sweeting 0dd6bc2b50 wip eventbus with EventResults aggregate for all results 2025-06-16 21:06:25 -07:00
yasithdev 8ea4b4c71a centralize playwright/patchwright imports, and update typing/checks to reduce lint errors 2025-06-16 22:57:20 -04:00
Nick Sweeting 552f4d46ed Merge branch 'main' into eventbus 2025-06-16 17:22:17 -07:00
Nick Sweeting e3d21d33a1 fix evaluate_tasks.py errors in CI 2025-06-16 17:20:27 -07:00
Nick Sweeting 04b25553a4 fix issue with actions registered with no parameters 2025-06-16 16:49:47 -07:00
Nick Sweeting f85cdd98bc fix browsersession init in tests 2025-06-16 16:38:44 -07:00
Nick Sweeting 1d31cac481 fix tests 2025-06-16 16:36:06 -07:00
Nick Sweeting ffea60ad79 lint fixes 2025-06-16 15:48:13 -07:00
Nick Sweeting b141958455 Merge branch 'main' into hot-fix/file-upload 2025-06-16 11:25:17 -07:00
claude[bot] c16bfa4f65 Add comprehensive tests for find_file_upload_element_by_index method
This commit adds extensive test coverage for the file upload element finding
functionality in BrowserSession. Tests cover all codepaths including:

- Success cases: finding inputs on current node, descendants, siblings, ancestors  
- Parameter variations: max_height and max_descendant_depth limits
- Edge cases: missing indices, no inputs found, exception handling
- DOM structures: complex nesting, case sensitivity, attribute validation

The 17 test methods ensure robust validation of the enhanced DOM traversal
logic introduced in the file upload improvements.

Co-authored-by: Nick Sweeting <pirate@users.noreply.github.com>
2025-06-16 17:48:26 +00:00
Nick Sweeting 66fbb8b282 Merge branch 'main' into eventbus 2025-06-14 01:19:15 -07:00
Nick Sweeting 4fbb199089 fix storage_state setup 2025-06-14 00:11:25 -07:00
Nick Sweeting 7628274790 fix start_browser_session test 2025-06-13 18:04:59 -07:00
Nick Sweeting 749a46854c fix registry test 2025-06-13 18:02:20 -07:00
Nick Sweeting a404158253 centralize LLM mocking for tests into mocks.py 2025-06-13 17:06:31 -07:00
Nick Sweeting 7f49b4aa1d centralize LLM mocking for tests into mocks.py 2025-06-13 17:05:48 -07:00
Nick Sweeting 06488e11ba fix clickaction error handling test 2025-06-11 00:05:58 -07:00
Nick Sweeting d5d341f229 dont raise exception from click action 2025-06-10 23:57:41 -07:00
Nick Sweeting 656a129fba include original LLM status_code in raised exception 2025-06-10 05:33:08 -07:00
Nick Sweeting 1d244960c4 move __del__ monkeypatch to init 2025-06-10 03:47:27 -07:00
Nick Sweeting 1c57d36211 attemp alternative approach where we creaet a dedicated loop for shudown 2025-06-10 03:43:53 -07:00
Nick Sweeting fa6fc98783 silence __del__ event loop closed errors on exit 2025-06-10 03:40:58 -07:00
Nick Sweeting 2631c4c03f also stop playwright at the end of the test 2025-06-10 03:38:45 -07:00
Nick Sweeting e143d079af stop playwright node subprocess when session.kill is called 2025-06-10 03:32:52 -07:00
Nick Sweeting ed2a503f0d fix multiprocessing tests 2025-06-10 03:18:28 -07:00
Nick Sweeting 1e57f0de6c add tests for parallelism 2025-06-10 03:04:04 -07:00
Nick Sweeting a65e43b07e update test best practices 2025-06-10 03:03:16 -07:00
Nick Sweeting 50cb5d858c Update tests/ci/test_registry.py
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
2025-06-10 05:21:37 -04:00
Nick Sweeting af85850b41 fix registry test fixture scopes 2025-06-10 00:25:41 -07:00
Nick Sweeting 930a7aa4de use self.logger for timing log lines 2025-06-10 00:24:50 -07:00
Nick Sweeting 02bba49ff6 fix older test_browser_session_parameter_issue test 2025-06-09 22:34:34 -07:00
Nick Sweeting 2ebb9db6f1 tweak logging and emoji 2025-06-09 21:18:04 -07:00
Nick Sweeting fe78e45a65 add waits into cloudflare eval test 2025-06-09 20:37:25 -07:00
Nick Sweeting fa974d6e2f fix early Path.resolve call and other cubic comments 2025-06-09 20:25:39 -07:00
Nick Sweeting 2540693482 tweak agent_tasks for evals slightly 2025-06-09 20:20:41 -07:00
Nick Sweeting b5ab4c6492 fix BrowserSession reuse in tests 2025-06-09 20:14:26 -07:00
Nick Sweeting b8f7b7cae2 tweak actions used in mock LLM responses 2025-06-09 18:52:17 -07:00
Nick Sweeting 921da7cb22 fix downloads timing tests 2025-06-09 18:51:15 -07:00
Nick Sweeting 15bd78cf0f add tests for all of the Re-Use a Browser examples 2025-06-09 18:39:14 -07:00
Nick Sweeting 68b033a8ff clarify docs that session must be started and stopped manually when keep_alive=True 2025-06-09 18:38:24 -07:00
Nick Sweeting b0ed680419 use patchright for stealth tests 2025-06-09 15:29:37 -07:00
Nick Sweeting bd349e922f stop playwright at the end of test 2025-06-09 15:28:58 -07:00
Magnus Müller eaab9f04d7 Enhance GitHub Actions workflow and evaluate_tasks.py to include detailed task evaluation results. The workflow now captures and displays detailed results in a structured format, while the Python script outputs detailed results as JSON for better integration with GitHub Actions. This improves visibility and understanding of task outcomes in the evaluation process. 2025-06-07 13:39:16 +02:00
Magnus Müller e6171e0fc1 Disable Chromium sandbox in BrowserProfile for CI environment in evaluate_tasks.py to improve compatibility with GitHub Actions. 2025-06-07 12:59:22 +02:00
Magnus Müller 43d96da06c Enhance error handling and debugging in evaluate_tasks.py by adding browser and LLM test calls. Capture and log errors during browser session initiation and agent execution, improving overall troubleshooting capabilities. 2025-06-07 12:53:14 +02:00