Commit Graph

1448 Commits

Author SHA1 Message Date
Magnus Müller 625e9db2f5 Refactor agent_history_list handling to allow optional input and filter out None values from previous screenshots 2025-07-06 14:15:32 +02:00
Magnus Müller 25392d9cde add multiple last screenshots to llm input message 2025-07-06 13:50:31 +02:00
Magnus Müller ef36632ccf Refactor observability imports to maintain consistency across modules 2025-07-05 23:12:05 +02:00
Magnus Müller a4c9b992ba Add observability module for browser-use with optional lmnr integration and debug mode support 2025-07-05 23:08:00 +02:00
Magnus Müller 09d336556f Update error logging to not confuese agent when site is not available 2025-07-05 16:03:27 +02:00
Magnus Müller bf266c6ed0 Add error msg for agent if site crashes 2025-07-05 15:46:04 +02:00
Magnus Müller 99ef62748f Add lmnr tracing 2025-07-05 15:23:38 +02:00
Magnus Müller face6a599b Enhance observability in browser and agent services
- Added `@observe` decorators to various methods in `service.py`, `session.py`, and `controller.py` to improve tracking of actions and state changes.
- Updated method signatures to include observability features for better debugging and monitoring.
- Adjusted retry logic for certain actions to enhance reliability and performance.
2025-07-05 14:44:43 +02:00
reformedot 9df2804b28 fix: improved logged CDP URL by just sending the hostname 2025-07-05 14:03:37 +02:00
reformedot 9841f4080c feat: add CDP URL to Agent Telemetry events 2025-07-05 13:13:41 +02:00
mertunsall f3e1a59642 improve 2025-07-05 01:51:00 +02:00
Magnus Müller 5ce6d23976 Fix potential error message duplicate 2025-07-04 17:34:45 +02:00
Magnus Müller dccff73b17 refactor: adjust timeouts for step execution and retry logic
- Increased step execution timeout from 60 seconds to 120 seconds for improved handling of longer operations.
- Reduced retry attempts in the screenshot logic from 3 to 2 to streamline error handling and reduce unnecessary retries.
2025-07-04 17:30:48 +02:00
Magnus Müller 5f8e46545e Consecutive failure increase for timeout 2025-07-04 15:40:02 +02:00
Magnus Müller 65f5502ab6 Change timeouts & wait in minimal summary 2025-07-04 15:34:32 +02:00
Magnus Müller 22f89efae4 refactor: reduce timeouts for various operations to improve responsiveness
- Updated timeouts for action execution, step processing, and screenshot operations to more aggressive values (e.g., reduced from 60s to 20s for actions, 30s to 10s for DOM processing).
- Adjusted retry logic and timeout settings for screenshot and iframe content extraction to enhance performance and reduce potential hangs.
- Improved logging for timeout events to provide clearer feedback on operation failures.
2025-07-04 14:30:54 +02:00
Magnus Müller 6be3ad952f Merge remote-tracking branch 'origin/main' into fix-browser-error-recovery 2025-07-04 14:26:48 +02:00
Magnus Müller 2045ad747c Improve logging 2025-07-04 13:22:38 +02:00
Magnus Müller 28207e3564 Enhance logging in Agent and eval service
- Added detailed debug logging throughout the Agent class to track execution steps, including browser state retrieval, action model updates, and LLM calls.
- Improved error logging to capture failures during LLM calls and execution.
- Updated eval service to log task execution progress and final state, enhancing traceability and debugging capabilities.
2025-07-04 00:50:21 +02:00
Magnus Müller bfb2083adb Improve error logging in action results
- Truncated error messages to a maximum of 100 characters at the beginning and end for better readability.
- Updated logging to reflect the new error message format.
2025-07-03 23:22:24 +02:00
Magnus Müller e5c1488fe6 Include pixel information 2025-07-03 22:42:51 +02:00
Magnus Müller b99f5185bc Merge remote-tracking branch 'origin/main' into fix-browser-error-recovery 2025-07-03 21:31:20 +02:00
Magnus Müller f0228e608c Add error recovery strategies for browser state retrieval
- Introduced `_get_browser_state_with_recovery` method to handle state retrieval with fallback options.
- Implemented `_get_minimal_state_summary` for basic page info retrieval without DOM processing.
- Updated `step` method to utilize the new recovery method for improved resilience in state fetching.
2025-07-03 21:05:55 +02:00
mertunsall 86cc3fcf57 fix a tiny bit 2025-07-03 19:16:46 +02:00
mertunsall 578360b293 fix disabled thinking mode 2025-07-03 19:09:04 +02:00
Gregor Žunič 177d5bcb7e Merge branch 'main' into fuckaround/dom-processing-tree 2025-07-02 18:14:40 +02:00
Gregor Žunič 33fc9c5aeb removed unnecesary ]* after new element 2025-07-01 12:43:13 +02:00
Gregor Žunič b1aa20ae64 making extraction simpler, removed some unnecesary optimizations 2025-07-01 10:43:28 +02:00
Magnus Müller 7fda8927d2 agent-add-step-info-to-take-step 2025-06-30 13:19:41 +02:00
mertunsall 6ab1093627 fix more tests 2025-06-29 23:18:10 +02:00
Gregor Žunič 2c884040c4 Merge branch 'main' into gregor/eng-238-fix-token-counts-on-eval-platform 2025-06-29 19:40:29 +02:00
Gregor Žunič d7c8dc99a8 Update browser_use/agent/views.py
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
2025-06-29 19:36:43 +02:00
Gregor Žunič 184fa8efb7 tests for schema generator 2025-06-29 18:09:25 +02:00
Gregor Žunič 48ae2d19cf much better structured output + utils for generating pydantic schema 2025-06-29 17:42:19 +02:00
Gregor Žunič 0691500c6a wip 2025-06-29 16:22:19 +02:00
Gregor Žunič b37e026f89 added usage data to agent history and evals 2025-06-29 11:28:20 +02:00
Nick Sweeting 622bd1da0f fix lint 2025-06-28 04:07:16 -07:00
Nick Sweeting 1a9d56fccc fix eventbus name 2025-06-28 03:50:19 -07:00
Nick Sweeting 4c48fe9400 send device id with all cloud events 2025-06-28 03:46:12 -07:00
Nick Sweeting 94b986cc22 fix failing bubus issue 2025-06-28 03:46:12 -07:00
Nick Sweeting 20d1acfd1c dont force browser session to be started before passing in 2025-06-28 03:46:11 -07:00
mertunsall 32569460b4 no screenshot in the beginning blank page 2025-06-27 15:08:01 +02:00
Mert Unsal f52b124d6e Merge branch 'main' into mert/sys_msg_updates 2025-06-27 14:44:38 +02:00
mertunsall c3802b04ab Make agent aware of user asked structured output
Ask agent not to use the file system if task is short
2025-06-27 14:33:41 +02:00
Mert Unsal add400e922 Merge branch 'main' into cursor/remove-memory-support-and-raise-error-b7bd 2025-06-27 14:19:39 +02:00
mertunsall bdf5149480 fix 2025-06-27 14:19:21 +02:00
Nick Sweeting e2777b8cbf fix logging spacing 2025-06-27 05:19:02 -07:00
Mert Unsal 2bf61fe58d Merge branch 'main' into cursor/remove-memory-support-and-raise-error-b7bd 2025-06-27 14:17:44 +02:00
mertunsall a1972d6297 move 2025-06-27 14:12:00 +02:00
Mert Unsal fb1470f2f7 Merge branch 'main' into mert/display_files_by_default 2025-06-27 14:07:11 +02:00