Commit Graph

1452 Commits

Author SHA1 Message Date
magmueller 85bdf707f7 Rerun in agent 2024-11-28 22:34:04 +01:00
magmueller 519881a7b3 Rerun works 2024-11-28 21:10:25 +01:00
magmueller de7e38b75c History is saved and loaded 2024-11-28 19:37:18 +01:00
Gregor Žunič 10af7535e8 tiny import and format fixes 2024-11-28 12:55:53 +01:00
Gregor Žunič 40e8c05c7d Merge branch 'main' into gregpr07/bu-85-make-iframes-and-shadow-elements-work-with-dom-service 2024-11-28 12:51:33 +01:00
magmueller 6669a436c7 Merge remote-tracking branch 'origin/gregpr07/bu-85-make-iframes-and-shadow-elements-work-with-dom-service' into feature/reexecutable-script 2024-11-28 06:55:14 +01:00
magmueller d35b1ebc71 Draft rerun - but breaks if index change 2024-11-27 10:36:50 +01:00
Gregor Žunič 829ed138fd clicking version - still missing iframe/shadow elements penetration 2024-11-25 21:45:05 +01:00
Magnus Müller 416309e993 Merge pull request #60 from gregpr07/persistent
Persistent
2024-11-25 16:58:37 +01:00
magmueller d2e3de97d5 Save cookies 2024-11-25 16:56:15 +01:00
Shahar Yair 5a8882b809 Fixed exception handling bug in agent step 2024-11-25 17:38:31 +02:00
Shahar Yair 8f3f870532 Revert "Fixed exception handling bug in agent step"
This reverts commit 22ea904b98.
2024-11-25 17:36:30 +02:00
Shahar Yair 22ea904b98 Fixed exception handling bug in agent step 2024-11-25 17:34:17 +02:00
magmueller d46ce11fc5 Example how to use validator 2024-11-25 16:01:39 +01:00
magmueller 63e443201e Draft validator 2024-11-25 13:47:33 +01:00
magmueller e326844fa9 First remove state - dont remove old messages 2024-11-25 08:40:26 +01:00
magmueller 8b008c9e48 Remove link which is not reachable 2024-11-25 07:46:50 +01:00
magmueller 21198f5904 Fix tests - now most of them are running through again 2024-11-24 22:05:17 +01:00
magmueller 3c72d8aaaa Stress test 2024-11-24 20:44:19 +01:00
magmueller c4ee7db940 Message manager 2024-11-24 19:55:55 +01:00
magmueller 9db5f60aa0 Removed token calculation from agent to simplify 2024-11-24 19:55:38 +01:00
magmueller 4057e1527e Tests for message manager 2024-11-24 19:55:20 +01:00
magmueller e6e1d22e9c Error for max token limit logger 2024-11-24 11:46:48 +01:00
magmueller de5a194bb6 Logging for max token limit 2024-11-24 02:05:38 +01:00
magmueller 29668a6840 Mesage manager cut if too long 2024-11-24 02:01:34 +01:00
magmueller 2786152e58 Include state manager 2024-11-24 01:21:04 +01:00
magmueller 4ea66aea5b Remove cut text 2024-11-24 01:20:50 +01:00
magmueller 8aa4321efe Merge branch 'main' into hot-fix/max-token-message-manager 2024-11-23 18:31:10 +01:00
magmueller 60fbd16730 When page not loaded return empty state - fixes break for not loading page 2024-11-23 15:39:47 +01:00
magmueller cd688d0b6e Improved naming of output history 2024-11-23 13:12:14 +01:00
magmueller 84dd41eebf Overwrite str method 2024-11-23 12:46:08 +01:00
magmueller fd73b1642f Return trace 2024-11-22 23:32:51 +01:00
magmueller 0e2237a2ec Remove tab_handle from browser state tests 2024-11-22 22:59:33 +01:00
magmueller ef6311b22c Merge remote-tracking branch 'origin/main' into output-history 2024-11-22 22:41:58 +01:00
magmueller 7fdf80deda Test for history output 2024-11-22 22:37:59 +01:00
Gregor Žunič b48f94e394 Merge pull request #40 from BedroomDev:main
ResultOnlyMode: Added logLevel.RESULT & env to filter the output
2024-11-22 17:20:44 +01:00
Gregor Žunič 5941dd2752 Merge branch 'staging' into gregorzunic/bu-56-switch-from-selenium-to-playwright 2024-11-22 15:08:30 +01:00
magmueller e5d7dc2e3f Agent history tests included 2024-11-22 13:08:37 +01:00
magmueller 8a90a8855a Work in progress - message manager 2024-11-22 10:32:37 +01:00
magmueller 6ab82b7921 Print error trace and fix saveing message 2024-11-22 09:40:14 +01:00
Marvin 864483968c Added logLevel.RESULT and to filter the output 2024-11-21 12:01:27 +01:00
magmueller d0f215ef4d Fix max token error - cut history context or current message if its too long 2024-11-20 16:40:12 +01:00
magmueller e4ed949141 Seperate results which stay in context and which not to avoid max token limit 2024-11-20 15:42:32 +01:00
Gregor Žunič f7148e3542 untested version of playwright (kinda works) 2024-11-19 18:32:31 +01:00
magmueller 3d33a4ff94 Example for system prompt change 2024-11-19 16:53:56 +01:00
magmueller 2bba5d4617 Option to set new tasks and to do custom system prompt 2024-11-19 16:25:06 +01:00
magmueller be31ac9359 Fix token calculation 2024-11-18 20:23:09 +01:00
Gregor Žunič 4f74170685 Added anonymized posthog telemetry (#22)
* added anonymized telemetry

* collect data with posthog readme
2024-11-17 01:17:01 +01:00
Gregor Žunič 89c63fdd63 Added custom actions registry and fixed extraction layer (#20)
* Validator

* Test mind2web

* Cleaned up logger

* Pytest logger

* Cleaned up logger

* Disable flag for human input

* Multiple clicks per button

* Multiple clicks per button

* More structured system prompt

* Fields with description

* System prompt example

* One logger

* Cleaner logging

* Log step in step function

* Fix critical clicking error - wrong argument used

* Improved thought process of agent

* Improve system prompt

* Remove human input message

* Custome action registration

* Pydantic model for custom actions

* Pydantic model for custome output

* Runs through, model outputs functions, but not called yet

* Work in progress - description for custome actions

* Description works, but schema not yet

* Model can call the right action - but is not executed

* Seperate is_controller_action  and is_custom_action

* Works! Model can call custom function

* Use registry for action, but result is not feed back to model

* Include result in messages

* Works with custom function - but typing is not correct

* Renamed registry

* First test cases

* Captcha tests

* Pydantic for tests

* Improve prompts for multy step

* System prompt structure

* Handle errors like validation error

* Refactor error handling in agent

* Refactor error handling in agent

* Improved logging

* Update view

* Fix click parameter to index

* Simplify dynamic actions

* Use run instead of step

* Rename history

* Rename AgentService to Agent

* Rename ControllerService to Controller

* Pytest file

* Rename get state

* Rename BrowserService

* reversed dom extraction recursion to while

* Rename use_vision

* Rename use_vision

* reversed dom tree items and made browser less anoying

* Renaming and fixing type errors

* Renamed class names for agent

* updated requirements

* Update prompt

* Action registration works for user and controller

* Fix done call by returning ActionResult

* Fix if result is none

* Rename AgentOutput and ActionModel

* Improved prompt Passes 6/8 tests from test_agent_actions

* Calculate token cost

* Improve display

* Simplified logger

* Test function calling

* created super simple xpath extraction algo

* Tests logging

* tiny fixes to dom extraction

* Remove test

* Dont log number of clicks

* Pytest file

* merged per element js checks

* Check if driver is still open

* super fast processing

* fixed agent planning and stuff

* Fix example

* Fix example

* Improve error

* Improved error correction

* New line for step

* small type error fixes

* Test for pydantic

* Fix line

* Removed sample

* fixed readme and examples

---------

Co-authored-by: magmueller <mamagnus00@gmail.com>
2024-11-15 21:42:02 +01:00
Gregor Žunič f11c37388d added highlighting of items 2024-11-07 19:02:02 +01:00