57 lines
1.5 KiB
Markdown
57 lines
1.5 KiB
Markdown
|
---
|
||
|
|
name: windows-ui-automation
|
||
|
|
description: "使用PowerShell自动化Windows GUI交互。"
|
||
|
|
---
|
||
|
|
|
||
|
|
# Windows UI Automation
|
||
|
|
|
||
|
|
Control the Windows desktop environment programmatically.
|
||
|
|
|
||
|
|
## Core Capabilities
|
||
|
|
|
||
|
|
- **Mouse**: Move, click (left/right/double), drag.
|
||
|
|
- **Keyboard**: Send text, press special keys (Enter, Tab, Alt, etc.).
|
||
|
|
- **Windows**: Find, focus, minimize/maximize, and screenshot windows.
|
||
|
|
|
||
|
|
## Usage Guide
|
||
|
|
|
||
|
|
### Mouse Control
|
||
|
|
|
||
|
|
Use the provided PowerShell script `mouse_control.ps1.txt`:
|
||
|
|
|
||
|
|
```powershell
|
||
|
|
# Move to X, Y
|
||
|
|
powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action move -X 500 -Y 500
|
||
|
|
|
||
|
|
# Click at current position
|
||
|
|
powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action click
|
||
|
|
|
||
|
|
# Right click
|
||
|
|
powershell -File skills/windows-ui-automation/mouse_control.ps1.txt -Action rightclick
|
||
|
|
```
|
||
|
|
|
||
|
|
### Keyboard Control
|
||
|
|
|
||
|
|
Use `keyboard_control.ps1.txt`:
|
||
|
|
|
||
|
|
```powershell
|
||
|
|
# Type text
|
||
|
|
powershell -File skills/windows-ui-automation/keyboard_control.ps1.txt -Text "Hello World"
|
||
|
|
|
||
|
|
# Press Enter
|
||
|
|
powershell -File skills/windows-ui-automation/keyboard_control.ps1.txt -Key "{ENTER}"
|
||
|
|
```
|
||
|
|
|
||
|
|
### Window Management
|
||
|
|
|
||
|
|
To focus a window by title:
|
||
|
|
```powershell
|
||
|
|
$wshell = New-Object -ComObject WScript.Shell; $wshell.AppActivate("Notepad")
|
||
|
|
```
|
||
|
|
|
||
|
|
## Best Practices
|
||
|
|
|
||
|
|
1. **Safety**: Always move the mouse slowly or include delays between actions.
|
||
|
|
2. **Verification**: Take a screenshot before and after complex UI actions to verify state.
|
||
|
|
3. **Coordinates**: Remember that coordinates (0,0) are at the top-left of the primary monitor.
|