Commit Graph

60 Commits

Author SHA1 Message Date
yutao 768c32dd6e feat: update subcommand for skills 2026-02-13 22:22:45 +08:00
yutao f0a37634f4 fix best practices numbering in computer automation skill
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-13 18:05:17 +08:00
yutao b1b68f85b3 update faq for osx 2026-02-13 18:03:40 +08:00
yutao a6afdb9613 update readme 2026-02-13 11:35:11 +08:00
yutao ff954557f9 clarify multi-display best practice: move app or switch display
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-13 10:41:27 +08:00
yutao da4a3bc851 lowercase all subcommand names and add multi-display check tip for computer automation
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-13 10:12:42 +08:00
yutao 16933ee597 pin all npx commands to Midscene 1.x and remove iOS simulator references
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-13 09:40:55 +08:00
yutao f966f977db update skill descriptions: vision-driven approach and Powered by Midscene.js
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-13 09:37:50 +08:00
yutao 991d96bb40 add best practice: prefer CLI commands to launch apps over midscene
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-12 23:54:47 +08:00
yuyutaotao 305c21e458 Merge pull request #7 from web-infra-dev/feat/update-readme
update skills: rewrite rules as principles, fix model config and add …
2026-02-12 20:07:45 +08:00
yutao 222cdfbee8 Merge branch 'main' into feat/update-readme 2026-02-12 20:06:36 +08:00
yutao e2e8504cb2 update readme 2026-02-12 20:04:51 +08:00
yutao c3315a031c update skills: rewrite rules as principles, fix model config and add examples
- Rewrite CRITICAL RULES to describe principles instead of specific parameter values
- Replace old prerequisites with proper model configuration section and examples (Gemini, Qwen3-VL via OpenRouter, Doubao Seed 1.6)
- Fix incorrect MIDSCENE_MODEL_FAMILY values (gemini, qwen3-vl, doubao-vision)
- Simplify "never run in background" best practice descriptions

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-12 19:52:14 +08:00
Leyang dec0566f69 Merge pull request #6 from web-infra-dev/feat/update-readme
update readme
2026-02-12 19:15:10 +08:00
yutao 3b9085f178 update readme: list skill code paths for each platform
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-12 19:12:04 +08:00
yutao 2592868944 update readme 2026-02-12 19:04:19 +08:00
quanruzhuoxiu c5c4ea49a0 refactor: update critical rules for Bash tool calls across automation skills to enhance clarity and consistency 2026-02-12 18:53:28 +08:00
yutao 788b3e1b5c update readme 2026-02-12 18:39:03 +08:00
yutao 0642267378 update readme 2026-02-12 18:36:31 +08:00
Leyang b703d6b13c Merge pull request #5 from web-infra-dev/feat/skills-format-migration
Migrate from Claude Code plugin to Agent Skills format
2026-02-12 17:07:02 +08:00
quanruzhuoxiu a16b2148b4 refactor: migrate from Claude Code plugin to Agent Skills format
- Remove .claude-plugin/ and plugins/ directory structure
- Move skills from plugins/midscene-automation/skills/ to skills/
- Delete marketplace.json and plugin.json metadata files
- Rewrite README to follow Agent Skills format (agentskills.io)
  - Add Available Skills section with per-skill descriptions and trigger phrases
  - Replace Claude Code plugin install with `npx skills add`
  - Fix Setup section: remove deprecated GPT-4o, add recommended models from model-strategy
  - Fix How It Works: use correct per-platform CLI commands
  - Rename "Web" to "Browser", "desktop" to "computer" for consistency
  - Add Skill Structure section
2026-02-12 17:05:38 +08:00
quanruzhuoxiu 743f2ce8a4 docs: update Desktop Computer Automation documentation for cross-platform support and clarify command usage 2026-02-12 16:22:59 +08:00
Leyang dfd1e9cbf1 Merge pull request #4 from web-infra-dev/feat/platform-cli-skill-docs
docs: rewrite SKILL.md for platform-specific CLI bins
2026-02-12 15:33:23 +08:00
quanruzhuoxiu 3af715be7e Refactor CLI command usage in documentation to remove specific versioning and enforce critical rules for background execution across all automation skills. Update command examples for Android, iOS, web, Chrome Bridge, and desktop automation to ensure consistency and clarity in usage. 2026-02-12 15:11:25 +08:00
quanruzhuoxiu 9cfc26aaf8 docs: fix env check in all SKILL.md files
Replace `echo $MIDSCENE_MODEL_API_KEY` with `cat .env | grep ...`
since the CLI auto-loads .env via dotenv at runtime. The shell env
check always shows empty and confuses AI agents into manually
sourcing .env files. Also remove unnecessary setup verification
steps (node --version, xcodebuild, --help discovery).
2026-02-12 13:03:06 +08:00
quanruzhuoxiu 19c8fb2da0 docs: restore --bridge flag syntax and add explicit warnings in SKILL.md
Revert from MIDSCENE_USE_BRIDGE env var back to --bridge flag.
Add stronger warnings: do NOT use -p flag, do NOT substitute env vars.
2026-02-12 12:00:51 +08:00
quanruzhuoxiu cd4c506690 docs: use MIDSCENE_USE_BRIDGE env var in chrome-bridge SKILL.md
Switch from --bridge flag to MIDSCENE_USE_BRIDGE=1 env var prefix for
all commands. This prevents AI agents from improvising command syntax
and ensures bridge mode is always activated correctly.
2026-02-12 11:48:57 +08:00
quanruzhuoxiu 7267b9112a docs: simplify Chrome Bridge SKILL.md setup section
Remove setup verification steps that Claude would run before the actual
task. In bridge mode the user has already prepared the browser and
extension — just connect directly.
2026-02-12 11:29:32 +08:00
quanruzhuoxiu 238c6a6d73 docs: enforce act command for transient UI in Computer SKILL.md
Individual CLI commands will never work for Spotlight, context menus,
and other transient UI because each command is a separate process and
macOS returns focus to the terminal on exit. Remove the individual
commands alternative and make act the only approach.
2026-02-12 10:56:13 +08:00
quanruzhuoxiu c3c8136240 chore: bump midscene version to v1.3.12-beta-20260211155735.0 2026-02-12 08:45:02 +08:00
quanruzhuoxiu a58ed32907 docs: update SKILL.md for unified midscene-web CLI with Puppeteer/Bridge modes
- browser SKILL: default Puppeteer mode, persistent Chrome across calls
- chrome-bridge SKILL: add --bridge flag to all commands
- ios SKILL: simplify npx syntax (single bin, no -p needed)
- Remove npx -p syntax from all skills
2026-02-11 23:54:55 +08:00
quanruzhuoxiu b00af71292 docs: remove bridge mode references from browser SKILL.md
Browser skill is general web automation, not bridge mode.
Only chrome-bridge skill should reference bridge mode.
2026-02-11 22:16:15 +08:00
quanruzhuoxiu 1faf368353 fix: use npx -p syntax for packages with multiple bins
@midscene/web has two bins (midscene-web, midscene-playground) and
@midscene/ios has two bins (midscene-ios, midscene-ios-playground),
causing `npx @midscene/web` to fail with "could not determine
executable to run". Use `npx -p <pkg> <bin>` syntax instead.
2026-02-11 22:05:44 +08:00
quanruzhuoxiu 5ebe4fe714 docs: update SKILL.md files for new subcommand CLI syntax
- Rewrite browser SKILL.md to use @midscene/web instead of deprecated @midscene/cli
- Add `act` command documentation to all 5 platform skills
- Recommend `act` as primary approach for transient UI interactions
- Remove outdated Puppeteer fallback references from chrome-bridge
2026-02-11 20:46:51 +08:00
quanruzhuoxiu d858637e06 docs: add marketplace.json for midscene automation plugin configuration 2026-02-11 20:30:39 +08:00
quanruzhuoxiu d2022ecd08 docs: restore browser/chrome-bridge split and strengthen transient UI guidance
- Rename web-automation back to chrome-bridge (Bridge mode using @midscene/web CLI)
- Restore browser skill (Puppeteer mode using @midscene/cli)
- Add detailed "Handle Transient UI" sections to all platform skills with
  concrete examples showing back-to-back command execution without screenshots
- Add "Be specific about UI elements" guidance to computer skill
- Add "When to Use" section to chrome-bridge with fallback guidance
2026-02-11 20:14:21 +08:00
quanruzhuoxiu ce0177de92 docs: rewrite SKILL.md files for platform-specific CLI bins
Rewrite all SKILL.md files to use the new platform-specific CLI
binaries (midscene-android, midscene-ios, midscene-computer,
midscene-web) instead of the centralized @midscene/cli subcommand
architecture.

- Merge browser and chrome-bridge skills into unified web-automation
- Update command examples to use MCP tool commands directly
- Remove act/query/assert commands (AI agent now acts as the brain)
2026-02-11 18:37:34 +08:00
quanruzhuoxiu 2c136c4b89 docs: update SKILL.md files for new subcommand CLI syntax
Update all 5 platform SKILL.md files to use the new CLI subcommand
architecture: `midscene do <command> -p <platform>` instead of
`midscene <platform> <command>`. Affects browser, chrome-bridge,
computer-automation, android-automation, and ios-automation skills.
2026-02-11 16:01:51 +08:00
quanruzhuoxiu 4e03cef1be docs: add transient UI best practice across all platform skills
Advise combining interactions with ephemeral UI (Spotlight, menus,
dropdowns, toasts, action sheets) into a single act command to prevent
them from disappearing between separate CLI invocations.
2026-02-11 13:41:43 +08:00
quanruzhuoxiu 0627976bcb chore: pin @midscene/cli to 1.3.11-beta-20260211031343.0 for testing 2026-02-11 11:34:58 +08:00
quanruzhuoxiu 5c3b4da1d8 refactor: replace Web Browser Automation skill with Browser and Chrome Bridge Automation skills 2026-02-10 19:10:10 +08:00
quanruzhuoxiu ee29b46390 refactor: update CLI command syntax by removing 'skill' prefix across documentation 2026-02-10 19:09:29 +08:00
quanruzhuoxiu 35d4986e56 refactor: remove 'displays' command from Desktop Computer Automation skill documentation 2026-02-10 17:40:53 +08:00
quanruzhuoxiu 14515b134d docs: improve README with platform table and CLI examples 2026-02-10 17:27:05 +08:00
quanruzhuoxiu 186d755e7e refactor: merge 4 plugins into single midscene-automation plugin
Consolidate web, computer, android, and ios plugins into one unified
plugin so users can install all skills with a single command:
  /plugin install midscene-automation@midscene-marketplace
2026-02-10 17:25:06 +08:00
quanruzhuoxiu 34a8f10ad1 refactor: remove redundant EXAMPLES.md and REFERENCE.md files
SKILL.md already contains all commands, examples, patterns, and
troubleshooting info needed by the AI. These extra files only
duplicate content and waste context window tokens.
2026-02-10 17:15:58 +08:00
quanruzhuoxiu 83885adec0 refactor: remove static setup.json files and update references
setup.json files were static and never dynamically updated, duplicating
information already present in each skill's SKILL.md. Remove all 4
setup.json files and update references in SKILL.md and README.md.
2026-02-10 17:15:03 +08:00
quanruzhuoxiu ec1d6eb8c1 feat: update examples and skill documentation to consistently use Bridge mode for improved user experience 2026-02-10 17:10:33 +08:00
quanruzhuoxiu 316b173ed8 refactor: pure markdown skills with 4 platform support
Remove all CLI code from skills repo. Skills now only contain
Markdown files (SKILL.md, EXAMPLES.md, REFERENCE.md, setup.json).
CLI logic has been moved to @midscene/cli's `skill` subcommand.

- Remove midscene-automation plugin (code, deps, build config)
- Add web-automation plugin (Puppeteer + Bridge mode)
- Add computer-automation plugin (macOS desktop)
- Add android-automation plugin (ADB)
- Add ios-automation plugin (WebDriverAgent)
- Update marketplace.json with all 4 platforms
- Update README with multi-platform installation guide
- All commands now use: npx @midscene/cli skill <platform> <cmd>
2026-02-10 16:05:44 +08:00
quanruzhuoxiu 910e15f359 feat: add frontend verification examples and enhance skill description for improved user guidance 2026-02-05 11:19:56 +08:00