mirror of
https://github.com/jackwener/OpenCLI.git
synced 2026-09-14 18:25:42 +08:00
70b1145b5e
* refactor: remove version field from GenerateOutcome and EarlyHint All consumers are in the same repo and evolve together — version field adds ceremony without practical value at this stage. Keeps schema_version in VerifiedArtifactMetadata (sidecar file format). * refactor: migrate all 123 CLI adapters from YAML to TypeScript Remove YAML as an adapter format entirely. All adapters now use TypeScript with cli() from @jackwener/opencli/registry. - Convert 123 YAML adapter files to TypeScript via batch script - Remove YAML scanning from discovery.ts (registerYamlCli, yaml import) - Remove scanYaml() and shouldReplaceManifestEntry() from build-manifest.ts - Change synthesize.ts to output JSON candidates (internal format) - Change generate-verified.ts to write .ts adapter files instead of .yaml - Delete yaml-schema.ts (dead code) and scripts/yaml-to-ts.mjs (one-time tool) - Update all tests to match new format Closes discussion in #OpenCLI thread 47ddba82. * fix: close YAML migration gaps in plugin scaffold, validation, and scan - plugin-scaffold.ts: generate hello.ts (TS pipeline) instead of hello.yaml - plugin.ts validatePluginStructure: no longer accept .yaml as valid command file - plugin.ts scanPluginCommands: remove .yaml/.yml from scanned extensions - discovery.ts: add explicit log.warn() when YAML files detected in clis/ or plugins/ - plugin.test.ts: update all test fixtures from .yaml to .js - plugin-scaffold.test.ts: update hello.yaml references to hello.ts - Delete dead src/yaml-schema.ts Resolves PR #887 review blockers from @mbp-codex-pr0. * refactor: complete YAML removal across docs, skills, record, and binance adapters Code changes: - record.ts: candidate output changed from .yaml (yaml.dump) to .json (JSON.stringify), removed js-yaml import - src/clis/binance: convert all 11 YAML adapters to TypeScript cli() format - binance/commands.test.ts: rewrite to use registry instead of yaml.load - skill-generate.test.ts, diagnostic.test.ts: update mock paths from .yaml to .ts - build-manifest.ts, synthesize.ts: update stale YAML comments Documentation: - README.md: remove .yaml from Dynamic Loader, fix plugin types, fix synthesize comment - README.zh-CN.md: fix synthesize comment - CONTRIBUTING.md: replace YAML Adapter section with Pipeline Adapter (TS), update arg examples - docs/developer/yaml-adapter.md: replaced with deprecation redirect - docs/developer/architecture.md: remove YAML pipeline references - docs/developer/contributing.md: remove YAML adapter section - docs/developer/ai-workflow.md: YAML → TS in synthesize description - docs/guide/getting-started.md: remove .yaml from loader, update engine description - docs/guide/plugins.md: remove YAML plugin option, update plugin types - docs/index.md, docs/comparison.md: remove YAML adapter references - docs/zh/guide/plugins.md: remove .yaml from scan description Skills: - opencli-explorer/SKILL.md: rewrite YAML vs TS decision tree to TS-only - opencli-oneshot/SKILL.md: replace YAML templates with TS cli() templates - opencli-generate/SKILL.md: YAML artifact path → TS artifact path - opencli-usage/SKILL.md, plugins.md: update adapter format references * fix: clean up remaining YAML adapter references in docs - docs/zh/guide/plugins.md: replace YAML plugin example with TS pipeline - docs/developer/testing.md: YAML Adapter heading → Adapter, remove validate line - TESTING.md: same fix in root testing doc - CONTRIBUTING.md: remove "YAML validation" comment - docs/.vitepress/config.mts: mark YAML Adapter Guide as (Deprecated) in nav - docs/advanced/download.md: remove "YAML Adapters" from pipeline step heading
199 lines
5.8 KiB
Markdown
199 lines
5.8 KiB
Markdown
# Contributing to OpenCLI
|
|
|
|
Thanks for your interest in contributing to OpenCLI.
|
|
|
|
## Quick Start
|
|
|
|
```bash
|
|
# 1. Fork & clone
|
|
git clone git@github.com:<your-username>/opencli.git
|
|
cd opencli
|
|
|
|
# 2. Install dependencies
|
|
npm install
|
|
|
|
# 3. Build
|
|
npm run build
|
|
|
|
# 4. Run a few checks
|
|
npx tsc --noEmit
|
|
npm test
|
|
npm run test:adapter
|
|
|
|
# 5. Link globally (optional, for testing `opencli` command)
|
|
npm link
|
|
```
|
|
|
|
## Adding a New Site Adapter
|
|
|
|
All adapters use TypeScript. Use the pipeline API for data-fetching commands, and `func()` for complex browser interactions.
|
|
|
|
### Pipeline Adapter (Recommended for data-fetching commands)
|
|
|
|
Create a file like `clis/<site>/<command>.ts`:
|
|
|
|
```typescript
|
|
import { cli, Strategy } from '@jackwener/opencli/registry';
|
|
|
|
cli({
|
|
site: 'mysite',
|
|
name: 'trending',
|
|
description: 'Trending posts on MySite',
|
|
domain: 'www.mysite.com',
|
|
strategy: Strategy.PUBLIC,
|
|
browser: false,
|
|
args: [
|
|
{ name: 'query', positional: true, required: true, help: 'Search keyword' },
|
|
{ name: 'limit', type: 'int', default: 20, help: 'Number of items' },
|
|
],
|
|
columns: ['rank', 'title', 'score', 'url'],
|
|
pipeline: [
|
|
{ fetch: { url: 'https://api.mysite.com/trending' } },
|
|
{ map: {
|
|
rank: '${{ index + 1 }}',
|
|
title: '${{ item.title }}',
|
|
score: '${{ item.score }}',
|
|
url: '${{ item.url }}',
|
|
}},
|
|
{ limit: '${{ args.limit }}' },
|
|
],
|
|
});
|
|
```
|
|
|
|
See [`hackernews/top.ts`](clis/hackernews/top.ts) for a real example.
|
|
|
|
### func() Adapter (For complex browser interactions)
|
|
|
|
Create a file like `clis/<site>/<command>.ts`:
|
|
|
|
```typescript
|
|
import { cli, Strategy } from '@jackwener/opencli/registry';
|
|
|
|
cli({
|
|
site: 'mysite',
|
|
name: 'search',
|
|
description: 'Search MySite',
|
|
domain: 'www.mysite.com',
|
|
strategy: Strategy.COOKIE,
|
|
args: [
|
|
{ name: 'query', positional: true, required: true, help: 'Search query' },
|
|
{ name: 'limit', type: 'int', default: 10, help: 'Max results' },
|
|
],
|
|
columns: ['title', 'url', 'date'],
|
|
|
|
func: async (page, kwargs) => {
|
|
const { query, limit = 10 } = kwargs;
|
|
await page.goto('https://www.mysite.com');
|
|
|
|
const data = await page.evaluate(`
|
|
(async () => {
|
|
const res = await fetch('/api/search?q=${encodeURIComponent(query)}', {
|
|
credentials: 'include'
|
|
});
|
|
return (await res.json()).results;
|
|
})()
|
|
`);
|
|
|
|
return data.slice(0, Number(limit)).map((item: any) => ({
|
|
title: item.title,
|
|
url: item.url,
|
|
date: item.created_at,
|
|
}));
|
|
},
|
|
});
|
|
```
|
|
|
|
Use `opencli explore <url>` to discover APIs and see [opencli-explorer skill](./skills/opencli-explorer/SKILL.md) if you need the full adapter workflow.
|
|
|
|
### Validate Your Adapter
|
|
|
|
```bash
|
|
# Validate adapter
|
|
opencli validate
|
|
|
|
# Test your command
|
|
opencli <site> <command> --limit 3 -f json
|
|
|
|
# Verbose mode for debugging
|
|
opencli <site> <command> -v
|
|
```
|
|
|
|
## Arg Design Convention
|
|
|
|
Use **positional** for the primary, required argument of a command (the "what" — query, symbol, id, url, username). Use **named options** (`--flag`) for secondary/optional configuration (limit, format, sort, page, filters, language, date).
|
|
|
|
**Rule of thumb**: Think about how the user will type the command. `opencli xueqiu stock SH600519` is more natural than `opencli xueqiu stock --symbol SH600519`.
|
|
|
|
| Arg type | Positional? | Examples |
|
|
|----------|-------------|----------|
|
|
| Main target (query, symbol, id, url, username) | ✅ `positional: true` | `search '茅台'`, `stock SH600519`, `download BV1xxx` |
|
|
| Configuration (limit, format, sort, page, type, filters) | ❌ Named `--flag` | `--limit 10`, `--format json`, `--sort hot`, `--location seattle` |
|
|
|
|
Do **not** convert an argument to positional just because it appears first in the file. If the argument is optional, acts like a filter, or selects a mode/configuration, it should usually stay a named option.
|
|
|
|
Pipeline example:
|
|
```typescript
|
|
args: [
|
|
{ name: 'query', positional: true, required: true, help: 'Search query' }, // ← primary arg
|
|
{ name: 'limit', type: 'int', default: 20, help: 'Max results' }, // ← config arg
|
|
]
|
|
```
|
|
|
|
TS example:
|
|
```typescript
|
|
args: [
|
|
{ name: 'query', positional: true, required: true, help: 'Search query' },
|
|
{ name: 'limit', type: 'int', default: 10, help: 'Max results' },
|
|
]
|
|
```
|
|
|
|
## Testing
|
|
|
|
See [TESTING.md](./TESTING.md) for the full guide and exact test locations.
|
|
|
|
```bash
|
|
npm test # Core unit tests (non-adapter)
|
|
npm run test:adapter # Focused adapter tests: zhihu/twitter/reddit/bilibili
|
|
npx vitest run tests/e2e/ # E2E tests
|
|
npx vitest run # All tests
|
|
```
|
|
|
|
## Code Style
|
|
|
|
- **TypeScript strict mode** — avoid `any` where possible.
|
|
- **ES Modules** — use `.js` extensions in imports (TypeScript output).
|
|
- **Naming**: `kebab-case` for files, `camelCase` for variables/functions, `PascalCase` for types/classes.
|
|
- **No default exports** — use named exports.
|
|
|
|
## Commit Convention
|
|
|
|
We use [Conventional Commits](https://www.conventionalcommits.org/):
|
|
|
|
```
|
|
feat(twitter): add thread command
|
|
fix(browser): handle CDP timeout gracefully
|
|
docs: update CONTRIBUTING.md
|
|
test(reddit): add e2e test for save command
|
|
chore: bump vitest to v4
|
|
```
|
|
|
|
Common scopes: site name (`twitter`, `reddit`) or module name (`browser`, `pipeline`, `engine`).
|
|
|
|
## Submitting a Pull Request
|
|
|
|
1. Create a feature branch: `git checkout -b feat/mysite-trending`
|
|
2. Make your changes and add tests when relevant
|
|
3. Run the checks that apply:
|
|
```bash
|
|
npx tsc --noEmit # Type check
|
|
npm test # Core unit tests
|
|
npm run test:adapter # Focused adapter tests (if you touched adapter logic)
|
|
opencli validate # Adapter validation
|
|
```
|
|
4. Commit using conventional commit format
|
|
5. Push and open a PR
|
|
|
|
## License
|
|
|
|
By contributing, you agree that your contributions will be licensed under the [Apache-2.0 License](./LICENSE).
|