2 Commits

Author	SHA1	Message	Date
jay77721	6be7dc6e66	feat: add batch_size to embedding models in all_models.json (#17878) ... ## Summary Add a `batch_size` field to all **215 embedding models** in `conf/all_models.json`, synced from the values set in `conf/models/*.json` (see #17877) so the two config sources stay consistent. ## Matching strategy Values are assigned by layered matching against `conf/models/*.json`: 1. **Exact model name** match 2. **Alias** match 3. **Bare-name** map (entries that appear without a provider prefix) 4. **Provider-prefix family** match (e.g. `jinaai/*`, `nvidia/*`, `cohere/*`, `qwen/*`, `BAAI/*`, `voyage/*`, `zai-org/*`) ## Distribution | batch_size | # models | Source | |---|---|---| | 16384 | 88 | Jina (`jinaai/*`) — no documented batch limit, safe high cap | | 2048 | 26 | OpenAI + OpenAI-compatible proxies (Qwen, BGE, e5 families) | | 32 | 26 | NVIDIA NIM, BAAI/bge-m3, qwen3-embedding | | 1 | 27 | Conservative provider fallback where no API batch limit is documented | | 1000 | 24 | Voyage AI — API reference max | | 96 | 8 | Cohere | | 16 | 5 | Mistral, Baidu Qianfan, Baichuan, Replicate | | 100 | 4 | Google Gemini | | 512 | 3 | Zhipu GLM (`zai-org/embedding-2/3`, `zhipu-embedding-2`) | | 10 | 3 | Volcengine Doubao | | 1024 | 1 | DeepInfra Qwen3-Embedding-4B |	2026-08-06 10:48:05 +08:00
jay77721	40ff1c9d03	feat: update all_models.json to content_length + max_output (#17839) ... ## Summary Update `conf/all_models.json`: replace legacy `max_tokens` with `content_length` + `max_output` for all 2,178 chat/vision models, with values verified against official vendor documentation. --------- Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>	2026-08-05 15:43:11 +08:00