2026-04-27 20:35:47 +08:00
|
|
|
{
|
2026-07-09 10:19:10 +08:00
|
|
|
"name": "Gemini",
|
2026-07-03 18:27:32 +08:00
|
|
|
"rank": 997,
|
2026-04-27 20:35:47 +08:00
|
|
|
"url": {
|
|
|
|
|
"default": "https://generativelanguage.googleapis.com"
|
|
|
|
|
},
|
|
|
|
|
"url_suffix": {
|
|
|
|
|
"models": "v1beta/models"
|
|
|
|
|
},
|
2026-04-28 16:05:15 +08:00
|
|
|
"class": "gemini",
|
2026-04-27 20:35:47 +08:00
|
|
|
"models": [
|
|
|
|
|
{
|
|
|
|
|
"name": "gemini-2.5-flash",
|
2026-08-05 15:22:57 +08:00
|
|
|
"content_length": 1048576,
|
|
|
|
|
"max_output": 65536,
|
2026-04-27 20:35:47 +08:00
|
|
|
"model_types": [
|
|
|
|
|
"chat"
|
|
|
|
|
],
|
|
|
|
|
"thinking": {
|
|
|
|
|
"default_value": true,
|
|
|
|
|
"clear_thinking": true
|
2026-07-24 19:33:38 +08:00
|
|
|
},
|
|
|
|
|
"tools": {
|
|
|
|
|
"support": true
|
2026-04-27 20:35:47 +08:00
|
|
|
}
|
2026-05-10 23:24:21 -04:00
|
|
|
},
|
|
|
|
|
{
|
|
|
|
|
"name": "text-embedding-004",
|
|
|
|
|
"max_tokens": 2048,
|
|
|
|
|
"model_types": [
|
|
|
|
|
"embedding"
|
feat: add batch_size to all embedding model configs (#17877)
## Summary
Add a `batch_size` field to every embedding model entry in
`conf/models/*.json`. The field represents the maximum number of text
inputs that can be submitted to the embedding API in a single request.
**75 embedding models across 30 config files** now carry a `batch_size`.
Values were verified against each provider's official documentation (see
the verification table at `Desktop/embedding_models_verified.md`).
## Distribution
| batch_size | # models | Provider / Model |
|---|---|---|
| 1 | 2 | AWS Bedrock `amazon.titan-embed-text-v1/v2:0` — Bedrock
`invoke` accepts a single input per call |
| 10 | 3 | Aliyun `text-embedding-v3/v4`, Volcengine
`doubao-embedding-vision-251215` |
| 16 | 5 | BaiChuan `Baichuan-Text-Embedding`, Baidu Qianfan
`embedding-v1`, Mistral `mistral-embed`, Replicate (x2) |
| 32 | 10 | NVIDIA NIM (x3), SILICONFLOW (x2), PPIO (x3), GiteeAI
`bge-m3`, HuaweiCloud `bge-m3` |
| 50 | 4 | Tencent Hunyuan `kinfra` embeddings (x4) — `InputList.N` max
50 |
| 96 | 8 | Cohere embed-v3/v4 (x5), Bedrock Cohere (x3) |
| 100 | 3 | Google Gemini `text-embedding-004`, Upstage (x2) |
| 512 | 5 | Zhipu GLM `embedding-2/3` (x2), Perplexity `pplx-embed`
(x2), Astraflow `text-embedding-3-large` |
| 1000 | 9 | Voyage AI (x9) — API reference max |
| 1024 | 1 | DeepInfra `Qwen/Qwen3-Embedding-4B` |
| 2048 | 15 | OpenAI (x3) + OpenAI-API-compatible proxies (CometAPI,
n1n, Jiekou.AI, GreenPT, TogetherAI, NovitaAI) — OpenAI contract limit |
| 16384 | 10 | Jina (x8), 302.AI, GiteeAI `jina-clip-v2` — no documented
Jina batch limit, safe high cap |
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-08-06 10:47:38 +08:00
|
|
|
],
|
|
|
|
|
"batch_size": 100
|
2026-04-27 20:35:47 +08:00
|
|
|
}
|
|
|
|
|
],
|
|
|
|
|
"features": {
|
|
|
|
|
"thinking": {
|
|
|
|
|
"default_value": true,
|
|
|
|
|
"supported_models": [
|
|
|
|
|
"gemini-2.5-flash"
|
|
|
|
|
]
|
|
|
|
|
},
|
|
|
|
|
"reasoning_effort": {
|
|
|
|
|
"default_value": "high",
|
|
|
|
|
"supported_modes": [
|
|
|
|
|
"gemini-2.5-flash"
|
|
|
|
|
]
|
|
|
|
|
}
|
|
|
|
|
}
|
2026-07-09 10:19:10 +08:00
|
|
|
}
|