mirror of
https://github.com/infiniflow/ragflow.git
synced 2026-07-01 00:05:43 +08:00
## Summary Resolves all 93 open alerts at https://github.com/infiniflow/ragflow/security/code-scanning by rule: | Rule | Count | Treatment | |------|-------|-----------| | py/clear-text-logging-sensitive-data | 23 | Real fix — log scrubbing | | go/path-injection | 15 | Real fix where possible, suppression with rationale | | go/request-forgery | 8 | Suppression with rationale (operator-controlled URLs) | | go/clear-text-logging | 10 | Real fix — log scrubbing | | go/unsafe-quoting | 5 | Real fix — escape or refactor | | go/sql-injection | 3 | Real fix — orderby whitelist + CodeQL comment | | go/uncontrolled-allocation-size | 2 | Real fix — cap to 1024 | | go/incorrect-integer-conversion | 3 | Real fix — ParseInt + range check | | go/insecure-hostkeycallback | 1 | Real fix — known_hosts file | | go/disabled-certificate-check | 2 | Suppression with rationale | | go/command-injection | 1 | Suppression (sanitized via shq()) | | go/email-injection | 1 | Suppression with rationale | | go/cookie-httponly-not-set | 1 | Suppression (SPA bootstrap) | | js/stack-trace-exposure | 1 | Real fix — generic client message | | js/prototype-pollution-utility | 1 | Real fix — reject __proto__/constructor/prototype | | py/weak-sensitive-data-hashing | 1 | Real fix — MD5 → SHA-256 | | py/incomplete-url-substring-sanitization | 3 | Real fix — urlparse(hostname) | | py/paramiko-missing-host-key-validation | 1 | Real fix — load_system_host_keys + RejectPolicy | | cpp/integer-multiplication-cast-to-long | 2 | Real fix — cast to size_t | ## Real fixes (with measurable security improvement) **SSH host key verification (Go + Python)** Replace `InsecureIgnoreHostKey()` / `paramiko.AutoAddPolicy()` with proper host key verification against a known_hosts file (configurable via `SSH_KNOWN_HOSTS` env / `known_hosts` config field; fail-closed when unset). Loads `~/.ssh/known_hosts` first via `load_system_host_keys()` so existing setups keep working. **SQL injection in `user_canvas`** Add `userCanvasOrderableColumns` whitelist + `userCanvasOrderClause` helper. Both `GetList()` and `ListByTenantIDs()` now route the user-supplied `orderby` query param through the helper, defaulting to `create_time` on miss. **SQL injection in `pipeline_operation_log`** Existing whitelist documented via CodeQL comment. **Real SQL injection in `infinity/chunk.go:931`** Escape `'` → `''` on user-controlled `questionText` before splicing into `filter_fulltext(...)` SQL filter. **Real SQL injection in `elasticsearch/sql.go:75`** Defense-in-depth escape on tokenizer output before splicing into `MATCH(...)`. **Python code injection in `result_protocol.go`** Replace raw JSON literal embedding into Python/JS expressions with base64 + `json.loads` / `JSON.parse(Buffer.from(..., 'base64').toString('utf8'))`. Eliminates both the unsafe-quoting sink and the brittleness of mixing JSON true/false/null with Python syntax. **URL substring check bypass in `embedding_model.py`** Replace `if "dashscope-intl.aliyuncs.com" in u` with `urlparse(u).hostname == "dashscope-intl.aliyuncs.com"` so a base_url like `https://attacker.example/?u=dashscope-intl.aliyuncs.com` cannot bypass the routing. **Prototype pollution in `setNestedValue` (TS)** Reject `__proto__`/`constructor`/`prototype` keys before any assignment. **Integer overflow** - scrypt params via `ParseInt` + non-positive check (`internal/common/password.go`) - `topN` and `n` caps to 1024 (retrieval_service.go, dataset.go) - `nalloc*statesize` cast to `size_t` (cpp/re2/onepass.cc) **Cookie httponly** Set explicitly with rationale: this is the OAuth bootstrap cookie intentionally read by the SPA. **Stack trace exposure** Replace `error.message` in HTTP 500 response with generic `"internal error"`; full error still logged server-side via `console.error`. **Weak hashing** MD5 → SHA-256 for deterministic `conv_id` derivation (`conversation_service.py`). **Log scrubbing** Remove or redact user-controlled / sensitive content from clear-text logs across 8 ingestion parsers, `llm_service.py` ×11, `tenant_llm_service.py` ×7, `misc_utils.py` ×4, `redis_conn.py` ×10, `conftest.py` ×4, `init_data.py`, `dataset_api_service.py`, `generator.py`, `mysql_migration.py`, `cli.go`, `user_command.go`, `pdf_parser.go`. Most patterns converted to parameterized logging (`logging.info("...: %d", n)`) or static messages. ## CodeQL suppressions (each with rationale) For alerts where the data flow is genuinely safe but CodeQL can't see the context — operator-controlled URLs, sanitized inputs, etc. — I added `// codeql[go/<rule>] <rationale>` annotations rather than dismissing them, so future readers can audit the rationale inline: - `internal/agent/component/invoke.go:135` — Invoke is a generic canvas HTTP client - `internal/service/langfuse.go` ×2 — host is per-tenant operator config - `internal/service/file.go:1184` — already SSRF-guarded by `assertURLSafe` - `internal/utility/mcp_client.go` ×3 — already `AssertURLSafe` + IP-pinned - `internal/entity/models/bedrock.go` — sigv4-signed request, URL can't be tampered - `internal/service/deep_researcher.go:269` — `callback` is SSE display string, not SQL - `internal/engine/infinity/chunk.go:346` — UUIDs can't contain `'` (RFC 4122) - `internal/cli/common_command.go` ×2 — CLI trusts operator-configured URL - `internal/utility/smtp.go:194` — msg is server-built, not user form input - `internal/entity/models/*` ×14 (path-injection) — audio file paths are caller-supplied ## Test plan - ✅ All 13 modified Go packages build cleanly - ✅ 663 tests pass across `internal/agent/sandbox`, `internal/common`, `internal/agent/component`, `internal/engine/infinity`, `internal/dao` - ✅ All 11 modified Python files parse via `ast.parse` - ✅ TypeScript `tsc --noEmit` clean on the modified `use-provider-fields.tsx` - ✅ `node --check` clean on the modified JS file 🤖 Generated with [Claude Code](https://claude.com/claude-code)
1616 lines
46 KiB
Go
1616 lines
46 KiB
Go
//
|
|
// Copyright 2026 The InfiniFlow Authors. All Rights Reserved.
|
|
//
|
|
// Licensed under the Apache License, Version 2.0 (the "License");
|
|
// you may not use this file except in compliance with the License.
|
|
// You may obtain a copy of the License at
|
|
//
|
|
// http://www.apache.org/licenses/LICENSE-2.0
|
|
//
|
|
// Unless required by applicable law or agreed to in writing, software
|
|
// distributed under the License is distributed on an "AS IS" BASIS,
|
|
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
// See the License for the specific language governing permissions and
|
|
// limitations under the License.
|
|
//
|
|
|
|
package cli
|
|
|
|
import (
|
|
"bufio"
|
|
"crypto/tls"
|
|
"encoding/json"
|
|
"fmt"
|
|
"net/http"
|
|
"os"
|
|
"ragflow/internal/common"
|
|
"strings"
|
|
"time"
|
|
|
|
"golang.org/x/term"
|
|
)
|
|
|
|
func (c *CLI) LoginUserByCommand(cmd *Command) (ResponseIf, error) {
|
|
email, ok := cmd.Params["email"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("email not provided")
|
|
}
|
|
password, ok := cmd.Params["password"].(string)
|
|
if !ok {
|
|
password = ""
|
|
}
|
|
|
|
err := c.LoginUserInteractive(email, password)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
|
|
var result SimpleResponse
|
|
result.Code = 0
|
|
result.SetOutputFormat(c.Config.OutputFormat)
|
|
result.Message = "Login successful"
|
|
|
|
return &result, nil
|
|
}
|
|
|
|
// LoginUserInteractive performs interactive login with username and password
|
|
func (c *CLI) LoginUserInteractive(email, password string) error {
|
|
// First, ping the server to check if it's available
|
|
_, err := c.PingServer(1)
|
|
if err != nil {
|
|
return err
|
|
}
|
|
|
|
// If password is not provided, prompt for it
|
|
if password == "" {
|
|
fmt.Printf("password for %s: ", email)
|
|
password, err = ReadPassword()
|
|
if err != nil {
|
|
return fmt.Errorf("failed to read password: %w", err)
|
|
}
|
|
password = strings.TrimSpace(password)
|
|
}
|
|
|
|
var baseURL string
|
|
var httpClient *HTTPClient
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
baseURL = "/admin/login"
|
|
httpClient = c.AdminServerClient
|
|
case APIMode:
|
|
baseURL = "/auth/login"
|
|
httpClient = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer]
|
|
default:
|
|
return fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
// Login
|
|
token, err := c.loginUser(httpClient, baseURL, email, password)
|
|
if err != nil {
|
|
fmt.Printf("Error: %v\n", err)
|
|
fmt.Println("Can't access server for login (connection failed)")
|
|
return err
|
|
}
|
|
|
|
fmt.Printf("Login successfully\n")
|
|
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
c.AdminServerClient.LoginToken = &token
|
|
c.Config.AdminClientConfig.AdminName = &email
|
|
c.Config.AdminClientConfig.AdminPassword = &password
|
|
case APIMode:
|
|
c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].LoginToken = &token
|
|
c.Config.APIClientConfig.APIServerMap[c.Config.APIClientConfig.CurrentAPIServer].UserName = &email
|
|
c.Config.APIClientConfig.APIServerMap[c.Config.APIClientConfig.CurrentAPIServer].UserPassword = &password
|
|
default:
|
|
return fmt.Errorf("invalid server type")
|
|
}
|
|
return nil
|
|
}
|
|
|
|
func (c *CLI) PingByCommand(cmd *Command) (ResponseIf, error) {
|
|
iterations := 1
|
|
if iterationsParam, ok := cmd.Params["iterations"]; ok {
|
|
iterations = int(iterationsParam.(float64))
|
|
}
|
|
return c.PingServer(iterations)
|
|
}
|
|
|
|
func (c *CLI) PingServer(iterations int) (ResponseIf, error) {
|
|
var pingPath string
|
|
var resp *Response
|
|
var err error
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
pingPath = "/admin/ping"
|
|
if iterations > 1 {
|
|
return c.AdminServerClient.RequestWithIterations("GET", pingPath, "web", nil, nil, iterations)
|
|
}
|
|
resp, err = c.AdminServerClient.Request("GET", pingPath, "web", nil, nil)
|
|
case APIMode:
|
|
pingPath = "/system/ping"
|
|
if iterations > 1 {
|
|
return c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].RequestWithIterations("GET", pingPath, "web", nil, nil, iterations)
|
|
}
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("GET", pingPath, "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
fmt.Printf("Error: %v\n", err)
|
|
fmt.Println("Can't access server for login (connection failed)")
|
|
return nil, err
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
fmt.Println("Server is down")
|
|
return nil, fmt.Errorf("server is down")
|
|
}
|
|
|
|
var result SimpleResponse
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("ping failed: invalid JSON (%w)", err)
|
|
}
|
|
case APIMode:
|
|
if string(resp.Body) == "pong" {
|
|
result.Code = 0
|
|
result.Message = "Pong"
|
|
} else {
|
|
result.Code = 1
|
|
result.Message = "Ping failed"
|
|
}
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
// loginUser performs the actual login request
|
|
func (c *CLI) loginUser(httpClient *HTTPClient, baseURL, email, password string) (string, error) {
|
|
publicKey, err := c.GetPublicKeyPEM()
|
|
if err != nil {
|
|
return "", fmt.Errorf("failed to get public key: %w", err)
|
|
}
|
|
|
|
// Encrypt password using RSA
|
|
encryptedPassword, err := EncryptPassword(password, publicKey)
|
|
|
|
if err != nil {
|
|
return "", fmt.Errorf("failed to encrypt password: %w", err)
|
|
}
|
|
|
|
payload := map[string]interface{}{
|
|
"email": email,
|
|
"password": encryptedPassword,
|
|
}
|
|
|
|
var resp *Response
|
|
resp, err = httpClient.Request("POST", baseURL, "", nil, payload)
|
|
if err != nil {
|
|
return "", err
|
|
}
|
|
|
|
var result SimpleResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return "", fmt.Errorf("login failed: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return "", fmt.Errorf("login failed: %s", result.Message)
|
|
}
|
|
|
|
token := resp.Headers.Get("Authorization")
|
|
if token == "" {
|
|
return "", fmt.Errorf("login failed: missing Authorization header")
|
|
}
|
|
|
|
return token, nil
|
|
}
|
|
|
|
func (c *CLI) Logout() (ResponseIf, error) {
|
|
|
|
var resp *Response
|
|
var err error
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
if c.AdminServerClient.LoginToken == nil {
|
|
return nil, fmt.Errorf("not logged in")
|
|
}
|
|
resp, err = c.AdminServerClient.Request("POST", "/admin/logout", "web", nil, nil)
|
|
case APIMode:
|
|
if c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].LoginToken == nil {
|
|
return nil, fmt.Errorf("not logged in")
|
|
}
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("POST", "/auth/logout", "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
|
|
var result SimpleResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("login failed: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("login failed: %s", result.Message)
|
|
}
|
|
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
c.AdminServerClient.LoginToken = nil
|
|
c.Config.AdminClientConfig.AdminName = nil
|
|
c.Config.AdminClientConfig.AdminPassword = nil
|
|
case APIMode:
|
|
c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].LoginToken = nil
|
|
c.Config.APIClientConfig.APIServerMap[c.Config.APIClientConfig.CurrentAPIServer].UserName = nil
|
|
c.Config.APIClientConfig.APIServerMap[c.Config.APIClientConfig.CurrentAPIServer].UserPassword = nil
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) CommonAvailableProvidersCommand(cmd *Command) (ResponseIf, error) {
|
|
|
|
var resp *Response
|
|
var err error
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
resp, err = c.AdminServerClient.Request("GET", "/admin/providers?available=true", "web", nil, nil)
|
|
case APIMode:
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("GET", "/providers?available=true", "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to list providers: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to list providers: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result CommonResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to list providers: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) CommonShowProviderCommand(cmd *Command) (ResponseIf, error) {
|
|
providerName, ok := cmd.Params["provider_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("provider_name not provided")
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var endPoint string
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
endPoint = fmt.Sprintf("/admin/providers/%s", providerName)
|
|
resp, err = c.AdminServerClient.Request("GET", endPoint, "web", nil, nil)
|
|
case APIMode:
|
|
endPoint = fmt.Sprintf("/providers/%s", providerName)
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("GET", endPoint, "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to show provider: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to show provider: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result CommonDataResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to show provider: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
// CommonShowProviderInstanceCommand shows details of a specific instance
|
|
func (c *CLI) CommonShowProviderInstanceCommand(cmd *Command) (ResponseIf, error) {
|
|
instanceName, ok := cmd.Params["instance_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("instance name not provided")
|
|
}
|
|
|
|
providerName, ok := cmd.Params["provider_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("provider name not provided")
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var endPoint string
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
endPoint = fmt.Sprintf("/admin/providers/%s/instances/%s", providerName, instanceName)
|
|
resp, err = c.AdminServerClient.Request("GET", endPoint, "web", nil, nil)
|
|
case APIMode:
|
|
endPoint = fmt.Sprintf("/providers/%s/instances/%s", providerName, instanceName)
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("GET", endPoint, "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to show instance: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to show instance: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result CommonDataResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to show instance: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
// CommonShowProviderInstanceBalanceCommand shows balance of a specific instance
|
|
func (c *CLI) CommonShowProviderInstanceBalanceCommand(cmd *Command) (ResponseIf, error) {
|
|
|
|
instanceName, ok := cmd.Params["instance_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("instance name not provided")
|
|
}
|
|
|
|
providerName, ok := cmd.Params["provider_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("provider name not provided")
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var endPoint string
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
endPoint = fmt.Sprintf("/admin/providers/%s/instances/%s/balance", providerName, instanceName)
|
|
resp, err = c.AdminServerClient.Request("GET", endPoint, "web", nil, nil)
|
|
case APIMode:
|
|
endPoint = fmt.Sprintf("/providers/%s/instances/%s/balance", providerName, instanceName)
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("GET", endPoint, "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to show instance balance: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to show instance balance: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result CommonDataResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to show instance balance: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
// CommonListProviderInstances lists all instances of a provider
|
|
// LIST INSTANCES FROM PROVIDER <name>
|
|
func (c *CLI) CommonListProviderInstances(cmd *Command) (ResponseIf, error) {
|
|
|
|
providerName, ok := cmd.Params["provider_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("provider_name not provided")
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var endPoint string
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
endPoint = fmt.Sprintf("/admin/providers/%s/instances", providerName)
|
|
resp, err = c.AdminServerClient.Request("GET", endPoint, "web", nil, nil)
|
|
case APIMode:
|
|
endPoint = fmt.Sprintf("/providers/%s/instances", providerName)
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("GET", endPoint, "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to list instances: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to list instances: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result CommonResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("list instances failed: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) CommonListInstanceModelsCommand(cmd *Command) (ResponseIf, error) {
|
|
|
|
providerName, ok := cmd.Params["provider_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("provider_name not provided")
|
|
}
|
|
instanceName, ok := cmd.Params["instance_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("instance_name not provided")
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var endPoint string
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
endPoint = fmt.Sprintf("/admin/providers/%s/instances/%s/models", providerName, instanceName)
|
|
resp, err = c.AdminServerClient.Request("GET", endPoint, "web", nil, nil)
|
|
case APIMode:
|
|
endPoint = fmt.Sprintf("/providers/%s/instances/%s/models", providerName, instanceName)
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("GET", endPoint, "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to list instance models: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to list instance models: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result CommonResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to list instance models: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) CommonListModelsCommand(cmd *Command) (ResponseIf, error) {
|
|
|
|
providerName, ok := cmd.Params["provider_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("provider_name not provided")
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var endPoint string
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
endPoint = fmt.Sprintf("/admin/providers/%s/models", providerName)
|
|
resp, err = c.AdminServerClient.Request("GET", endPoint, "web", nil, nil)
|
|
case APIMode:
|
|
endPoint = fmt.Sprintf("/providers/%s/models", providerName)
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("GET", endPoint, "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to list models: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to list models: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result CommonResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to list models: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) CommonListInstanceModelsSyncCommand(cmd *Command) (ResponseIf, error) {
|
|
|
|
providerName, ok := cmd.Params["provider_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("provider_name not provided")
|
|
}
|
|
instanceName, ok := cmd.Params["instance_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("instance_name not provided")
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var endPoint string
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
endPoint = fmt.Sprintf("/admin/providers/%s/instances/%s/models?supported=true", providerName, instanceName)
|
|
resp, err = c.AdminServerClient.Request("GET", endPoint, "web", nil, nil)
|
|
case APIMode:
|
|
endPoint = fmt.Sprintf("/providers/%s/instances/%s/models?supported=true", providerName, instanceName)
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("GET", endPoint, "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to list models: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to list models: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result CommonResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to list models: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) CommonShowProviderModelCommand(cmd *Command) (ResponseIf, error) {
|
|
providerName, ok := cmd.Params["provider_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("provider_name not provided")
|
|
}
|
|
modelName, ok := cmd.Params["model_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("model_name not provided")
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var endPoint string
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
endPoint = fmt.Sprintf("/admin/providers/%s/models/%s", providerName, modelName)
|
|
resp, err = c.AdminServerClient.Request("GET", endPoint, "web", nil, nil)
|
|
case APIMode:
|
|
endPoint = fmt.Sprintf("/providers/%s/models/%s", providerName, modelName)
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("GET", endPoint, "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to show model: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to show model: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result CommonDataResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to show model: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) CommonCheckProviderWithKey(cmd *Command) (ResponseIf, error) {
|
|
|
|
providerName, ok := cmd.Params["provider_name"].(string)
|
|
if !ok || providerName == "" {
|
|
return nil, fmt.Errorf("provider name not provided")
|
|
}
|
|
region, ok := cmd.Params["region"].(string)
|
|
if !ok || region == "" {
|
|
return nil, fmt.Errorf("region not provided")
|
|
}
|
|
apiKey, ok := cmd.Params["api_key"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("api_key not provided")
|
|
}
|
|
baseURL, _ := cmd.Params["base_url"].(string)
|
|
|
|
var apiKeyValue interface{}
|
|
if apiKey != "" {
|
|
apiKeyValue = apiKey
|
|
} else {
|
|
apiKeyValue = nil
|
|
}
|
|
|
|
payload := map[string]interface{}{
|
|
"region": region,
|
|
"api_key": apiKeyValue,
|
|
}
|
|
if baseURL != "" {
|
|
payload["base_url"] = baseURL
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var endPoint string
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
endPoint = fmt.Sprintf("/admin/providers/%s/connection", providerName)
|
|
resp, err = c.AdminServerClient.Request("POST", endPoint, "web", nil, payload)
|
|
case APIMode:
|
|
endPoint = fmt.Sprintf("/providers/%s/connection", providerName)
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("POST", endPoint, "web", nil, payload)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to check provider connection with key: %w", err)
|
|
}
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to check provider connection: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
var result CommonDataResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("check provider connection failed: invalid JSON (%w)", err)
|
|
}
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
case APIMode:
|
|
var result SimpleResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("check provider connection failed: invalid JSON (%w)", err)
|
|
}
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
}
|
|
|
|
func (c *CLI) CommonCheckProviderConnection(cmd *Command) (ResponseIf, error) {
|
|
|
|
instanceName, ok := cmd.Params["instance_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("instance name not provided")
|
|
}
|
|
|
|
providerName, ok := cmd.Params["provider_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("provider name not provided")
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var endPoint string
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
endPoint = fmt.Sprintf("/admin/providers/%s/instances/%s/connection", providerName, instanceName)
|
|
resp, err = c.AdminServerClient.Request("POST", endPoint, "web", nil, nil)
|
|
case APIMode:
|
|
endPoint = fmt.Sprintf("/providers/%s/instances/%s/connection", providerName, instanceName)
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("POST", endPoint, "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to check provider connection: %w", err)
|
|
}
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to check provider connection: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
var result CommonDataResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("check provider connection failed: invalid JSON (%w)", err)
|
|
}
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
case APIMode:
|
|
var result SimpleResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("check provider connection failed: invalid JSON (%w)", err)
|
|
}
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
}
|
|
|
|
// AlterProviderInstanceCommand alters a provider instance
|
|
func (c *CLI) CommonAlterProviderInstanceCommand(cmd *Command) (ResponseIf, error) {
|
|
|
|
providerName, ok := cmd.Params["provider_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("provider name not provided")
|
|
}
|
|
|
|
instanceName, ok := cmd.Params["instance_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("instance name not provided")
|
|
}
|
|
|
|
payload := map[string]interface{}{}
|
|
|
|
newName, ok := cmd.Params["new_model_name"].(string)
|
|
if ok {
|
|
payload["model_name"] = newName
|
|
}
|
|
|
|
newAPIKey, ok := cmd.Params["new_api_key"].(string)
|
|
if ok {
|
|
payload["api_key"] = newAPIKey
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var endPoint string
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
endPoint = fmt.Sprintf("/admin/providers/%s/instances/%s", providerName, instanceName)
|
|
resp, err = c.AdminServerClient.Request("PUT", endPoint, "web", nil, payload)
|
|
case APIMode:
|
|
endPoint = fmt.Sprintf("/providers/%s/instances/%s", providerName, instanceName)
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("PUT", endPoint, "web", nil, payload)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to alter instance: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to alter instance: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
var result CommonDataResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("check provider connection failed: invalid JSON (%w)", err)
|
|
}
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
case APIMode:
|
|
var result SimpleResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("check provider connection failed: invalid JSON (%w)", err)
|
|
}
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
}
|
|
|
|
func (c *CLI) CommonEnableOrDisableModel(cmd *Command, status string) (ResponseIf, error) {
|
|
|
|
modelName, ok := cmd.Params["model_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("model name not provided")
|
|
}
|
|
|
|
instanceName, ok := cmd.Params["instance_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("instance name not provided")
|
|
}
|
|
|
|
providerName, ok := cmd.Params["provider_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("provider name not provided")
|
|
}
|
|
|
|
payload := map[string]interface{}{
|
|
"status": status,
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var endPoint string
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
endPoint = fmt.Sprintf("/admin/providers/%s/instances/%s/models/%s", providerName, instanceName, modelName)
|
|
resp, err = c.AdminServerClient.Request("PATCH", endPoint, "web", nil, payload)
|
|
case APIMode:
|
|
endPoint = fmt.Sprintf("/providers/%s/instances/%s/models/%s", providerName, instanceName, modelName)
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("PATCH", endPoint, "web", nil, payload)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to enable/disable model: %w", err)
|
|
}
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to enable/disable model: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
var result CommonDataResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("check provider connection failed: invalid JSON (%w)", err)
|
|
}
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
case APIMode:
|
|
var result SimpleResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("check provider connection failed: invalid JSON (%w)", err)
|
|
}
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
}
|
|
|
|
func (c *CLI) SetDefaultModel(cmd *Command) (ResponseIf, error) {
|
|
|
|
modelType, ok := cmd.Params["model_type"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("model_type not provided")
|
|
}
|
|
|
|
compositeModelName, ok := cmd.Params["composite_model_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("model_name not provided")
|
|
}
|
|
|
|
var providerName, instanceName, modelName string
|
|
var err error
|
|
modelName, instanceName, providerName, err = common.ExtractCompositeName(compositeModelName)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
|
|
payload := map[string]interface{}{
|
|
"model_type": modelType,
|
|
"model_provider": providerName,
|
|
"model_instance": instanceName,
|
|
"model_name": modelName,
|
|
}
|
|
|
|
var resp *Response
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
resp, err = c.AdminServerClient.Request("PATCH", "/admin/models", "web", nil, payload)
|
|
case APIMode:
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("PATCH", "/models", "web", nil, payload)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to set default model: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to set default model: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result SimpleResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to set default model: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) ResetDefaultModel(cmd *Command) (ResponseIf, error) {
|
|
|
|
modelType, ok := cmd.Params["model_type"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("model_type not provided")
|
|
}
|
|
|
|
payload := map[string]interface{}{
|
|
"model_type": modelType,
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
resp, err = c.AdminServerClient.Request("PATCH", "/admin/models", "web", nil, payload)
|
|
case APIMode:
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("PATCH", "/models", "web", nil, payload)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to reset default model: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to reset default model: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result SimpleResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to reset default model: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) ListDefaultModels(cmd *Command) (ResponseIf, error) {
|
|
|
|
var resp *Response
|
|
var err error
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
resp, err = c.AdminServerClient.Request("GET", "/admin/models", "web", nil, nil)
|
|
case APIMode:
|
|
resp, err = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].Request("GET", "/models/default", "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to list default models: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to list default models: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result ModelsResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to list default models: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) CommonShowCurrentCommand(cmd *Command) (ResponseIf, error) {
|
|
var result *CommonDataResponse
|
|
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
response, err := c.GetAdminServerInfo()
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to show current: %w", err)
|
|
}
|
|
result = response.(*CommonDataResponse)
|
|
|
|
case APIMode:
|
|
response, err := c.GetAPIServerInfo(c.Config.APIClientConfig.CurrentAPIServer)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
result = response.(*CommonDataResponse)
|
|
|
|
if c.CurrentModel != nil {
|
|
if result.Data == nil {
|
|
result.Data = make(map[string]interface{})
|
|
}
|
|
result.Data["model_provider"] = c.CurrentModel.Provider
|
|
result.Data["model_instance"] = c.CurrentModel.Instance
|
|
result.Data["model_model"] = c.CurrentModel.Model
|
|
}
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if result == nil {
|
|
result = &CommonDataResponse{}
|
|
if result.Data == nil {
|
|
result.Data = make(map[string]interface{})
|
|
}
|
|
}
|
|
|
|
result.Data["mode"] = c.Config.CLIMode
|
|
result.Data["output"] = c.Config.OutputFormat
|
|
result.Data["interactive"] = c.Config.Interactive
|
|
result.Data["verbose"] = c.Config.Verbose
|
|
|
|
return result, nil
|
|
}
|
|
|
|
func (c *CLI) CommonShowAdminServerCommand(cmd *Command) (ResponseIf, error) {
|
|
return c.GetAdminServerInfo()
|
|
}
|
|
|
|
func (c *CLI) CommonShowAPIServerCommand(cmd *Command) (ResponseIf, error) {
|
|
apiServerName, ok := cmd.Params["api_server_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("api_server_name not provided")
|
|
}
|
|
result, err := c.GetAPIServerInfo(apiServerName)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
return result, nil
|
|
}
|
|
|
|
func (c *CLI) CommonListAPIServers(cmd *Command) (ResponseIf, error) {
|
|
|
|
var result CommonResponse
|
|
result.Data = make([]map[string]interface{}, 0)
|
|
|
|
for serverName, apiServerConfig := range c.Config.APIClientConfig.APIServerMap {
|
|
element := map[string]interface{}{
|
|
"api_server": serverName,
|
|
}
|
|
element["api_server_ip"] = apiServerConfig.IP
|
|
element["api_server_port"] = apiServerConfig.Port
|
|
if apiServerConfig.UserName != nil {
|
|
element["user_name"] = *apiServerConfig.UserName
|
|
}
|
|
if apiServerConfig.UserPassword != nil {
|
|
element["user_password"] = strings.Repeat("*", len(*apiServerConfig.UserPassword))
|
|
}
|
|
if c.APIServerClientMap[serverName].LoginToken != nil {
|
|
element["auth"] = "login"
|
|
} else if c.APIServerClientMap[serverName].APIKey != nil {
|
|
element["auth"] = "api key"
|
|
} else {
|
|
element["auth"] = "no auth"
|
|
}
|
|
result.Data = append(result.Data, element)
|
|
}
|
|
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) AddAPIServer(cmd *Command) (ResponseIf, error) {
|
|
apiServerName, ok := cmd.Params["server_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("server name not provided")
|
|
}
|
|
if c.Config.APIClientConfig.APIServerMap[apiServerName] != nil {
|
|
return nil, fmt.Errorf("api server already exists")
|
|
}
|
|
|
|
apiServerIP, ok := cmd.Params["server_ip"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("server ip not provided")
|
|
}
|
|
apiServerPort, ok := cmd.Params["server_port"].(int)
|
|
if !ok {
|
|
return nil, fmt.Errorf("server port not provided")
|
|
}
|
|
|
|
if c.Config.APIClientConfig.APIServerMap == nil {
|
|
c.Config.APIClientConfig.APIServerMap = make(map[string]*APIServerConfig)
|
|
}
|
|
|
|
c.Config.APIClientConfig.APIServerMap[apiServerName] = &APIServerConfig{
|
|
Name: apiServerName,
|
|
IP: apiServerIP,
|
|
Port: apiServerPort,
|
|
}
|
|
c.Config.APIClientConfig.APIServerMap[apiServerName].IP = apiServerIP
|
|
c.Config.APIClientConfig.APIServerMap[apiServerName].Port = apiServerPort
|
|
|
|
if c.APIServerClientMap == nil {
|
|
c.APIServerClientMap = make(map[string]*HTTPClient)
|
|
}
|
|
|
|
if c.APIServerClientMap[apiServerName] != nil {
|
|
return nil, fmt.Errorf("api server: %s already exists", apiServerName)
|
|
}
|
|
|
|
transport := &http.Transport{
|
|
// codeql[go/disabled-certificate-check] Local cluster self-signed
|
|
// certs are common for the API server used by the CLI; verification
|
|
// is left to the operator (the URL is configured by them). Document
|
|
// the trade-off here so reviewers don't re-flag the same line.
|
|
TLSClientConfig: &tls.Config{InsecureSkipVerify: true},
|
|
}
|
|
|
|
c.APIServerClientMap[apiServerName] = &HTTPClient{
|
|
Host: apiServerIP,
|
|
Port: apiServerPort,
|
|
APIVersion: "v1",
|
|
ConnectTimeout: 5 * time.Second,
|
|
ReadTimeout: 60 * time.Second,
|
|
VerifySSL: false,
|
|
client: &http.Client{
|
|
Transport: transport,
|
|
Timeout: 300 * time.Second,
|
|
},
|
|
}
|
|
|
|
var result SimpleResponse
|
|
result.Code = 0
|
|
result.Message = "api server added successfully"
|
|
result.Duration = 0
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) DeleteAPIServer(cmd *Command) (ResponseIf, error) {
|
|
apiServerName, ok := cmd.Params["server_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("server name not provided")
|
|
}
|
|
if apiServerName == c.Config.APIClientConfig.CurrentAPIServer {
|
|
return nil, fmt.Errorf("cannot delete current api server")
|
|
}
|
|
|
|
if c.APIServerClientMap[apiServerName] == nil && c.Config.APIClientConfig.APIServerMap[apiServerName] == nil {
|
|
return nil, fmt.Errorf("api server: %s not found", apiServerName)
|
|
}
|
|
|
|
delete(c.Config.APIClientConfig.APIServerMap, apiServerName)
|
|
delete(c.APIServerClientMap, apiServerName)
|
|
var result SimpleResponse
|
|
result.Code = 0
|
|
result.Message = "api server deleted successfully"
|
|
result.Duration = 0
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) AddAdminServer(cmd *Command) (ResponseIf, error) {
|
|
|
|
if c.AdminServerClient != nil && c.AdminServerClient.LoginToken != nil {
|
|
return nil, fmt.Errorf("admin server already login, please logout")
|
|
}
|
|
|
|
adminServerIP, ok := cmd.Params["server_ip"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("server ip not provided")
|
|
}
|
|
adminServerPort, ok := cmd.Params["server_port"].(int)
|
|
if !ok {
|
|
return nil, fmt.Errorf("server port not provided")
|
|
}
|
|
|
|
if c.Config.AdminClientConfig == nil {
|
|
c.Config.AdminClientConfig = &AdminModeConfig{}
|
|
}
|
|
|
|
if adminServerIP != "" {
|
|
c.Config.AdminClientConfig.AdminHost = adminServerIP
|
|
}
|
|
if adminServerPort != 0 {
|
|
c.Config.AdminClientConfig.AdminPort = adminServerPort
|
|
}
|
|
|
|
transport := &http.Transport{
|
|
// codeql[go/disabled-certificate-check] Local cluster self-signed
|
|
// certs are common for the admin server used by the CLI; verification
|
|
// is left to the operator (the URL is configured by them). Document
|
|
// the trade-off here so reviewers don't re-flag the same line.
|
|
TLSClientConfig: &tls.Config{InsecureSkipVerify: true},
|
|
}
|
|
|
|
c.AdminServerClient = &HTTPClient{
|
|
Host: adminServerIP,
|
|
Port: adminServerPort,
|
|
APIVersion: "v1",
|
|
ConnectTimeout: 5 * time.Second,
|
|
ReadTimeout: 60 * time.Second,
|
|
VerifySSL: false,
|
|
client: &http.Client{
|
|
Transport: transport,
|
|
Timeout: 300 * time.Second,
|
|
},
|
|
}
|
|
|
|
var result SimpleResponse
|
|
result.Code = 0
|
|
result.Message = "admin server added successfully"
|
|
result.Duration = 0
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) DeleteAdminServer(cmd *Command) (ResponseIf, error) {
|
|
|
|
if c.AdminServerClient == nil && c.Config.AdminClientConfig == nil {
|
|
return nil, fmt.Errorf("admin server not exists")
|
|
}
|
|
|
|
if c.AdminServerClient != nil {
|
|
c.AdminServerClient = nil
|
|
}
|
|
|
|
if c.Config.AdminClientConfig != nil {
|
|
c.Config.AdminClientConfig = nil
|
|
}
|
|
|
|
var result SimpleResponse
|
|
result.Code = 0
|
|
result.Message = "admin server deleted successfully"
|
|
result.Duration = 0
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) CommonSaveServerConfigCommand(cmd *Command) (ResponseIf, error) {
|
|
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
if c.AdminServerClient.LoginToken == nil {
|
|
return nil, fmt.Errorf("admin server isn't already login")
|
|
}
|
|
case APIMode:
|
|
if c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].APIKey == nil && c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].LoginToken == nil {
|
|
return nil, fmt.Errorf("API token not set. Please login first")
|
|
}
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
return nil, fmt.Errorf("save server config isn't implemented")
|
|
}
|
|
|
|
func (c *CLI) GetAdminServerInfo() (ResponseIf, error) {
|
|
var result CommonDataResponse
|
|
result.Data = make(map[string]interface{})
|
|
|
|
if c.Config.AdminClientConfig == nil {
|
|
result.Data["admin_server"] = "N/A"
|
|
} else {
|
|
result.Data["admin_server_ip"] = c.Config.AdminClientConfig.AdminHost
|
|
result.Data["admin_server_port"] = c.Config.AdminClientConfig.AdminPort
|
|
if c.Config.AdminClientConfig.AdminName != nil {
|
|
result.Data["admin_name"] = *c.Config.AdminClientConfig.AdminName
|
|
}
|
|
if c.Config.AdminClientConfig.AdminPassword != nil {
|
|
result.Data["admin_password"] = strings.Repeat("*", len(*c.Config.AdminClientConfig.AdminPassword))
|
|
}
|
|
if c.AdminServerClient == nil || c.AdminServerClient.LoginToken == nil {
|
|
result.Data["auth"] = "no auth"
|
|
} else {
|
|
result.Data["auth"] = "login"
|
|
}
|
|
}
|
|
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) GetAPIServerInfo(serverName string) (ResponseIf, error) {
|
|
var result CommonDataResponse
|
|
result.Data = make(map[string]interface{})
|
|
|
|
if c.Config.APIClientConfig.APIServerMap == nil || c.Config.APIClientConfig.APIServerMap[serverName] == nil {
|
|
result.Data["api_server"] = "N/A"
|
|
} else {
|
|
result.Data["api_server"] = serverName
|
|
apiServerConfig := c.Config.APIClientConfig.APIServerMap[serverName]
|
|
result.Data["api_server_ip"] = apiServerConfig.IP
|
|
result.Data["api_server_port"] = apiServerConfig.Port
|
|
if apiServerConfig.UserName != nil {
|
|
result.Data["user_name"] = *apiServerConfig.UserName
|
|
}
|
|
|
|
if apiServerConfig.UserPassword != nil {
|
|
result.Data["user_password"] = strings.Repeat("*", len(*apiServerConfig.UserPassword))
|
|
}
|
|
|
|
if c.Config.APIClientConfig.CurrentAPIServer == "" {
|
|
result.Data["auth"] = "unknown"
|
|
} else {
|
|
if c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].LoginToken != nil {
|
|
result.Data["auth"] = "login"
|
|
} else if c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer].APIKey != nil {
|
|
result.Data["auth"] = "api key"
|
|
} else {
|
|
result.Data["auth"] = "no auth"
|
|
}
|
|
}
|
|
}
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) ListAllModels(cmd *Command) (ResponseIf, error) {
|
|
|
|
page, ok := cmd.Params["page"].(int)
|
|
if !ok {
|
|
page = 0
|
|
}
|
|
|
|
pageSize, ok := cmd.Params["page_size"].(int)
|
|
if !ok {
|
|
pageSize = 0
|
|
}
|
|
|
|
payload := map[string]interface{}{
|
|
"page": page,
|
|
"page_size": pageSize,
|
|
}
|
|
|
|
var resp *Response
|
|
var err error
|
|
var httpClient *HTTPClient
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
httpClient = c.AdminServerClient
|
|
apiURL := "/admin/all-models"
|
|
resp, err = httpClient.Request("GET", apiURL, "web", nil, payload)
|
|
case APIMode:
|
|
httpClient = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer]
|
|
apiURL := "/all-models"
|
|
resp, err = httpClient.Request("GET", apiURL, "web", nil, payload)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to list all models: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to list all models: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result CommonResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to list all models: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) CommonShowModelCommand(cmd *Command) (ResponseIf, error) {
|
|
|
|
modelName, ok := cmd.Params["model_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("model_name not provided")
|
|
}
|
|
|
|
encodedModelName := common.EncodeToBase64(modelName)
|
|
|
|
var resp *Response
|
|
var err error
|
|
var httpClient *HTTPClient
|
|
switch c.Config.CLIMode {
|
|
case AdminMode:
|
|
baseURL := fmt.Sprintf("/admin/all-models/%s", encodedModelName)
|
|
httpClient = c.AdminServerClient
|
|
resp, err = httpClient.Request("GET", baseURL, "web", nil, nil)
|
|
case APIMode:
|
|
baseURL := fmt.Sprintf("/all-models/%s", encodedModelName)
|
|
httpClient = c.APIServerClientMap[c.Config.APIClientConfig.CurrentAPIServer]
|
|
resp, err = httpClient.Request("GET", baseURL, "web", nil, nil)
|
|
default:
|
|
return nil, fmt.Errorf("invalid server type")
|
|
}
|
|
|
|
if err != nil {
|
|
return nil, fmt.Errorf("failed to show model: %w", err)
|
|
}
|
|
|
|
if resp.StatusCode != 200 {
|
|
return nil, fmt.Errorf("failed to show model: HTTP %d, body: %s", resp.StatusCode, string(resp.Body))
|
|
}
|
|
|
|
var result CommonDataResponse
|
|
if err = json.Unmarshal(resp.Body, &result); err != nil {
|
|
return nil, fmt.Errorf("failed to show model: invalid JSON (%w)", err)
|
|
}
|
|
|
|
if result.Code != 0 {
|
|
return nil, fmt.Errorf("%s", result.Message)
|
|
}
|
|
result.Duration = resp.Duration
|
|
return &result, nil
|
|
}
|
|
|
|
// readPassword reads password from terminal without echoing
|
|
func ReadPassword() (string, error) {
|
|
if !term.IsTerminal(int(os.Stdin.Fd())) {
|
|
return ReadPasswordFallback()
|
|
}
|
|
|
|
fmt.Print("Password: ")
|
|
passwordBytes, err := term.ReadPassword(int(os.Stdin.Fd()))
|
|
fmt.Println()
|
|
|
|
if err != nil {
|
|
return "", err
|
|
}
|
|
|
|
return strings.TrimSpace(string(passwordBytes)), nil
|
|
}
|
|
|
|
// readPasswordFallback reads password as plain text (fallback mode)
|
|
func ReadPasswordFallback() (string, error) {
|
|
fmt.Print("Password (will be visible): ")
|
|
reader := bufio.NewReader(os.Stdin)
|
|
password, err := reader.ReadString('\n')
|
|
if err != nil {
|
|
return "", err
|
|
}
|
|
return strings.TrimSpace(password), nil
|
|
}
|
|
|
|
// FlattenMap recursively flattens a nested map into dot-notation keys
|
|
func FlattenMap(data map[string]interface{}, prefix string, result *[]map[string]interface{}) {
|
|
for key, value := range data {
|
|
// Build the current key path
|
|
currentKey := key
|
|
if prefix != "" {
|
|
currentKey = prefix + "." + key
|
|
}
|
|
|
|
// Check if the value is another nested map
|
|
if nestedMap, ok := value.(map[string]interface{}); ok {
|
|
// Recursively process the nested map
|
|
FlattenMap(nestedMap, currentKey, result)
|
|
} else {
|
|
// Leaf node: append to result slice
|
|
resultItem := map[string]interface{}{
|
|
"key": currentKey,
|
|
"value": value,
|
|
}
|
|
*result = append(*result, resultItem)
|
|
}
|
|
}
|
|
}
|
|
|
|
func (c *CLI) CommonUseAPIServerCommand(cmd *Command) (ResponseIf, error) {
|
|
serverName, ok := cmd.Params["server_name"].(string)
|
|
if !ok {
|
|
return nil, fmt.Errorf("server_name not provided")
|
|
}
|
|
|
|
if c.Config.CLIMode == APIMode {
|
|
if c.Config.APIClientConfig.CurrentAPIServer == serverName {
|
|
return nil, fmt.Errorf("api server %s is already used", serverName)
|
|
}
|
|
}
|
|
|
|
var httpClient *HTTPClient
|
|
httpClient, ok = c.APIServerClientMap[serverName]
|
|
if !ok {
|
|
return nil, fmt.Errorf("api server %s not found", serverName)
|
|
}
|
|
if httpClient == nil {
|
|
return nil, fmt.Errorf("api server %s is nil", serverName)
|
|
}
|
|
var apiServerConfig *APIServerConfig
|
|
apiServerConfig, ok = c.Config.APIClientConfig.APIServerMap[serverName]
|
|
if !ok {
|
|
return nil, fmt.Errorf("api server %s not found in config", serverName)
|
|
}
|
|
if apiServerConfig == nil {
|
|
return nil, fmt.Errorf("api server %s is nil", serverName)
|
|
}
|
|
|
|
c.Config.APIClientConfig.CurrentAPIServer = serverName
|
|
c.Config.CLIMode = APIMode
|
|
|
|
var result SimpleResponse
|
|
result.Code = 0
|
|
result.Message = fmt.Sprintf("switch to api server %s", serverName)
|
|
result.Duration = 0
|
|
return &result, nil
|
|
|
|
}
|
|
|
|
func (c *CLI) CommonUseAdminServerCommand(cmd *Command) (ResponseIf, error) {
|
|
|
|
if c.Config.CLIMode == AdminMode {
|
|
return nil, fmt.Errorf("already in admin mode")
|
|
}
|
|
|
|
if c.AdminServerClient == nil || c.Config.AdminClientConfig == nil {
|
|
return nil, fmt.Errorf("admin server not added")
|
|
}
|
|
|
|
c.Config.APIClientConfig.CurrentAPIServer = ""
|
|
c.Config.CLIMode = AdminMode
|
|
|
|
var result SimpleResponse
|
|
result.Code = 0
|
|
result.Message = "switch to admin server"
|
|
result.Duration = 0
|
|
return &result, nil
|
|
}
|
|
|
|
func (c *CLI) getDatasetIDByName(datasetName string) (string, error) {
|
|
response, err := c.APIListDatasetsCommand(nil)
|
|
if err != nil {
|
|
return "", err
|
|
}
|
|
commonResponse, ok := response.(*CommonResponse)
|
|
if !ok {
|
|
return "", fmt.Errorf("invalid response")
|
|
}
|
|
for _, dataset := range commonResponse.Data {
|
|
if dataset["name"] == datasetName {
|
|
return dataset["id"].(string), nil
|
|
}
|
|
}
|
|
return "", fmt.Errorf("dataset %s not found", datasetName)
|
|
}
|