internal/service/document/document_upload_helpers.go

package document

import (
	"encoding/hex"

	"github.com/zeebo/xxh3"
)

// contentHashHex mirrors Python xxhash.xxh128(blob).hexdigest().
func contentHashHex(blob []byte) string {
	sum := xxh3.Hash128(blob).Bytes()
	return hex.EncodeToString(sum[:])
}
Refactor: dataset/document/file service (#17071) ### Summary Refactor dataset.go document.do file.go file2document.go in internal/service. 2026-07-20 09:48:24 +08:00			`package document`
feat(go-api): implement dataset document upload API (#16295) ## Summary Migrated the dataset document upload API (`POST /api/v1/datasets/:dataset_id/documents`) from Python to the Go backend. It supports local file uploads (`type=local`), web page ingestion (`type=web`), and empty document creation (`type=empty`). ## Changes - Router: Registered `POST /api/v1/datasets/:dataset_id/documents` route. - Handler: Implemented `UploadDocuments` handler and its routing functions (`uploadLocalDocuments`, `uploadWebDocument`, `uploadEmptyDocument`). - Service: Implemented `UploadLocalDocuments`, `UploadWebDocument`, and `UploadEmptyDocument` in `DocumentService`. - Refactoring: Moved permission checking logic to a shared helper for reuse in file and document services. - Tests: Added comprehensive unit tests for the new handler and service upload paths. ## Verification Ran and passed the test suite for service and handler packages: - `go test ./internal/service` - `go test ./internal/handler` 2026-06-25 13:36:49 +08:00
			`import (`
			`"encoding/hex"`

			`"github.com/zeebo/xxh3"`
			`)`

			`// contentHashHex mirrors Python xxhash.xxh128(blob).hexdigest().`
			`func contentHashHex(blob []byte) string {`
			`sum := xxh3.Hash128(blob).Bytes()`
			`return hex.EncodeToString(sum[:])`
			`}`