Jack 17bafb363f fix(chunker): align Go token merge with Python OVER_CAP and delimiter boundary (#17835) ...

Consolidates the Go chunker work that syncs `TokenChunker` with the Python reference (`rag/nlp.naive_merge` / `rag/flow/chunker/token_chunker.py`)

2026-08-05 13:58:45 +08:00

..

chunk_types.go

Fix(go): align ingestion pipeline with Python (parser/media dispatch + PDF coordinate chain + Chunker) (#17349)

2026-07-24 21:06:38 +08:00

chunker.go

fix(chunker): align Go token merge with Python OVER_CAP and delimiter boundary (#17835)

2026-08-05 13:58:45 +08:00

errors.go

Align Go ingestion boundaries with Python (#16647)

2026-07-05 20:43:52 +08:00

extractor.go

Go port: doc-level metadata extraction and knowledge compiler (#17536)

2026-07-29 21:06:48 +08:00

file.go

Align Go ingestion boundaries with Python (#16647)

2026-07-05 20:43:52 +08:00

parser.go

Support pipeline DSL modification through dataset configuration (backend) (#16991)

2026-07-17 14:40:09 +08:00

schema_test.go

Support pipeline DSL modification through dataset configuration (backend) (#16991)

2026-07-17 14:40:09 +08:00

tokenizer.go

Align Go ingestion boundaries with Python (#16647)

2026-07-05 20:43:52 +08:00