Jack b505437db5 fix(chunker): honor bare (non-backtick) delimiters in TokenChunker (#17723) (#18182) ...

Go's `TokenChunker` previously ignored **bare (non-backtick)
delimiters** such as `::`, `.`, or `；`. `compileDelimPattern` compiled
them with `keepBare=false`, so a bare delimiter produced a `nil` pattern
and the payload was routed to the single-section merge that never split
on it — diverging from Python's `naive_merge`, which splits on bare
delimiters and then merges by token size.

2026-08-12 22:36:11 +08:00

..

chunker

fix(chunker): honor bare (non-backtick) delimiters in TokenChunker (#17723) (#18182)

2026-08-12 22:36:11 +08:00

globals

Port PR14140 and PR16881 to GO (#17102)

2026-07-21 17:46:23 +08:00

knowledge_compiler

Port dataset-level knowledge compile to Go with variant dispatch (#18161)

2026-08-12 17:24:12 +08:00

schema

Go: fix context and warnings (#18097)

2026-08-11 16:18:49 +08:00

dispatch_model.go

Go: introduce content_length and max_output (#17807)

2026-08-04 19:08:31 +08:00

document_storage.go

Go: add context to storage (#17690)

2026-08-03 15:08:21 +08:00

docx_vision_dispatch_test.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

docx_vision_dispatch.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

extractor_tag_test.go

fix(ingestion): fit extractor and tagger prompts to model context (#18095)

2026-08-12 15:45:01 +08:00

extractor_tag.go

fix(ingestion): fit extractor and tagger prompts to model context (#18095)

2026-08-12 15:45:01 +08:00

extractor_test.go

fix(ingestion): strip mid-text think blocks in extractor metadata path (#18175)

2026-08-12 19:39:49 +08:00

extractor.go

fix(ingestion): strip mid-text think blocks in extractor metadata path (#18175)

2026-08-12 19:39:49 +08:00

file_test.go

Go: add context to storage (#17690)

2026-08-03 15:08:21 +08:00

file.go

Go: fix warnings (#17738)

2026-08-03 21:30:01 +08:00

idempotency.go

Align Go ingestion boundaries with Python (#16647)

2026-07-05 20:43:52 +08:00

image_uploader.go

Go: add context to storage (#17690)

2026-08-03 15:08:21 +08:00

markdown_vision_dispatch.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

media_dispatch_test.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

media_dispatch.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

parser_check_test.go

Go: fix warnings (#17738)

2026-08-03 21:30:01 +08:00

parser_dispatch_pdf_vision_cgo_test.go

Go: add context, part12 (#17435)

2026-07-27 19:30:41 +08:00

parser_dispatch_test.go

Go: fix context and warnings (#18097)

2026-08-11 16:18:49 +08:00

parser_dispatch.go

Go: fix context and warnings (#18097)

2026-08-11 16:18:49 +08:00

parser_test.go

Go: add context to storage (#17690)

2026-08-03 15:08:21 +08:00

parser.go

docs(ingestion): correct stale parser-component scope comment (#18147)

2026-08-12 17:58:05 +08:00

pdf_vision_dispatch_cgo.go

Align Go parser backends and PDF pipeline with Python (#16676)

2026-07-06 19:50:54 +08:00

pdf_vision_dispatch_nocgo.go

Align Go parser backends and PDF pipeline with Python (#16676)

2026-07-06 19:50:54 +08:00

pdf_vision_dispatch_test.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

pdf_vision_dispatch.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

slice3_integration_test.go

Go: add context, part5 (#17392)

2026-07-27 10:20:16 +08:00

slice3_test.go

Refactor: refactor dataflow_service.go and guard nats message re-delivery (#16826)

2026-07-13 11:08:04 +08:00

ssrf_test_helper_test.go

Go: fix SSRF (#17641)

2026-07-31 19:15:38 +08:00

tokenizer_nonpersist_test.go

Feat(ingestion): add canvas pipeline debug (dry-run) mode with View result log (#17538)

2026-07-31 13:10:08 +08:00

tokenizer_test.go

Go knowledge compiler with scheduler-driven dataset compilation (#17913)

2026-08-06 15:54:00 +08:00

tokenizer_unit_test.go

Fix(tokenizer): pin alignment guards (#18011)

2026-08-11 10:09:07 +08:00

tokenizer.go

Fix(tokenizer): pin alignment guards (#18011)

2026-08-11 10:09:07 +08:00

vision_language_test.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

vision_language.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00