jay77721 86b6f64abb fix(ingestion): fit extractor and tagger prompts to model context (#18095) ...

Trim Extractor call prompts and the automatic tagger prompt to the chat model's context window (`content_length`) before sending, so oversized chunks or tag files are trimmed instead of rejected by the provider with a context-length error.

2026-08-12 15:45:01 +08:00

..

chunker

Test(chunker): add golden parity harness, fixtures, and live Go<->Python tool (#17735)

2026-08-11 17:46:34 +08:00

globals

Port PR14140 and PR16881 to GO (#17102)

2026-07-21 17:46:23 +08:00

knowledge_compiler

feat: wiki incremental Mode A/B with durable rewrite barrier (#18122)

2026-08-11 22:10:49 +08:00

schema

Go: fix context and warnings (#18097)

2026-08-11 16:18:49 +08:00

dispatch_model.go

Go: introduce content_length and max_output (#17807)

2026-08-04 19:08:31 +08:00

document_storage.go

Go: add context to storage (#17690)

2026-08-03 15:08:21 +08:00

docx_vision_dispatch_test.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

docx_vision_dispatch.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

extractor_tag_test.go

fix(ingestion): fit extractor and tagger prompts to model context (#18095)

2026-08-12 15:45:01 +08:00

extractor_tag.go

fix(ingestion): fit extractor and tagger prompts to model context (#18095)

2026-08-12 15:45:01 +08:00

extractor_test.go

fix(ingestion): fit extractor and tagger prompts to model context (#18095)

2026-08-12 15:45:01 +08:00

extractor.go

fix(ingestion): fit extractor and tagger prompts to model context (#18095)

2026-08-12 15:45:01 +08:00

file_test.go

Go: add context to storage (#17690)

2026-08-03 15:08:21 +08:00

file.go

Go: fix warnings (#17738)

2026-08-03 21:30:01 +08:00

idempotency.go

Align Go ingestion boundaries with Python (#16647)

2026-07-05 20:43:52 +08:00

image_uploader.go

Go: add context to storage (#17690)

2026-08-03 15:08:21 +08:00

markdown_vision_dispatch.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

media_dispatch_test.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

media_dispatch.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

parser_check_test.go

Go: fix warnings (#17738)

2026-08-03 21:30:01 +08:00

parser_dispatch_pdf_vision_cgo_test.go

Go: add context, part12 (#17435)

2026-07-27 19:30:41 +08:00

parser_dispatch_test.go

Go: fix context and warnings (#18097)

2026-08-11 16:18:49 +08:00

parser_dispatch.go

Go: fix context and warnings (#18097)

2026-08-11 16:18:49 +08:00

parser_test.go

Go: add context to storage (#17690)

2026-08-03 15:08:21 +08:00

parser.go

Go: fix context and warnings (#18097)

2026-08-11 16:18:49 +08:00

pdf_vision_dispatch_cgo.go

Align Go parser backends and PDF pipeline with Python (#16676)

2026-07-06 19:50:54 +08:00

pdf_vision_dispatch_nocgo.go

Align Go parser backends and PDF pipeline with Python (#16676)

2026-07-06 19:50:54 +08:00

pdf_vision_dispatch_test.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

pdf_vision_dispatch.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

slice3_integration_test.go

Go: add context, part5 (#17392)

2026-07-27 10:20:16 +08:00

slice3_test.go

Refactor: refactor dataflow_service.go and guard nats message re-delivery (#16826)

2026-07-13 11:08:04 +08:00

ssrf_test_helper_test.go

Go: fix SSRF (#17641)

2026-07-31 19:15:38 +08:00

tokenizer_nonpersist_test.go

Feat(ingestion): add canvas pipeline debug (dry-run) mode with View result log (#17538)

2026-07-31 13:10:08 +08:00

tokenizer_test.go

Go knowledge compiler with scheduler-driven dataset compilation (#17913)

2026-08-06 15:54:00 +08:00

tokenizer_unit_test.go

Fix(tokenizer): pin alignment guards (#18011)

2026-08-11 10:09:07 +08:00

tokenizer.go

Fix(tokenizer): pin alignment guards (#18011)

2026-08-11 10:09:07 +08:00

vision_language_test.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

vision_language.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00