jay77721 2a1a93ed3a refactor(extractor): unify 5-in-1 modular schema across dataset and pipeline, drop legacy field_name and custom prompt (#18432) ...

Refactor the Extractor component into a pure, unified **5-in-1 modular extraction engine** across both Dataset (`knowledgebase.parser_config`) and Pipeline (Canvas DSL).

2026-08-19 15:02:46 +08:00

..

chunker

Fix ingestion pipeline child delimiter extra newline (#18490)

2026-08-19 13:47:09 +08:00

globals

Port PR14140 and PR16881 to GO (#17102)

2026-07-21 17:46:23 +08:00

knowledge_compiler

feat: improve Go wiki compilation (#18479)

2026-08-19 11:41:20 +08:00

schema

refactor(extractor): unify 5-in-1 modular schema across dataset and pipeline, drop legacy field_name and custom prompt (#18432)

2026-08-19 15:02:46 +08:00

dispatch_model.go

Go: introduce content_length and max_output (#17807)

2026-08-04 19:08:31 +08:00

document_storage.go

Go: add context to storage (#17690)

2026-08-03 15:08:21 +08:00

docx_vision_dispatch_test.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

docx_vision_dispatch.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

extractor_tag_test.go

refactor(extractor): unify 5-in-1 modular schema across dataset and pipeline, drop legacy field_name and custom prompt (#18432)

2026-08-19 15:02:46 +08:00

extractor_tag.go

refactor(extractor): unify 5-in-1 modular schema across dataset and pipeline, drop legacy field_name and custom prompt (#18432)

2026-08-19 15:02:46 +08:00

extractor_test.go

refactor(extractor): unify 5-in-1 modular schema across dataset and pipeline, drop legacy field_name and custom prompt (#18432)

2026-08-19 15:02:46 +08:00

extractor.go

refactor(extractor): unify 5-in-1 modular schema across dataset and pipeline, drop legacy field_name and custom prompt (#18432)

2026-08-19 15:02:46 +08:00

file_test.go

Go: add context to storage (#17690)

2026-08-03 15:08:21 +08:00

file.go

Go: fix warnings (#17738)

2026-08-03 21:30:01 +08:00

idempotency.go

Align Go ingestion boundaries with Python (#16647)

2026-07-05 20:43:52 +08:00

image_uploader.go

Go: add context to storage (#17690)

2026-08-03 15:08:21 +08:00

markdown_vision_dispatch.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

media_dispatch_test.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

media_dispatch.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

parser_check_test.go

Go: fix warnings (#17738)

2026-08-03 21:30:01 +08:00

parser_dispatch_pdf_vision_cgo_test.go

Go: add context, part12 (#17435)

2026-07-27 19:30:41 +08:00

parser_dispatch_test.go

Go: refactor embed and rerank interface (#18240)

2026-08-13 22:14:23 +08:00

parser_dispatch.go

Go: fix context and warnings (#18097)

2026-08-11 16:18:49 +08:00

parser_test.go

Go: add context to storage (#17690)

2026-08-03 15:08:21 +08:00

parser.go

docs(ingestion): correct stale parser-component scope comment (#18147)

2026-08-12 17:58:05 +08:00

pdf_vision_dispatch_cgo.go

Align Go parser backends and PDF pipeline with Python (#16676)

2026-07-06 19:50:54 +08:00

pdf_vision_dispatch_nocgo.go

Align Go parser backends and PDF pipeline with Python (#16676)

2026-07-06 19:50:54 +08:00

pdf_vision_dispatch_test.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

pdf_vision_dispatch.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

slice3_integration_test.go

Go: add context, part5 (#17392)

2026-07-27 10:20:16 +08:00

ssrf_test_helper_test.go

Go: fix SSRF (#17641)

2026-07-31 19:15:38 +08:00

tokenizer_nonpersist_test.go

Feat(ingestion): add canvas pipeline debug (dry-run) mode with View result log (#17538)

2026-07-31 13:10:08 +08:00

tokenizer_test.go

Go knowledge compiler with scheduler-driven dataset compilation (#17913)

2026-08-06 15:54:00 +08:00

tokenizer_unit_test.go

Fix(tokenizer): pin alignment guards (#18011)

2026-08-11 10:09:07 +08:00

tokenizer.go

Fix(tokenizer): pin alignment guards (#18011)

2026-08-11 10:09:07 +08:00

vision_language_test.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00

vision_language.go

fix: honor dataset language in Go vision dispatch (#17892)

2026-08-11 22:18:04 +08:00