7 Commits

Author	SHA1	Message	Date
jay77721	2022efa9fc	refactor(ingestion): unify auto-metadata on modular metadata and hard-delete legacy flats (BuiltInMetadata carried, not LLM) (#18511)	2026-08-20 15:35:51 +08:00
jay77721	2a1a93ed3a	refactor(extractor): unify 5-in-1 modular schema across dataset and pipeline, drop legacy field_name and custom prompt (#18432) ... Refactor the Extractor component into a pure, unified **5-in-1 modular extraction engine** across both Dataset (`knowledgebase.parser_config`) and Pipeline (Canvas DSL).	2026-08-19 15:02:46 +08:00
jay77721	c71991bb7a	feat(ingestion,web): modularize extractor configuration with sub-tabs, independent prompts, and metadata integration (#18383) ... This PR modularizes the **Extractor** component configuration with dedicated feature subtabs, adds independent system prompt configuration, fixes multi-node execution determinism and parameter persistence across save and page refresh, and ensures backward compatibility with legacy flat fields.	2026-08-18 11:38:52 +08:00
Zhichang Yu	90f46b0b4d	Go port: doc-level metadata extraction and knowledge compiler (#17536) ... Ports doc-level auto-metadata extraction to Go and adds the knowledge_compiler component with scheduler/routing. Fixes Extractor metadata injection type assertion and enable_metadata default-on.	2026-07-29 21:06:48 +08:00
qinling0210	edeb47cd54	Implement Tagger in Extractor component in GO (#17128) ... ### Summary Implement Tagger in Extractor component in GO	2026-07-21 17:52:06 +08:00
qinling0210	995e405e8c	Support pipeline DSL modification through dataset configuration (backend) (#16991) ... …end) ### Summary Support pipeline DSL modification through dataset configuration (backend) Key modification: knowledgebase.parser_config --------- Co-authored-by: yzc <yuzhichang@gmail.com>	2026-07-17 14:40:09 +08:00
Zhichang Yu	014c3f634f	Align Go ingestion boundaries with Python (#16647) ... Moves doc_id blob resolution into Parser, tightens chunker/tokenizer to Python output_format semantics, updates extractor list handling, and fixes real-template integration tests.	2026-07-05 20:43:52 +08:00