Jack 1aa4e3c1f3 refactor(chunker): converge delimiter_mode to {delimiter, one}, drop token_size (#17979) ...

Converge `TokenChunker.delimiter_mode` from three values (`token_size`,
`delimiter`, `one`) to two (`delimiter`, `one`). The unified `delimiter`
mode now carries the old `token_size` semantics: when no active
(backtick) delimiter is present, text/JSON chunks are merged up to
`chunk_token_size`; when a backtick delimiter is present, the text is
split by it and not merged. `one` continues to be handled by the
separate `OneChunker`.

2026-08-07 16:11:42 +08:00

..

chunker

refactor(chunker): converge delimiter_mode to {delimiter, one}, drop token_size (#17979)

2026-08-07 16:11:42 +08:00

compiler

refa: simplify RAPTOR tree clustering and configuration (#17614)

2026-08-03 17:46:50 +08:00

extractor

Feat: add wiki folder (#16749)

2026-07-08 20:08:14 +08:00

parser

Revert "feat: Go knowledge compiler with scheduler-driven dataset compilation" (#17897)

2026-08-05 21:50:28 +08:00

tests

refactor(chunker): converge delimiter_mode to {delimiter, one}, drop token_size (#17979)

2026-08-07 16:11:42 +08:00

tokenizer

refa: resolve tenant model refs consistently (#16744)

2026-07-09 14:02:08 +08:00

__init__.py

Feat: refine dataflow and initialize dataflow app (#9952)

2025-09-05 18:50:46 +08:00

base.py

Refactor: reformat all code for lefthook using ruff and gofmt (#16585)

2026-07-03 12:53:39 +08:00

file.py

Refactor: reformat all code for lefthook using ruff and gofmt (#16585)

2026-07-03 12:53:39 +08:00

pipeline.py

fix: optimize dataflow indexing and logs (#17737)

2026-08-03 19:15:44 +08:00