bitloi 01a5598aa5 Fix: markdown fenced code block extraction (#15630) ...

### What problem does this PR solve?

Markdown extraction currently applies custom delimiters before
respecting fenced code blocks. When a delimiter such as a newline is
configured, fenced code can be split into separate chunks, and longer
outer fences can be closed incorrectly by shorter nested fences.

This PR keeps the fix intentionally narrow for the Markdown chunking
discussion in #15482:

- preserve fenced code blocks when delimiter-based extraction is used
- support both backtick and tilde fences
- respect fence length so longer outer fences can contain shorter inner
fences
- keep delimiter splitting unchanged outside fenced blocks

Refs #15482

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

### Testing

- `ruff check deepdoc/parser/markdown_parser.py
test/unit_test/deepdoc/parser/test_markdown_parser.py`
- `python3 run_tests.py -t
test/unit_test/deepdoc/parser/test_markdown_parser.py`

2026-06-04 13:33:46 +08:00

..

test_epub_parser.py

Feat: support epub parsing (#13650)

2026-03-17 20:14:06 +08:00

test_markdown_parser.py

Fix: markdown fenced code block extraction (#15630)

2026-06-04 13:33:46 +08:00

test_mineru_parser.py

fix(mineru): skip page chrome blocks to prevent duplicate chunks (#15387)

2026-06-01 20:15:04 +08:00

test_opendataloader_parser.py

Feat: add OpenDataLoader PDF parser backend (#14058) (#14097)

2026-04-25 00:33:02 +08:00

test_pdf_garbled_detection.py

fix: detect and fallback garbled PDF text to OCR (#13366) (#13404)

2026-03-10 11:20:31 +08:00