zlei6/ragflow
1
0
Fork 0
mirror of https://github.com/infiniflow/ragflow.git synced 2026-08-13 12:23:36 +08:00
Code Issues Packages Projects Releases Wiki Activity
8,241 Commits 5 Branches 107 Tags
5b701f23e58a99a2be3da985c8140aed6454c588
Commit Graph

871 Commits

Author SHA1 Message Date
euvre
fdb6b5fdd2 fix: search files recursively within current folder subtree (#17779) 2026-08-12 14:43:06 +08:00
euvre
a530a3a170 fix: clean up wiki blueprint default instruction text (#17893) 2026-08-12 14:39:36 +08:00
qinling0210
b73aac38f4 Update infinity json_extract_string usage (#18139) 
### Summary

Update infinity json_extract_string usage. 

Example: json_extract_string(chunk_data, '$.name') LIKE '%Alice%'
 2026-08-12 10:59:22 +08:00
buua436
6f50e478e0 fix: exclude disabled documents from dataset structures (#18041) 2026-08-10 17:50:34 +08:00
buua436
c0582b8e18 fix: handle disabled documents in dataset structures (#18033) 2026-08-10 13:52:49 +08:00
Wang Qi
373050c7ca Fix agentic chat not working in chatbot (#18035) 2026-08-10 13:07:15 +08:00
Lynn
7433fbb77b Fix: exclude unauthorized memory/dataset from list results (#18006) 2026-08-10 10:16:56 +08:00
Wang Qi
2fef38f955 Fix answer in think (#17998) 2026-08-07 17:30:14 +08:00
Wang Qi
993b41b7b1 Append attachments content to last message (#17993) 2026-08-07 16:04:19 +08:00
buua436
42329f140d feat: add agent filter counts (#17984) 2026-08-07 15:29:07 +08:00
buua436
48b2d3b914 fix: preserve page index chapter chunk provenance (#17963) 2026-08-07 13:47:04 +08:00
buua436
f77f2bb9ce fix: optimize timeline compilation template (#17972) 2026-08-07 13:31:33 +08:00
buua436
8379165c12 fix: record generated wiki page versions (#17931) 2026-08-06 16:49:50 +08:00
buua436
dced12251a fix: allow recreating deleted template groups (#17915) 2026-08-06 13:24:09 +08:00
Wang Qi
e35956bcc4 Fix attachments not take effect in agentic chat (#17895) 2026-08-06 11:12:22 +08:00
buua436
d16b2556a2 fix: split wiki template instruction and example (#17891) 2026-08-06 09:41:57 +08:00
Jin Hai
cf13082a1a Revert "feat: Go knowledge compiler with scheduler-driven dataset compilation" (#17897) 
Reverts infiniflow/ragflow#17881
 2026-08-05 21:50:28 +08:00
Zhichang Yu
14b943a04a feat: Go knowledge compiler with scheduler-driven dataset compilation (#17881) 
Ports the dataset knowledge compilation (wiki/graph/tree/mindmap) to the
Go scheduler with a status contract, aligns wiki storage/retrieval with
Python, and sizes prompts by content_length.
 2026-08-05 20:00:42 +08:00
chanx
2dfb34f7ab feat(agent-list): support multi-select canvas category filtering (#17843) 2026-08-05 19:32:45 +08:00
buua436
cd6e73bcb5 fix: stream agentic reasoning and answers correctly (#17849) 2026-08-05 15:59:19 +08:00
Lynn
02923bfc46 Fix: display embedding model name in list dataset api response (#17832) 2026-08-05 14:51:07 +08:00
Yingfeng
302e611a43 Fix: throw exception when switching ingestion pipeline (#17833) 
### Summary

Throw exception when switching pipeline :

OperationalError（'Attempting to close database while transaction is open.！）
 2026-08-05 11:44:15 +08:00
deadtrickster
f063cfdb19 fix(api): decrement knowledgebase counters on SDK re-parse / stop-parse (#17236) 2026-08-05 10:28:46 +08:00
EthanZhang
bdcd8aadde feat(chat): add Querit web search provider (#17813) 2026-08-05 09:54:46 +08:00
deadtrickster
197b142cef feat(serenedb): add SereneDB doc-store engine (Go + Python connectors) (#17375) 
## What

Adds [**SereneDB**](https://serenedb.com) as a selectable doc-store
engine on **both** RAGFlow paths:
- the **Go** `DocEngine` (`internal/engine/serenedb`), alongside
Elasticsearch and Infinity;
- the **Python** `DocStoreConnection` (`rag/utils/serenedb_conn.py`) +
`DOC_ENGINE=serenedb` registration.

SereneDB is a PostgreSQL-wire engine (DuckDB execution) whose single
inverted index carries **both** a scored text column (`@@`, BM25) and an
IVF vector column (`<#>`, inner product), so hybrid search is one SQL
statement. The Go engine connects with `database/sql` + `lib/pq`
(already a dependency, no new module); the Python connector uses
psycopg2 (already a dependency).

## Storage model

One table per tenant with `kb_id` as a filter column - the
**Elasticsearch / OceanBase** model, not Infinity's per-dataset tables.
This keeps BM25 statistics (IDF, avgdl) computed over the whole tenant
corpus (global IDF). Both connectors use this identical layout, so they
are storage- and retrieval-compatible: `hybrid` proxy routing and
Python↔Go switching are safe. On the Python side the connector is wired
as OceanBase's plain-SQL sibling (chunk_data JSON metadata, inline chunk
vectors, verbatim ES field names); the ES tokenizer path is unchanged.
Metadata stays one table per tenant (`ragflow_doc_meta_<tenant>`).

The query shapes mirror the Python connector, including the five
empirically-found landmines: the scored dictionary needs `frequency +
norm` (else `BM25()` silently returns 0.0), the `@@` query is the
tokenized query, the scored lexical branch matches one column, vectors
use an L2-normalized shadow column with `ip`/`sq8`, and the similarity
threshold goes directly in the ANN scan's `WHERE`. **Minimum engine
version: SereneDB 26.07.4.**

---------

Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-08-04 14:16:39 +08:00
buua436
3e11914144 fix: normalize legacy parser configuration (#17761) 2026-08-04 13:49:44 +08:00
Wang Qi
ffa168ccca fix: search sessions by id and conversation (#808) (#17764) 
Co-authored-by: buua436 <sz_buua@foxmail.com>
 2026-08-04 11:34:32 +08:00
Wang Qi
d236fc4437 Let agentic rag search honor metadata filter (#17731) 2026-08-04 10:35:21 +08:00
Lynn
11b2dfcfdd Fix: handle llm_setting switch (#17745) 2026-08-04 10:02:14 +08:00
Jin Hai
86021932ae Go: fix warnings (#17738) 
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
 2026-08-03 21:30:01 +08:00
buua436
1d141aff18 fix: optimize dataflow indexing and logs (#17737) 2026-08-03 19:15:44 +08:00
buua436
3e7cfbe052 refa: simplify RAPTOR tree clustering and configuration (#17614) 2026-08-03 17:46:50 +08:00
buua436
8ac047d11a fix: synchronize chat model configuration (#17717) 2026-08-03 16:43:53 +08:00
Kevin Hu
3b4a96d421 Refactor: refine wiki plan procedure. (#17579) 
### Summary

Refine wiki plan procedure.

---------

Co-authored-by: Yingfeng Zhang <yingfeng.zhang@gmail.com>
Co-authored-by: buua436 <sz_buua@foxmail.com>
 2026-08-03 16:03:17 +08:00
Lynn
2e0dda59fc Fix: handle html tags in empty_response (#17657) 2026-08-03 11:14:18 +08:00
buua436
44e13d1cb6 feat: add LLM-guided semantic rechunking for knowledge compilation (#17546) 2026-07-31 13:33:30 +08:00
Wang Qi
0969c04eca Feature: GET /datasets to support ids array (#17606) 2026-07-31 13:23:02 +08:00
Kevin Hu
3f8a3dfcff Feat: Compilation benefit naive rag. (#17555) 
### Summary

Compilation benifit naive rag

---------

Co-authored-by: Yingfeng Zhang <yingfeng.zhang@gmail.com>
 2026-07-30 18:39:01 +08:00
Wang Qi
4592d06a67 Fix deepcopy the chat model (#17560) 2026-07-30 14:29:24 +08:00
Wang Qi
6e0e495929 Fix: upload document might be hung the whole ragflow (#17537) 2026-07-30 13:54:07 +08:00
Kevin Hu
9bb037271e Refact: Rename "artifact_" to "wiki_". (#17553) 2026-07-30 11:06:16 +08:00
Kevin Hu
48a3280eac Refactor: merge dataset scope graph. (#17526) 
### Summary

merge dataset scope graph.

---------

Co-authored-by: Yingfeng Zhang <yingfeng.zhang@gmail.com>
 2026-07-29 18:23:51 +08:00
balibabu
1140db3b8c Fix: The multi-model comparison page cannot output messages. (#17507) 2026-07-29 15:16:40 +08:00
Wang Qi
3297b5c756 Fix: drop and add index for mysql (#17513) 
Drop complile template not used index
 2026-07-29 14:54:20 +08:00
Sbaaoui Idriss
e9637c9f94 fix: list model function for nvidia on python/go not returning current models (#17501) 
### Summary

fix the list model logic for nvidia models
 2026-07-29 13:15:34 +08:00
Lynn
8d1eff6ea2 Fix: resolve model_id to model before judge parse method (#17493) 2026-07-29 09:34:52 +08:00
Jin Hai
7f21a7ba18 Go: add context, part14 (#17446) 
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
 2026-07-28 19:05:59 +08:00
Wang Qi
619b58faef Add {date} replacement to chat (#17430) 2026-07-28 09:49:17 +08:00
buua436
6e1e540f98 fix: persist pipeline tree graph rows (#17400) 2026-07-27 16:40:29 +08:00
euvre
6cc862fc00 Fix: agent list owner filter not applied (#17410) 2026-07-27 13:58:43 +08:00