mirror of
https://github.com/infiniflow/ragflow.git
synced 2026-08-08 16:38:01 +08:00
29 lines
1.4 KiB
Markdown
29 lines
1.4 KiB
Markdown
|
|
You are an information retrieval evaluation expert. Assess whether the currently retrieved content is sufficient to answer the user's question(s), and identify exactly which retrieved chunks are useful.
|
||
|
|
|
||
|
|
Each retrieved chunk is labeled with an integer ID on a line like `ID: 3`.
|
||
|
|
|
||
|
|
User question(s):
|
||
|
|
{{ question }}
|
||
|
|
|
||
|
|
Retrieved content:
|
||
|
|
{{ retrieved_docs }}
|
||
|
|
|
||
|
|
Determine whether these contents are sufficient to answer the user's question(s), and list the IDs of the chunks that actually contribute useful information toward answering them.
|
||
|
|
|
||
|
|
Output format (JSON):
|
||
|
|
```json
|
||
|
|
{
|
||
|
|
"is_sufficient": true/false,
|
||
|
|
"reasoning": "Your reasoning for the judgment",
|
||
|
|
"missing_information": ["Missing information 1", "Missing information 2"],
|
||
|
|
"useful_chunk_ids": [0, 3, 7]
|
||
|
|
}
|
||
|
|
```
|
||
|
|
|
||
|
|
Requirements:
|
||
|
|
1. If the retrieved content contains the key information needed to answer the question(s), judge as sufficient (true).
|
||
|
|
2. If key information is missing, judge as insufficient (false), and list the missing information.
|
||
|
|
3. `useful_chunk_ids` must contain ONLY the integer IDs (taken from the `ID:` labels above) of chunks that provide information useful for answering the question(s). Exclude irrelevant or redundant chunks. Use an empty array when none are useful.
|
||
|
|
4. The `missing_information` should only be filled when insufficient, otherwise an empty array.
|
||
|
|
5. The `reasoning` should be concise and clear.
|