I Installed XWiki with LLM, I want to limit it only search internal doc, but it always search external, how to fix?

Help / Discuss
1

I Installed XWiki with extension LLM Application 0.7.2, I created a few sample docs, and try to use LLM Application to search something, I selected the llm model qwen2 from drop-down list (the gpt-4oxxx is not accessialbe for my env), I search some keywords and want the answer only from my internal docs, but it always search external (thru qwen2?), how to fix?

git clone GitHub - xwiki-contrib/ai-llm: AI features using a LLM (Large Language Model) · GitHub

cd ai-llm/docker/16/postgres-tomcat/

docker compose up -d

docker ps

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES

52dab57dbeb8 xwikicontrib/ai-llm:0.6.2-16.6.0-postgres-tomcat “docker-entrypoint.s…” 4 days ago Up About an hour 0.0.0.0:8080->8080/tcp, [::]:8080->8080/tcp postgres-tomcat-web-1

915e0919b8cb postgres:16 “docker-entrypoint.s…” 4 days ago Up About an hour 5432/tcp xwiki-postgres-db

f463d4cdeb9a ollama/ollama “/bin/sh -c 'ollama …” 4 days ago Up About an hour 0.0.0.0:11434->11434/tcp, [::]:11434->11434/tcp ollama

2

any friend can help? thanks thanks thanks…

3

There is no external search in XWiki. You might be misunderstanding how LLMs work, it is basically impossible to prevent an LLM from using the knowledge it has. You can try tweaking the context prompt in the model configuration to explicitly instruct the model to base its answer only on the provided context but even then the model might still add (possibly made-up) facts that aren’t in the context.

4

Hi Michael,

Nice to talk with you; the problem is, no matter what i do, it NEVER refer to the internal docs’ content;

do you have a step by step instruction or article for me to follow, i really love the XWiki architecture…

Thanks & Regards,

Martin.