Advanced settings for Chatbot profiles - Fluid Topics - Latest

It is possible to set the following advanced settings for Chatbot AI profiles:

• The number of semantic search results sent to the LLM.

  The value of this field must be superior to 0, and inferior to 20. By default, the value is 5.

  A higher number of semantic search results can increase the cost of requests, and decrease the speed and quality of answers. For most use cases, use the default value of 5.

• When the reranking option is active, Fluid Topics reranks semantic search results before sending them to the LLM. The value must be smaller or equal to the number of semantic search results.

  Reranking can help with Chatbot relevance. See What is re-ranking?.

• Overwrite default prompts:

  • A Retrieval-augmented generation (RAG) prompt. Asks the user question to the LLM. It must have the {relevant_documents} and {chatbot_instructions} variables.

    {relevant_documents} dynamically contains the relevant documents (gotten through the Clustered semantic search web service), and {chatbot_instructions} is the prompt set before the Advanced settings.

  • A Retrieval-augmented generation (RAG) history prompt. Asks the LLM to transform the user question and the conversation history into a standalone question asked to the LLM.

  See Chatbot architecture for a better understanding of the use of Chatbot prompts and reranking.