Skip to main content

Index knowledge base

Before using the knowledge base, it needs to be indexed. Indexing the knowledge base in Tovie Data Agent includes the following steps:

  1. Preparing the uploaded data.

  2. Chunking: dividing data into small fragments (chunks).

  3. Vectorisation: converting text fragments into vectors.

    When preparing the response to a user query, Tovie Data Agent compares the query vector with the chunk vectors.

You can change indexing settings in the Project settings → Indexing section. Learn more about these settings.

info
  • To start knowledge base indexing, you need at least the KHUB_EDITOR role.
  • To edit project settings, you need the KHUB_OWNER or KHUB_ADMIN role.

To learn more about how Tovie Data Agent works, see the Main stages of Tovie Data Agent operation section.

How to index knowledge base​

Click Index at the top of any page.

After that, the knowledge base indexing begins, which may take some time depending on the data volume. You can leave the page — this will not affect the indexing.

caution

All the files and web pages uploaded are subject to index. You cannot select specific sources for indexing.

If you want to index a portion of the data, remove unnecessary sources before indexing.

Once indexing is complete, go to the Test chat section to test your knowledge base.

How to re-index knowledge base​

If you have uploaded new data or changed indexing settings, re-index the knowledge base. Re-indexing is similar to indexing.

Note that if the settings are changed, the previous index will be deleted. Specifically, links to images in previous responses will no longer work. If the channel, such as a messenger, doesn’t save images on its side, they will disappear from the chat.