Powered by

# Benchmark Conversational Agents

# Manual Setup

Manually entering the Input and expected output, useful in cases where a smaller number of inputs need to be tested

  1. Add a field, which will add a row
  2. Enter the 'Input'
  3. Provide the 'Expected Output' (ideal response) manually
  4. Optional: you can Add files as context for your input by clicking on the 'Add Files' icon

Adding Files as Context
To add files as context to your input,

  1. Click on 'Add Files', Add Files window will appear
  2. You can upload the files here directly by drag and drop or by browsing through the system to upload
  3. You can additionally click on the Documnet Library icon to select files from the library and add them as context. All the uploaded files will appear inside the ‘Available Files’ Tab
  4. You can re use the files already uploaded by making use of this tab
  5. A file added to any row will be retained in the subsequent rows as a context for the conversation. For example, File A is added to row 1 will be added automatically to the subsequent rows below Row 1, unless explicitly deleted by you. If the File A is then deleted from row 1, it will automatically be deleted from the subsequent rows below it to remove it from the context of the conversation
  6. A total of 10 files can be added as context to one particular row

# Bulk Setup

Importing JSON files that contain the Input and Expected output pairs, useful in cases where a large number of queries need to be tested

  1. Click on Import
  2. Download the ‘Document Template’ ( illustrates the JSON structure which is supported by the system)
  3. Prepare the JSON file according to the template
  4. Upload the file by dragging and dropping or browsing through the system
  5. Click on submit

In case you need to add multiple files as context during bulk import, you need to add the “doc id” and “doc name” for each file to enable the system to add that as a context in the row.

  1. Click on the documents tab ( placed alongside the import button )
  2. The Documents dialog box will appear, and you can directly import files here
  3. After the import is complete, an option to download the file list will appear
  4. Click on the ‘Download file list’ button
  5. A CSV file would be downloaded, this file would contain the ‘doc id’ and ‘doc name’ for each file uploaded, to reference within the JSON import file

OR

  1. The Documents dialog box will appear, and you can opt for the option to ‘Select files from Doc Library’
  2. Doc Library will open
  3. You can select the folder and then select the files for which you want to download the file list
  4. You can also import additional files into the existing folders to update the library and then download the document list