#
FAQ & Troubleshooting
#
I want to ensure that no agent uses GPT-4 due to cost concerns. Can I enforce this at the platform level?
Yes, as a tenant admin, you can disable GPT-4 for all workspaces, ensuring agents can’t access it during creation or benchmarking.
#
Our compliance team wants to audit how an agent responded to a specific customer query. Is that possible?
Yes. Under the Governance module, navigate to the particular agent you want to check this for. Inside the Agent monitoring dashboard, navigate to the Messages tab, and search for that query. You can now view the exact input/output payload. This includes the input and the agent output along with the traces, providing full transparency for audit purposes.
#
We changed the prompt and model of an agent and want to verify that it didn’t degrade performance. How can governance help?
Use Benchmarking + Governance Transaction Logs. Compare pre-change and post-change agent transactions using version-level comparisons and benchmark metrics to verify accuracy, latency, and cost impact.
#
I need to monitor how many tokens are being consumed per agent per week. Where can I find that?
Under Agent Monitoring, you can view token usage trends, cost-per-agent, and even drill down to per-transaction token counts. Use these views to track consumption and optimize model configurations.
#
Can we restrict certain agents/Knowledge bases from being visible or modifiable by specific teams?
Yes, as the creator of the Agent/Knowledge base, you can select the agent visibility to private via the Expert Agent Studio to restrict the visibility of agents to only yourself. This helps enforce privacy for sensitive agents. You can also set the visibility of a particular Knowledge base to private via the Knowledge Garden Module to restrict the visibility to only yourself. This helps enforce privacy for sensitive documents.
#
I saw an unexpected spike in model usage yesterday. How can I find out what happened?
Navigate to the Governance Module, and you can sort the transactions to view the agents having a high number of transactions. To check the model usage for a specific agent, you can click on the Agent, and the Agent Monitoring page will open, which will provide you with an overview of the model usage as well as the transaction-level logs.