Agent Trace

When leveraging AI, you need to be aware that AI can and will make mistakes. Furthermore, you may be building a complex system, where AI makes decisions on, for example, what tools to use in which sequence. In every step of this complex system, you introduce the possibility of errors.

To help you understand the failure modes of your AI system, Neptune DXP - Open Edition provides you with:

  • System Logs: internal errors are logged and can be reviewed in the System Logs tool.

  • AI Agent Trace: the AI Agent Trace tool provides detailed logs on every AI invocation.

Use the Agent Trace tool

  1. In the Cockpit, go to the Agent Trace tool.

  2. Select the date range you want to investigate, and select Update.

    If there have been AI invocations during that time range, you see them in a list view. You can also open Analytic to see a visual summary of requests, response times, and proportion of tool calls and success rate of tool calls.

  3. Open a specific log entry by selecting it. You can then review details of the invocation as well as a trace on tools executed by the agent.

Input and output cannot be accessed or viewed in the tool if Hide log content is enabled on the settings of the agent.

Administering the logs

When you set up your AI agent, you can configure the detail level of the logs. You can also go to the Housekeeping tool to configure if/how often AI logs are cleared.

Related topics