Question
You have a Microsoft Foundry project that contains a customer support agent grounded in internal documentation.
After a recent update, users report the following issues:
- Some answers are unsupported by retrieved documents.
- A small number of responses are flagged for policy violations.
You need to evaluate each issue.
Which observability signals should you use for each issue? To answer, drag the appropriate observability signals to the correct issues. Each observability signal may be used once, more than once, or not at all. You may need to drag the split bar between panes or scroll to view content.
NOTE: Each correct selection is worth one point.
Explanation
Groundedness is a RAG-specific quality metric that measures whether a response is supported by the retrieved content, so it fits answers that the documents do not back up. Risk and safety metrics measure safety and security concerns such as harmful or protected content, so they fit responses flagged for policy violations. Latency traces show where time is spent and token analytics show consumption, and neither measures whether an answer is supported or compliant.
