Question
You have a Microsoft Foundry project that contains an internal Q&A agent.
Users report the following issues when they ask the agent questions:
- An increase in the following response: "No relevant information found"
- Periodic HTTP 429 rate limit exceeded errors during peak hours
You need to identify whether each issue is caused by model unavailability, resource limits, or inference failures.
What should you do? To answer, select the appropriate options in the answer area.
NOTE: Each correct selection is worth one point.
Explanation
Metrics to enable: Model Availability Rate and Provisioned Utilization separate the first two causes. Model Availability Rate is calculated from server errors (HTTP 500 and above), so it reveals model unavailability, and Provisioned Utilization shows when consumption reaches 100%, the point at which calls are throttled with error 429, so it reveals resource limits. Cache match rate, requests filtered to status 200, and latency with token totals cannot distinguish these causes, and filtering to status 200 would hide the failures altogether.
Diagnostic log to collect: RequestResponse records the individual requests and their outcomes, which lets you investigate inference failures call by call, including calls that succeed at the HTTP level but return an unhelpful answer. AllMetrics is a metrics export rather than a request log, and audit and trace do not record the per-request results needed here.
