Question
You have a Microsoft Foundry project that has a generative AI model deployment.
You need to ensure that responses generated by the model minimize costs and remain within a defined length.
Which parameter should you configure?
- A. Top P
- B. Temperature
- C. Max Completion Tokens Correct
- D. Model version settings
Explanation
Max Completion Tokens caps the number of tokens a model can generate in its response, directly limiting output length and controlling cost, since billing is based on tokens produced. Top P and Temperature only influence the randomness and diversity of word selection, not how long the response is. Model version settings determine which build of the model runs and do not constrain response length.
