Why Can the OpenAI API Return Different Answers to the Same Prompt?

Asked 2 hours ago 18 views

0

I’m testing the same prompt with the same model, but the wording and sometimes the details change between API calls. I even tried setting the temperature to zero, and the responses still weren’t always identical.

How much can model updates, request settings, tool calls, or other parts of the API setup affect repeatability? I’m trying to work out what to log so I can tell whether the variation is expected or a bug in my integration.

0 Answers


Write Your Answer