Why Can OpenAI API Usage Increase While Request Volume Stays Flat?

Asked yesterday 75 views

0

We haven’t added users or increased the number of API requests, but our OpenAI usage has climbed over the last few days. The application has had a couple of small changes, so I’m wondering whether longer prompts, retries, or a different model setting could account for the difference.

Which usage details are most useful to compare when investigating a rise in API token usage? I’d like to pinpoint what changed before adjusting the budget limit.

0 Answers


Write Your Answer