英文:
OpenAi api 429 rate limit error without reaching rate limit
问题
有时候我会在没有超过速率限制的情况下收到速率限制错误。我正在使用付费API上的文本完成终端点，该终端点的速率限制为每分钟3,000个请求。我最多每分钟使用3-4个请求。
有时我会从API收到以下错误：
- 状态代码：
429（请求过多） - OpenAI错误类型：
server_error - OpenAI错误消息：
该模型目前正在处理其他请求，您可以重试您的请求，或者如果错误持续存在，请通过我们的帮助中心联系我们。
OpenAI文档说明，429错误表示您已超过速率限制，而显然我没有。
https://help.openai.com/en/articles/6891829-error-code-429-rate-limit-reached-for-requests
奇怪的是，OpenAI的错误消息没有说明这一点。它给出了我通常从503错误（服务不可用）中收到的响应。
我很想听听对此的一些想法，任何理论，或者是否有其他人也遇到了这个问题。
英文:
On occasion I'm getting a rate limit error without being over my rate limit. I'm using the text completions endpoint on the paid api which has a rate limit of 3,000 requests per minute. I am using at most 3-4 requests per minute.
Sometimes I will get the following error from the api:
- Status Code:
429(Too Many Requests) - Open Ai error type:
server_error - Open Ai error message:
That model is currently overloaded with other
requests. You can retry your request, or contact us through our help
center at help.openai.com if the error persists.
Open ai documentation states that a 429 error indicates that you have exceeded your rate limit which clearly I have not.
https://help.openai.com/en/articles/6891829-error-code-429-rate-limit-reached-for-requests
The weird thing is the open ai error message is not stating that. It is giving the response I usually get from a 503 error (service unavailable).
I'd love to hear some thoughts on this, any theories, or if anyone else has been experiencing this.
答案1
得分: 2
这个错误表明OpenAI服务器收到了来自所有用户的过多请求，他们的服务器已经达到了无法为您的请求提供服务的容量。目前这相当常见。
希望他们会尽快升级他们的服务器。不太清楚为什么这是一个大问题，因为他们在Azure上运行，应该能够根据需求的增加进行扩展。也许他们只是在试图降低成本。
英文:
This error indicates the OpenAI servers have too many requests from all users and their servers have reached their capacity to service your request. It's pretty common at the moment.
Hopefully they will upgrade their servers soon. Not really sure why it is a big problem since they run on Azure and should be able to scale based on ramped up demand. Maybe they are just trying to minimise costs.
答案2
得分: 1
我在OpenAI社区论坛上看到了一些类似的消息。我建议查看我们提供的错误代码指南，其中包含缓解这些错误的建议。总的来说，可能是模型本身出现故障，与您的速率限制无关：https://platform.openai.com/docs/guides/error-codes
英文:
I have seen a few message on the OpenAI community forum with similar messages. I suggest checking out the error code guide we have with suggestion to mitigate these errors, in general though, it's possible the model itself was down and has nothing to do with your rate limit: https://platform.openai.com/docs/guides/error-codes
答案3
得分: -1
免费试用版每分钟允许您进行 3 次请求。3 RPM
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论