Does GitHub have any plans for improvement on rate limits while using anthropic models.

[Raj-Koneru]

Select Topic Area

Question

Body

Our teams have encountered rate limits when using anthropic models during our regular development activities, which can occur when providers are experiencing high loads. Although the rate limits typically resolve after a few minutes, they can sometimes significantly disrupt our workflows. Hence interested to understand if GitHub has any plans for improvement on rate limits.

[meeran-jeelani]

Rate limits for third-party models (including Anthropic) are primarily enforced by the model provider and can vary based on current load, usage tier, and capacity. GitHub typically applies provider-recommended limits to ensure platform stability. While temporary spikes can cause short-term throttling, improvements usually depend on upstream provider capacity and GitHub’s internal optimizations. For now, implementing client-side retries, backoff strategies, and usage smoothing is the recommended approach.