Overcoming Throttling Issue by Rate Limiting
GitHub rate limits API requests to 5,000 per hour (or more for Enterprise accounts). The default catalog back-end refreshes data every 100 seconds, which issues an API request for each discovered location.
This means if you have more than ~140 catalog entities, you may get throttled by rate limiting. You would see an error on the UI saying 403 Forbidden. Rate limit exceeded.
The default catalog refresh interval can be updated by adding a config catalogRefreshDelayInSec
. The default value for this config is set to 100 seconds. The lower limit is 100 seconds and the upper limit is 900 seconds. Refer to Backstage Documentation if you need to learn more about the catalog.