Hello there @Roy!
It looks like in this case, a good solution for this could be using pagination.
Here is an article explaining the different things you can do in order to avoid hitting the rate limit.
Hope it helps!
Cheers, Matias