[GH-ISSUE #147] [Feature Request] Add configurable pause timer between file downloads to avoid rate limits #100

New issue

Open

opened 2026-10-13 19:49:56 +00:00 by bsakaguchi · 3 comments

bsakaguchi commented

2026-10-13 19:49:56 +00:00

Owner

Originally created by @JakeyE17 on GitHub (Aug 30, 2026).
Original GitHub issue: https://github.com/Yuvi9587/Kemono-Downloader/issues/147

I've noticed it's occasionally possible to hit "Too Many Requests" errors on Pawchive when downloading lots of small files in quick succession, probably something to do with Cloudflare preventing the site from becoming too unstable. It's possible to trigger this even when only using one download thread. Would it be possible to add a feature in the settings to set a wait time between each individual file download within a post to avoid triggering this, as it makes posts with many small files and/or artists with many posts that contain only a couple of small files per post frustrating to download when it occurs. I can already see that there is a 10 second safety pause timer that the software triggers at times when downloading entire artist pages (what is the actual trigger for this?), so something like that but for every file individual file within a download with the option to change it to the user's preferred time in seconds and having it save in-between sessions/jobs.

Thanks for all your hard work!

Originally created by @JakeyE17 on GitHub (Aug 30, 2026). Original GitHub issue: https://github.com/Yuvi9587/Kemono-Downloader/issues/147 I've noticed it's occasionally possible to hit "Too Many Requests" errors on Pawchive when downloading lots of small files in quick succession, probably something to do with Cloudflare preventing the site from becoming too unstable. It's possible to trigger this even when only using one download thread. Would it be possible to add a feature in the settings to set a wait time between each individual file download within a post to avoid triggering this, as it makes posts with many small files and/or artists with many posts that contain only a couple of small files per post frustrating to download when it occurs. I can already see that there is a 10 second safety pause timer that the software triggers at times when downloading entire artist pages (what is the actual trigger for this?), so something like that but for every file individual file within a download with the option to change it to the user's preferred time in seconds and having it save in-between sessions/jobs. Thanks for all your hard work!

bsakaguchi commented

2026-10-13 19:49:58 +00:00

Author

Owner

@Yuvi9587 commented on GitHub (Aug 30, 2026):

just use 2 threads and it will not give that if you use to many threads it will give error "Too Many Requests"

@Yuvi9587 commented on GitHub (Aug 30, 2026): just use 2 threads and it will not give that if you use to many threads it will give error "Too Many Requests"

bsakaguchi commented

2026-10-13 19:49:58 +00:00

Author

Owner

@JakeyE17 commented on GitHub (Aug 30, 2026):

I was able to trigger it yesterday while only using 1 thread and having the multithreading option disabled. I've only used 1 thread since I hit rate limit issues a while back and it worked until now. Maybe they have tightened the rate limit, or maybe it only occurs once the server(s) are under heavy load? Maybe you could have the software automatically trigger a safety pause if the server returns a 429 Too Many Requests error?

@JakeyE17 commented on GitHub (Aug 30, 2026): I was able to trigger it yesterday while only using 1 thread and having the multithreading option disabled. I've only used 1 thread since I hit rate limit issues a while back and it worked until now. Maybe they have tightened the rate limit, or maybe it only occurs once the server(s) are under heavy load? Maybe you could have the software automatically trigger a safety pause if the server returns a 429 Too Many Requests error?

bsakaguchi commented

2026-10-13 19:49:59 +00:00

Author

Owner

@Yuvi9587 commented on GitHub (Aug 31, 2026):

https://github.com/Yuvi9587/Kemono-Downloader/releases/tag/v9.0.7

@Yuvi9587 commented on GitHub (Aug 31, 2026): https://github.com/Yuvi9587/Kemono-Downloader/releases/tag/v9.0.7