mirror of
https://github.com/unclecode/crawl4ai.git
synced 2026-06-12 00:38:00 +00:00
This commit adds a delay of 5 seconds after fetching the URL in the `after_get_url` hook of the crawler hooks. The delay is implemented using the `time.sleep()` function. This change ensures that the entire page is fetched before proceeding with further actions.