unclecode c0912f7234 feat: add avoid_ads/avoid_css resource filtering and pool release lifecycle ...

Add opt-in BrowserConfig flags (avoid_ads, avoid_css) for blocking ad/tracker
domains and CSS resources at the browser context level. Refactor crawler pool
with release_crawler() and active_requests tracking to prevent janitor from
closing browsers with in-flight requests. Add proper finally blocks to all
Docker API/server handlers. Update docs for new config options.

Inspired by #1689.

2026-02-25 07:12:28 +00:00

..

test_resource_filtering_config.py

feat: add avoid_ads/avoid_css resource filtering and pool release lifecycle

2026-02-25 07:12:28 +00:00

test_sitemap_namespace_parsing.py

#1559 :Add tests for sitemap parsing and URL normalization in AsyncUrlSeeder

2025-11-10 14:15:54 +08:00