crawl4ai

mirror of https://github.com/unclecode/crawl4ai.git synced 2026-06-10 15:58:15 +00:00

Files

unclecode c0912f7234 feat: add avoid_ads/avoid_css resource filtering and pool release lifecycle

Add opt-in BrowserConfig flags (avoid_ads, avoid_css) for blocking ad/tracker
domains and CSS resources at the browser context level. Refactor crawler pool
with release_crawler() and active_requests tracking to prevent janitor from
closing browsers with in-flight requests. Add proper finally blocks to all
Docker API/server handlers. Update docs for new config options.

Inspired by #1689.

2026-02-25 07:12:28 +00:00

simple_api_test.py

fix: Check for raw: and raw:// URLs before auto-appending https:// prefix

2025-08-11 22:10:53 +05:30

test_config_object.py

feat(config): enhance serialization and add deep crawling exports

2025-02-13 21:45:19 +08:00

test_docker.py

fix: Check for raw: and raw:// URLs before auto-appending https:// prefix

2025-08-11 22:10:53 +05:30

test_dockerclient.py

feat(docker): add JWT authentication and improve server architecture