UncleCode 768aa06ceb feat(crawler): Enhance stealth and flexibility, improve error handling ...

- Implement playwright_stealth for better bot detection avoidance
- Add user simulation and navigator override options
- Improve iframe processing and browser selection
- Enhance error reporting and debugging capabilities
- Optimize image processing and parallel crawling
- Add new example for user simulation feature
- Added support for including links in Markdown content, by definin g a new flag `include_links_on_markdown` in `crawl` method.

2024-10-17 21:37:48 +08:00

..

assets

- User agent

2024-06-08 17:59:42 +08:00

tmp

Push async version last changes for merge to main branch

2024-09-24 20:52:08 +08:00

async_webcrawler_multiple_urls_example.py

Enhance AsyncWebCrawler with smart waiting and screenshot capabilities

2024-10-02 17:34:56 +08:00

chainlit.md

Add research assistant example using Chainlit

2024-06-04 22:43:09 +08:00

crawlai_vs_firecrawl.py

chore: Update crawl4ai package with AsyncWebCrawler and JsonCssExtractionStrategy

2024-09-03 23:32:27 +08:00

language_support_example.py

Enhance AsyncWebCrawler with smart waiting and screenshot capabilities

2024-10-02 17:34:56 +08:00

llm_extraction_openai_pricing.py

refactor: Update image description minimum word threshold in get_content_of_website_optimized

2024-08-02 15:55:32 +08:00

quickstart_async.py

feat(crawler): Enhance stealth and flexibility, improve error handling

2024-10-17 21:37:48 +08:00

quickstart_sync.py

Create series of quickstart files.

2024-09-04 15:33:24 +08:00

quickstart.ipynb

Update quickstart_async.py to improve performance and add Firecrawl simulation

2024-09-28 00:11:39 +08:00

research_assistant.py

Push async version last changes for merge to main branch

2024-09-24 20:52:08 +08:00

rest_call.py

- User agent

2024-06-08 17:59:42 +08:00

sample_ecommerce.html

Push async version last changes for merge to main branch

2024-09-24 20:52:08 +08:00

summarize_page.py

## [v0.2.74] - 2024-07-08

2024-07-08 16:33:25 +08:00