Commit Graph

Select branches

Hide Pull Requests

0.3.5

0.3.6

0.3.7

0.3.72

0.3.73

0.3.74

0.3.742

0.3.743

0.3.744

0.3.745

0.3.75

0.4.0

0.4.1

0.4.2

2025-JUN-1

add-claude-github-actions-1759553116682

bug/proxy_config

bugfix/arun-many-cdp-managed-browser

claude/fix-update-pyopenssl-security-011CUPexU25DkNvoxfu5ZrnB

claude/implement-webhook-crawl-feature-011CULZY1Jy8N5MUkZqXkRVp

coderabbitai/docstrings/14vTVzYa3bH06l5wYNY9jTghrrj9FxxWL

codex/add-httpx-and-https-http2]-packages

codex/add-memory_wait_timeout-parameter-to-memoryadaptivedispatche

codex/add-use_stemming-parameter-to-bm25contentfiler

codex/add-vnc-streaming-endpoint-to-docker-server

codex/find-and-fix-a-bug

codex/fix-indexerror-in-browser-manager-py-with-use-managed-browse

copilot/modify-page-creation-and-logging

deploy

develop

devin/1748137705-fix-bm25contentfilter-docs

docker-test

docker/add_features

docker/base_config_overrides

docker/fix_sig

docs

docs-llm-strategies-update

docs-proxy-security

extract-media

feat/ahmed_dev

feat/follow-frameset

feat/undetected-browser

feature/agent-oai

feature/async-llm-extaction

feature/c4a-script

feature/configHealthMonitor

feature/content-filter

feature/content-filter-nasrin-1

feature/docker-cluster

feature/docker-hooks

feature/docker-llm-parameters

feature/marketplace-sponsor-logo

feature/nasrin-cli-deep-crawl

feature/scraper

feature/scraping-strategy

feature/telemetry

fix-async-url-seeder-redirect-verification

fix-cors-disable-web-security

fix/adaptive-crawler-llm-config

fix/arun-return-type-1898

fix/async-llm-extraction-arunMany

fix/batch-easy-issues-10

fix/bedrock-provider-prefix

fix/case_senstive_params

fix/cdp

fix/configurable-backoff

fix/deep-crawl-scoring

fix/deep-crawl-scoring-priority

fix/deep-crawl-stream-docker

fix/deep-crawl-streaming-contextvar-1917

fix/deprecated_pydantic

fix/deserialize-schema-type-false-positive

fix/dfs_deep_crawling

fix/docker

fix/docker-filter

fix/docker-jwt

fix/docker-llmEnvFile

fix/exit_with_q

fix/https-reditrect

fix/issue-1748-screenshot-scroll-delay

fix/issue-1776-adaptive-external-filter

fix/json-infinity-serialization

fix/linkPreviewScoring

fix/marketplace

fix/mcp-crawler-config-passthrough

fix/mcp-ensure-ascii-cjk-encoding

fix/n-playwright-stealth

fix/nlp-sentence-chunking-1909

fix/playwright-stealth

fix/preserve-tail-text-1938

fix/proxy_deprecation

fix/rate-limiter-burst-and-headers-1095

fix/relative_url

fix/release-notes-demo-code

fix/request-crawl-stream

fix/sandbox-escape-allowlist-attrs

fix/serialize-proxy-config

fix/sitemap_seeder

fix/timeline-deadlock-shared-lock-1754

fix/viewport_in_managed_browser

format-inline-tags

hooks

image-description

image-filterizer

implement-webhook-crawl-feature-011CULZY1Jy8N5MUkZqXkRVp

integrate-verified-prs

main

main-0.3.7

main-1

main-75

main-img-captionify

main-v0.2.72

merge-pr971

new-release-0.0.2

new-release-0.0.2-no-spacy

next

next-2-batch-crawl

next-JUN

next-MAY

next-alpine-docker

next-browser-farm

patch/generate_schema

pdf_processing

proxy-support

pull-84

release/v0.7.0

release/v0.7.1

release/v0.7.2

release/v0.7.3

release/v0.7.4

release/v0.7.5

release/v0.7.6

release/v0.7.7

release/v0.7.8

release/v0.8.0

release/v0.8.5

release/v0.8.7

release/v0.8.8

release/v0.8.9

run-many-deep-crawling

scraper-uc

scrapper

sponsors/thor_data

ssh-server

staging

unclecode-patch-1

unclecode-patch-2

unclecode-patch-3

unclecode-patch-4

unclecode-patch-5

unclecode-patch-6

unclecode-patch-7

unclecode-patch-8

unclecode/issue157

unclecode/issue167

v0.2.74

v0.2.76

v0.4.24

v0.4.241

v0.4.242

v0.4.243

v0.5.5

vr0.4.244

vr0.4.245

vr0.4.246

vr0.4.267

vr0.4.3b1

vr0.4.3b2

vr0.4.3b3

vr0.5.0.post1

vr0.5.0.post5

#1004

#1030

#1054

#1058

#1059

#1060

#1062

#1065

#1068

#1073

#1074

#1077

#1078

#108

#1081

#1083

#1085

#1085

#109

#1090

#1093

#1094

#1098

#1100

#1102

#1104

#1106

#1107

#1108

#1110

#1113

#1122

#1123

#1124

#1124

#1133

#1137

#1140

#1145

#1152

#1155

#1155

#1156

#1157

#1159

#1161

#1170

#1175

#1179

#1180

#1184

#1186

#119

#1192

#1193

#1195

#1200

#1207

#1208

#1209

#1210

#1211

#1212

#1214

#1220

#1223

#1225

#1232

#1234

#1238

#1239

#1245

#1249

#125

#1255

#1263

#1265

#1266

#1267

#1272

#1274

#128

#1281

#1282

#1285

#1289

#1289

#129

#1290

#1296

#13

#1303

#1304

#1305

#1307

#1308

#1313

#1319

#1334

#1334

#1336

#1337

#1339

#134

#135

#1351

#1356

#1358

#1361

#1364

#1366

#1368

#1369

#1371

#1372

#1373

#1376

#1378

#1381

#1383

#1384

#1386

#1387

#1388

#1389

#139

#1390

#1393

#1395

#1398

#1399

#14

#1402

#1408

#1413

#1416

#1417

#1420

#1422

#1425

#1426

#1432

#1433

#1435

#1436

#1440

#1441

#1444

#1447

#1448

#1450

#1451

#1454

#1463

#1464

#1465

#1467

#1469

#1470

#1471

#1478

#1482

#1483

#1486

#1488

#149

#1494

#1495

#1496

#1497

#1501

#1508

#1513

#1514

#1518

#1519

#1525

#1527

#1528

#1529

#1530

#1531

#1532

#1533

#1533

#1535

#1536

#1537

#1539

#1546

#1547

#1548

#1550

#1554

#1555

#1556

#1557

#1558

#1560

#1565

#1568

#1569

#1570

#1572

#1576

#158

#1580

#1588

#1589

#1590

#1592

#1595

#1596

#1597

#1598

#1599

#1600

#1605

#1607

#1609

#1612

#1613

#1617

#1617

#1619

#1620

#1622

#1623

#1624

#1628

#1630

#1633

#1637

#1640

#1641

#1643

#1645

#1648

#1650

#1653

#1655

#1661

#1662

#1667

#1668

#1674

#1676

#1677

#1681

#1683

#1685

#1689

#169

#1694

#1696

#1697

#1698

#1700

#1702

#1703

#1706

#1707

#1710

#1712

#1713

#1714

#1715

#1716

#1717

#1718

#1719

#172

#1720

#1721

#1722

#1723

#1724

#1729

#1730

#1733

#1734

#1744

#1746

#1752

#1755

#1756

#1756

#1759

#176

#1760

#1761

#1763

#1764

#1765

#1766

#1768

#1770

#1771

#1772

#1773

#1774

#1775

#1777

#1778

#1782

#1783

#1784

#1785

#1786

#1787

#1788

#1789

#1790

#1791

#1792

#1793

#1794

#1795

#1796

#1798

#1803

#1804

#1805

#1806

#1807

#1807

#1808

#1808

#1809

#1809

#1810

#1810

#1811

#1811

#1812

#1812

#1813

#1814

#1814

#1816

#1816

#1822

#1822

#1823

#1824

#1826

#1827

#1828

#1829

#1830

#1831

#1832

#1833

#1834

#1835

#1835

#1836

#1838

#1838

#1840

#1840

#1844

#1845

#1846

#1847

#1847

#1849

#1851

#1852

#1853

#1853

#1854

#1854

#1855

#1856

#1856

#1857

#1857

#1858

#1858

#1859

#1859

#1860

#1860

#1861

#1861

#1862

#1862

#1866

#1866

#1868

#1868

#1869

#1869

#1870

#1870

#1871

#1871

#1873

#1873

#1874

#1874

#1875

#1875

#1876

#1876

#1877

#1879

#1881

#1881

#1882

#1884

#1884

#1885

#1886

#1887

#1887

#1891

#1891

#1892

#1892

#1893

#1893

#1895

#1895

#1896

#1896

#1897

#1899

#1899

#1901

#1902

#1902

#1904

#1904

#1906

#1906

#1907

#1908

#1908

#1910

#1911

#1913

#1914

#1915

#1915

#1922

#1923

#1923

#1925

#1929

#1931

#1932

#1932

#1933

#1934

#1935

#1935

#1936

#1937

#1939

#194

#1940

#1941

#1941

#1943

#1944

#1944

#1946

#1946

#1947

#1951

#1952

#1953

#1955

#1955

#1957

#1957

#1960

#1965

#1965

#1967

#1969

#1970

#1970

#1971

#1975

#1976

#1977

#1977

#1978

#1979

#1981

#1983

#1983

#1984

#1984

#1985

#1985

#1986

#1986

#1987

#1987

#1988

#1988

#1989

#1990

#1991

#1991

#1993

#1993

#1994

#1994

#1995

#1995

#1997

#1997

#200

#2001

#2001

#2003

#2003

#2004

#2004

#2005

#2005

#2008

#2008

#215

#218

#229

#232

#234

#24

#249

#255

#269

#271

#279

#286

#288

#293

#294

#298

#299

#3

#300

#304

#312

#313

#314

#324

#33

#332

#335

#337

#34

#357

#358

#369

#37

#379

#387

#389

#390

#394

#403

#410

#411

#416

#419

#419

#427

#440

#444

#445

#458

#462

#465

#472

#475

#496

#510

#562

#581

#60

#605

#606

#609

#612

#617

#618

#622

#64

#640

#65

#657

#658

#66

#662

#671

#679

#680

#681

#685

#687

#706

#708

#723

#724

#729

#734

#741

#749

#75

#752

#754

#775

#776

#777

#788

#792

#799

#80

#800

#806

#808

#821

#84

#84

#846

#85

#864

#865

#868

#891

#899

#901

#903

#914

#915

#916

#918

#929

#93

#931

#945

#948

#95

#961

#967

#969

#970

#971

#973

#977

#983

#988

#988

#990

#994

#999

0.3.4

checkpoint-pre-antibot-fallback

docker-rebuild-v0.7.5

docker-rebuild-v0.7.6

docker-rebuild-v0.7.7

docker-rebuild-v0.7.8

docker-rebuild-v0.8.0

docker-rebuild-v0.8.5

docker-rebuild-v0.8.6

docker-rebuild-v0.8.7

docker-rebuild-v0.8.8

docker-rebuild-v0.8.9

v.3.72

v0.0.75

v0.1.0

v0.2.0

v0.2.1

v0.2.2

v0.2.4

v0.2.6

v0.2.7

v0.2.71

v0.2.72

v0.2.73

v0.2.74

v0.2.77

v0.3.0

v0.3.3

v0.3.6

v0.3.745

v0.3.746

v0.4.24

v0.4.243

v0.5.0.post1

v0.6.3

v0.7.0

v0.7.1

v0.7.2

v0.7.3

v0.7.4

v0.7.5

v0.7.6

v0.7.7

v0.7.8

v0.8.0

v0.8.5

v0.8.6

v0.8.7

v0.8.8

v0.8.9

vr0.6.0

vr0.6.0rc1

vr0.6.3

Mono Color

• 361499d291 Release v0.7.5: The Update ntohidi 2025-09-29 18:05:26 +08:00
• 3fe49a766c fix(docker-deployment): replace console.log with print for metadata extraction ntohidi 2025-09-25 14:12:59 +08:00
• fef715a891 Merge branch 'feature/docker-hooks' into develop ntohidi 2025-09-25 14:11:46 +08:00
• d48d382d18 feat(tests): Implement comprehensive testing framework for telemetry system feature/telemetry AHMET YILMAZ 2025-09-22 19:06:20 +08:00
• 69e8ca3d0d Merge pull request #1508 from unclecode/docker/base_config_overrides Nasrin 2025-09-22 18:02:14 +08:00
• a1950afd98 #1505 fix(api): update config handling to only set base config if not provided by user docker/base_config_overrides AHMET YILMAZ 2025-09-22 17:19:27 +08:00
• d0eb5a6ffe Merge pull request #1501 from unclecode/fix/n-playwright-stealth Nasrin 2025-09-19 14:17:35 +08:00
• 89679cee67 #1489 refactor(normalize_url): enhance URL normalization logic and add comprehensive test suite fix/case_senstive_params AHMET YILMAZ 2025-09-18 18:31:07 +08:00
• 77559f3373 feat(StealthAdapter): fix stealth features for Playwright integration. ref #1481 fix/n-playwright-stealth ntohidi 2025-09-18 15:39:06 +08:00
• 84ba78c852 #1489 refactor(normalize_url): improve query parameter handling and sorting AHMET YILMAZ 2025-09-17 18:56:45 +08:00
• e3467c08f6 #1490 feat(ManagedBrowser): add viewport size configuration for browser launch fix/viewport_in_managed_browser AHMET YILMAZ 2025-09-17 17:40:38 +08:00
• 3899ac3d3b Merge pull request #1464 from unclecode/fix/proxy_deprecation Nasrin 2025-09-16 15:48:45 +08:00
• 23431d8109 Merge pull request #1389 from unclecode/fix/deep-crawl-scoring Nasrin 2025-09-16 15:45:54 +08:00
• 1717827732 refactor(BrowserConfig): change deprecation warning for 'proxy' parameter to UserWarning fix/proxy_deprecation AHMET YILMAZ 2025-09-12 11:10:38 +08:00
• f8eaf01ed1 Merge pull request #1467 from unclecode/fix/request-crawl-stream Nasrin 2025-09-11 17:40:43 +08:00
• 14b42b1f9a Merge pull request #1471 from unclecode/fix/adaptive-crawler-llm-config Nasrin 2025-09-09 12:56:33 +08:00
• 3bc56dd028 fix: allow custom LLM providers for adaptive crawler embedding config. ref: #1291 fix/adaptive-crawler-llm-config ntohidi 2025-09-09 12:49:55 +08:00
• 813b1f5534 #1268 fix: update redirected_url to current page URL and enhance normalize_url function fix/relative_url AHMET YILMAZ 2025-09-08 19:09:33 +08:00
• 1874a7b8d2 fix: update option labels in request builder for clarity fix/request-crawl-stream AHMET YILMAZ 2025-09-05 17:06:25 +08:00
• 0482c1eafc Merge pull request #1469 from unclecode/fix/docker-jwt Nasrin 2025-09-04 15:00:15 +08:00
• 6a3b3e9d38 Commit without API AHMET YILMAZ 2025-09-03 17:02:40 +08:00
• 1eacea1d2d Merge pull request #1432 from unclecode/example/web2api-example Nasrin 2025-09-03 16:30:39 +08:00
• bc6d8147d2 Merge pull request #1451 from unclecode/fix/remove-python3.9-version Nasrin 2025-09-02 16:50:40 +08:00
• 487839640f fix: raise error on last attempt failure in perform_completion_with_backoff. ref #989 ntohidi 2025-09-02 16:49:01 +08:00
• 6772134a3a remove: delete unused yoyo snapshot subproject ntohidi 2025-09-02 12:07:08 +08:00
• ae67d66b81 Merge pull request #1454 from nafeqq-1306/docstring-changes Nasrin 2025-09-02 11:59:59 +08:00
• af28e84a21 Merge pull request #1441 from unclecode/fix/improve-docker-error-handling Nasrin 2025-09-02 11:56:01 +08:00
• edd0b576b1 Fix: Use correct URL variable for raw HTML extraction (#1116) rbushria 2025-08-28 10:46:44 +03:00
• b54c200c74 feat: make device_scale_factor configurable via BrowserConfig TristanDonze 2025-09-01 17:04:34 +02:00
• 5e7fcb17e1 Merge pull request #1448 from unclecode/fix/https-reditrect Nasrin 2025-09-01 16:11:25 +08:00
• 6e728096fa fix(auth): fixed Docker JWT authentication. ref #1442 fix/docker-jwt ntohidi 2025-09-01 12:48:16 +08:00
• 367190fc75 Merge branch 'unclecode:main' into patch-versionmanager Vladimir Mandic 2025-08-30 23:22:26 -04:00
• 2de200c1ba Merge pull request #1433 from Thermofish/fix/excluded_selector Nasrin 2025-08-29 16:08:24 +08:00
• 9749e2832d issue #1329 refactor(crawler): move unwanted properties to CrawlerRunConfig class nafeqq-1306 2025-08-29 10:20:47 +08:00
• 70f473b84d fix: drop Python 3.9 support and require Python >=3.10. The library no longer supports Python 3.9 and so it was important to drop all references to python 3.9. Following changes have been made: - pyproject.toml: set requires-python to ">=3.10"; remove 3.9 classifier - setup.py: set python_requires to ">=3.10"; remove 3.9 classifier - docs: update Python version mentions - deploy/docker/c4ai-doc-context.md: options -> 3.10, 3.11, 3.12, 3.13 Soham Kukreti 2025-08-28 19:27:33 +05:30
• bdacf61ca9 feat: update documentation for preserve_https_for_internal_links. ref #1410 fix/https-reditrect ntohidi 2025-08-28 17:48:12 +08:00
• f566c5a376 feat: add preserve_https_for_internal_links flag to maintain HTTPS during crawling. Ref #1410 ntohidi 2025-08-28 17:38:40 +08:00
• 4ed33fce9e Remove deprecated test for 'proxy' parameter in BrowserConfig and update .gitignore to include test_scripts directory. AHMET YILMAZ 2025-08-28 17:26:10 +08:00
• f7a3366f72 #1375 : refactor(proxy) Deprecate 'proxy' parameter in BrowserConfig and enhance proxy string parsing AHMET YILMAZ 2025-08-28 17:21:49 +08:00
• 4e1c4bd24e Merge pull request #1436 from unclecode/fix/docker-filter Nasrin 2025-08-27 11:08:42 +08:00
• 2ad3fb5fc8 feat(docker): improve docker error handling - Return comprehensive error messages along with status codes for api internal errors. - Fix fit_html property serialization issue in both /crawl and /crawl/stream endpoints - Add sanitization to ensure fit_html is always JSON-serializable (string or None) - Add comprehensive error handling test suite. Soham Kukreti 2025-08-26 23:18:35 +05:30
• cce3390a2d Merge pull request #1426 from unclecode/fix/update-quickstart-and-adaptive-strategies-docs Nasrin 2025-08-26 16:53:47 +08:00
• 4fe2d01361 Merge pull request #1440 from unclecode/feature/docker-llm-parameters Nasrin 2025-08-26 16:48:17 +08:00
• 159207b86f feat(docker): Add temperature and base_url parameters for LLM configuration. ref #1035 feature/docker-llm-parameters ntohidi 2025-08-26 16:44:07 +08:00
• 38f3ea42a7 fix(logger): ensure logger is a Logger instance in crawling strategies. ref #1437 fix/docker-filter ntohidi 2025-08-26 12:06:56 +08:00
• 102352eac4 fix(docker): resolve filter serialization and JSON encoding errors in deep crawl strategy (ref #1419) ntohidi 2025-08-25 14:04:08 +08:00
• f2da460bb9 fix(dependencies): add cssselect to project dependencies James T. Wood 2025-08-24 22:12:20 -04:00
• b1dff5a4d3 feat: Add comprehensive website to API example with frontend Soham Kukreti 2025-08-24 18:20:15 +05:30
• 40ab287c90 fix(utils): Improve URL normalization by avoiding quote/unquote to preserve '+' signs. ref #1332 ntohidi 2025-08-22 12:05:21 +08:00
• c09a57644f docs: update adaptive crawler docs and cache defaults; remove deprecated examples (#1330) - Replace BaseStrategy with CrawlStrategy in custom strategy examples (DomainSpecificStrategy, HybridStrategy) - Remove “Custom Link Scoring” and “Caching Strategy” sections no longer aligned with current library - Revise memory pruning example to use adaptive.get_relevant_content and index-based retention of top 500 docs - Correct Quickstart note: default cache mode is CacheMode.BYPASS; instruct enabling with CacheMode.ENABLED Soham Kukreti 2025-08-21 19:11:31 +05:30
• 90af453506 Merge branch 'develop' of https://github.com/unclecode/crawl4ai into develop ntohidi 2025-08-21 14:10:01 +08:00
• 8bb0e68cce Merge pull request #1422 from unclecode/fix/docker-llmEnvFile Nasrin 2025-08-21 14:05:06 +08:00
• 95051020f4 fix(docker): Fix LLM API key handling for multi-provider support fix/docker-llmEnvFile ntohidi 2025-08-21 14:01:04 +08:00
• 69961cf40b Merge branch 'develop' of https://github.com/unclecode/crawl4ai into develop ntohidi 2025-08-20 16:56:19 +08:00
• 7f360577d9 feat(telemetry): Add opt-in telemetry system for error tracking and stability improvement ntohidi 2025-08-20 16:49:44 +08:00
• ef174a4c7a Merge pull request #1104 from emmanuel-ferdman/main Nasrin 2025-08-20 10:57:39 +08:00
• f4206d6ba1 Merge pull request #1369 from NezarAli/main Nasrin 2025-08-18 14:22:54 +08:00
• 9447054a65 docs: update Docker instructions to use the latest release tag ntohidi 2025-08-18 14:20:05 +08:00
• dad7c51481 Merge pull request #1398 from unclecode/fix/update-url-seeding-docs Nasrin 2025-08-18 13:00:26 +08:00
• f4a432829e fix(crawler): Removed the incorrect reference in browser_config variable #1310 ntohidi 2025-08-18 10:59:14 +08:00
• e651e045c4 Release v0.7.4: Merge release branch v0.7.4 UncleCode 2025-08-17 19:46:48 +08:00
• 5398acc7d2 docs: add v0.7.4 release blog post and update documentation release/v0.7.4 UncleCode 2025-08-17 19:45:23 +08:00
• 22c7932ba3 chore(version): update version to 0.7.4 UncleCode 2025-08-17 19:22:23 +08:00
• 2ab0bf27c2 refactor(utils): move memory utilities to utils and update imports UncleCode 2025-08-17 19:14:55 +08:00
• d30dc9fdc1 fix(http-crawler): bring back HTTP crawler strategy ntohidi 2025-08-16 09:27:23 +08:00
• e6044e6053 Merge branch 'develop' of https://github.com/unclecode/crawl4ai into develop ntohidi 2025-08-15 19:44:06 +08:00
• a50e47adad Merge branch 'feature/table-extraction-strategies' into develop ntohidi 2025-08-15 19:41:37 +08:00
• ada7441bd1 refactor: Update LLMTableExtraction examples and tests ntohidi 2025-08-15 18:47:31 +08:00
• 9f7fee91a9 feat: 🚀 Introduce revolutionary LLMTableExtraction with intelligent chunking for massive tables ntohidi 2025-08-14 18:21:24 +08:00
• 7f48655cf1 feat(browser-profiler): implement cross-platform keyboard listeners and improve quit handling AHMET YILMAZ 2025-08-08 11:18:34 +08:00
• 1417a67e90 chore(profile-test): fix filename typo ( test_crteate_profile.py → test_create_profile.py ) prokopis3 2025-06-12 14:38:32 +03:00
• 19398d33ef fix(browser_profiler): improve keyboard input handling prokopis3 2025-06-12 14:33:12 +03:00
• 263d362daa fix(browser_profiler): cross-platform 'q' to quit prokopis3 2025-05-30 14:43:18 +03:00
• bac92a47e4 refactor: Update LLMTableExtraction examples and tests ntohidi 2025-08-15 18:47:31 +08:00
• 8e1362acf5 Fix async generator type mismatch in Docker Client streaming feat/ahmed_dev AHMET YILMAZ 2025-08-15 15:49:11 +08:00
• 07e9d651fb feat: Comprehensive deep crawl streaming functionality restoration AHMET YILMAZ 2025-08-15 15:31:36 +08:00
• a51545c883 feat: 🚀 Introduce revolutionary LLMTableExtraction with intelligent chunking for massive tables ntohidi 2025-08-14 18:21:24 +08:00
• ecbe5ffb84 docs: Update URL seeding examples to use proper async context managers - Wrap all AsyncUrlSeeder usage with async context managers - Update URL seeding adventure example to use "sitemap+cc" source, focus on course posts, and add stream=True parameter to fix runtime error Soham Kukreti 2025-08-13 18:16:46 +05:30
• 926e41aab8 Merge pull request #1378 from unclecode/fix/exit_with_q Nasrin 2025-08-13 14:16:47 +08:00
• 11b310edef Merge pull request #1378 from unclecode/fix/exit_with_q Nasrin 2025-08-13 14:16:47 +08:00
• 489981e670 Merge pull request #1390 from unclecode/fix/docker-raw-html Nasrin 2025-08-13 13:56:33 +08:00
• b92be4ef66 Merge pull request #1371 from unclecode/bug/proxy_config Nasrin 2025-08-12 16:55:52 +08:00
• 7c0edaf266 Merge pull request #1384 from unclecode/fix/update_docker_examples Nasrin 2025-08-12 16:53:42 +08:00
• dfcfd8ae57 fix(dispatcher): enable true concurrency for fast-completing tasks in arun_many. REF: #560 ntohidi 2025-08-12 16:51:22 +08:00
• 955110a8b0 Merge branch 'develop' of https://github.com/unclecode/crawl4ai into develop ntohidi 2025-08-12 12:22:25 +08:00
• f30811b524 fix: Check for raw: and raw:// URLs before auto-appending https:// prefix - Add raw HTML URL validation alongside http/https checks - Fix URL preprocessing logic to handle raw: and raw:// prefixes - Update error message and add comprehensive test cases Soham Kukreti 2025-08-11 22:10:53 +05:30
• 8146d477e9 Merge branch 'main' into develop ntohidi 2025-08-11 18:56:15 +08:00
• 96c4b0de67 fix(browser_manager): serialize new_page on persistent context to avoid races ref #1198 - Add _page_lock and guarded creation; handle empty context.pages safely - Prevents BrowserContext.new_page “Target page/context closed” during concurrent arun_many ntohidi 2025-08-11 18:55:43 +08:00
• 57c14db7cb Merge pull request #1381 from unclecode/fix/base-tag-link-resolution Nasrin 2025-08-11 18:32:32 +08:00
• 88a9fbbb7e fix(deep-crawl): BestFirst priority inversion; remove pre-scoring truncation. ref #1253 fix/deep-crawl-scoring ntohidi 2025-08-11 18:16:57 +08:00
• be63c98db3 feat(docker): add user-provided hooks support to Docker API feature/docker-hooks ntohidi 2025-08-11 13:25:17 +08:00
• cd2dd68e4c docs: remove CRAWL4AI_API_TOKEN references and use correct endpoints in Docker example scripts (#1015) Soham Kukreti 2025-08-09 19:15:11 +05:30
• f0ce7b2710 feat: add v0.7.3 release notes, changelog updates, and documentation for new features UncleCode 2025-08-09 21:04:18 +08:00
• 21f79fe166 Release v0.7.3: Merge release branch v0.7.3 UncleCode 2025-08-09 20:11:35 +08:00
• a9a2d798b4 feat: update sponsorship tier details and add custom arrangements note release/v0.7.3 unclecode 2025-08-09 20:10:32 +08:00
• 612270fcb0 feat: add scheduling link to contact information in SPONSORS.md unclecode 2025-08-09 20:05:59 +08:00
• bc099fdd76 Merge branch 'main' into release/v0.7.3 unclecode 2025-08-09 19:30:46 +08:00
• 18504d782e Add Founding Sponsors section and update README with detailed project information unclecode 2025-08-09 19:11:32 +08:00
• ad547607b9 feat: add GitHub Sponsors support with 4 tiers unclecode 2025-08-09 17:57:47 +08:00
• 18ad3ef159 fix: Implement base tag support in link extraction (#1147) - Extract base href from <head><base> tag using XPath in _process_element method - Use base URL as the primary URL for link normalization when present - Add error handling with logging for malformed or problematic base tags - Maintain backward compatibility when no base tag is present - Add test to verify the functionality of the base tag extraction. Soham Kukreti 2025-08-08 20:00:11 +05:30