feat: add Cloudflare /crawl API client (Phase 1 of Cloudflare migration) - #54

Open

mfafore22 wants to merge 16 commits into

mainfrom

cloudflare-migration

Commits on Jul 1, 2026

fix: add from __future__ import annotations to config_manager
mfafore22
committed
1cffb25
feat: add Cloudflare /crawl client and fix config_manager type annotation
mfafore22
committed
2ccda0e

Commits on Jul 2, 2026

feat: add Cloudflare crawler params to CrawlerConfig and site_configs
mfafore22
committed
b2e088e

Commits on Jul 7, 2026

wip: Phase 3 - rewrite BaseCrawler to use Cloudflare client (untested)
mfafore22
committed
b52ff04

Commits on Jul 8, 2026

feat: replace async BaseCrawler with Cloudflare-backed sync runner
mfafore22
committed
4a2ec16

Commits on Jul 13, 2026

added mock crawl test
mfafore22
committed
237b001

Commits on Jul 14, 2026

test: add unit tests for client, crawler, and runner
mfafore22
committed
4932087
Merge branch 'main' into cloudflare-migration
mfafore22
authored
eb20bba

Commits on Jul 20, 2026

fix: narrow credential types, ruff cleanup, client timeouts and pagination
mfafore22
committed
0834968
Added docstring
mfafore22
committed
fa0221a
fix: add trailing commas to multi-line Field definitions
mfafore22
committed
aea4131

Commits on Jul 22, 2026

Working on the test file , then cloudflare migration complete
mfafore22
committed
8adbe4c

Commits on Jul 23, 2026

Test
mfafore22
committed
2ebf8c4

Commits on Jul 27, 2026

fix: repair broken cli commands, ruff findings, and flaky tests

mfafore22
and
claude
committed
746bc92
style: apply ruff format and fix missing EOF newline

mfafore22
and
claude
committed
4ad9d72
test: fix ambiguous exception assertion, remove duplicate test file

mfafore22
and
claude
committed
24c3b09