Skip to content

docs(release): 0.4.5 follow-ups — pdf_backends CHANGELOG entry + stale coding count #82

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
dongwhee merged 1 commit into from
Jun 7, 2026
Merged

docs(release): 0.4.5 follow-ups — pdf_backends CHANGELOG entry + stale coding count #82

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -93,6 +93,14 @@ _No changes yet._
suffix-less API/RSS paths like `news.ycombinator.com/rss` still
route through raw passthrough (`fetcher_used: passthrough-probed`).

- **Pluggable PDF extraction backends**
(`src/trawl/fetchers/pdf_backends.py`) — the PDF fetcher now routes
through a backend layer (`pymupdf` / `markitdown` / `unstructured` /
`docling` / `mineru`, heavy parsers behind lazy imports). The
production default is unchanged (PyMuPDF); the layer powers the R5
backend comparison harness, which concluded keep-PyMuPDF (see
Tests / research below).

### Fixed

- **Wikipedia fetcher heading preservation** — modern MediaWiki HTML
Expand Down
5 changes: 3 additions & 2 deletions CLAUDE.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,8 +37,9 @@ trawl directory. Humans should read `README.md` first, then
- **Longform retrieval cost (default on, 2026-04-22)**: `TRAWL_CHUNK_BUDGET`
default flipped from `0` to `100` after re-validating on curl.se
manpage (275 KB / 760 chunks, p95 25149 ms → 3065 ms). Parity 15/15
+ agent_patterns coding 23/24 (pre-existing unrelated `arxiv_pdf_lora`
fetcher fail) preserved. Opt out via `TRAWL_CHUNK_BUDGET=0`.
+ agent_patterns coding 23/24 at that time preserved (the unrelated
`arxiv_pdf_lora` fetcher flake has since recovered — coding is 24/24
as of v0.4.5). Opt out via `TRAWL_CHUNK_BUDGET=0`.

### What a new session should do first

Expand Down
Loading