Skip to content

Browsertrix Crawler 0.4.4

Choose a tag to compare

View all tags
@ikreymer ikreymer released this 18 Aug 04:28
· 507 commits to main since this release
0.4.4
8c8cf23

This release includes fixes block rules system and README improvements:

  • Page Block Rules Fix: 'request already handled' errors by avoiding adding duplicate handlers to same page.
  • Page Block Rules Fix: await all continue/abort() calls and catch errors.
  • Page Block Rules: Don't apply to top-level page, print warning and recommend scope rules instead.
  • Setup: Attempt to create the crawl working directory (cwd) specified via --cwd if it doesn't exist.
  • Scope Types: Rename 'none' -> 'page' (single page only) and 'page' -> 'page-spa' (page with hashtags).
  • README: Add more scope rule examples, clarify distinction between scope rules and block rules.
  • README: Update old type -> scopeType, list new scope types.
Assets 2
Loading