Browsertrix Crawler v1.9.1

What's Changed

• brave: update policies to disable new brave services by @ikreymer in #914
• remove --disable-component-update flag, fixes shields not working by @ikreymer in #915

Full Changelog: v1.9.0...v1.9.1

Browsertrix Crawler v1.9.0

What's Changed

• profile download improvements: by @ikreymer in #899
• add --saveProfile option to save profile after successful crawl by @ikreymer in #903
• profiles: add singleton lock removal on startup to avoid any issues by @ikreymer in #904
• deps: update to browsertrix-behaviors 0.9.4 by @ikreymer in #906
• Fix directory path in user guide for WACZ file by @wannaphong in #910
• fix: Skip proxy for seed file downloads in Self-Hosting environments by @Percivalll in #907
• feat: add extraChromeArgs support for passing custom Chrome flags by @aponb in #877
• Fix linting following external contribution by @tw4l in #911
• deps: bump dependencies for 1.9.0 (browsertrix-behaviors 0.9.5) by @ikreymer in #912

New Contributors

• @wannaphong made their first contribution in #910
• @Percivalll made their first contribution in #907

Full Changelog: v1.8.1...v1.9.0

Browsertrix Crawler v1.9.0-beta.1

deps: update to browsertrix-behaviors 0.9.5 for Instagram behavior fix

Full Changelog: v1.9.0-beta.0...v1.9.0-beta.1

Browsertrix Crawler v1.9.0-beta.0

What's Changed

• profile download improvements: by @ikreymer in #899
• add --saveProfile option to save profile after successful crawl by @ikreymer in #903
• profiles: add singleton lock removal on startup to avoid any issues by @ikreymer in #904
• deps: update to browsertrix-behaviors 0.9.4 by @ikreymer in #906

Full Changelog: v1.8.1...v1.9.0-beta.0

Browsertrix Crawler v1.8.1

What's Changed

• Add addLink doc by @edsu in #890
• flow behaviors: add scrolling into view by @ikreymer in #892
• logging: remove duplicate seeds found error by @ikreymer in #893
• dismiss js dialog popups by @ikreymer in #895
• Profile Saving Improvements by @ikreymer in #894

Full Changelog: v1.8.0...v1.8.1

Browsertrix Crawler v1.8.0

What's Changed

• Support host-specific proxies with proxy config YAML by @ikreymer in #837
• Async Fetch Refactor by @ikreymer in #880
• seed urls list: check for quoted URLs and remove quotes by @ikreymer in #883
• tests: remove example.com from tests, also use local http-server for … by @ikreymer in #885
• deps update: bump browser to brave 1.82.170, wabac.js 2.24.1 by @ikreymer in #886

Full Changelog: v1.7.0...v1.8.0

Browsertrix Crawler v1.8.0-beta.1

What's Changed

• tests: remove example.com from tests, also use local http-server for … by @ikreymer in #885
• deps update: bump browser to brave 1.82.170, wabac.js 2.24.1 by @ikreymer in #886

Full Changelog: v1.8.0-beta.0...v1.8.0-beta.1

Browsertrix Crawler v1.8.0-beta.0

What's Changed

• Support host-specific proxies with proxy config YAML by @ikreymer in #837
• Async Fetch Refactor by @ikreymer in #880
• seed urls list: check for quoted URLs and remove quotes by @ikreymer in #883

Full Changelog: v1.7.1...v1.8.0-beta.0

Browsertrix Crawler v1.7.1

CHANGES

• check for urls that are wrapped in quotes, eg. 'https://example.com/' or "https://example.com/" and remove the quotes before adding seed
• reduce logging for duplicate/page limited seeds, log only once

Full Changelog: v1.7.0...v1.7.1

Browsertrix Crawler v1.7.0

What's Changed

• Add option to save local/sessionStorage by @ikreymer in #856
• Support downloading seed file from URL by @tw4l in #852
• Use consistent profile directory name (merge 1.6.4 change) by @ikreymer in #859
• async fetch: allow retrying async fetch if interrupted by @ikreymer in #863
• Support option to fail crawl on content check by @ikreymer in #861
• Fix docs mistaking --waitUntil with --pageLoadTimeout by @tw4l in #864
• deps update: by @ikreymer in #867
• url queueing: log skipped URLs as errors if depth === 0 by @ikreymer in #868
• Add documentation for --failOnContentCheck and update CLI options in docs by @tw4l in #869
• Capitalization fix for log messages by @SuaYoo in #870
• quickfix: WACZ upload retry support: by @ikreymer in #871
• Don't trim to limit if limit is default of 0 by @tw4l in #873
• behavior logging: remove last line dupe check for behavior logs by @ikreymer in #874
• deps: bump base to brave 1.80.125 by @ikreymer in #875

New Contributors

• @SuaYoo made their first contribution in #870

Full Changelog: v1.6.4...v1.7.0