CI job to fetch stale blocks from mempool-space API each night

[0xB10C]

mempool-space has an API for stale blocks: https://mempool.space/api/blocks/stale

Probably makes sense to fetch them, convert the JSON into a CSV file, and open a PR for the ones that we don't yet know about.

Since mempool.space runs multiple servers, it might make sense to fetch from all of them in a single run. I think they don't share information about stale blocks between servers.

e.g.

https://node208.va1.mempool.space/api/blocks/stale
https://node204.fra.mempool.space/api/blocks/stale

See more listed on https://mempool.space/lightning/group/the-mempool-open-source-project

[mononaut]

just fyi, that's our regular paginated blocks endpoint - mempool.space/api/blocks/<height> returns 10 canonical blocks up to the requested height (or the latest 10 blocks if <height> is omitted or something like "stale" that can't be parsed as a valid blockheight).

you're probably looking for https://mempool.space/api/v1/chain-tips, although that endpoint hasn't been stabilized yet.

we're also planning to replicate stale blocks across our servers in future, but I don't have an ETA for when that'll be live.

[0xB10C]

Thanks, that's very useful. I should have checked it!