As raised by @gstrauss we could do with some better controls here.
One idea is to add another input to the flush() function that says to disable
for_retry for the matching ECHConfigs.
Note: This issue is really about the ECHStore APIs that are part of the feature branch, but this seems a better place to record the issue as it'll be a couple of PRs ahead in the feature branch plan before I address this.