CHANGELOG.md is there for a while, but we never do anything with it.

@clementblaudeau was suggesting we could add a job to warn us on PRs.
@clementblaudeau feel free to comment with more precise ideas :)