Since there is a plan to have a number of Alpha/Beta releases for the tool, it makes sense to do some automation for changelog generation to save some time. Jenkins project supports Release Drafter, and I suggest enabling it. See https://github.com/jenkinsci/.github/blob/master/.github/release-drafter.adoc and the linked examples