Between credentials release 2.3.0 and 2.3.1, a dependency on configuration-as-code v1.35 was introduced. configuration-as-code:1.35 isn't included in the Jenkins LTS Docker image, and so this breaks deployments that are not explicitly specifying configuration-as-code:1.35 be installed. The version included with Jenkins LTS is 1.32.
This is mainly an issue with Docker deployments since the plugins folder may not be on a persistent volume.
In general it doesn't seem like a good practice to update dependencies in a patch release.