Most objects in Jenkins properly apply transparency. The only one that is clearly wrong is the save button:

Notably, the original file has transparency: https://github.com/jenkinsci/jenkins/blob/master/war/images/save.svg

Fwiw, Git's logo is officially transparent (i.e. a single color for the diamond and transparency for the graph and the background).