When you populate recipients on failure but disable failure emails, the address is used for first failure emails(when recipient list is empty on first failure) rather than the default recipient list. When you see that the build is emailing the wrong address it's hard to tell what the problem is. I had to search the config xml for the address.