We have a number of steps which we wrap in a composition step set to always succeed, so that when we send the notification we can check for HAS_FAILED_STEPS and put WARNING in the subject, but the dashboard icon, and overall status of the build shows SUCCESS. It would be nice to have a built-in status and dashboard icon (yellow?, between red and green) that indicates that even the critical steps succeeded, something went wrong. For example setting maven to ignore test failures and then detect the test failures during JUnit reporting. The icon would be yellow and the status could be HAS_FAILED_TESTS (which could by the generic test report base implementation that all the specific report plugins implement so all test report publish steps could return that status. Maybe another status for static code quality analysis reports like Cobertura, EMMA, and JaCoCo.