I am experimenting with using the JUnit plugin to generate test reports and am noticing some inconsistent behavior in the UI regarding skipped steps.
1) Although the plugin doesn't strictly treat a "skip" as a failure, a newly skipped test shows up as a newly failed test. When clicking on the "New Failed" count, it takes the user to a tag that shows failed tests. But the skipped test doesn't show up there. One must click on the "By Test" link to see the skipped test. That skipped test is in turn linked up, but once again, clicking on it takes the user back to an empty "Failed Tests" tab.
2) If skipped tests are treated in some regard as failures (they count in the "New Failed" counter) they should also be reflected in the "Not Fixed" count.
3) Could the number of skipped steps be made available to go along with the failures and errors? We treat skips as failures and I would like to use it as a condition to fail the step.
|
