History | Log In     View a printable version of the current page.  
Issue Details (XML | Word | Printable)

Key: QB-2336
Type: Improvement Improvement
Status: Resolved Resolved
Resolution: Fixed
Priority: Major Major
Assignee: Steve Luo
Reporter: John Szakmeister
Votes: 0
Watchers: 0
Operations

If you were logged in you would be able to see more operations.
QuickBuild

Allow seeing the hostnames under the test details.

Created: 20/Feb/15 12:05 PM   Updated: 06/Mar/15 01:42 AM
Component/s: None
Affects Version/s: 6.0.5
Fix Version/s: 6.0.9

Original Estimate: Unknown Remaining Estimate: Unknown Time Spent: Unknown
File Attachments: 1. XML File unittest-hostnames.xml (186 kb)

Image Attachments:

1. failed-tests.png
(108 kb)

2. unittests-with-hostnames.png
(107 kb)


 Description  « Hide
It'd be nice to see the hostnames and pass/fail in the test details. I can see that there were 6 runs, but can't discern which hosts they were. I did this by adding the hostname attribute to the testsuite tags.

 All   Comments   Work Log   Change History      Sort Order:
John Szakmeister [20/Feb/15 12:05 PM]
Screenshow of details summary.

John Szakmeister [20/Feb/15 12:07 PM]
Sample unittest file with hostnames. Note: this was created using busted and then I used a script to combine the results into a consolidated report.

Steve Luo [21/Feb/15 04:28 AM]
There is a "Report Set Name" field in publish report step, you can use some variables here to separate the reports into groups.
For example, you can add a step to publish reports on windows and set the name as "on windows", add another step to publish reports on linux and set the name as "on linux", and after publish the reports, you can find there is a select box on right top corner for you to filter the reports.

For your case, you can simply specify a expression like below in the "Report Set Name" field:

${node.hostName}


See more information on our wiki:
http://wiki.pmease.com/display/QB60/Publish+Reports#PublishReports-DistributeJUnitTests

John Szakmeister [21/Feb/15 08:45 AM]
I'm doing that now, but I've already got 12 reports being publish and only 3 slave nodes (6 for functional tests, and 6 for unit tests). By the time we get all the build we want to have in place, that number will more than double. It's simply too much to look at. That's why I'm looking into the consolidated report. I believe this will help keep the overview from being overwhelming, and could still help provide the details we need. The catch right now is that I can see that 6 runs occurred, and that all 6 runs passed. My fear is that we won't be able to see who failed and how. Either way, it'd still be nice to see (somehow) which ones were run.

Steve Luo [21/Feb/15 02:58 PM]
If you have one run failed, the status of this testcase will be marked as failure, also, QuickBuild will show the error message.

John Szakmeister [21/Feb/15 04:31 PM]
A screenshot with failed tests.

John Szakmeister [21/Feb/15 04:34 PM]
I just uploaded another screenshot. Can you tell me which machine this test failed on? I cannot. :-)

Steve Luo [21/Feb/15 04:51 PM]
Didn't you use ${node.hostName} as your "Report Set Name"?


Steve Luo [21/Feb/15 05:01 PM]
The reason we don't like to show host name here is that there are too many possible cases, for example, some may want to show JDK version, some may want to show some custom runtime attributes here.

Actually, you can generate as many "Report Set" as you want, while still have one place to show the total numbers, you just need define an aggregation for this and QuickBuild will show the number in configuration overview tab. See an example below:
https://demo.pmease.com/overview/25


Steve Luo [21/Feb/15 05:06 PM]
Anyway, we will add this feature in the coming release.