<< Back to previous view

[QB-2336] Allow seeing the hostnames under the test details.
Created: 20/Feb/15  Updated: 06/Mar/15

Status: Resolved
Project: QuickBuild
Component/s: None
Affects Version/s: 6.0.5
Fix Version/s: 6.0.9

Type: Improvement Priority: Major
Reporter: John Szakmeister Assigned To: Steve Luo
Resolution: Fixed Votes: 0
Remaining Estimate: Unknown Time Spent: Unknown
Original Estimate: Unknown

File Attachments: PNG File failed-tests.png     XML File unittest-hostnames.xml     PNG File unittests-with-hostnames.png    

 Description   
It'd be nice to see the hostnames and pass/fail in the test details. I can see that there were 6 runs, but can't discern which hosts they were. I did this by adding the hostname attribute to the testsuite tags.

 Comments   
Comment by John Szakmeister [ 20/Feb/15 12:05 PM ]
Screenshow of details summary.
Comment by John Szakmeister [ 20/Feb/15 12:07 PM ]
Sample unittest file with hostnames. Note: this was created using busted and then I used a script to combine the results into a consolidated report.
Comment by Steve Luo [ 21/Feb/15 04:28 AM ]
There is a "Report Set Name" field in publish report step, you can use some variables here to separate the reports into groups.
For example, you can add a step to publish reports on windows and set the name as "on windows", add another step to publish reports on linux and set the name as "on linux", and after publish the reports, you can find there is a select box on right top corner for you to filter the reports.

For your case, you can simply specify a expression like below in the "Report Set Name" field:

${node.hostName}


See more information on our wiki:
http://wiki.pmease.com/display/QB60/Publish+Reports#PublishReports-DistributeJUnitTests
Comment by John Szakmeister [ 21/Feb/15 08:45 AM ]
I'm doing that now, but I've already got 12 reports being publish and only 3 slave nodes (6 for functional tests, and 6 for unit tests). By the time we get all the build we want to have in place, that number will more than double. It's simply too much to look at. That's why I'm looking into the consolidated report. I believe this will help keep the overview from being overwhelming, and could still help provide the details we need. The catch right now is that I can see that 6 runs occurred, and that all 6 runs passed. My fear is that we won't be able to see who failed and how. Either way, it'd still be nice to see (somehow) which ones were run.
Comment by Steve Luo [ 21/Feb/15 02:58 PM ]
If you have one run failed, the status of this testcase will be marked as failure, also, QuickBuild will show the error message.
Comment by John Szakmeister [ 21/Feb/15 04:31 PM ]
A screenshot with failed tests.
Comment by John Szakmeister [ 21/Feb/15 04:34 PM ]
I just uploaded another screenshot. Can you tell me which machine this test failed on? I cannot. :-)
Comment by Steve Luo [ 21/Feb/15 04:51 PM ]
Didn't you use ${node.hostName} as your "Report Set Name"?

Comment by Steve Luo [ 21/Feb/15 05:01 PM ]
The reason we don't like to show host name here is that there are too many possible cases, for example, some may want to show JDK version, some may want to show some custom runtime attributes here.

Actually, you can generate as many "Report Set" as you want, while still have one place to show the total numbers, you just need define an aggregation for this and QuickBuild will show the number in configuration overview tab. See an example below:
https://demo.pmease.com/overview/25

Comment by Steve Luo [ 21/Feb/15 05:06 PM ]
Anyway, we will add this feature in the coming release.
Generated at Thu May 16 09:21:13 UTC 2024 using JIRA 189.