 |
History
| Log In
|
|
|
|
[
Permlink
| « Hide
]
Steve Luo [08/Dec/15 12:56 AM]
Is your testng report very big? Can you please share your testng report to me (steve at pmease) so that I can have a test?
Attached the reports. We are actually collecting multiple xml files from different component builds.
David Hi David,
Thank you very much for sharing me the reports. I can publish the reports in less than 1 minutes in my computer. Please turn your configuration log level to DEBUG by editing configuration General Setting so we can know more detailed on where is the slowest part. By the way, if the attached reports contains any confidential information, let me know and I will remove it. Hi Steve,
Yes can you please delete the reports if you are finished with them. I will switch on debug and send you the info shortly. one thing I have noticed is that if I clear doen the h2 db behing testng on the quickbuidl server this also runs in under a minute. Thanks David
From your log, it seems that transferring files between your server and agent is very slow, see log below:
10:49:03,345 DEBUG - Start transfering previous report from server [e:\qb-storage\root\LAE\trunk\proofBuild\java\*****s\83904/reports/testng/DEFAULT] to local [/home/*****/app/pmease/*****agent-prod/temp/previouscategorycd431c62-d658-4f79-92c2-024b00186c8a/DEFAULT] 10:51:24,403 INFO - Finished generating report 'methods' successfully. It cost about 2 minutes. So I'd like to suggest you test copying the same file/directory [e:\qb-storage\root\LAE\trunk\proofBuild\java\*****s\83904/reports/testng/DEFAULT] to the agent and see how many time you need. Or, you can try run Publish TestNG step on your server node directly to see whether it can become faster. I have gone into the advanced setting and switched it to store artifacts on the server but for some reason it is still doing the transfer? Do I need to do anything else?
12:16:32,639 INFO - Start processing report: methods 12:16:34,968 DEBUG - Start transfering previous report from server [e:\qb-storage\root\LAE\trunk\proofBuild\java\*****s\83946/reports/testng/DEFAULT] to local [/home/*****/app/pmease/*****agent-prod/temp/previouscategoryd383b4cd-9af3-406a-ae16-7c221e32a0f1/DEFAULT] 12:19:03,872 INFO - Finished generating report 'methods' successfully. I have also logged onto the quickbuild server and using scp copied the file listed above in under 30 seconds. The file is on 17M so the delay does nor make sense.
David Sorry, I don't mean storing artefacts on server node. I want you to test run publish step on server node only. A simple test is:
1. Copy all XML reports to some directory on server 2. Create a test configuration with one step - Publish TestNG reports which publishes the reports in that directory 3. Run a few builds 4. Let me know your results. So running this on the server directly takes 1 minute .
David So we can now confirm the slow is caused by transferring files here.
Was there a lot of transferring artefacts at that time? And what was your server load? You may try run a build in some spare time to see what's the result. Also, if there is a lot of transferring artefacts, I recommend you storing artefacts in your agents instead of server to reduce the server load. See below page for more details: http://wiki.pmease.com/display/QB60/Store+Build+Artifacts+on+Agent Hi Steve,
I agree the slow speed is during transfer but why? What protocol is used for the transfer? When I transfer the same file from the server to the agent using scp is takes seconds? Is the slow time down to server load ? I am already storing artefacts on the agents but it sill transfers from the server to agent if the steps are not ran on the agent. Thanks QB only stores user published artifacts on agent, but various test reports are still saved on server for web UI accessibility. We transfer files via http download, and its speed is comparable with ftp in normal cases. However if server is overloaded when many files are transferred in the same time (for instance, QB has to send various reports, build logs to server), it might be slow. If possible please check if the transfer is still slow when there is only one build running.
Hi Robin,
Thanks for the info I will run some tests and get back yo you. I am also talking to the network team here to see if we can establish if there is any packet loss on the network. Thanks David
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
 |
|
Bug
Closed
Major
Testng publish task taking over 4 minutes 
