History | Log In     View a printable version of the current page.  
Issue Details (XML | Word | Printable)

Key: QB-2906
Type: Bug Bug
Status: Closed Closed
Resolution: Cannot Reproduce
Priority: Blocker Blocker
Assignee: Robin Shen
Reporter: Todd Scholl
Votes: 0
Watchers: 1
Operations

If you were logged in you would be able to see more operations.
QuickBuild

Quickbuild Server Queue hangs

Created: 22/Feb/17 03:57 AM   Updated: 17/Jan/18 07:19 AM
Component/s: None
Affects Version/s: 6.1.9
Fix Version/s: None

Original Estimate: Unknown Remaining Estimate: Unknown Time Spent: Unknown
File Attachments: 1. GZip Archive qb_issues_02212017_1.tar.gz (2.10 Mb)
2. GZip Archive qb_issues_02212017_2.tar.gz (7.90 Mb)
3. Zip Archive quickbuild_issues_2_28_console.log.1.zip (705 kb)
4. Zip Archive quickbuild_issues_2_28_console.zip (572 kb)
5. Zip Archive quickbuild_issues_2_28_quickbuild.zip (2.30 Mb)

Image Attachments:

1. Issue_2_21_2017.JPG
(317 kb)

2. Issue_2_21_2017_2.JPG
(181 kb)
Environment: Linux 3.0.101-71-default #1 SMP Thu Mar 3 12:56:15 UTC 2016 (7bdad2e) x86_64 x86_64 x86_64 GNU/Linux


 Description  « Hide
In our quick build server today we are seeing an odd set of circumstances, this has occurred 3 times in the last 12 hours:
1. Jobs currently in progress stop progressing - Jobs collecting metrics stick in that state, jobs checking for build condition stick there, and job running steps stick there
2. All newly triggered jobs stay queued with Waiting_Process

The only thing that seems to resolve the issue is a Quickbuild service restart which interrupts our production job runs

Can you have a look at the logs and thread dumps we have and see if you can pinpoint what is going on?

 All   Comments   Work Log   Change History      Sort Order:
Change by Todd Scholl [22/Feb/17 04:05 AM]
Field Original Value New Value
Attachment qb_issues_02212017_1.tar.gz [ 10613 ]

Change by Todd Scholl [22/Feb/17 04:06 AM]
Attachment qb_issues_02212017_2.tar.gz [ 10614 ]

Change by Todd Scholl [22/Feb/17 04:11 AM]
Attachment Issue_2_21_2017.JPG [ 10615 ]
Attachment Issue_2_21_2017_2.JPG [ 10616 ]

Change by Todd Scholl [28/Feb/17 06:51 PM]
Attachment quickbuild_issues_2_28_console.zip [ 10617 ]
Attachment quickbuild_issues_2_28_quickbuild.zip [ 10618 ]
Attachment quickbuild_issues_2_28_console.log.1.zip [ 10619 ]

Change by Robin Shen [17/Jan/18 07:19 AM]
Status Open [ 1 ] Closed [ 6 ]
Resolution Cannot Reproduce [ 5 ]