<< Back to previous view

[QB-1164] QB is stuck
Created: 08/Dec/11  Updated: 27/Dec/12

Status: Resolved
Project: QuickBuild
Component/s: None
Affects Version/s: 4.0.18
Fix Version/s: None

Type: Bug Priority: Critical
Reporter: Pini Reznik Assigned To: Robin Shen
Resolution: Incomplete Votes: 0
Remaining Estimate: Unknown Time Spent: Unknown
Original Estimate: Unknown
Environment: Server Information
Host Name nlsrvup-fcr02.intra.local
System Date and Time 2011-12-08 06:54:29
Operating System Linux 2.6.16.60-0.21-smp, amd64
OS User Name quickbuild
JVM Java HotSpot(TM) 64-Bit Server VM 1.6.0_23, Sun Microsystems Inc.
QuickBuild Version 4.0.18 - Sat Dec 03 13:25:39 CET 2011
Total Memory 7.38 GB
Used Memory 1.16 GB
Configurations 2704
Installed Plugins
com.pmease.quickbuild.plugin.scm.subversion;4.0.21
com.pmease.quickbuild.plugin.report.pmd;4.0.19
com.pmease.quickbuild.plugin.report.boosttest;4.0.9
com.pmease.quickbuild.plugin.report.fxcop;4.0.20
com.pmease.quickbuild.plugin.report.changes;4.0.39
com.pmease.quickbuild.plugin.scm.filesystem;4.0.19
com.pmease.quickbuild.plugin.notifier.passive;4.0.1
com.pmease.quickbuild.plugin.scm.cvs;4.0.19
com.pmease.quickbuild.plugin.scm.tfs;4.0.28
com.pmease.quickbuild.plugin.notifier.email;4.0.19
com.pmease.quickbuild.plugin.tracker.core;4.0.37
com.pmease.quickbuild.plugin.tracker.redmine;4.0.15
com.pmease.quickbuild.plugin.scm.starteam;4.0.20
com.pmease.quickbuild.plugin.report.junit;4.0.34
com.pmease.quickbuild.plugin.report.engine;4.0.42
com.pmease.quickbuild.plugin.scm.bazaar;4.0.19
com.pmease.quickbuild.plugin.authenticator.ldap;4.0.1
com.pmease.quickbuild.plugin.scm.perforce;4.0.26
com.pmease.quickbuild.plugin.builder.ant;4.0.1
com.pmease.quickbuild.plugin.htmlreport;4.0.19
com.pmease.quickbuild.plugin.scm.helper;4.0.18
com.pmease.quickbuild.plugin.tracker.trac;4.0.36
com.pmease.quickbuild.plugin.report.mstest;4.0.34
com.pmease.quickbuild.plugin.scm.mercurial;4.0.19
com.pmease.quickbuild.plugin.basis;4.0.27
com.pmease.quickbuild.plugin.scm.clearcase;4.0.27
com.pmease.quickbuild.plugin.report.emma;4.0.25
com.pmease.quickbuild.plugin.notifier.jabber;4.0.19
com.pmease.quickbuild.plugin.report.buildstats;4.0.27
com.pmease.quickbuild.plugin.report.cpd;4.0.25
com.pmease.quickbuild.plugin.builder.rake;4.0.1
com.pmease.quickbuild.plugin.scm.accurev;4.0.19
com.pmease.quickbuild.plugin.scm.repo;4.0.27
com.pmease.quickbuild.plugin.builder.nant;4.0.1
com.pmease.quickbuild.plugin.tracker.teamforge;4.0.36
com.pmease.quickbuild.plugin.report.mbunit;4.0.33
com.pmease.quickbuild.plugin.report.ncover;4.0.25
com.pmease.quickbuild.plugin.scm.git;4.0.25
com.pmease.quickbuild.plugin.tracker.bugzilla;4.0.36
com.pmease.quickbuild.plugin.report.testng;4.0.33
com.pmease.quickbuild.plugin.report.nunit;4.0.33
com.example.promptbean;4.0.0
com.pmease.quickbuild.plugin.notifier.msn;4.0.19
com.pmease.quickbuild.plugin.builder.msbuild;4.0.1
com.pmease.quickbuild.plugin.builder.devenv;4.0.1
com.pmease.quickbuild.plugin.report.cobertura;4.0.19
com.pmease.quickbuild.plugin.artifact;4.0.28
com.pmease.quickbuild.plugin.scm.vss;4.0.19
com.pmease.quickbuild.plugin.report.checkstyle;4.0.25
com.pmease.quickbuild.plugin.tracker.jira;4.0.42
com.pmease.quickbuild.plugin.builder.maven;4.0.13
com.pmease.quickbuild.plugin.report.customstats;4.0.9
com.pmease.quickbuild.plugin.report.findbugs;4.0.33
Grid Information
Build Agents 62
User Agents 2


 Description   
Hello,
About a week ago I sent another request where I reported that our server got stack.
This is the second time it happens in exactly the same way.
We have few hundreds of builds starting every night at 10PM.
Tonight, everything worked OK till 10PM. First 6-7 second after that it was still processing requests, and then, just nothing except few errors we get all the time

2011-12-07 22:10:06,433 [1542123897@qtp-237656761-6042] ERROR com.pmease.quickbuild.rest.providers.AccessDeniedExceptionMapper - Access denied when accessing
 restful service.
 com.pmease.quickbuild.AccessDeniedException: Access denied for builds under configuration 'root/Intake/n

and at 10:42PM it started to remove agents


2011-12-07 22:42:25,395 [Thread-21] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'ehv-lx-016.intra.local:8811' timed out, removin
g...
2011-12-07 22:42:25,395 [Thread-21] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'ehv-lx-026.intra.local:8811' timed out, removin
g...
2011-12-07 22:42:25,395 [Thread-21] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'ehv-lx-023.intra.local:8811' timed out, removin
g...


I tried to access the web interface around 6AM and it was not accessible. Not down, just stuck.
Since this is a second time it becomes very important for us.
Our development organization relies heavily on this tool


Thanks
Pini
Generated at Thu May 16 21:32:40 UTC 2024 using JIRA 189.