<< Back to previous view

[QB-3744] Quickbuild server restart with no reason. Could you help me explain this logs to me?
Created: 17/Jun/21  Updated: 08/Jan/22

Status: Closed
Project: QuickBuild
Component/s: None
Affects Version/s: 10.0.15
Fix Version/s: None

Type: Bug Priority: Major
Reporter: Cheolhee Jeon Assigned To: Robin Shen
Resolution: Cannot Reproduce Votes: 0
Remaining Estimate: 1 day Time Spent: Unknown
Original Estimate: 1 day
Environment: ubuntu16.04(k8s pod)


 Description   
Hello, Robin.

I've got something weird situation with Quickbuild server.
It has just got restarted in my environment - k8s pod (qb server & agent) with no reason.
I want to know why this happen occurs, but I can't understand with logs.
could you explain this logs to me?

thx.

 Comments   
Comment by Cheolhee Jeon [ 17/Jun/21 07:22 AM ]
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-19:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-18:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-17:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-16:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-15:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-14:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-13:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-12:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-11:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-10:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-9:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-7:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-6:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-5:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-4:8811' timed out, removing...
2021-06-17 13:52:57,259 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-3:8811' timed out, removing...
2021-06-17 13:52:57,258 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-2:8811' timed out, removing...
2021-06-17 13:52:57,258 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-1:8811' timed out, removing...
2021-06-17 13:52:57,257 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'qb-slsi-ap-android-base-0:8811' timed out, removing...
2021-06-17 13:52:56,670 [Thread-74] INFO com.pmease.quickbuild.grid.DefaultAgentManager - Active build agent 'DCSPTSFILE:8812' timed out, removing...
2021-06-17 13:52:18,501 [qtp848012768-28] ERROR com.pmease.quickbuild.rest.providers.GenericExceptionMapper - Error serving restful request.
 org.hibernate.ObjectNotFoundException: No row with the given identifier exists: [com.pmease.quickbuild.model.Build#5778]
  at org.hibernate.internal.SessionFactoryImpl$1$1.handleEntityNotFound(SessionFactoryImpl.java:253)
  at org.hibernate.proxy.AbstractLazyInitializer.checkTargetState(AbstractLazyInitializer.java:262)
  at org.hibernate.proxy.AbstractLazyInitializer.initialize(AbstractLazyInitializer.java:176)
Comment by Robin Shen [ 17/Jun/21 07:23 AM ]
No logs attached.
Comment by Cheolhee Jeon [ 17/Jun/21 07:23 AM ]
46 row all ~~~
2021-06-17 13:52:18,488 [qtp848012768-35] ERROR com.pmease.quickbuild.rest.providers.GenericExceptionMapper - Error serving restful request.
 org.hibernate.ObjectNotFoundException: No row with the given identifier exists: [com.pmease.quickbuild.model.Build#5779]
  at org.hibernate.internal.SessionFactoryImpl$1$1.handleEntityNotFound(SessionFactoryImpl.java:253)
  at org.hibernate.proxy.AbstractLazyInitializer.checkTargetState(AbstractLazyInitializer.java:262)
  at org.hibernate.proxy.AbstractLazyInitializer.initialize(AbstractLazyInitializer.java:176)
46 row all ~~~
2021-06-17 13:52:18,476 [qtp848012768-63] ERROR com.pmease.quickbuild.rest.providers.GenericExceptionMapper - Error serving restful request.
 org.hibernate.ObjectNotFoundException: No row with the given identifier exists: [com.pmease.quickbuild.model.Build#5781]
  at org.hibernate.internal.SessionFactoryImpl$1$1.handleEntityNotFound(SessionFactoryImpl.java:253)
  at org.hibernate.proxy.AbstractLazyInitializer.checkTargetState(AbstractLazyInitializer.java:262)
  at org.hibernate.proxy.AbstractLazyInitializer.initialize(AbstractLazyInitializer.java:176)
46 row all ~~~
2021-06-17 13:52:18,464 [qtp848012768-36] ERROR com.pmease.quickbuild.rest.providers.GenericExceptionMapper - Error serving restful request.
 org.hibernate.ObjectNotFoundException: No row with the given identifier exists: [com.pmease.quickbuild.model.Build#5784]
  at org.hibernate.internal.SessionFactoryImpl$1$1.handleEntityNotFound(SessionFactoryImpl.java:253)
  at org.hibernate.proxy.AbstractLazyInitializer.checkTargetState(AbstractLazyInitializer.java:262)
  at org.hibernate.proxy.AbstractLazyInitializer.initialize(AbstractLazyInitializer.java:176)
46 row all ~~~
2021-06-17 13:52:18,452 [qtp848012768-77] ERROR com.pmease.quickbuild.rest.providers.GenericExceptionMapper - Error serving restful request.
 org.hibernate.ObjectNotFoundException: No row with the given identifier exists: [com.pmease.quickbuild.model.Build#5785]
  at org.hibernate.internal.SessionFactoryImpl$1$1.handleEntityNotFound(SessionFactoryImpl.java:253)
  at org.hibernate.proxy.AbstractLazyInitializer.checkTargetState(AbstractLazyInitializer.java:262)
  at org.hibernate.proxy.AbstractLazyInitializer.initialize(AbstractLazyInitializer.java:176)
46 row all ~~~
2021-06-17 13:52:18,439 [qtp848012768-22] ERROR com.pmease.quickbuild.rest.providers.GenericExceptionMapper - Error serving restful request.
 org.hibernate.ObjectNotFoundException: No row with the given identifier exists: [com.pmease.quickbuild.model.Build#5787]
  at org.hibernate.internal.SessionFactoryImpl$1$1.handleEntityNotFound(SessionFactoryImpl.java:253)
  at org.hibernate.proxy.AbstractLazyInitializer.checkTargetState(AbstractLazyInitializer.java:262)
  at org.hibernate.proxy.AbstractLazyInitializer.initialize(AbstractLazyInitializer.java:176)
46 row all ~~~
2021-06-17 13:52:18,424 [qtp848012768-33] ERROR com.pmease.quickbuild.rest.providers.GenericExceptionMapper - Error serving restful request.
 org.hibernate.ObjectNotFoundException: No row with the given identifier exists: [com.pmease.quickbuild.model.Build#5789]
  at org.hibernate.internal.SessionFactoryImpl$1$1.handleEntityNotFound(SessionFactoryImpl.java:253)
  at org.hibernate.proxy.AbstractLazyInitializer.checkTargetState(AbstractLazyInitializer.java:262)
  at org.hibernate.proxy.AbstractLazyInitializer.initialize(AbstractLazyInitializer.java:176)
46 row all ~~~
2021-06-17 13:52:18,409 [qtp848012768-39] ERROR com.pmease.quickbuild.rest.providers.GenericExceptionMapper - Error serving restful request.
 org.hibernate.ObjectNotFoundException: No row with the given identifier exists: [com.pmease.quickbuild.model.Build#5797]
  at org.hibernate.internal.SessionFactoryImpl$1$1.handleEntityNotFound(SessionFactoryImpl.java:253)
  at org.hibernate.proxy.AbstractLazyInitializer.checkTargetState(AbstractLazyInitializer.java:262)
  at org.hibernate.proxy.AbstractLazyInitializer.initialize(AbstractLazyInitializer.java:176)
46 row all ~~~
2021-06-17 13:52:18,392 [qtp848012768-37] ERROR com.pmease.quickbuild.rest.providers.GenericExceptionMapper - Error serving restful request.
 org.hibernate.ObjectNotFoundException: No row with the given identifier exists: [com.pmease.quickbuild.model.Build#5800]
  at org.hibernate.internal.SessionFactoryImpl$1$1.handleEntityNotFound(SessionFactoryImpl.java:253)
  at org.hibernate.proxy.AbstractLazyInitializer.checkTargetState(AbstractLazyInitializer.java:262)
  at org.hibernate.proxy.AbstractLazyInitializer.initialize(AbstractLazyInitializer.java:176)
46 row all ~~~
2021-06-17 13:51:59,651 [pool-2-thread-6838] INFO com.pmease.quickbuild.DefaultBuildEngine - Checking build condition on node (address: DCSPTSFILE:8812, ip: 10.166.101.48)...
2021-06-17 13:51:59,638 [Thread-73] ERROR com.pmease.quickbuild.DefaultBuildEngine - Error allocating node for step 'master'.
 com.pmease.quickbuild.QuickbuildException: Can not find any node matching specified criteria.
  at com.pmease.quickbuild.DefaultBuildEngine.run(DefaultBuildEngine.java:1382)
  at java.lang.Thread.run(Thread.java:748)
2021-06-17 13:51:59,634 [pool-2-thread-6838] INFO com.pmease.quickbuild.DefaultBuildEngine - Processing build request (configuration:root/sat-cicd/sat-ap-unit-test, request id:e427f32b-dc78-48e4-b236-5c1b20f30046)
2021-06-17 13:51:59,629 [Thread-73] ERROR com.pmease.quickbuild.DefaultBuildEngine - Error allocating node for step 'master'.
 com.pmease.quickbuild.QuickbuildException: Can not find any node matching specified criteria.
  at com.pmease.quickbuild.DefaultBuildEngine.run(DefaultBuildEngine.java:1382)
  at java.lang.Thread.run(Thread.java:748)
2021-06-17 13:51:59,550 [Thread-73] ERROR com.pmease.quickbuild.DefaultBuildEngine - Error allocating node for step 'master'.
 com.pmease.quickbuild.QuickbuildException: Can not find any node matching specified criteria.
Comment by Cheolhee Jeon [ 17/Jun/21 07:25 AM ]
I've try to upload logs in text, but it seems like encoding iussue occurs to me. (my mother languages in it, and it makes error I guess)
anyway, I've change all the languages in English on comment.
Thx for quick reply~ :)
Comment by Robin Shen [ 17/Jun/21 07:27 AM ]
There is no sign of server restarting in the log. Only that build agent is shutdown abnormally.
Comment by Robin Shen [ 17/Jun/21 07:28 AM ]
You send me email directly at [robin AT pmease DOT com]
Generated at Thu May 02 04:51:16 UTC 2024 using JIRA 189.