History | Log In     View a printable version of the current page.  
Issue Details (XML | Word | Printable)

Key: QB-4132
Type: Bug Bug
Status: Closed Closed
Resolution: Won't Fix
Priority: Major Major
Assignee: Robin Shen
Reporter: Phong Trinh
Votes: 0
Watchers: 0
Operations

If you were logged in you would be able to see more operations.
QuickBuild

QuickBuild service on Linux node stopped occasionally.

Created: 21/Nov/24 09:35 PM   Updated: 03/Dec/24 01:27 AM
Component/s: None
Affects Version/s: 12.0.19
Fix Version/s: None

Original Estimate: Unknown Remaining Estimate: Unknown Time Spent: Unknown
File Attachments: None
Image Attachments:

1. qb-service-stopped.PNG
(99 kb)


 Description  « Hide
 We upgraded our Linux nodes to Red Hat 8 and are experiencing the following issue very often:
 2024-11-21 19:30:08,167 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Stopping QuickBuild agent...
 2024-11-21 19:30:08,188 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Disconnecting from server...
 2024-11-21 19:30:08,190 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Waiting for finish of remaining jobs...
 2024-11-21 19:30:08,190 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Stopping plugins...
 2024-11-21 19:30:08,191 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Stopping task scheduler...
 2024-11-21 19:30:08,200 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - QuickBuild agent stopped.

 Looks like the service is stopped by itself. May you give me any idea why it happens?

 Thank you in advance,
ptrinh

 All   Comments   Work Log   Change History      Sort Order:
Robin Shen [21/Nov/24 11:20 PM]
Please check "logs/console.log" to see if there are more info for agent stopping.

Phong Trinh [22/Nov/24 03:17 AM]
I took a snapshot of the console.log

Change by Phong Trinh [22/Nov/24 03:17 AM]
Field Original Value New Value
Attachment qb-service-stopped.PNG [ 11010 ]

Phong Trinh [22/Nov/24 03:58 AM]
Per the logs in console.log file, there were no activities for ~30 minutes before the service was shutting down.
 wrapper | TERM trapped. Shutting down.

Robin Shen [22/Nov/24 12:42 PM]
Seems that it gets terminated by some other process. If I remembered correctly, you have some tests running on agents, and restart the agent after test done. Could that be related?

Phong Trinh [22/Nov/24 01:44 PM]
Thank you for promptly responses, Robin!
 These Linux systems are for builds and not reverted, and the other systems that you mentioned are for tests and reverted after the tests are done.

Robin Shen [22/Nov/24 02:09 PM]
Please edit <agent dir>/conf/wrapper.conf to uncomment below line:

# wrapper.debug=TRUE

Then restart the agent to get more debug logging in "logs/console.log" when the issue happens next time.

Phong Trinh [22/Nov/24 02:16 PM]
I turned the debug on and will keep an eye on the system. Thank you!

Phong Trinh [03/Dec/24 01:25 AM]
Hi Robin,
 I think I found the root cause of the issue. There was an admin setup that terminated any tasks/processes that were associated with the service account after they were idle for period of time. QB agent was running under this service account; therefore, it was shutting down occasionally.
 Please close this ticket when you have a chance.
 Thank you for your help,
ptrinh

Change by Robin Shen [03/Dec/24 01:27 AM]
Status Open [ 1 ] Closed [ 6 ]
Resolution Won't Fix [ 2 ]