[#QB-4132] QuickBuild service on Linux node stopped occasionally.

QuickBuild

QuickBuild service on Linux node stopped occasionally.

Created: 21/Nov/24 09:35 PM Updated: 03/Dec/24 01:27 AM

Component/s:

None

Affects Version/s:

12.0.19

Fix Version/s:

None

Original Estimate:

Unknown

Remaining Estimate:

Unknown

Time Spent:

Unknown

File Attachments:

None

Image Attachments:

1. qb-service-stopped.PNG
(99 kb)

Description

« Hide

We upgraded our Linux nodes to Red Hat 8 and are experiencing the following issue very often:
2024-11-21 19:30:08,167 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Stopping QuickBuild agent...
2024-11-21 19:30:08,188 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Disconnecting from server...
2024-11-21 19:30:08,190 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Waiting for finish of remaining jobs...
2024-11-21 19:30:08,190 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Stopping plugins...
2024-11-21 19:30:08,191 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Stopping task scheduler...
2024-11-21 19:30:08,200 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - QuickBuild agent stopped.

Looks like the service is stopped by itself. May you give me any idea why it happens?

Thank you in advance,
ptrinh

All

Comments

Work Log

Change History

Sort Order:

[ Permlink | « Hide ]

Phong Trinh [03/Dec/24 01:25 AM]

Hi Robin,
I think I found the root cause of the issue. There was an admin setup that terminated any tasks/processes that were associated with the service account after they were idle for period of time. QB agent was running under this service account; therefore, it was shutting down occasionally.
Please close this ticket when you have a chance.
Thank you for your help,
ptrinh

[ Permlink | « Hide ]

Phong Trinh [22/Nov/24 02:16 PM]

I turned the debug on and will keep an eye on the system. Thank you!

[ Permlink | « Hide ]

Robin Shen [22/Nov/24 02:09 PM]

Please edit <agent dir>/conf/wrapper.conf to uncomment below line:

# wrapper.debug=TRUE

Then restart the agent to get more debug logging in "logs/console.log" when the issue happens next time.

[ Permlink | « Hide ]

Phong Trinh [22/Nov/24 01:44 PM]

Thank you for promptly responses, Robin!
These Linux systems are for builds and not reverted, and the other systems that you mentioned are for tests and reverted after the tests are done.

[ Permlink | « Hide ]

Robin Shen [22/Nov/24 12:42 PM]

Seems that it gets terminated by some other process. If I remembered correctly, you have some tests running on agents, and restart the agent after test done. Could that be related?

[ Permlink | « Hide ]

Phong Trinh [22/Nov/24 03:58 AM]

Per the logs in console.log file, there were no activities for ~30 minutes before the service was shutting down.
wrapper | TERM trapped. Shutting down.

[ Permlink | « Hide ]

Phong Trinh [22/Nov/24 03:17 AM]

I took a snapshot of the console.log

[ Permlink | « Hide ]

Robin Shen [21/Nov/24 11:20 PM]

Please check "logs/console.log" to see if there are more info for agent stopping.