| << Back to previous view |
|
[QB-4132] QuickBuild service on Linux node stopped occasionally.
|
|
| Status: | Closed |
| Project: | QuickBuild |
| Component/s: | None |
| Affects Version/s: | 12.0.19 |
| Fix Version/s: | None |
| Type: | Bug | Priority: | Major |
| Reporter: | Phong Trinh | Assigned To: | Robin Shen |
| Resolution: | Won't Fix | Votes: | 0 |
| Remaining Estimate: | Unknown | Time Spent: | Unknown |
| Original Estimate: | Unknown | ||
| File Attachments: |
qb-service-stopped.PNG
|
| Description |
|
We upgraded our Linux nodes to Red Hat 8 and are experiencing the following issue very often:
2024-11-21 19:30:08,167 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Stopping QuickBuild agent... 2024-11-21 19:30:08,188 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Disconnecting from server... 2024-11-21 19:30:08,190 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Waiting for finish of remaining jobs... 2024-11-21 19:30:08,190 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Stopping plugins... 2024-11-21 19:30:08,191 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - Stopping task scheduler... 2024-11-21 19:30:08,200 [WrapperListener_stop_runner] INFO com.pmease.quickbuild.Quickbuild - QuickBuild agent stopped. Looks like the service is stopped by itself. May you give me any idea why it happens? Thank you in advance, ptrinh |
| Comments |
| Comment by Robin Shen [ 21/Nov/24 11:20 PM ] |
| Please check "logs/console.log" to see if there are more info for agent stopping. |
| Comment by Phong Trinh [ 22/Nov/24 03:17 AM ] |
| I took a snapshot of the console.log |
| Comment by Phong Trinh [ 22/Nov/24 03:58 AM ] |
|
Per the logs in console.log file, there were no activities for ~30 minutes before the service was shutting down.
wrapper | TERM trapped. Shutting down. |
| Comment by Robin Shen [ 22/Nov/24 12:42 PM ] |
| Seems that it gets terminated by some other process. If I remembered correctly, you have some tests running on agents, and restart the agent after test done. Could that be related? |
| Comment by Phong Trinh [ 22/Nov/24 01:44 PM ] |
|
Thank you for promptly responses, Robin!
These Linux systems are for builds and not reverted, and the other systems that you mentioned are for tests and reverted after the tests are done. |
| Comment by Robin Shen [ 22/Nov/24 02:09 PM ] |
|
Please edit <agent dir>/conf/wrapper.conf to uncomment below line:
# wrapper.debug=TRUE Then restart the agent to get more debug logging in "logs/console.log" when the issue happens next time. |
| Comment by Phong Trinh [ 22/Nov/24 02:16 PM ] |
| I turned the debug on and will keep an eye on the system. Thank you! |
| Comment by Phong Trinh [ 03/Dec/24 01:25 AM ] |
|
Hi Robin,
I think I found the root cause of the issue. There was an admin setup that terminated any tasks/processes that were associated with the service account after they were idle for period of time. QB agent was running under this service account; therefore, it was shutting down occasionally. Please close this ticket when you have a chance. Thank you for your help, ptrinh |