History | Log In     View a printable version of the current page.  
Issue Details (XML | Word | Printable)

Key: QB-3501
Type: Bug Bug
Status: Closed Closed
Resolution: Fixed
Priority: Critical Critical
Assignee: Robin Shen
Reporter: Robin Shen
Votes: 0
Watchers: 0
Operations

If you were logged in you would be able to see more operations.
QuickBuild

Frequently gets "too many files open" error and new builds won't start

Created: 26/Feb/20 01:45 AM   Updated: 12/Aug/20 09:48 PM
Component/s: None
Affects Version/s: 9.0.38
Fix Version/s: 9.0.39

Original Estimate: Unknown Remaining Estimate: Unknown Time Spent: Unknown


 All   Comments   Work Log   Change History      Sort Order:
Change by Robin Shen [09/Mar/20 10:49 AM]
Field Original Value New Value
Status Open [ 1 ] Closed [ 6 ]
Fix Version/s 9.0.39 [ 11932 ]
Resolution Fixed [ 1 ]

Rafael Pallares [11/Aug/20 04:07 PM]
Hi,

I observe this issue to a very small QuickBuild 10.0.3 server (test)
Is the fix have been correctly integrated into QuickBuild 10.+ versions ?

I note this other issue QB-3401 that you suggest to increase ulimit number, but we have a production server at version 8.0.20 which much more activity, and I never seen this issue.

Robin Shen [12/Aug/20 12:23 AM]
The fix was included in 10.0.3. But normally for QB server ulimit should be increased, as it can open a lot of handles considering it needs to talk to build agents and orchestrate each build job

Rafael Pallares [12/Aug/20 08:47 AM]
Ok, thanks for your response.
We have another exception that may cause this one finally.

2020-08-11 16:48:26,209 [MeasurementPollingTask] ERROR oshi.software.os.linux.LinuxFileSystem - Failed to get file counts from statvfs. {}
java.lang.NoClassDefFoundError: Could not initialize class com.sun.jna.Native

Need to investigate further, but we may miss some permissions, may be with Java temp dir.

To stay on the initial topic, do you have a suggested ulimit number for a QuickBuild server?

Robin Shen [12/Aug/20 09:48 PM]
It highly depends on your build agent number and build request volume. For a medium sized installation, I suggest to increase it to 100000 at least.