Bug #5644
closed"Too man open files" error when running 3 Metacat/Geoserver webapps together
0%
Description
Derik and I tried to deploy PAR, ESA and EVOS Metacat instances (and corresponding Geoserver webapps) under the same Tomcat instance. After configuring the third (EVOS) webapp, we saw the "Too many open files" message and geoserver-evos failed to start.
We should run tests to isolate the condidtions under which this occurs -- first by ruling out Metacat as the origination of the error then by adding geoserver webapps into the mix one by one.
Updated by Derik Barseghian over 11 years ago
I think the 'open file' limit is set too low. Nick, could you increase this, maybe to 'unlimited', or some large number as you see fit. I believe we then must reboot -- Ben, Matt asked I check w/ you if it's ok to reboot, i.e. if there's anything else of importance besides parc and esa on this machine.
barseghian@mn-ucsb-2:~$ ulimit -aS | grep open
open files (-n) 1024
barseghian@mn-ucsb-2:~$ ulimit -aH | grep open
open files (-n) 1024
Kernel limits seem ok from what I can tell, although aio-max-nr is set lower than what oracle recommends (1048576):
fs.aio-max-nr = 65536
Updated by ben leinfelder over 11 years ago
Reboot away! (Only parc and esa will be affected)
Updated by Nick Brand over 11 years ago
I made the change in /etc/security/limits.conf, from 1024 to 65k.
Updated by Nick Brand over 11 years ago
Also uncommented "session required pam_limits.so" in /etc/pam.d/su
Updated by Derik Barseghian over 11 years ago
Adding to /etc/init.d/tomcat6:
ulimit -Hn 65536
ulimit -Sn 65536
seems to have done the trick, no more 'too many open files' errors, and http://evos.nceas.ucsb.edu/evos/style/skins/default/ is online.
I restarted tomcat to be certain parc, esa, and evos all come up normally, and i think they do (afaict -- there are a lot of errors but I believe they're all 'expected/known').
Will leave open a little while more before closing in case anyone wants to test...