Project

General

Profile

Bug #5644

"Too man open files" error when running 3 Metacat/Geoserver webapps together

Added by ben leinfelder about 7 years ago. Updated about 7 years ago.

Status:
Resolved
Priority:
Normal
Category:
metacat
Target version:
Start date:
08/06/2012
Due date:
% Done:

0%

Estimated time:
Bugzilla-Id:
5644

Description

Derik and I tried to deploy PAR, ESA and EVOS Metacat instances (and corresponding Geoserver webapps) under the same Tomcat instance. After configuring the third (EVOS) webapp, we saw the "Too many open files" message and geoserver-evos failed to start.

We should run tests to isolate the condidtions under which this occurs -- first by ruling out Metacat as the origination of the error then by adding geoserver webapps into the mix one by one.

History

#1 Updated by Derik Barseghian about 7 years ago

I think the 'open file' limit is set too low. Nick, could you increase this, maybe to 'unlimited', or some large number as you see fit. I believe we then must reboot -- Ben, Matt asked I check w/ you if it's ok to reboot, i.e. if there's anything else of importance besides parc and esa on this machine.
barseghian@mn-ucsb-2:~$ ulimit -aS | grep open
open files (-n) 1024
barseghian@mn-ucsb-2:~$ ulimit -aH | grep open
open files (-n) 1024

Kernel limits seem ok from what I can tell, although aio-max-nr is set lower than what oracle recommends (1048576):
fs.aio-max-nr = 65536

#2 Updated by ben leinfelder about 7 years ago

Reboot away! (Only parc and esa will be affected)

#3 Updated by Nick Brand about 7 years ago

I made the change in /etc/security/limits.conf, from 1024 to 65k.

#4 Updated by Nick Brand about 7 years ago

Also uncommented "session required pam_limits.so" in /etc/pam.d/su

#5 Updated by Derik Barseghian about 7 years ago

Adding to /etc/init.d/tomcat6:
ulimit -Hn 65536
ulimit -Sn 65536
seems to have done the trick, no more 'too many open files' errors, and http://evos.nceas.ucsb.edu/evos/style/skins/default/ is online.

I restarted tomcat to be certain parc, esa, and evos all come up normally, and i think they do (afaict -- there are a lot of errors but I believe they're all 'expected/known').

Will leave open a little while more before closing in case anyone wants to test...

#6 Updated by ben leinfelder about 7 years ago

Looks good!

#7 Updated by Redmine Admin over 6 years ago

Original Bugzilla ID was 5644

Also available in: Atom PDF