Bug: OMERO.tables too many open files

[spli]

This occurred after running the tablestest.service unit tests several times to try to figure out a problem (so lots of failed tests and exceptions). I'm not sure if this is a bug where files aren't being closed properly, or expected behaviour and the python resource limits need to be increased.

If anyone else comes across this add a comment.

11  )  Meth: TablesI.getTable
2012-12-05 19:51:22,417 INFO  [                    omero.tables.TablesI] (Dummy-11  ) getTable: 1233 {'omero.session.uuid': '6088372c-65f8-4618-8956-8f2792a4ca9c', 'omero.client.uuid': 'dd35cfe4-bd6c-4789-aaec-692fd261fc07'}
2012-12-05 19:51:22,419 INFO  [                            omero.remote] (Dummy-11  )  Excp: [Errno 24] Too many open files: '/Users/simon/var/omero.data/Files/Dir-001/1233'
2012-12-05 19:51:22,419 WARNI [                            omero.remote] (Dummy-11  ) <function getTable at 0x110c87c08> raised a non-ServerError (<type 'exceptions.IOError'>): [Errno 24] Too many open files: '/Users/simon/var/omero.data/Files/Dir-001/1233'
2012-12-05 19:51:27,550 INFO  [                            omero.remote] (Dummy-5   )  Meth: TablesI.getTable
2012-12-05 19:51:27,550 INFO  [                    omero.tables.TablesI] (Dummy-5   ) getTable: 1234 {'omero.session.uuid': '4e17b10d-81f6-4a77-8c63-629b6cc419c6', 'omero.client.uuid': 'dba0716b-3da7-4298-892a-fb0bb0fbc083'}
2012-12-05 19:51:27,552 INFO  [                            omero.remote] (Dummy-5   )  Excp: [Errno 24] Too many open files: '/Users/simon/var/omero.data/Files/Dir-001/1234'
2012-12-05 19:51:27,552 WARNI [                            omero.remote] (Dummy-5   ) <function getTable at 0x110c87c08> raised a non-ServerError (<type 'exceptions.IOError'>): [Errno 24] Too many open files: '/Users/simon/var/omero.data/Files/Dir-001/1234'
2012-12-05 19:51:56,996 WARNI [                                  stderr] (Dummy-8   ) 2012-12-05 19:51:56.996877 Tables-0: error: fatal error: can't accept more connections:
Network.cpp:1273: Ice::SocketException:
socket exception: Too many open files

Update

This is a bug:

bash$ let n=0; while true; do let n++; echo $n; python -m unittest -b tablestest.service; done

...

12
.............
----------------------------------------------------------------------
Ran 13 tests in 12.864s
OK
13
FFFFFFFFFFF.F
======================================================================

Default Python limits:

In [3242]: resource.getrlimit(resource.RLIMIT_NOFILE)
Out[3242]: (256, 9223372036854775807)

bash$ lsof +D ~/var/omero.data/Files |wc
     239    2151   24558
bash$ lsof +D ~/var/omero.data/Files |head -n3
COMMAND   PID  USER   FD   TYPE DEVICE SIZE/OFF    NODE NAME
Python  20672 simon   16u   REG    1,3     6000 6731392 /Users/simon/var/omero.data/Files/Dir-001/1430
Python  20672 simon   20u   REG    1,3     6000 6731392 /Users/simon/var/omero.data/Files/Dir-001/1430

[jburel]

Moved from sprint Bugs Fixing

[spli]

​https://github.com/openmicroscopy/openmicroscopy/pull/806
​https://github.com/openmicroscopy/openmicroscopy/pull/907