Python filedescriptor out of range

[wmoore]

Running tests on my machine, with this Python

Python 2.5.1 (r251:54863, Dec 16 2010, 14:12:43) 
[GCC 4.0.1 (Apple Inc. build 5465)] on darwin

Gives this.. (NB: without changing ulimit)

$ cd components/tools/OmeroPy/
$ . source 
$ ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) 6144
file size               (blocks, -f) unlimited
max locked memory       (kbytes, -l) unlimited
max memory size         (kbytes, -m) unlimited
open files                      (-n) 256
pipe size            (512 bytes, -p) 1
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 266
virtual memory          (kbytes, -v) unlimited
$ cd ../../../
$ ./build.py -f components/tools/OmeroPy/build.xml -Dtest.with.fail=true integration

....

----------------------------------------------------------------------
Ran 256 tests in 1585.498s
FAILED (failures=3, errors=11)
Generating XML reports...

BUILD SUCCESSFUL
Total time: 26 minutes 29 seconds



Most of the failures were
======================================================================
ERROR [16.042s]: testNoParams (scriptstest.makeMovieTest.TestMakeMovie)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/will/Desktop/OMERO/components/tools/OmeroPy/test/scriptstest/makeMovieTest.py", line 26, in testNoParams
    imported_pix = ",".join(self.import_image())
  File "/Users/will/Desktop/OMERO/components/tools/OmeroPy/test/integration/library.py", line 152, in import_image
    out, err = popen.communicate()
  File "/System/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/subprocess.py", line 667, in communicate
    return self._communicate(input)
  File "/System/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/subprocess.py", line 1138, in _communicate
    rlist, wlist, xlist = select.select(read_set, write_set, [])
ValueError: filedescriptor out of range in select()

[jmoore]

Chris, here's what I found in the way of causes:

• ​http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/6.1_Technical_Notes/python.html
• ​https://bugzilla.redhat.com/show_bug.cgi?id=650588

Should be fixed in later Python versions.

[jmoore]

Passing to Chris for evaluation. Perhaps just something we add to "known limitations" ?

[cxallan]

Fixed in Python 2.7.0. Source: ​http://bugs.python.org/issue3392 and ​http://hg.python.org/cpython/raw-file/eb3c9b74884c/Misc/NEWS (Python 2.7.2 changelog)

What's New in Python 2.7 alpha 1
================================
*Release date: 2009-12-05*

Core and Builtins
-----------------
...
Library
-------
...
- Issue #3392: The subprocess communicate() method no longer fails in select()
  when file descriptors are large; communicate() now uses poll() when possible.

[cxallan]

Added text to the known limitations page (http://www.openmicroscopy.org/site/support/omero4/known-limitations) on the OME website, closing.