BUG: Dropbox, importing plate in windows

[dzmacdonald]

When importing the incell3000 data from test_images_good into a windows 7 server:

WindowsError: [Error 32] The process cannot access the file because it is being used by another process: u'C:\\Windows\\system32\\config\\systemprofile\\AppData\\Roaming\\omero\\tmp\\omero_DONALD-PC$\\2448\\dropboxhli5m6out'
2011-06-07 04:13:13,707 INFO  [         fsclient.fsDropBoxMonitorClient] (Thread-3  ) Getting filesets on : set(['c:/omero/DropBox/root/incell3000/samples/SBS/20041103 1049_01_REF-1049-03 - EvoTec_0_H11_0.frm', 'c:/omero/DropBox/root/incell3000/samples/SBS/20041103 1049_01_REF-1049-03 - EvoTec_0_H6_0.frm', 'c:/omero/DropBox/root/incell3000/samples/SBS/20041103 1049_01_REF-1049-03 - EvoTec_0_H1_0.frm', 'c:/omero/DropBox/root/incell3000/samples/SBS/20041103 1049_01_REF-1049-03 - EvoTec_0_H4_0.frm', 'c:/omero/DropBox/root/incell3000/samples/SBS/20041103 1049_01_REF-1049-03 - EvoTec_0_H3_0.frm', 'c:/omero/DropBox/root/incell3000/samples/SBS/20041103 1049_01_REF-1049-03 - EvoTec_0_H7_0.frm', 'c:/omero/DropBox/root/incell3000/samples/SBS/20041103 1049_01_REF-1049-03 - EvoTec_0_H12_0.frm', 'c:/omero/DropBox/root/incell3000/samples/SBS/20041103 1049_01_REF-1049-03 - EvoTec_0_H10_0.frm', 'c:/omero/DropBox/root/incell3000/samples/SBS/20041103 1049_01_REF-1049-03 - EvoTec_0_H2_0.frm', 'c:/omero/DropBox/root/incell3000/samples/SBS/20041103 1049_01_REF-1049-03 - EvoTec_0_H5_0.frm'])
2011-06-07 04:13:13,707 INFO  [         fsclient.fsDropBoxMonitorClient] (Thread-119) Removed key c:\omero\DropBox\root\incell3000\samples\SBS\20041103 1049_01_REF-1049-03 - EvoTec_0_F8_0.frm
2011-06-07 04:13:13,769 WARNI [                                  stderr] (Thread-39 ) Exception in thread Thread-39:
Traceback (most recent call last):
  File "C:\Python26\lib\threading.py", line 534, in __bootstrap_inner
    self.run()
  File "c:\omero_dist\lib\python\omero\util\concurrency.py", line 98, in run
    self.function(*self.args, **self.kwargs)
  File "c:\omero_dist\lib\python\fsDropBoxMonitorClient.py", line 466, in importFileWrapper
    self.importFile(fileId, exName)
  File "c:\omero_dist\lib\python\omero\util\decorators.py", line 28, in handler
    return func(*args, **kwargs)
  File "c:\omero_dist\lib\python\fsDropBoxMonitorClient.py", line 618, in importFile
    remove_path(t)
  File "c:\omero_dist\lib\python\omero\util\temp_files.py", line 345, in remove_path
    return manager.remove_path(file)
  File "c:\omero_dist\lib\python\omero\util\temp_files.py", line 288, in remove_path
    p.remove()
  File "c:\omero_dist\lib\python\path.py", line 939, in remove
    os.remove(self)
WindowsError: [Error 32] The process cannot access the file because it is being used by another process: u'C:\\Windows\\system32\\config\\systemprofile\\AppData\\Roaming\\omero\\tmp\\omero_DONALD-PC$\\2448\\dropboxbx8hllerr'
2011-06-07 04:13:13,894 INFO  [         fsclient.fsDropBoxMonitorClient] (Thread-121) Removed key c:\omero\DropBox\root\incell3000\samples\SBS\20041103 1049_01_REF-1049-03 - EvoTec_0_G12_0.frm

[cblackburn]

It looks like this problem could have wider implications. Any Windows use of remove() from util\temp_files.py may cause errors in Windows due to known problems deleting files (see #5515).

Here the bug can be fixed by catching the exception but we may end up with a lot of temporary files building up.

[dzmacdonald]

works with MIAS 3 D set 2 july 13 2009 in test images good

[cblackburn]

It looks like the underlying cause of this error is that Incell 3000 is not recognised as an SPW format (see #5335) and so 300+ files are imported well beyond acquisition rate. The remove() problem on Windows still needs to be addressed (see #5515) and DropBox should be improved to cope with faster file appearance rates.