BUG: Deleting of images under windows does not remove pixels binary data from omero/pixels folder

[bwzloranger]

(as above).. blitz message says 'warning: 1 file(s) comprising XXX bytes were not removed' This ticket blocks test: #5506

[jmoore]

Brian, can you attach the log files please?

[jmoore]

Brian, there's nothing more in your log other than the line you pointed out (unfortunately). Can you please reproduce and give me the exact steps. Thanks.

[jmoore]

If this was pixels 101, then the following might explain at least one scenario:

~/Downloads/5515/Logs $ grep 101 Blitz-0.log 
...
2011-05-24 11:09:43,892 INFO  [  ome.services.pixeldata.PixelDataThread] (2-thread-2) Creating PIXELDATA event for pixels id:101
2011-05-24 11:09:43,907 INFO  [                ome.io.nio.PixelsService] (l.Server-1) Missing pyramid:c:\OMERO\Pixels\101_pyramid
2011-05-24 11:09:44,610 INFO  [        ome.services.util.ServiceHandler] (l.Server-5)  Args:	[class ome.model.core.Image, (101), (), (), ome.parameters.Parameters@aafeff]
2011-05-24 11:09:44,657 INFO  [        ome.services.util.ServiceHandler] (l.Server-5)  Rslt:	{101=(ome.model.annotations.FileAnnotation:Id_151)}
2011-05-24 11:09:44,704 INFO  [        ome.services.util.ServiceHandler] (l.Server-4)  Args:	[101]
2011-05-24 11:09:44,751 INFO  [        ome.services.util.ServiceHandler] (l.Server-4)  Rslt:	ome.model.core.Pixels:Id_101
2011-05-24 11:09:44,767 INFO  [        ome.services.util.ServiceHandler] (l.Server-8)  Args:	[101, 0]
2011-05-24 11:09:44,782 INFO  [        ome.services.util.ServiceHandler] (l.Server-8)  Rslt:	(ome.model.display.RenderingDef:Id_101)
2011-05-24 11:09:44,954 INFO  [        ome.services.util.ServiceHandler] (l.Server-1)  Rslt:	{102=[-1, -40, -1, ... 1 more], 103=[-1, -40, -1, ... 1 more], 101=[-1, -40, -1, ... 1 more], ... 1 more}
2011-05-24 11:09:52,563 INFO  [   ome.services.blitz.impl.DeleteHandleI] (3-thread-5) Deleting /Image:101
... This leads to the warning ...

~/Downloads/5515/Logs $ grep 101 PixelData-0.log 
2011-05-24 10:25:41,101 INFO  [             ome.io.nio.RomioPixelBuffer] (3-thread-1) Retrieving plane: 0x1x0
2011-05-24 10:25:43,101 INFO  [             ome.io.nio.RomioPixelBuffer] (3-thread-1) Retrieving plane: 0x1x0
2011-05-24 10:26:49,101 INFO  [             ome.io.nio.RomioPixelBuffer] (3-thread-1) Retrieving plane: 0x1x0
2011-05-24 10:28:31,101 INFO  [             ome.io.nio.RomioPixelBuffer] (3-thread-1) Retrieving plane: 0x2x0
2011-05-24 10:28:43,101 INFO  [             ome.io.nio.RomioPixelBuffer] (3-thread-1) Retrieving plane: 0x2x0
2011-05-24 10:28:46,101 INFO  [             ome.io.nio.RomioPixelBuffer] (3-thread-1) Retrieving plane: 0x2x0
2011-05-24 10:29:35,101 INFO  [             ome.io.nio.RomioPixelBuffer] (3-thread-1) Retrieving plane: 0x2x0
2011-05-24 10:30:07,101 INFO  [             ome.io.nio.RomioPixelBuffer] (3-thread-1) Retrieving plane: 0x2x0
2011-05-24 11:09:45,485 INFO  [e.io.bioformats.OmeroPixelsPyramidWriter] (3-thread-3) setId(c:\OMERO\Pixels\.101_pyramid7646151252646832883.tmp)
2011-05-24 11:13:31,240 INFO  [                ome.io.nio.PixelsService] (3-thread-3) SUCCESS -- Pyramid created for pixels id:101
2011-05-24 11:13:31,240 INFO  [e.io.bioformats.OmeroPixelsPyramidWriter] (3-thread-3) close(c:\OMERO\Pixels\.101_pyramid7646151252646832883.tmp)

[atarkowska]

I got the same problem on Windows test box Delete image 30 Finished 0 error(s) ( Warning: 1file(s) comprising 327680 bytes were not removed.). After a while I refreshed status and it was vanished. It seams that file was deleted successfully.

[atarkowska]

You can reproduce it by:

• import set of 011B1_Morph_A01_s*_w*.TIF and 011B1_Morph_P01_s*_w*.TIF (I store them in dataset called Morph and was importing them with 'Folder As Dataset')
• view thumbnails
• delete orphaned dataset with images and annotations.

In web if you quickly go to STATUS this message is for next minute or less.

[bwzloranger]

This bug seems reproducible under the following conditions:

1) Start windows server
2) Import *.dv from test_images_good\dv
3) In insight, select all images and hit the 'delete' key. Apply delete to all images and attachments.
4) Review pixels in omero\pixels directory - one file remains!

Consistently, the last image in the set will not be deleted and several 'warning: 1file(s) comprising XXX bytes were not removed.' messages appear in the blitz log. (Although it seems all but the last file does get removed).

[bwzloranger]

I've attached my lastest blitz log from the test above.

[bwzloranger]

Latest blitz results for Colin

[jburel]

Moved from sprint 2011-06-02 (13)

[cblackburn]

Downgrading priority. This is a known issue on Windows. However, it does demand further investigation.

[jburel]

Moved from sprint 2011-06-16 (14)

[cblackburn]

In reviewing my bugs I think this one needs to be closed as wontfix (as a bug at least). It's a known limitation of Windows and is documented on the Known Limitations page and on the trac at wiki:Delete#BinaryData There may well be a case for a new Story to look at Windows deletes as they affect more areas than just the Delete Service.