Warning: Can't synchronize with repository "(default)" (/home/git/ome.git does not appear to be a Git repository.). Look in the Trac log for more information.

Changes between Initial Version and Version 2 of Ticket #6224


Ignore:
Timestamp:
01/16/12 07:36:11 (12 years ago)
Author:
jmoore
Comment:

Currently pushed a version of solution 2 to https://github.com/joshmoore/openmicroscopy/tree/mt-pixeldata. Colin: if possible, it would be good to make sure this is generally working and have it in sprint6-server-backlog so we can do more testing on ome-pfelts.

Legend:

Unmodified
Added
Removed
Modified
  • Ticket #6224

    • Property Status changed from new to accepted
    • Property Cc cblackburn jburel added
    • Property Remaining Time changed from 2.0 to 1.5
    • Property Milestone changed from Unscheduled to OMERO-Beta4.4
    • Property Owner set to jmoore
    • Property Sprint changed from to 2012-01-17 (6)
  • Ticket #6224 – Description

    initial v2  
     1There are several ways to have more through-put in the pixel data system. 
     2 1. '''Run multiple `PixelData` processes''': long-term this option would be beneficial to have more protection between the individual runs. However, at the moment, each process needs a full Hibernate `SessionFactory` which amounts to 512M-1G of overhead. There may also be some contention on the eventlog loading. 
     3 2. '''Have each `PixelData` process be multi-threaded''': this is a fairly straight-forward change which should probably come first. One caveat is the error-handling. If a single thread either throws some specific exception or brings down the whole service, all concurrently processed pyramids may have errors. 
     4 3. '''Have the `makePyramid` call be (more) multi-threaded''': though more complicated to implement, having a multi-threaded call deeper in the stack will better pipeline IO. 

1.3.13-PRO © 2008-2011 Agilo Software all rights reserved (this page was served in: 0.13376 sec.)

We're Hiring!