Task #6232 (closed)
RFE: Speed up .cxd file parsing
| Reported by: | mlinkert | Owned by: | mlinkert |
|---|---|---|---|
| Priority: | minor | Milestone: | Unscheduled |
| Component: | Bio-Formats | Version: | n.a. |
| Keywords: | n.a. | Cc: | |
| Resources: | n.a. | Referenced By: | n.a. |
| References: | n.a. | Remaining Time: | 0.0d |
| Sprint: | n.a. |
Description
See test_images_good/simplepci/mb_220411PS.cxd.
melissa@medusa:~/test_images_good/simplepci$ time inf mb_220411PS.cxd ... real 2m17.379s user 0m38.934s sys 0m24.318s
This is a 1.5 GB file, but it would be nice if setId were a little faster.
Change History (9)
comment:1 Changed 13 years ago by Melissa Linkert <melissa@…>
comment:2 Changed 13 years ago by Melissa Linkert <melissa@…>
(In [8072ddfd6ef391b10db5d5677db07b545436f1f5/bioformats.git]) Do not open a document stream for images.
This saves a lot of time, especially for large files.
See #6232.
comment:3 Changed 13 years ago by mlinkert
- Remaining Time changed from 1 to 0
- Resolution set to fixed
- Status changed from new to closed
Initialization time for our largest .cxd file (~13 GB) is now down to ~7 minutes from ~32 minutes.
The file mentioned above now takes 1 minute and 6 seconds to initialize (approximately half of the previous time).
comment:4 Changed 13 years ago by Melissa Linkert <melissa@…>
(In [a5a945295ade722dddf9d684413755b03a4a86c4/bioformats.git]) Tweak isThisType so that it does not fully parse the file.
This saves many minutes for large non-ZVI files that require POI.
See #6232.
comment:5 Changed 13 years ago by Melissa Linkert <melissa@…>
(In [8072ddfd6ef391b10db5d5677db07b545436f1f5/bioformats.git]) Do not open a document stream for images.
This saves a lot of time, especially for large files.
See #6232.
comment:6 Changed 13 years ago by Melissa Linkert <melissa@…>
(In [469ba62b9d7bde19d7177ef6b823b3139e3e25b7/bioformats.git]) Tweak isThisType so that it does not fully parse the file.
This saves many minutes for large non-ZVI files that require POI.
See #6232.
(cherry picked from commit a5a945295ade722dddf9d684413755b03a4a86c4)
comment:7 Changed 13 years ago by Melissa Linkert <melissa@…>
(In [4df04872a921af630d2096d8b18c7dcd3d92c917/bioformats.git]) Do not open a document stream for images.
This saves a lot of time, especially for large files.
See #6232.
(cherry picked from commit 8072ddfd6ef391b10db5d5677db07b545436f1f5)
comment:8 Changed 13 years ago by Melissa Linkert <melissa@…>
(In [469ba62b9d7bde19d7177ef6b823b3139e3e25b7/bioformats.git]) Tweak isThisType so that it does not fully parse the file.
This saves many minutes for large non-ZVI files that require POI.
See #6232.
(cherry picked from commit a5a945295ade722dddf9d684413755b03a4a86c4)
comment:9 Changed 13 years ago by Melissa Linkert <melissa@…>
(In [4df04872a921af630d2096d8b18c7dcd3d92c917/bioformats.git]) Do not open a document stream for images.
This saves a lot of time, especially for large files.
See #6232.
(cherry picked from commit 8072ddfd6ef391b10db5d5677db07b545436f1f5)
(In [a5a945295ade722dddf9d684413755b03a4a86c4/bioformats.git]) Tweak isThisType so that it does not fully parse the file.
This saves many minutes for large non-ZVI files that require POI.
See #6232.