Task #10377 (closed)
Opened 6 years ago
Closed 5 years ago
Bug: Import out of memory, large number of files
| Reported by: | khgillen | Owned by: | jburel |
|---|---|---|---|
| Priority: | critical | Milestone: | 5.0.1 |
| Component: | Import | Version: | 5.0.0 |
| Keywords: | n.a. | Cc: | ux@…, jamoore |
| Resources: | n.a. | Referenced By: | n.a. |
| References: | n.a. | Remaining Time: | n.a. |
| Sprint: | n.a. |
Description (last modified by khgillen)
4.4.6 mac insight build 102, 4.4.6 VM appliance server..
I pointed the importer at a folder which contained a large number of files (many very small) and the importer ran for a while counting up the files (max reached was 48,158), went away, came back to a stacktrace dialogue.
java.lang.Exception: java.lang.OutOfMemoryError: Java heap space at org.openmicroscopy.shoola.agents.fsimporter.util.FileImportComponent.initComponents(FileImportComponent.java:547) at org.openmicroscopy.shoola.agents.fsimporter.util.FileImportComponent.<init>(FileImportComponent.java:720) at org.openmicroscopy.shoola.agents.fsimporter.util.FileImportComponent.insertFiles(FileImportComponent.java:660) at org.openmicroscopy.shoola.agents.fsimporter.util.FileImportComponent.propertyChange(FileImportComponent.java:1437) at java.beans.PropertyChangeSupport.firePropertyChange(PropertyChangeSupport.java:339) at java.beans.PropertyChangeSupport.firePropertyChange(PropertyChangeSupport.java:276) at java.awt.Component.firePropertyChange(Component.java:8255) at org.openmicroscopy.shoola.env.data.util.StatusLabel.setFiles(StatusLabel.java:225) at org.openmicroscopy.shoola.env.data.OmeroImageServiceImpl.importFile(OmeroImageServiceImpl.java:1302) at org.openmicroscopy.shoola.env.data.views.calls.ImagesImporter.importFile(ImagesImporter.java:85) at org.openmicroscopy.shoola.env.data.views.calls.ImagesImporter.access$000(ImagesImporter.java:54) at org.openmicroscopy.shoola.env.data.views.calls.ImagesImporter$1.doCall(ImagesImporter.java:110) at org.openmicroscopy.shoola.env.data.views.BatchCall.doStep(BatchCall.java:144) at org.openmicroscopy.shoola.util.concur.tasks.CompositeTask.doStep(CompositeTask.java:226) at org.openmicroscopy.shoola.env.data.views.CompositeBatchCall.doStep(CompositeBatchCall.java:126) at org.openmicroscopy.shoola.util.concur.tasks.ExecCommand.exec(ExecCommand.java:165) at org.openmicroscopy.shoola.util.concur.tasks.ExecCommand.run(ExecCommand.java:276) at org.openmicroscopy.shoola.util.concur.tasks.AsyncProcessor$Runner.run(AsyncProcessor.java:91) at java.lang.Thread.run(Thread.java:680) at org.openmicroscopy.shoola.env.ui.UserNotifierImpl.showErrorDialog(UserNotifierImpl.java:189) at org.openmicroscopy.shoola.env.ui.UserNotifierImpl.notifyError(UserNotifierImpl.java:287) at org.openmicroscopy.shoola.env.ui.UserNotifierImpl.notifyError(UserNotifierImpl.java:257) at org.openmicroscopy.shoola.agents.fsimporter.ImagesImporter.handleException(ImagesImporter.java:138) at org.openmicroscopy.shoola.env.data.events.DSCallAdapter.eventFired(DSCallAdapter.java:84) at org.openmicroscopy.shoola.env.data.views.BatchCallMonitor$1.run(BatchCallMonitor.java:124) at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:209) at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:702) at java.awt.EventQueue.access$400(EventQueue.java:82) at java.awt.EventQueue$2.run(EventQueue.java:663) at java.awt.EventQueue$2.run(EventQueue.java:661) at java.security.AccessController.doPrivileged(Native Method) at java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87) at java.awt.EventQueue.dispatchEvent(EventQueue.java:672) at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:296) at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:211) at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:201) at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:196) at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:188) at java.awt.EventDispatchThread.run(EventDispatchThread.java:122)
Attachments (1)
Change History (5)
Changed 6 years ago by khgillen
comment:1 Changed 6 years ago by khgillen
- Description modified (diff)
comment:2 Changed 5 years ago by jburel
- Resolution set to invalid
- Status changed from new to closed
- Version set to 5.0.0
comment:3 Changed 5 years ago by jamoore
- Milestone changed from 5.x to 5.0.1
- Resolution invalid deleted
- Status changed from closed to reopened
comment:4 Changed 5 years ago by jamoore
- Priority changed from minor to critical
- Resolution set to duplicate
- Status changed from reopened to closed
Changing to duplicate since we did successfully close it. (See #12012)
see https://github.com/openmicroscopy/openmicroscopy/pull/2207
A limited has been set to 2000, this should prevent such issue.