Notice: In order to edit this ticket you need to be either: a Product Owner, The owner or the reporter of the ticket, or, in case of a Task not yet assigned, a team_member"

Task #10377 (closed)

Opened 6 years ago

Closed 5 years ago

Bug: Import out of memory, large number of files

Reported by: khgillen Owned by: jburel
Priority: critical Milestone: 5.0.1
Component: Import Version: 5.0.0
Keywords: n.a. Cc: ux@…, jamoore
Resources: n.a. Referenced By: n.a.
References: n.a. Remaining Time: n.a.
Sprint: n.a.

Description (last modified by khgillen)

4.4.6 mac insight build 102, 4.4.6 VM appliance server..

I pointed the importer at a folder which contained a large number of files (many very small) and the importer ran for a while counting up the files (max reached was 48,158), went away, came back to a stacktrace dialogue.

java.lang.Exception: java.lang.OutOfMemoryError: Java heap space
	at org.openmicroscopy.shoola.agents.fsimporter.util.FileImportComponent.initComponents(FileImportComponent.java:547)
	at org.openmicroscopy.shoola.agents.fsimporter.util.FileImportComponent.<init>(FileImportComponent.java:720)
	at org.openmicroscopy.shoola.agents.fsimporter.util.FileImportComponent.insertFiles(FileImportComponent.java:660)
	at org.openmicroscopy.shoola.agents.fsimporter.util.FileImportComponent.propertyChange(FileImportComponent.java:1437)
	at java.beans.PropertyChangeSupport.firePropertyChange(PropertyChangeSupport.java:339)
	at java.beans.PropertyChangeSupport.firePropertyChange(PropertyChangeSupport.java:276)
	at java.awt.Component.firePropertyChange(Component.java:8255)
	at org.openmicroscopy.shoola.env.data.util.StatusLabel.setFiles(StatusLabel.java:225)
	at org.openmicroscopy.shoola.env.data.OmeroImageServiceImpl.importFile(OmeroImageServiceImpl.java:1302)
	at org.openmicroscopy.shoola.env.data.views.calls.ImagesImporter.importFile(ImagesImporter.java:85)
	at org.openmicroscopy.shoola.env.data.views.calls.ImagesImporter.access$000(ImagesImporter.java:54)
	at org.openmicroscopy.shoola.env.data.views.calls.ImagesImporter$1.doCall(ImagesImporter.java:110)
	at org.openmicroscopy.shoola.env.data.views.BatchCall.doStep(BatchCall.java:144)
	at org.openmicroscopy.shoola.util.concur.tasks.CompositeTask.doStep(CompositeTask.java:226)
	at org.openmicroscopy.shoola.env.data.views.CompositeBatchCall.doStep(CompositeBatchCall.java:126)
	at org.openmicroscopy.shoola.util.concur.tasks.ExecCommand.exec(ExecCommand.java:165)
	at org.openmicroscopy.shoola.util.concur.tasks.ExecCommand.run(ExecCommand.java:276)
	at org.openmicroscopy.shoola.util.concur.tasks.AsyncProcessor$Runner.run(AsyncProcessor.java:91)
	at java.lang.Thread.run(Thread.java:680)

	at org.openmicroscopy.shoola.env.ui.UserNotifierImpl.showErrorDialog(UserNotifierImpl.java:189)
	at org.openmicroscopy.shoola.env.ui.UserNotifierImpl.notifyError(UserNotifierImpl.java:287)
	at org.openmicroscopy.shoola.env.ui.UserNotifierImpl.notifyError(UserNotifierImpl.java:257)
	at org.openmicroscopy.shoola.agents.fsimporter.ImagesImporter.handleException(ImagesImporter.java:138)
	at org.openmicroscopy.shoola.env.data.events.DSCallAdapter.eventFired(DSCallAdapter.java:84)
	at org.openmicroscopy.shoola.env.data.views.BatchCallMonitor$1.run(BatchCallMonitor.java:124)
	at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:209)
	at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:702)
	at java.awt.EventQueue.access$400(EventQueue.java:82)
	at java.awt.EventQueue$2.run(EventQueue.java:663)
	at java.awt.EventQueue$2.run(EventQueue.java:661)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
	at java.awt.EventQueue.dispatchEvent(EventQueue.java:672)
	at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:296)
	at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:211)
	at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:201)
	at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:196)
	at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:188)
	at java.awt.EventDispatchThread.run(EventDispatchThread.java:122)

Attachments (1)

Screen Shot 2013-02-13 at 10.26.31.png (27.2 KB) - added by khgillen 6 years ago.

Download all attachments as: .zip

Change History (5)

Changed 6 years ago by khgillen

comment:1 Changed 6 years ago by khgillen

  • Description modified (diff)

comment:2 Changed 5 years ago by jburel

  • Resolution set to invalid
  • Status changed from new to closed
  • Version set to 5.0.0

see https://github.com/openmicroscopy/openmicroscopy/pull/2207

A limited has been set to 2000, this should prevent such issue.

comment:3 Changed 5 years ago by jamoore

  • Milestone changed from 5.x to 5.0.1
  • Resolution invalid deleted
  • Status changed from closed to reopened

comment:4 Changed 5 years ago by jamoore

  • Priority changed from minor to critical
  • Resolution set to duplicate
  • Status changed from reopened to closed

Changing to duplicate since we did successfully close it. (See #12012)

Note: See TracTickets for help on using tickets. You may also have a look at Agilo extensions to the ticket.

1.3.13-PRO © 2008-2011 Agilo Software all rights reserved (this page was served in: 0.90554 sec.)

We're Hiring!