Warning: Can't synchronize with repository "(default)" (/home/git/ome.git does not appear to be a Git repository.). Look in the Trac log for more information.
Notice: In order to edit this ticket you need to be either: a Product Owner, The owner or the reporter of the ticket, or, in case of a Task not yet assigned, a team_member"

Task #9827 (closed)

Opened 11 years ago

Closed 11 years ago

Capture server-side import logs

Reported by: jamoore Owned by: cblackburn
Priority: critical Milestone: 5.0.0-beta1
Component: OmeroFs Version: n.a.
Keywords: n.a. Cc: ux@…, bpindelski, jburel, cblackburn, wmoore, cxallan, mlinkert
Resources: n.a. Referenced By: n.a.
References: n.a. Remaining Time: n.a.
Sprint: FS Demo 3

Description

The thread(s) which perform the server-side import should have their log4j output redirected to files which can be stored for later evaluation. This will allow users to download their own import logs as well as prevent the server log from filling up with 2012-10-12 11:24:16,180 WARN [l.model.enums.handlers.MediumEnumHandler] (l.Server-5) Unknown Medium value 'null' will be stored as "Other".

Further, it may be of benefit to capture a partial client-side log of the upload and transmit that to the server for safe storage.

Both of these files then should be available, either via the API as original files under /OMERO/Files or be stored in the managed repository beside the other files. (NB: If pyramid files are also stored in the managed repo, then it might be nice to keep them all together. See #4873).

Implementation details: it's not entirely clear how this information will be captured unless the import happens in a separate Java process. The major barrier to using a separate Java process is the memory usage issue with Java. If we do perform the import in the server process, then either we will need something like a thread-local loggers, or (worst case) we will need to modify how all the import classes obtain their logger.

Change History (12)

comment:1 Changed 11 years ago by jburel

  • Milestone changed from OMERO-4.5 to OMERO-5

comment:2 Changed 11 years ago by jmoore

  • Sprint set to FS Demo 2

comment:3 Changed 11 years ago by jmoore

One option may be to use logback's SiftingAppender which would log to a file var/log/import-${THREADNUMBER}.log. The file could be copied after the import and then nulled.

This may requiring changing all use of commons-logging to logback (via slf4j) throughout OMERO. Bio-Formats is already solely slf4j-based.

comment:4 Changed 11 years ago by jmoore

  • Sprint FS Demo 2 deleted

Not included in fs demo 2 tag. Removing from sprint

comment:5 Changed 11 years ago by jmoore

  • Owner set to cblackburn
  • Sprint set to FS Demo 3

comment:6 Changed 11 years ago by cblackburn

  • Status changed from new to accepted

comment:7 Changed 11 years ago by cblackburn

  • Owner cblackburn deleted
  • Status changed from accepted to new

comment:8 Changed 11 years ago by cblackburn

  • Owner set to cblackburn

comment:9 Changed 11 years ago by cblackburn

  • Status changed from new to accepted

comment:10 Changed 11 years ago by cblackburn

  • Owner cblackburn deleted
  • Status changed from accepted to new

comment:11 Changed 11 years ago by cblackburn

  • Owner set to cblackburn
  • Status changed from new to accepted

comment:12 Changed 11 years ago by cblackburn

  • Resolution set to fixed
  • Status changed from accepted to closed

See: http://github.com/openmicroscopy/openmicroscopy/pull/1062

Further configuration, refactoring and clean-up may be needed. These will be done under new tickets.

Note: See TracTickets for help on using tickets. You may also have a look at Agilo extensions to the ticket.

1.3.13-PRO © 2008-2011 Agilo Software all rights reserved (this page was served in: 0.73474 sec.)

We're Hiring!