Warning: Can't synchronize with repository "(default)" (/home/git/ome.git does not appear to be a Git repository.). Look in the Trac log for more information.
Notice: In order to edit this ticket you need to be either: a Product Owner, The owner or the reporter of the ticket, or, in case of a Task not yet assigned, a team_member"

User Story #8182 (closed)

Opened 12 years ago

Closed 10 years ago

Re-parse metadata from existing FS files

Reported by: jburel Owned by: jburel
Priority: major Milestone: Future
Component: OmeroFs Keywords: fs-lite
Cc: mlinkert, cxallan, cblackburn, jamoore, jburel, bpindelski Story Points: n.a.
Sprint: n.a. Importance: n.a.
Total Remaining Time: n.a. Estimated Remaining Time: n.a.

Description (last modified by jmoore)

Assuming all appropriate files have been uploaded, a later version of Bio-Formats could be used to re-parse metadata contained in FS files and either show the discrepancies to the user or directly modify the database. This would allow for super-fast server-side fixes in which a user would not lose their existing work. One caveat would be if the difference in Bio-Formats changed which files were detected during setId, in which case a full re-import would likely be necessary (or hand-fiddling to add/remove the missed files).

Change History (17)

comment:1 Changed 12 years ago by cblackburn

  • Owner set to cblackburn

In the fs-lite import import model I use isMetadataOnly for files that already exist in a repository. The key existing case here is DropBox but it also allows for imports via the repository system (copy then import) or imports from other repositories, whatever they might be! If this flag is set the import should only proceed if all the usedFiles already exist in a repository - this might need to be stricter: a specified area of a repository. But how this happens eventually will depend on the refactoring of the repository service.

comment:2 Changed 12 years ago by jburel

  • Sprint changed from 2012-03-13 (10) to 2012-03-27 (11)

Moved from sprint 2012-03-13 (10)

comment:3 Changed 12 years ago by jburel

  • Sprint changed from 2012-03-27 (11) to 2012-04-10 (12)

Moved from sprint 2012-03-27 (11)

comment:4 Changed 12 years ago by jburel

  • Sprint changed from 2012-04-10 (12) to 2012-04-24 (13)

Moved from sprint 2012-04-10 (12)

comment:5 Changed 12 years ago by jburel

  • Sprint changed from 2012-04-24 (13) to 2012-05-08 (14)

Moved from sprint 2012-04-24 (13)

comment:6 Changed 12 years ago by cblackburn

  • Sprint 2012-05-08 (14) deleted

comment:7 Changed 12 years ago by jburel

  • Keywords fs-lite added
  • Milestone changed from OMERO-Beta4.4 to OMERO-Beta4.4.1

comment:8 Changed 12 years ago by cblackburn

Referencing ticket #909 has changed sprint.

comment:9 Changed 12 years ago by cblackburn

  • Milestone changed from OMERO-Beta4.4.1 to Future

comment:10 Changed 12 years ago by jmoore

Referencing ticket #909 has changed sprint.

comment:11 Changed 12 years ago by jmoore

Colin, is there anything left to do here? Does this include the refactoring of RepositoryImportContainer, or is that a separate ticket?

comment:12 Changed 12 years ago by cblackburn

  • Owner changed from cblackburn to jburel

I don't think this is still valid unless Jean-Marie feels there is a use case at this stage for client-side metadata-only imports. Refactoring the RepositoryImportContainer should be a separate ticket as all the elements of that container need to be assessed. I'll let Jean-Marie comment or close as necessary.

comment:13 Changed 12 years ago by jburel

we had cases of importing hcs files w/o binary data (from Ruben???). That's a case I had to handle in the UI.
In that situation, the companion file was the only file parsed. We could argue that the companion file will be stored as part of fs.

Last edited 12 years ago by jburel (previous) (diff)

comment:14 Changed 12 years ago by jmoore

  • Cc mlinkert-x cxallan added
  • Component changed from General to OmeroFs

Replying to jburel:

we had cases of importing hcs files w/o binary data (from Ruben???). That's a case I had to handle in the UI.

Can you explain more about what should happen specifically? I.e. Ruben wanted to import and skip the binary?

Replying to jburel:

In that situation, the companion file was the only file parsed. We could argue that the companion file will be stored as part of fs.

All companion files should definitely be stored as a part of FS.

comment:15 Changed 12 years ago by jburel

I honestly can't remember what was the rational behind it. But having a metadata only flag could be useful if for some reasons a user import a file, there is a bug in BF related to metadata parsing at the time of import and the metadata needs to be read again.

comment:16 Changed 12 years ago by jmoore

  • Cc jburel bpindelski added
  • Description modified (diff)
  • Summary changed from Bug: Metadata flag to Re-parse metadata from existing FS files
  • Type changed from Task to User Story

comment:17 Changed 10 years ago by jamoore

  • Resolution set to duplicate
  • Status changed from new to closed

Closing in favor of https://trello.com/c/22XfjucX/159-export-and-re-import. We may want to re-open this when the time comes. (Currently no tasks)

Note: See TracTickets for help on using tickets. You may also have a look at Agilo extensions to the ticket.

1.3.13-PRO © 2008-2011 Agilo Software all rights reserved (this page was served in: 0.72910 sec.)

We're Hiring!