Notice: In order to edit this ticket you need to be either: a Product Owner, The owner or the reporter of the ticket, or, in case of a Task not yet assigned, a team_member"

Task #12376 (new)

Opened 5 years ago

Last modified 4 years ago

RFE: Lucene to index Original Metadata

Reported by: wmoore Owned by: jamoore
Priority: critical Milestone: Asynchronous
Component: Search Version: n.a.
Keywords: n.a. Cc: ux@…, jamoore
Resources: n.a. Referenced By: n.a.
References: n.a. Remaining Time: n.a.
Sprint: n.a.

Description

I don't seem to get any image results when I search by field :annotation.

Tried this manually using current Insight search, only using 'annotation' checked.

Also in my own web code I see the same.

Wrote a small Python script that reads every key, value pair from image.loadOriginalMetadata() using every value as a search term with annotation field, and I get no results from any.
This was using my current Blitz Gateway code, so not valid to add here as a test yet, but I'll prepare this using the search service directly.

Change History (9)

comment:1 Changed 5 years ago by jamoore

  • Cc jamoore added
  • Owner changed from jmoore to wmoore

There are a couple of things here that we'll likely need to break down:

1) I just did the following on octopus:

s = client.sf.createSearchService()
s.onlyType("Image")
s.byFullText("e74eed78e043")
s.hasNext()
s.next().id.val
s.byFullText("annotation:e74eed78e043")
s.hasNext()
s.next().id.val

If you're seeing issues, we're likely going to have to be very specific. A failing test would be best.

2) None of the original metadata is currently parsed into the full text search. For me this falls under the "testing" banner that we mentioned. Somewhere we need an encoding of what you're expecting, but that probably needs a single ticket or perhaps even a story and probably a good deal of discussion. Note: each time we update what needs to be in the index, we will have to re-index the entire database, so if we can get a good estimation early on, our lives will be much simpler. I'm currently working on something that will hopefullly speed up indexing, but it will still take up to days on some of our DBs.

comment:2 Changed 5 years ago by wmoore

OK, indexing of Original Metadata will have to wait, but I would imagine that companion files, E.g. DV log files, would be indexed.

comment:3 Changed 5 years ago by jamoore

This is currently not happening and so would require a server-side change and a full re-indexing.

comment:4 Changed 5 years ago by wmoore

  • Owner changed from wmoore to jamoore
  • Priority changed from critical to major
  • Summary changed from Bug: Search by annotation: to RFE: Lucene to index Original Metadata

comment:5 Changed 5 years ago by wmoore

  • Milestone changed from 5.0.3 to 5.1.0

comment:6 Changed 5 years ago by jamoore

  • Milestone changed from 5.1.0 to 5.1.0-m1

This really should be quite straight-forward to do. The only question is what format would you/we/one expect? Just the original metadata as it was formatted in 4.4, i.e. like an .ini file? Each value as a key/value pair? With some prefix?

comment:7 Changed 5 years ago by jamoore

  • Milestone changed from 5.1.0-m1 to 5.1.0-m2

Probably best to do along with #12318 (mapannotation index)

comment:8 Changed 5 years ago by jamoore

  • Milestone changed from 5.1.0-m2 to 5.x
  • Priority changed from major to critical

Pushing beyond 5.1.

comment:9 Changed 4 years ago by jamoore

  • Milestone changed from 5.x to Asynchronous
Note: See TracTickets for help on using tickets. You may also have a look at Agilo extensions to the ticket.

1.3.13-PRO © 2008-2011 Agilo Software all rights reserved (this page was served in: 0.79687 sec.)

We're Hiring!