Bug: Unexpected search results

[wmoore]

From Gus (testing webclient search):

• Search for 'ome' returns imgaes that have no 'ome' text.
• Search for 'centrosomes' does not find images that have this in their name.
• Often repeating a search returns different results each time.

I'll see if I can reproduce some of this, then hand over to someone else!

[jburel]

Moved from sprint 2012-05-08 (14)

[wmoore]

I have found similar unexpected search results. E.g. import 50 images named "emd_1000.map", "emd_1001.map" etc.
Do a search and it only finds a subset of these images.

[jmoore]

Doesn't look like the values are even getting saved to FullText?. Not sure what's going on.

[jmoore]

After initial investigation, it looks like no values are being store in /OMERO/FullText whatsoever. This will take more research just to figure out what's happened. Pushing to the next sprint.

[saloynton]

Josh is this a related issue?

It seems like the date is ignored in searches. Get the same search results regardless of whether the date field is populated or which date is picked.
Taken from the two problems in ticket #8679. This seems like a higher priority.

[jmoore]

Scott: this issue will block all other search testing.

[jmoore]

Two commits are involved here:

59ddcbd - OmeroSearch : temporary fix post-JTA and relevance. (3 years, 5 months ago) <jmoore>
e17e85f - Post-hibernate upgrade search config improvements (4 months ago) <jmoore>

A FIXME was added 3 years ago when worker.batch_size was set to 1. With a Hibernate update, I thought it could be removed, but apparently it can't (at least not for use with the IUpdate.indexObject method). Turning the batch_size back down so low will again have negative performance impacts, but there may not be a way around it for the moment.

[jmoore]

Search should be fixed now (or back to its regular state at least). Commits pushed to sprint16-bugfixes:

6a6c0b3 - (HEAD, origin/sprint16-bugfixes, sprint16-bugfixes) Fix typo in search.py plugin (3 minutes ago) <jmoore>
dcbe3f8 - Fix startup error in background processes (3 minutes ago) <jmoore>
0d21613 - Revert to the batch_size=1 FIXME (Fix #8692) (3 minutes ago) <jmoore>

[rkferguson]

Still problems with search results:

Insight:

User-6 read-only-1. Insight - searched for copy-and-paste word from description "centrosome". Found it in 9 private-1 group images but not in any read-only-1 images - definitely there in more than one image (counted at least 5) - see screenshot. Reproduced for another definite positive search term in the name field - also returned 9 results for private-1 but none for read-only-1.

Web:

User-6 read-only. Not finding search term "kinetochores" in title of images when it is in a number of them. When serching in private-1 seems to be finding images in read-only-1 as well as private-1.

[jburel]

The arguments specified for the search services are the same but results are only returned in the context of the private group.

[jburel]

I am not able to check in web since it is not possible to search terms in description

[jburel]

Passing it back to Josh. No results returned for non-private groups.

[jmoore]

Added and pushed a passing test, J-M. Let's discuss when you're available:

commit bd102f75b183ec32d096ca132f38966904eb9d32
Author: jmoore <josh@glencoesoftware.com>
Date:   Tue Jun 5 08:49:16 2012

    Passing test of search as group and system admin (See #8692)

[wmoore]

Is this just a case of search by default using your "default group"? or just getting the wrong eventContext?

[jmoore]

If omero.group is not getting passed, then currently you won't find anything that's not in your current group, if that's what you mean.

[jmoore]

(duplicate post)

[jmoore <josh@…>]

(In [0d21613e599a5dbb058c31d8c0d87870a04698fa/ome.git] on branch develop) Revert to the batch_size=1 FIXME (Fix #8692)

[jmoore <josh@…>]

(In [bd102f75b183ec32d096ca132f38966904eb9d32/ome.git] on branch develop) Passing test of search as group and system admin (See #8692)