Notice: In order to edit this ticket you need to be either: a Product Owner, The owner or the reporter of the ticket, or, in case of a Task not yet assigned, a team_member"

Bug #1150 (closed)

Opened 12 years ago

Closed 11 years ago

Last modified 11 years ago

RFloat returns wrong value

Reported by: atarkowska Owned by: bwzloranger
Priority: critical Cc: cxallan, bwzloranger
Sprint: n.a.
Total Remaining Time: n.a.

Description

DB lensNA = 1.4

_lensNA = object #37 (::omero::RFloat)
           {
               _val = 1.39999997616
           }

Change History (8)

comment:1 Changed 11 years ago by jmoore

  • Priority changed from minor to critical
  • Type changed from User Story to defect

comment:2 Changed 11 years ago by jmoore

r3436 has failing tests. This issue shows up as soon as you query the db via jdbc:

  SELECT lensna FROM objective

Note how this is not the case for doubles.

comment:3 Changed 11 years ago by jmoore

  • Resolution set to fixed
  • Status changed from new to closed

r3494 and r3496 convert all float fields to doubles. No changes were needed to the database since that conversion took place in #803

comment:4 Changed 11 years ago by atarkowska

  • Resolution fixed deleted
  • Status changed from closed to reopened

This time RDouble return wrong val

DB Pixel.physicalsizex = 0.31415

object #0 (::omero::RDouble)
{
    _val = 0.314150005579
}

comment:5 Changed 11 years ago by jmoore

I have this in my db:

omero4.0.1=# select id, lensna from objective order by id desc;
  id  | lensna  
------+---------
 1354 | 1.03333
 1353 |  1.1125
 1352 |   1.225
 1351 |    1.35
 1350 |     1.4
 1322 |        

created in unit tests. Ola's db looks like this:

ola=# select id, physicalsizex, physicalsizey, physicalsizez from pixels;
 id  |   physicalsizex   |   physicalsizey   |   physicalsizez   
-----+-------------------+-------------------+-------------------
  50 | 0.125793963670731 | 0.125793963670731 |              0.25
  51 | 0.125789999961853 | 0.125789999961853 |              0.25
  52 | 0.125793963670731 | 0.125793963670731 |              0.25
  53 | 0.132620006799698 | 0.132620006799698 | 0.200000002980232
  54 | 0.157076463103294 | 0.157076463103294 |  1.04999995231628
  55 | 0.314152926206589 | 0.314152926206589 |  4.19999980926514
  56 | 0.314152926206589 | 0.314152926206589 |  4.19999980926514
  59 |                 0 |                 0 |                 0
  60 |                 0 |                 0 |                 0
  61 |                 0 |                 0 |                 0
  58 |                 0 |                 0 |                 0
 100 | 0.314150005578995 | 0.314150005578995 |  1.04999995231628
  57 | 0.314150005578995 | 0.314152926206589 |  4.19999980926514

comment:6 Changed 11 years ago by jmoore

  • Cc brain added
  • Owner changed from jmoore to brain
  • Status changed from reopened to new

comment:7 Changed 11 years ago by bwzloranger

  • Resolution set to fixed
  • Status changed from new to closed

comment:8 Changed 11 years ago by cxallan

Fixed in r3696.

Note: See TracTickets for help on using tickets. You may also have a look at Agilo extensions to the ticket.

1.3.13-PRO © 2008-2011 Agilo Software all rights reserved (this page was served in: 0.212690 sec.)

We're Hiring!