Comment 9 for bug 1774316

Revision history for this message
Fabián Inostroza (fabianinostroza) wrote :

I don't know if this is related or not, I was stepping in include/geometry/rtree.h:1602 and noticed that the values stored in the area array were different in amd64 and i386, even though the a_parVars->m_branchBuf[].m_rect had the same values.
So I wrote a program that made the same calculations that the CalcRectVolume method, ran the program in the two architectures and the program gave different outputs in the different architectures.

These are the outputs (notice last two values, "area" and his hex representation):
i386:
1073741824.000000, 2305843009213693952.000000, 1518500224.000000, 7244020209416142848.000000, 0x5EC90FDC

amd64:
1073741824.000000, 2305843009213693952.000000, 1518500224.000000, 7244019659660328960.000000, 0x5EC90FDB

Also the call to CalcRectVolume in rtree:1621 returned nan.

Both machines are running debian testing.