We're Hiring!

large tifs, corrupted pixel values in OMERO import

Historical discussions about the Bio-Formats library. Please look for and ask new questions at https://forum.image.sc/tags/bio-formats
Please note:
Historical discussions about the Bio-Formats library. Please look for and ask new questions at https://forum.image.sc/tags/bio-formats

If you are having trouble with image files, there is information about reporting bugs in the Bio-Formats documentation. Please send us the data and let us know what version of Bio-Formats you are using. For issues with your code, please provide a link to a public repository, ideally GitHub.

large tifs, corrupted pixel values in OMERO import

Postby dsudar » Fri Jan 12, 2018 10:36 pm

Hi team,

I've split this topic out from my earlier post http://www.openmicroscopy.org/community ... =13&t=8374 because it really is a different topic. This is specifically about the corrupted display and pixel values (when examined using iviewer) when importing large XY-extent images that require pyramid-ing when imported into OMERO. I originally reported on this behaviour with Zeiss Axioscan CZI files but as demonstrated with QA file id 18868, the same happens with some fairly regular tif files.

I looked a little further and found that I can read that file into Fiji (with BF 4.7.3) and it looks perfectly fine with correct pixel values. When I "Bio-Formats Exporter" it as either a TIFF or OME.TIFF file, the resulting file has the same problems as the original when imported into OMERO 5.4.1. However, when I "Save As"->Tiff from Fiji using the regular Fiji method, the resulting file imports fine into OMERO and the pixel values are all correct as viewed using iviewer 0.4.1.

I used showinf and tiffinfo to look for differences between the original file, the Bio-Formats Exported file, and the tiff created by Fiji, nothing jumps out except that the Fiji tiff is big endian while the others are all little endian and that the compression and the Rows/Strip is different.

Hopefully this provides another clue towards solving this issue.

Cheers,
- Damir
dsudar
 
Posts: 235
Joined: Mon May 14, 2012 8:43 pm
Location: Berkeley, CA, USA

Re: large tifs, corrupted pixel values in OMERO import

Postby dsudar » Sat Jan 13, 2018 2:52 am

Quick followup: I tried converting the "original" TIFF file from little endian encoding to big endian encoding using ImageMagick and surprise: that works. So my current thinking is that somewhere in the OMERO importer when creating pyramids, there is some kind of mishandling of little endian encoded pixel values.
- Damir
dsudar
 
Posts: 235
Joined: Mon May 14, 2012 8:43 pm
Location: Berkeley, CA, USA

Re: large tifs, corrupted pixel values in OMERO import

Postby Dominik » Wed Jan 17, 2018 7:40 am

Hi Damir,
sorry for the late reply. Yes, for some reason the importer thinks it's big endian. I'm still trying to find out why/where this happens. Definitely trying to get that fixed for 5.4.3. As 5.4.2 is coming out soon, it's probably a bit too late to get it in there.

Regards,
Dominik
User avatar
Dominik
Team Member
 
Posts: 149
Joined: Mon Feb 10, 2014 11:26 am

Re: large tifs, corrupted pixel values in OMERO import

Postby dsudar » Wed Jan 17, 2018 7:13 pm

Hi Dominik,

Glad you were able to confirm my observations. One additional observation: this behaviour only appears to occur when the image is large enough to require pyramid'ing. When I crop the image down to 3000 by 3000 during the ImageMagick processing, both the big endian and little endian versions of the image import fine. So probably good to focus on the code that does the pyramid construction.

Also, my guess is that this exact same problem is in play for CZI files that require pyramid construction during import. This is the issue I originally reported and is tracked in Trello (https://trello.com/c/ZMZP2rVv/211-rende ... ne-bug-czi). While I cannot tell for sure, I imagine those files are also little endian encoded. And again, if the CZI file has the pyramids already, there's no problem with the import.

Cheers,
- Damir
dsudar
 
Posts: 235
Joined: Mon May 14, 2012 8:43 pm
Location: Berkeley, CA, USA


Return to User Discussion [Legacy]

Who is online

Users browsing this forum: No registered users and 0 guests