We're Hiring!

omero export cli utility

General and open developer discussion about using OMERO APIs from C++, Java, Python, Matlab and more! Please new questions at https://forum.image.sc/tags/omero
Please note:
Historical discussions about OMERO. Please look for and ask new questions at https://forum.image.sc/tags/omero

If you are having trouble with custom code, please provide a link to a public repository, ideally GitHub.

omero export cli utility

Postby dsudar » Sat Aug 05, 2017 8:25 pm

Hi team,

I chanced upon (maybe add a mention of it in the docs?) the omero export capability in the cli which is extremely useful for a number of folks in my group. I have a few questions related to it:

1) when I export an image with rich OME-XML metadata, only a small amount of that appears to make it into the generated ome.tif file. At least when looking at that with showinf or when loading into imagej/fiji, very little shows up.

2) the --iterate is great for Dataset. Any plans of adding the capability to use that for Plate and/or Screen?

3) this question is a bit out there: any thought to make it do some kind of ROI handling e.g. if the image has ROIs, then have the option to only export the ROIs as individual ome.tif's?

4) finally, I noticed that this cli export as OME-TIFF works fine even when in the webclient, I only have the options to export as tiff, png, or jpg. This happens e.g. for images in SPW. Since the capability to export as ome.tiff clearly exists, any thought of enabling that capability in the webclient/insight client as well?

Always great to find another useful nugget in OMERO and sorry that I always want more ..... :-)
Cheers,
- Damir
dsudar
 
Posts: 235
Joined: Mon May 14, 2012 8:43 pm
Location: Berkeley, CA, USA

Re: omero export cli utility

Postby jmoore » Tue Aug 08, 2017 8:34 am

dsudar wrote:Hi team,


Hi Damir,

I chanced upon (maybe add a mention of it in the docs?) the omero export capability in the cli which is extremely useful for a number of folks in my group.


The new webpage has: https://www.openmicroscopy.org/omero/export/ but https://docs.openmicroscopy.org/omero/5.3.3/users/cli/index.html?highlight=command%20line%20interface (minimally) should add a mention.

I have a few questions related to it:

1) when I export an image with rich OME-XML metadata, only a small amount of that appears to make it into the generated ome.tif file. At least when looking at that with showinf or when loading into imagej/fiji, very little shows up.


Yes. At the moment, the use is intended mostly for getting the binary data out of OMERO not for all the related metadata, though that's something we're interested in adding.


2) the --iterate is great for Dataset. Any plans of adding the capability to use that for Plate and/or Screen?


Added to https://trello.com/c/22XfjucX/7-export-re-import.


3) this question is a bit out there: any thought to make it do some kind of ROI handling e.g. if the image has ROIs, then have the option to only export the ROIs as individual ome.tif's?


Ditto.

4) finally, I noticed that this cli export as OME-TIFF works fine even when in the webclient, I only have the options to export as tiff, png, or jpg. This happens e.g. for images in SPW. Since the capability to export as ome.tiff clearly exists, any thought of enabling that capability in the webclient/insight client as well?


I'm not sure what's happening there, and filed https://trello.com/c/bxkT6Jla/107-export-ome-tiff-export-disabled-in-web-when-available-from-cli for someone to take a look.

All the best.
~Josh.
User avatar
jmoore
Site Admin
 
Posts: 1591
Joined: Fri May 22, 2009 1:29 pm
Location: Germany

Re: omero export cli utility

Postby wmoore » Mon Aug 21, 2017 12:37 pm

Hi Damir,

To enable export of SPW images in webclient/Insight, you need to configure
https://docs.openmicroscopy.org/omero/5 ... ary-access.

Code: Select all
$ bin/omero config set omero.policy.binary_access '+read,+write,+image,+plate'


This will also enable the download of Original Image files.

In general, downloading of SPW original data is disabled because even a single image comes from the whole 'fileset' of SPW data (whole screen) so is likely quite large.

Even without configuring the omero.policy.binary_access, you can export SPW images as OME-TIFF by selecting the image(s) and running the Batch_Image_Export script, choosing Format: OME-TIFF.

Regards,

Will.
User avatar
wmoore
Team Member
 
Posts: 674
Joined: Mon May 18, 2009 12:46 pm

Re: omero export cli utility

Postby dsudar » Tue Aug 22, 2017 6:26 pm

Hi Will,

Thanks for pointing me at that config setting (and the reminder about the batch export script). I had seen it long time ago but completely forgot about the existence. That works. I agree that in general one would not want to enable this since it enables downloading of entire plates/screens. Maybe another "permission level" could be considered for a future version which allows exports of OME-TIFs but does not allow downloading of the original data for entire plates/screens?

Cheers,
- Damir
dsudar
 
Posts: 235
Joined: Mon May 14, 2012 8:43 pm
Location: Berkeley, CA, USA

Re: omero export cli utility

Postby mtbc » Wed Aug 23, 2017 10:23 am

Dear Damir,

Even without adjusting the server's access policy we should enable the export of individual fields as OME-TIFF from OMERO.web, we'll look into that, thank you.

It's worth mentioning that larger-scale remote data access is at least very much on our radar. For example, https://github.com/mtbc/omero-downloader is a proof-of-concept for resumable download/export of large screens. In export, that tool does the construction of the OME-TIFFs client-side to avoid burdening the server with everybody's enormous exports.

Cheers,
Mark
User avatar
mtbc
Team Member
 
Posts: 282
Joined: Tue Oct 23, 2012 10:59 am
Location: Dundee, Scotland

Re: omero export cli utility

Postby dsudar » Wed Aug 23, 2017 7:58 pm

Hi Mark,

Great that you'll consider individual image/field OME-TIFF exports as part of the "default" policy of: '+read,+write,+image'. That makes perfect sense.

I'll have a look at omero-downloader. Thanks for directing me to it.

Cheers,
- Damir
dsudar
 
Posts: 235
Joined: Mon May 14, 2012 8:43 pm
Location: Berkeley, CA, USA

Re: omero export cli utility

Postby mtbc » Fri Aug 25, 2017 2:58 pm

Dear Damir,

Also note that Will has now opened https://github.com/openmicroscopy/openm ... /pull/5472 which should indeed allow OME-TIFF export of individual wells in OMERO.web for 5.4.0.

Cheers,
Mark
User avatar
mtbc
Team Member
 
Posts: 282
Joined: Tue Oct 23, 2012 10:59 am
Location: Dundee, Scotland


Return to Developer Discussion

Who is online

Users browsing this forum: Bing [Bot] and 1 guest

cron