We're Hiring!

OME.TIFF export problems

General user discussion about using the OMERO platform to its fullest. Please ask new questions at https://forum.image.sc/tags/omero
Please note:
Historical discussions about OMERO. Please look for and ask new questions at https://forum.image.sc/tags/omero

There are workflow guides for various OMERO functions on our help site - http://help.openmicroscopy.org

You should find answers to any basic questions about using the clients there.

OME.TIFF export problems

Postby sameh » Mon Jul 09, 2018 10:46 am

Hello,

we are currently transferring images from our omero database to a new omero database.

we have about 230 go to transfer.

on omero we annotate all images. And we spent a lot of time doing this description.

to avoid losing our annotations we want to export the images in batch and in the format ome.tiff to keep all the annotations.

we use the scipt export (Batch_Image_Export) with omero insight.

we have problems, to export large files (> 1go).

and when we select a lot of small images, export is not possible either.

to export large volumes in OME.Tiff there prerequisites in the system settings of our database?

is there another way to export our images by keeping the annotations?

thank you for your help

Regards,

sameh
sameh
 
Posts: 29
Joined: Tue Apr 17, 2018 8:38 am

Re: OME.TIFF export problems

Postby Dominik » Tue Jul 10, 2018 9:09 am

Hi Sameh,

the ome.tiff export doesn't export the annotations, so that won't work.
Why do you want to export and reimport the images? Usually one would just
copy / upgrade the database. What version is the old and the new system?

We have some scripts for copying annotations over from one server to another,
which you could use as template. But it would be good to check first if that's
really the best approach for what you want to achieve.

Regards,
Dominik
User avatar
Dominik
Team Member
 
Posts: 149
Joined: Mon Feb 10, 2014 11:26 am

Re: OME.TIFF export problems

Postby mtbc » Tue Jul 10, 2018 9:54 am

Dear Sameh,

There is a lot that could be done for bulk transfer of data from one OMERO server to another; unfortunately, it is not trivial and is not yet slated for a coming release. In the meantime, could it work to simply create the new OMERO server from a backup of the existing one? If not, do you also need to preserve attached files?

You will have noticed that OME-TIFF export does in fact preserve some annotations. Though, for instance, you may find that at the other end you have duplicate tags and need to write a script to merge them. What kinds of annotations are the most important to preserve?

Cheers,
Mark
User avatar
mtbc
Team Member
 
Posts: 282
Joined: Tue Oct 23, 2012 10:59 am
Location: Dundee, Scotland

Re: OME.TIFF export problems

Postby sameh » Tue Jul 10, 2018 12:02 pm

Dominik wrote:Hi Sameh,

the ome.tiff export doesn't export the annotations, so that won't work.
Why do you want to export and reimport the images? Usually one would just
copy / upgrade the database. What version is the old and the new system?

We have some scripts for copying annotations over from one server to another,
which you could use as template. But it would be good to check first if that's
really the best approach for what you want to achieve.

Regards,
Dominik


Hello Dominik,

indeed we need to transfer the annotated data from our omero server to another omero server. our new database is hosted at another infrastructure in France.

our database is in version 5.4.6 and the new database is in version 5.4.4


what is important for us is to keep the tags. because it takes a lot of time to redo everything.

we tried to export and import our images in ome.tif format, this format retains the tags.

but our problem is that we can not export big data. and we wonder if there are prerequisites in the system settings.


thank you for your ideas and your help
sameh
 
Posts: 29
Joined: Tue Apr 17, 2018 8:38 am

Re: OME.TIFF export problems

Postby sameh » Tue Jul 10, 2018 12:09 pm

mtbc wrote:Dear Sameh,

There is a lot that could be done for bulk transfer of data from one OMERO server to another; unfortunately, it is not trivial and is not yet slated for a coming release. In the meantime, could it work to simply create the new OMERO server from a backup of the existing one? If not, do you also need to preserve attached files?

You will have noticed that OME-TIFF export does in fact preserve some annotations. Though, for instance, you may find that at the other end you have duplicate tags and need to write a script to merge them. What kinds of annotations are the most important to preserve?

Cheers,
Mark


Hello,

thank you for your reply ,

we need to keep the tags.

we tried with the format ome tif format and it works.

and after the import we use a scipt to merge the tags, and it works too.

the main problem is that we can not export big data in batch.

we wonder if there are prerequisites in the system settings.

Thank you for your help
sameh
 
Posts: 29
Joined: Tue Apr 17, 2018 8:38 am

Re: OME.TIFF export problems

Postby Dominik » Tue Jul 10, 2018 12:23 pm

You are right, tags are indeed exported, sorry about that. What do you mean with "big" images exactly? Are these large 5D images or pyramidal images?

Regards,
Dominik
User avatar
Dominik
Team Member
 
Posts: 149
Joined: Mon Feb 10, 2014 11:26 am

Re: OME.TIFF export problems

Postby sameh » Tue Jul 10, 2018 2:49 pm

Dominik wrote:You are right, tags are indeed exported, sorry about that. What do you mean with "big" images exactly? Are these large 5D images or pyramidal images?

Regards,
Dominik


yes it is 5D images,

when I select several 5D images to export in batch, the zip file is not created
sameh
 
Posts: 29
Joined: Tue Apr 17, 2018 8:38 am

Re: OME.TIFF export problems

Postby mtbc » Wed Jul 11, 2018 9:28 am

Dear Sameh,

It's still sounding as if your easiest option at this time would be to simply create the new OMERO server from a backup of the existing one. It would work fine to restore a 5.4.6 binary repository and database to run under a 5.4.4 server.

In case that's not an option: The tags you need to preserve, what are they on? Do the most valuable ones just tag the images, or are you tagging other objects like ROIs? (OMERO makes a lot possible, even beyond what the graphical clients offer.) It could make sense to write a script that connects to both servers at once to copy the tags from a group on one to a group on the other based on matching image names or whatever.

Cheers,
Mark
User avatar
mtbc
Team Member
 
Posts: 282
Joined: Tue Oct 23, 2012 10:59 am
Location: Dundee, Scotland

Re: OME.TIFF export problems

Postby mtbc » Wed Jul 11, 2018 3:05 pm

Dear Sameh,

Also, what are the typical dimensions of your 5D images? (X, Y, Z, C, T)

Cheers,
Mark
User avatar
mtbc
Team Member
 
Posts: 282
Joined: Tue Oct 23, 2012 10:59 am
Location: Dundee, Scotland

Re: OME.TIFF export problems

Postby sameh » Thu Jul 12, 2018 9:00 am

mtbc wrote:Dear Sameh,

Also, what are the typical dimensions of your 5D images? (X, Y, Z, C, T)

Cheers,
Mark


hello

we have different images,

for example;
- 1024x1024 32Z 1C 20t
- 3216x3216 1Z 3C 1t
sameh
 
Posts: 29
Joined: Tue Apr 17, 2018 8:38 am

Next

Return to User Discussion

Who is online

Users browsing this forum: Google [Bot] and 0 guests

cron