We're Hiring!

Multiple Omero Data Directories

Having a problem deploying OMERO? Please ask new questions at https://forum.image.sc/tags/omero
Please note:
Historical discussions about OMERO. Please look for and ask new questions at https://forum.image.sc/tags/omero

The OMERO.server installation documentation begins here and you can find OMERO.web deployment documentation here.

Multiple Omero Data Directories

Postby dwj » Thu Apr 26, 2018 10:22 am

Hi OMERO developers.

In our OMERO environment we use a network share as ‘omero.data.dir’. That works very smoothly.
Our network administration offers network shares with a maximum size of 16TB. Since we need more than 16TB, we could get a second network share with the same size of 16TB.

Is it possible to configure OMERO to use two or more network shares as ‘omero.data.dir’ so that we can use the complete 32TB?

I also think about using a Software-RAID to abstract multiple network shares to one big share. Does anybody have experiences with a software RAID? We use CentOS 7 as operation system.

Thanks,
Daniel
dwj
 
Posts: 23
Joined: Mon Nov 16, 2015 10:46 am

Re: Multiple Omero Data Directories

Postby kennethgillen » Thu Apr 26, 2018 2:45 pm

dwj wrote:Hi OMERO developers.


Hi Daniel,

dwj wrote:Is it possible to configure OMERO to use two or more network shares as ‘omero.data.dir’ so that we can use the complete 32TB?


Yes, The OMERO managed repository, where newly imported data ends up, could be organised in such a way that some data is on one of your existing storage paths (in this case your network share) and newly imported data goes to another.

Our docs show the process under https://docs.openmicroscopy.org/latest/ ... repository - a good diagram showing the repository as new data is added is at http://downloads.openmicroscopy.org/pre ... paris/#/16

The binary repository layout itself (including managed repository) is discussed in our docs here: https://docs.openmicroscopy.org/latest/ ... itory.html

dwj wrote:I also think about using a Software-RAID to abstract multiple network shares to one big share. Does anybody have experiences with a software RAID? We use CentOS 7 as operation system.


Software RAID isn't designed to work with remote filesystems like NFS mounts. You would be better off with a different filesystem type which does support sizes >16TB. There are a few options out there, which can be discussed with the team who are providing the storage infrastructure you're currently using.

Hope that's useful.

Kenny
kennethgillen
 
Posts: 254
Joined: Mon Nov 05, 2012 3:39 pm

Re: Multiple Omero Data Directories

Postby dwj » Mon May 07, 2018 2:27 pm

Hi Kenny,

Thanks for your hints.
I changed the ‘omero.managed.dir’ settings and all new imaged files are stored in that new repository. So that works fine.

Is it possible that new images for one group (or user) are stored in one repository and the images of a second group (or user) are stored in a second repository?

Thanks,
Daniel
dwj
 
Posts: 23
Joined: Mon Nov 16, 2015 10:46 am

Re: Multiple Omero Data Directories

Postby jmoore » Mon May 07, 2018 3:38 pm

Hi Daniel,

dwj wrote:Is it possible that new images for one group (or user) are stored in one repository and the images of a second group (or user) are stored in a second repository?


There's only one repository, but you can change the template prefix to additionally take group information into account.

Note though that this only holds for new imports and if a user changes groups the data is not automatically migrated.

Cheers,
~Josh
User avatar
jmoore
Site Admin
 
Posts: 1591
Joined: Fri May 22, 2009 1:29 pm
Location: Germany

Re: Multiple Omero Data Directories

Postby dwj » Tue May 08, 2018 11:50 am

OK,
thank you Josh!
dwj
 
Posts: 23
Joined: Mon Nov 16, 2015 10:46 am


Return to Installation and Deployment

Who is online

Users browsing this forum: No registered users and 1 guest