Memory issues with bfconvert

[jmichael]

Here is what I get when I try to use this version.

Code: Select all

Command is time /hpcf/apps/bioformats/test/bioformats/tools/bfconvert /scratch_space/jmichael/LightMicroscopy/data/filename.czi filename.tiff
*** A new stable version is available. ***
*** Install the new version using:     ***
***   'upgradechecker -install'        ***
/scratch_space/jmichael/LightMicroscopy/data/filename.czi
ZeissCZIReader initializing /scratch_space/jmichael/LightMicroscopy/data/filename.czi
Exception in thread "main" loci.formats.UnsupportedCompressionException: JPEG-XR not yet supported
   at loci.formats.in.ZeissCZIReader$SubBlock.readPixelData(ZeissCZIReader.java:2947)
   at loci.formats.in.ZeissCZIReader$SubBlock.readPixelData(ZeissCZIReader.java:2919)
   at loci.formats.in.ZeissCZIReader.initFile(ZeissCZIReader.java:565)
   at loci.formats.FormatReader.setId(FormatReader.java:1426)
   at loci.formats.ImageReader.setId(ImageReader.java:835)
   at loci.formats.tools.ImageConverter.testConvert(ImageConverter.java:367)
   at loci.formats.tools.ImageConverter.main(ImageConverter.java:874)
2.11user 0.15system 0:01.86elapsed 121%CPU (0avgtext+0avgdata 817568maxresident)k
0inputs+760outputs (0major+23551minor)pagefaults 0swaps


[dgault]

That last run looks like it was using an older version, if you built the complete repository from https://github.com/dgault/bioformats/tr ... terExample then it would be worth confirming there are no older versions of the jars in the tools folder.

The result for 'UnsupportedCompressionException: JPEG-XR not yet supported' would have been seen in older versions, support for JPEG-XR is available in versions 5.3.0 onwards. You can verify the version bfconvert is using by running

Code: Select all

bfconvert -version

[jmichael]

I used the branch you previously linked to an used ant tools but when I run 'bfconvert -version' I get:

Code: Select all

*** A new stable version is available. ***
*** Install the new version using:     ***
***   'upgradechecker -install'        ***
Version: 5.1.4-DEV
VCS revision: git: /usr/lib64/libcrypto.so.10: no version information available (required by git)880da66f37692d28b05e9291483a298ec4543b95
Build date: 9 February 2017


It looks like it was recently built (Feb 9) but it does look like it is 5.1.4 version. There do not appear to be any jar files in my 'tools' folder for this build.

[dgault]

It sounds like it it using an older version from elsewhere, do you have the BF_DEVEL environment variable set? The below command should display the path it if you do:

Code: Select all

echo $BF_DEVEL

If this is pointing towards an older version of Bio-Formats then you may want to set it to point towards the artefacts directory of that test branch, which should contain jars built from when you ran the 'ant tools' command. An example of how to do this is shown below:

Code: Select all

export BF_DEVEL=/Path/to/GitHub/bioformats/artifacts

[user]

Hello,
I am also having memory issues with bfconvert and I came across this thread as I was looking for solutions. I am setting BF_MAX_MEM to 14G on a node that has 16G of RAM (figuring 2G should be fine for the OS). My file is quite large (~700G). Is there an option to make bfconvert more I/O-intensive rather than memory-intensive? That is, rather than trying to hold too much in memory, could one designate a large tmp directory to which any intermediate results could be written, rather than storing them in memory? My use case is extraction of single z-stacks (one series, one time point) from a large file having dimensions of series, time, and Z. I would expect that despite the large input file size, the memory requirement would not be extraordinary (binary seek to the appropriate position(s) in the file and write metadata and pixel data to a file). The z-stacks I am extracting are themselves about 340M in .ome.tif format. Nevertheless, I am always exceeding the step memory limit on the HPC I am using. The specific error I see is the following:

Code: Select all

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
        at java.lang.StringCoding$StringDecoder.decode(StringCoding.java:149)
        at java.lang.StringCoding.decode(StringCoding.java:193)
        at java.lang.String.<init>(String.java:426)
        at java.io.ByteArrayOutputStream.toString(ByteArrayOutputStream.java:245)
        at loci.common.xml.XMLTools.dumpXML(XMLTools.java:252)
        at loci.common.xml.XMLTools.dumpXML(XMLTools.java:234)
        at ome.xml.meta.AbstractOMEXMLMetadata.dumpXML(AbstractOMEXMLMetadata.java:112)
        at ome.xml.meta.OMEXMLMetadataImpl.dumpXML(OMEXMLMetadataImpl.java:105)
        at loci.formats.services.OMEXMLServiceImpl.getOMEXML(OMEXMLServiceImpl.java:465)
        at loci.formats.tools.ImageConverter.testConvert(ImageConverter.java:414)
        at loci.formats.tools.ImageConverter.main(ImageConverter.java:880)

Any suggestions? Thanks.

PS: If it is better that this thread not be hijacked, let me know and I can move this message to a new thread.

[dgault]

Hi,

Would you be able to run the bfconvert command again using the below flags? This will produce a text file in the same directory as the bfconvert tool named java.hprof.txt. If you could paste the results from the bottom of the text file (from SITES BEGIN to SITES END) that should help us narrow down how the memory is being allocated.

BF_FLAGS=-agentlib:hprof=heap=sites

David Gault

[user]

Sure, I will try re-processing the data to produce the error, and will then post the java.hprof.txt file. As an expedient, I was able to circumvent the problem by increasing the amount of RAM (as well as the heap size).

[user]

Can I somehow pass "-XX:HeapDumpPath=" as an environment variable to bfconvert? It allows the path of the heap dump to be specified explicitly. The problem is that I serially run many instances of bfconvert within a job, and the hprof file is overwritten each time. If the job exceeds the allocated RAM (but not the total memory: RAM + swap), then I obtain an error at the completion of the job, but do not know which bfconvert instance was affected, and I only get the heap dump from the last instance.

[dgault]

Yes, you should be able to pass these parameters using the BF_FLAG in a similar way as for the hprof parameters

For example:

Code: Select all

BF_FLAGS="-agentlib:hprof=heap=sites,file=/Path/To/Output/java.hprof"

or

Code: Select all

BF_FLAGS="-XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/Path/To/Output"

[user]

I ran ~50 jobs with 40 sequential bfconvert commands per job, saving the .hprof output of all ~2,000 bfconvert commands to separate files. I allocated 2G to the heap to increase the likelihood of memory errors; output file sizes are 0.35 G in each case. Metadata (ome.xml) from the input file is ~40 MB. Memory errors occurred during all ~50 jobs, but what was exceeded was RAM rather than total memory (RAM + swap), so the jobs still completed. Below I paste all ~450 lines from the SITES section of the last bfconvert command of one of the jobs, and at this pastebin, you can find the top 100 lines from the SITES section of all 40 bfconvert commands from the same job. Thanks.

Code: Select all

0/40.hprof
SITES BEGIN (ordered by live bytes) Thu Feb 23 18:30:32 2017
            percent              live             alloc'ed   stack class
rank   self  accum     bytes objs     bytes  objs trace name
    1 15.09% 15.09%  77924480   69 910497816 138906 307612 byte[]
    2  8.94% 24.03%  46166000 2815 250428000 15270 301000 char[]
    3  4.48% 28.51%  23136256 2816  75258560  9160 309750 int[]
    4  4.48% 32.99%  23136256 2816  75258560  9160 309751 java.lang.Object[]
    5  4.48% 37.47%  23136256 2816  75258560  9160 309753 java.lang.Object[]
    6  4.48% 41.95%  23136256 2816  75258560  9160 309755 int[]
    7  4.48% 46.43%  23136256 2816  75258560  9160 309756 int[]
    8  4.48% 50.91%  23136256 2816  75258560  9160 309757 int[]
    9  4.48% 55.39%  23136256 2816  75258560  9160 309758 java.lang.Object[]
   10  4.48% 59.88%  23136256 2816  75258560  9160 309760 int[]
   11  4.47% 64.35%  23105520 2815 125377200 15275 300228 byte[]
   12  2.40% 66.75%  12395688 36764  64869632 280041 300011 char[]
   13  2.24% 68.99%  11579392 2816  37678256  9163 301270 char[]
   14  2.00% 71.00%  10341312 215444  10341600 215450 308802 java.util.HashMap
   15  1.34% 72.33%   6894208 215444   6894400 215450 308800 ome.xml.model.ReferenceList
   16  0.83% 73.16%   4293168 8131   8662896 16407 300218 byte[]
   17  0.73% 73.89%   3761216 11262  14073400 44136 300090 byte[]
   18  0.67% 74.56%   3447104 215444   3447200 215450 308801 java.util.HashSet
   19  0.59% 75.14%   3022784   14  10426920  3099 302080 byte[]
   20  0.58% 75.73%   3018152 16895  11575504 69699 300114 char[]
   21  0.51% 76.24%   2648256 82758  10684576 333893 300096 java.util.HashMap$Node
   22  0.45% 76.69%   2337832    1   2337832     1 311878 byte[]
   23  0.45% 77.15%   2336832    1  21556104     7 309850 byte[]
   24  0.45% 77.59%   2298880 3044   6572232  3054 309467 char[]
   25  0.42% 78.01%   2175920 11269  12600648 46579 300091 byte[]
   26  0.42% 78.43%   2164224 22544   7038336 73316 301116 java.lang.Object[]
   27  0.36% 78.79%   1846640 5630   6019984 18365 300872 char[]
   28  0.35% 79.14%   1803520 56360   5865280 183290 301106 org.apache.xerces.xni.QName
   29  0.34% 79.47%   1730432 54076   6895488 215484 300097 java.util.HashMap$Node
   30  0.30% 79.78%   1560056    9   5867352    21 307650 char[]
   31  0.30% 80.08%   1558560    1   1558560     1 311852 char[]
   32  0.30% 80.38%   1557896    1   5828856     3 309903 char[]
   33  0.30% 80.68%   1557816    1   1557816     1 311848 char[]
   34  0.29% 80.97%   1504608 26868   6631968 118428 309293 org.apache.xerces.dom.DeferredElementImpl
   35  0.29% 81.26%   1486160 6102   1486160  6102 310079 char[]
   36  0.27% 81.53%   1386432 22229   6780920 145963 308727 char[]
   37  0.25% 81.78%   1283816 8447   5096544 34849 300120 char[]
   38  0.25% 82.03%   1283640 8445   4964576 33639 300524 char[]
   39  0.24% 82.26%   1216256 8447   5653152 40919 300195 char[]
   40  0.23% 82.49%   1196208 2821   3887336  9168 301053 org.apache.xerces.util.SymbolTable$Entry[]
   41  0.23% 82.72%   1171288 5632   5119800 25635 300196 byte[]
   42  0.21% 82.93%   1106064 11293   4269296 44197 300093 char[]
   43  0.19% 83.13%   1000016    1   1000016     1 311875 byte[]
   44  0.19% 83.32%    968488 8447   3631928 34849 300116 char[]
   45  0.17% 83.49%    901760 22544   2932640 73316 301112 org.apache.xerces.util.XMLAttributesImpl$Attribute
   46  0.17% 83.66%    878280 8445   4768712 45853 300362 sun.net.www.protocol.file.FileURLConnection
   47  0.16% 83.82%    836512 12463   4169296 62069 309762 char[]
   48  0.16% 83.98%    835984 12260   3737624 54953 309465 char[]
   49  0.16% 84.14%    810912 16894   3345552 69699 300112 char[]
   50  0.15% 84.29%    788200 2815   4227312 15274 300523 char[]
   51  0.15% 84.45%    788200 2815   4229728 15285 300528 char[]
   52  0.15% 84.60%    781056 6102    781056  6102 310067 ome.xml.model.XMLAnnotation
   53  0.15% 84.75%    779320    1    786760   125 311742 byte[]
   54  0.15% 84.90%    767040 2820   2493424  9167 301165 char[]
   55  0.15% 85.05%    767040 2820   2493424  9167 301176 java.util.HashMap$Node[]
   56  0.15% 85.19%    749184 31216   2997144 124881 309463 org.apache.xml.serializer.utils.AttList
   57  0.14% 85.33%    721920 22560   2349696 73428 301115 org.apache.xerces.util.AugmentationsImpl$SmallContainer
   58  0.14% 85.47%    721920 22560   2346752 73336 301205 org.apache.xerces.xni.QName
   59  0.14% 85.61%    721408 22544   2346112 73316 301113 org.apache.xerces.xni.QName
   60  0.14% 85.75%    720896 22528   2345472 73296 308535 org.apache.xerces.xni.QName
   61  0.14% 85.88%    698232 8447   3229664 40919 300197 byte[]
   62  0.13% 86.01%    654240 2820   2126744  9167 301094 org.apache.xerces.impl.XMLNSDocumentScannerImpl
   63  0.13% 86.14%    654176    8   9058152  3704 300354 char[]
   64  0.13% 86.26%    651200 16280   1314040 32851 300162 java.lang.ref.Finalizer
   65  0.12% 86.39%    630784 2816   2052288  9162 308492 org.apache.xerces.impl.XMLDocumentScannerImpl
   66  0.12% 86.51%    623728 8131   7171872 16407 300219 byte[]
   67  0.11% 86.62%    585888 24412   2417448 100727 309462 org.apache.xerces.dom.AttributeMap
   68  0.11% 86.73%    585792 12204   2196720 45765 309293 org.apache.xerces.dom.ElementImpl
   69  0.10% 86.84%    541440 2820   1760064  9167 301036 org.apache.xerces.parsers.XIncludeAwareParserConfiguration
   70  0.10% 86.94%    540768 5633   3042528 31693 300201 java.util.jar.JarFile$JarFileEntry
   71  0.10% 87.05%    540672 2816   1758720  9160 309292 org.apache.xerces.dom.DeferredDocumentImpl
   72  0.10% 87.15%    540544 8446   2152896 33639 300526 java.net.URL
   73  0.10% 87.26%    540480 8445   2152896 33639 300522 java.net.URL
   74  0.10% 87.36%    540480 2815   2884792 15284 300991 byte[]
   75  0.10% 87.47%    540480 2815   2884792 15284 300996 byte[]
   76  0.10% 87.57%    533496 22229   3503112 145963 308726 java.lang.String
   77  0.10% 87.67%    496320 2820   1613392  9167 301181 org.apache.xerces.impl.dtd.XMLNSDTDValidator
   78  0.10% 87.76%    495616 2816   1612512  9162 308516 org.apache.xerces.impl.dtd.XMLDTDValidator
   79  0.10% 87.86%    495440 2815   2687872 15272 300245 char[]
   80  0.09% 87.95%    474208 8468   1540560 27510 300496 java.lang.Object[]
   81  0.09% 88.04%    470280 11757   1952920 48823 309295 org.apache.xerces.dom.DeferredTextImpl
   82  0.09% 88.13%    455336 8131    918792 16407 300209 java.util.zip.ZipFile$ZipFileInputStream
   83  0.09% 88.22%    455336 8131    918848 16408 300216 java.util.zip.ZipFile$ZipFileInflaterInputStream
   84  0.09% 88.30%    450880 5636   1466320 18329 301097 char[]
   85  0.09% 88.39%    450880 5636   1466320 18329 301099 char[]
   86  0.09% 88.48%    450880 5636   1466320 18329 301101 char[]
   87  0.09% 88.57%    450880 5636   1466320 18329 301121 char[]
   88  0.09% 88.65%    450880 5636   1466320 18329 301123 char[]
   89  0.09% 88.74%    450560 5632   2535440 31693 300199 java.util.zip.ZipEntry
   90  0.08% 88.82%    428640 2820   1393384  9167 301146 org.apache.xerces.impl.XMLDTDScannerImpl
   91  0.08% 88.90%    414936 3051    414936  3051 309285 loci.formats.meta.OriginalMetadataAnnotation
   92  0.08% 88.98%    406080 2820   1320048  9167 301193 org.apache.xerces.xni.QName[]
   93  0.08% 89.06%    406080 2820   1320048  9167 301194 int[]
   94  0.08% 89.14%    406080 2820   1319616  9164 309279 org.apache.xerces.parsers.DOMParser
   95  0.08% 89.22%    405792 2818   1317744  9151 309790 java.lang.String[]
   96  0.08% 89.30%    405504 2816   1319328  9162 308523 org.apache.xerces.xni.QName[]
   97  0.08% 89.38%    405504 2816   1319328  9162 308524 int[]
   98  0.08% 89.45%    405504 2816   1319040  9160 309742 int[][]
   99  0.08% 89.53%    405504 2816   1319040  9160 309743 java.lang.Object[][]
  100  0.08% 89.61%    405504 2816   1319040  9160 309744 java.lang.Object[][]
  101  0.08% 89.69%    405504 2816   1319040  9160 309745 int[][]
  102  0.08% 89.77%    405504 2816   1319040  9160 309746 int[][]
  103  0.08% 89.85%    405504 2816   1319040  9160 309747 int[][]
  104  0.08% 89.93%    405504 2816   1319040  9160 309748 java.lang.Object[][]
  105  0.08% 90.00%    405504 2816   1319040  9160 309749 int[][]
  106  0.08% 90.08%    405480 16895   1672776 69699 300113 java.lang.String
  107  0.08% 90.16%    405456 16894   1672776 69699 300111 java.lang.StringBuilder
  108  0.08% 90.24%    405360 2815   1320048  9167 301050 java.util.HashMap$Node[]
  109  0.08% 90.32%    405360 2815   1320048  9167 301128 java.lang.String[]
  110  0.08% 90.40%    405360 2815   1319328  9162 308505 java.lang.String[]
  111  0.08% 90.47%    398160 9954   4007200 100180 309893 org.apache.xerces.dom.DeferredAttrImpl
  112  0.07% 90.55%    383024 2817   2201216 16407 300267 char[]
  113  0.07% 90.62%    383016 2817   2149976 16407 300205 char[]
  114  0.07% 90.70%    383016 2817   2150040 16407 300254 char[]
  115  0.07% 90.77%    383016 2817   2150040 16407 300256 char[]
  116  0.07% 90.84%    382840 2815   2028232 15273 300963 char[]
  117  0.07% 90.92%    382840 2815   2029152 15284 300980 char[]
  118  0.07% 90.99%    361440 11295   1174304 36697 300232 java.util.Vector
  119  0.07% 91.06%    360704 22544   1173056 73316 301114 org.apache.xerces.util.AugmentationsImpl
  120  0.07% 91.13%    360704 5636   1173056 18329 301185 java.util.Hashtable$Entry[]
  121  0.07% 91.20%    360704 5636   1173056 18329 301187 java.util.Hashtable$Entry[]
  122  0.07% 91.27%    360704 5636   1173056 18329 301208 java.util.Hashtable$Entry[]
  123  0.07% 91.33%    343184 2902   1860032 15560 300236 char[]
  124  0.07% 91.40%    341184 2834   1838144 15307 300063 char[]
  125  0.07% 91.47%    338400 2820   1099680  9164 309281 char[]
  126  0.07% 91.53%    338040 2817   1968840 16407 300265 char[]
  127  0.06% 91.59%    321408 6696    321408  6696 309232 char[]
  128  0.06% 91.66%    318496 9953   1761952 55061 309644 org.apache.xerces.dom.AttrImpl
  129  0.06% 91.72%    315840 2820   1026704  9167 301066 org.apache.xerces.impl.XMLEntityManager
  130  0.06% 91.78%    315280 2815   1711808 15284 300977 char[]
  131  0.06% 91.84%    299016 12459   1489176 62049 309761 java.lang.String
  132  0.06% 91.89%    295816 8527    978888 28127 301276 char[]
  133  0.06% 91.95%    293464 8463    966312 27802 308721 char[]
  134  0.06% 92.01%    292864 2816   1590288 15291 300535 char[]
  135  0.05% 92.06%    282352 6720   2823520 67200 309835 char[]
  136  0.05% 92.11%    270976 8468    880320 27510 300232 java.util.Stack
  137  0.05% 92.17%    270720 2820    880032  9167 301072 java.lang.Object[]
  138  0.05% 92.22%    270720 2820    880032  9167 301170 org.apache.xerces.impl.dtd.XMLDTDProcessor
  139  0.05% 92.27%    270528 5636    879792 18329 301184 java.util.Hashtable
  140  0.05% 92.32%    270528 5636    879792 18329 301186 java.util.Hashtable
  141  0.05% 92.38%    270528 5636    879792 18329 301207 java.util.Hashtable
  142  0.05% 92.43%    270288 11262   1059216 44134 300092 java.lang.String
  143  0.05% 92.48%    270240 5630   1466448 30551 300234 java.nio.HeapCharBuffer
  144  0.05% 92.53%    270240 8445   1467296 45853 300357 java.io.File
  145  0.05% 92.59%    270240 8445   1467296 45853 300365 java.lang.String[]
  146  0.05% 92.64%    270240 8445   1467296 45853 300366 java.lang.String[]
  147  0.05% 92.69%    270240 2815   1467264 15284 300993 sun.net.www.protocol.jar.URLJarFile$URLJarFileEntry
  148  0.05% 92.74%    270240 11260    878688 36612 309781 org.apache.xerces.dom.AttributeMap
  149  0.05% 92.79%    270240 2815    878496  9151 309784 java.lang.String[]
  150  0.05% 92.85%    270240 2815    878496  9151 309785 java.lang.String[]
  151  0.05% 92.90%    247808 2816    806344  9163 301268 org.apache.xerces.impl.XMLEntityManager$ScannedEntity
  152  0.05% 92.94%    247720 2815   1344992 15284 300975 sun.net.www.protocol.jar.JarURLConnection
  153  0.04% 92.99%    225600 2820    733360  9167 301054 java.util.HashMap$Node[]
  154  0.04% 93.03%    225600 2820    733360  9167 301138 char[]
  155  0.04% 93.07%    225600 2820    733360  9167 301148 char[]
  156  0.04% 93.12%    225600 2820    733360  9167 301149 char[]
  157  0.04% 93.16%    225600 2820    733360  9167 301150 char[]
  158  0.04% 93.21%    225600 2820    733360  9167 301158 char[]
  159  0.04% 93.25%    225600 2820    733360  9167 301160 char[]
  160  0.04% 93.29%    225440 5636    733160 18329 301110 org.apache.xerces.util.XMLAttributesImpl
  161  0.04% 93.34%    225440 2818    732080  9151 309792 java.lang.String[]
  162  0.04% 93.38%    225312 2817   1245176 16407 300207 byte[]
  163  0.04% 93.42%    225280 2816    732960  9162 308514 char[]
  164  0.04% 93.47%    225200 5630   1221880 30547 300509 sun.misc.URLClassPath$1
  165  0.04% 93.51%    225200 2815   1221600 15270 301006 java.util.HashMap$Node[]
  166  0.04% 93.55%    225200 2815    733360  9167 301049 java.util.HashMap$Node[]
  167  0.04% 93.60%    225200 2815    733360  9167 301130 java.lang.String[]
  168  0.04% 93.64%    225200 2815    732960  9162 308507 java.lang.String[]
  169  0.04% 93.68%    217856 3404    774336 12099 309293 org.apache.xerces.dom.ElementNSImpl
  170  0.04% 93.73%    217728 6804   1050592 32831 309646 java.util.Vector
  171  0.04% 93.77%    215040 6720   2150400 67200 309834 java.util.Hashtable$Entry
  172  0.04% 93.81%    215040 6720   2150400 67200 309837 java.util.Hashtable$Entry
  173  0.04% 93.85%    214272 6696    214272  6696 309233 java.util.Hashtable$Entry
  174  0.04% 93.89%    204504 8521    674808 28117 301275 java.lang.String
  175  0.04% 93.93%    203112 8463    667248 27802 308720 org.apache.xerces.util.SymbolTable$Entry
  176  0.04% 93.97%    202944 8456    659904 27496 301096 org.apache.xerces.util.XMLStringBuffer
  177  0.04% 94.01%    202944 8456    659904 27496 301098 org.apache.xerces.util.XMLStringBuffer
  178  0.04% 94.05%    202944 8456    659904 27496 301100 org.apache.xerces.util.XMLStringBuffer
  179  0.04% 94.09%    202728 8447    836376 34849 300115 java.lang.String
  180  0.04% 94.13%    202680 8445   1100472 45853 300364 sun.net.www.MessageHeader
  181  0.04% 94.17%    202680 8445    807336 33639 300525 java.lang.String
  182  0.04% 94.20%    196160 6130    781664 24427 309295 org.apache.xerces.dom.TextImpl
  183  0.04% 94.24%    195144 8131    393768 16407 300217 byte[]
  184  0.04% 94.28%    184592 3729    752264 16324 306853 char[]
  185  0.04% 94.31%    180880 5637    587056 18330 301111 org.apache.xerces.util.XMLAttributesImpl$Attribute[]
  186  0.03% 94.35%    180480 2820    586688  9167 301068 java.util.Hashtable$Entry[]
  187  0.03% 94.38%    180480 2820    586688  9167 301085 java.util.Hashtable$Entry[]
  188  0.03% 94.42%    180480 2820    586688  9167 301173 java.util.Hashtable$Entry[]
  189  0.03% 94.45%    180480 5640    586688 18334 301244 java.util.Hashtable$Entry
  190  0.03% 94.49%    180352 5636    586528 18329 301102 org.apache.xerces.util.XMLResourceIdentifierImpl
  191  0.03% 94.52%    180352 5636    586528 18329 301126 org.apache.xerces.impl.XMLEntityManager$ExternalEntity
  192  0.03% 94.56%    180288 2817   1050048 16407 300257 java.net.URL
  193  0.03% 94.59%    180224 2816    978176 15284 300978 java.net.URL
  194  0.03% 94.63%    180160 5630    587680 18365 300873 java.io.File
  195  0.03% 94.66%    178560 2232    178560  2232 309251 char[]
  196  0.03% 94.69%    161280 6720   1612800 67200 309836 java.lang.String
  197  0.03% 94.72%    158448 2821    513880  9168 301105 org.apache.xerces.xni.QName[]
  198  0.03% 94.75%    157920 2820    513352  9167 301174 java.lang.Object[]
  199  0.03% 94.78%    157920 2820    513352  9167 301175 java.lang.Object[]
  200  0.03% 94.81%    157920 2820    513352  9167 301239 java.lang.Object[]
  201  0.03% 94.84%    157920 2820    513352  9167 301242 char[]
  202  0.03% 94.88%    157696 2816    513072  9162 308495 org.apache.xerces.xni.QName[]
  203  0.03% 94.91%    157696 2816    512960  9160 309741 java.lang.Object[]
  204  0.03% 94.94%    157640 2815    855288 15273 300951 java.util.LinkedHashMap
  205  0.03% 94.97%    157640 2815    516640  9217 301033 char[]
  206  0.03% 95.00%    146448 6102    146448  6102 310080 java.lang.String
  207  0.03% 95.02%    146368 3051    146368  3051 309289 char[]
  208  0.03% 95.05%    140616 2511    140616  2511 310002 ome.xml.model.Plane
  209  0.03% 95.08%    138528 2886   7403808 154246 300229 java.nio.HeapByteBuffer
  210  0.03% 95.10%    136040 3401    482960 12074 309901 java.lang.Object[]
  211  0.03% 95.13%    135360 2820    440016  9167 301046 java.util.HashMap
  212  0.03% 95.16%    135360 2820    440016  9167 301047 java.util.HashMap
  213  0.03% 95.18%    135360 2820    440016  9167 301067 java.util.Hashtable
  214  0.03% 95.21%    135360 2820    440016  9167 301084 java.util.Hashtable
  215  0.03% 95.24%    135360 2820    440016  9167 301172 java.util.Hashtable
  216  0.03% 95.26%    135360 2820    440016  9167 301190 int[]
  217  0.03% 95.29%    135360 2820    440016  9167 301191 int[]
  218  0.03% 95.31%    135360 2820    440016  9167 301192 org.apache.xerces.xni.QName[]
  219  0.03% 95.34%    135360 2820    440016  9167 301204 char[]
  220  0.03% 95.37%    135264 5636    439896 18329 301095 org.apache.xerces.xni.XMLString
  221  0.03% 95.39%    135264 5636    439896 18329 301120 org.apache.xerces.util.XMLStringBuffer
  222  0.03% 95.42%    135264 5636    439896 18329 301122 org.apache.xerces.util.XMLStringBuffer
  223  0.03% 95.44%    135264 5636    439896 18329 301137 org.apache.xerces.util.XMLStringBuffer
  224  0.03% 95.47%    135264 2818    439248  9151 309791 int[]
  225  0.03% 95.50%    135168 2816    439776  9162 308520 int[]
  226  0.03% 95.52%    135168 2816    439776  9162 308521 int[]
  227  0.03% 95.55%    135168 2816    439776  9162 308522 org.apache.xerces.xni.QName[]
  228  0.03% 95.58%    135168 2816    439776  9162 308534 char[]
  229  0.03% 95.60%    135168 2816    439680  9160 309740 char[]
  230  0.03% 95.63%    135120 2815    733200 15275 300227 sun.nio.cs.StreamDecoder
  231  0.03% 95.65%    135120 2815    442560  9220 300875 java.util.HashMap
  232  0.03% 95.68%    135120 2815    733104 15273 300961 char[]
  233  0.03% 95.71%    135120 2815    733680 15285 300982 char[]
  234  0.03% 95.73%    135120 2815    732960 15270 300999 java.io.BufferedReader
  235  0.03% 95.76%    135120 2815    440016  9167 301039 java.util.HashMap
  236  0.03% 95.79%    135120 2815    440016  9167 301040 java.util.HashMap
  237  0.03% 95.81%    135120 2815    440016  9167 301129 int[]
  238  0.03% 95.84%    135120 2815    440016  9167 301141 java.lang.String[]
  239  0.03% 95.86%    135120 2815    439776  9162 308506 int[]
  240  0.03% 95.89%    135120 2815    439776  9162 308538 java.lang.String[]
  241  0.02% 95.91%    124992 2232    124992  2232 308868 ome.xml.model.Plane
  242  0.02% 95.94%    122040 3051    366120  9153 309728 java.lang.Object[]
  243  0.02% 95.96%    117960 2949    616680 15417 300457 java.util.LinkedHashMap$Entry
  244  0.02% 95.98%    113720 2843    657360 16434 300220 java.util.WeakHashMap$Entry
  245  0.02% 96.00%    113360 7085    464896 29056 300049 java.lang.Object
  246  0.02% 96.03%    112800 2820    366680  9167 301075 org.apache.xerces.impl.XMLEntityManager$CharacterBufferPool
  247  0.02% 96.05%    112800 2820    366680  9167 301083 org.apache.xerces.impl.XMLErrorReporter
  248  0.02% 96.07%    112800 2820    366680  9167 301139 org.apache.xerces.impl.dtd.XMLDTDDescription
  249  0.02% 96.09%    112800 2820    366680  9167 301152 int[]
  250  0.02% 96.11%    112800 2820    366680  9167 301153 int[]
  251  0.02% 96.14%    112800 2820    366680  9167 301163 java.lang.String[]
  252  0.02% 96.16%    112800 2820    366680  9167 301171 org.apache.xerces.impl.dtd.XMLEntityDecl
  253  0.02% 96.18%    112800 2820    366680  9167 301183 org.apache.xerces.impl.validation.ValidationState
  254  0.02% 96.20%    112800 2820    366680  9167 301197 org.apache.xerces.impl.dtd.XMLSimpleType
  255  0.02% 96.22%    112800 2820    366680  9167 301200 org.apache.xerces.impl.dtd.XMLSimpleType
  256  0.02% 96.24%    112800 2820    366680  9167 301201 org.apache.xerces.impl.dtd.XMLEntityDecl
  257  0.02% 96.27%    112640 2816    366480  9162 308515 org.apache.xerces.impl.dtd.XMLDTDDescription
  258  0.02% 96.29%    112640 2816    366480  9162 308517 org.apache.xerces.impl.validation.ValidationState
  259  0.02% 96.31%    112640 2816    366480  9162 308527 org.apache.xerces.impl.dtd.XMLSimpleType
  260  0.02% 96.33%    112640 2816    366480  9162 308530 org.apache.xerces.impl.dtd.XMLSimpleType
  261  0.02% 96.35%    112640 2816    366480  9162 308531 org.apache.xerces.impl.dtd.XMLEntityDecl
  262  0.02% 96.38%    112600 2815    611040 15276 300226 sun.nio.cs.UTF_8$Decoder
  263  0.02% 96.40%    112600 2815    611000 15275 300505 sun.misc.URLClassPath$2
  264  0.02% 96.42%    112600 2815    610920 15273 300953 java.util.ServiceLoader$LazyIterator
  265  0.02% 96.44%    112600 2815    366680  9167 301140 java.lang.String[]
  266  0.02% 96.46%    112600 2815    366480  9162 308537 java.lang.String[]
  267  0.02% 96.48%    112600 2815    366120  9153 309730 org.apache.xerces.jaxp.DocumentBuilderImpl
  268  0.02% 96.51%    112600 2815    366120  9153 309736 java.io.StringReader
  269  0.02% 96.53%    112600 2815    365920  9148 309794 org.apache.xerces.jaxp.DocumentBuilderFactoryImpl
  270  0.02% 96.55%    112560 2814    366120  9153 309737 org.apache.xerces.xni.parser.XMLInputSource
  271  0.02% 96.57%    107520 6720   1075200 67200 309833 java.lang.Integer
  272  0.02% 96.59%    107136 4464    107136  4464 309231 java.lang.String
  273  0.02% 96.61%     95560  219    375080   751 309782 char[]
  274  0.02% 96.63%     95296  378     95296   378 302336 byte[]
  275  0.02% 96.65%     90768 2821    293872  9168 301074 byte[][]
  276  0.02% 96.66%     90768 2821    293872  9168 301076 org.apache.xerces.impl.XMLEntityManager$CharacterBuffer[]
  277  0.02% 96.68%     90240 2820    293344  9167 301052 org.apache.xerces.util.SymbolTable
  278  0.02% 96.70%     90240 2820    293344  9167 301069 org.apache.xerces.util.XMLResourceIdentifierImpl
  279  0.02% 96.72%     90240 2820    293344  9167 301071 org.apache.xerces.util.AugmentationsImpl$SmallContainer
  280  0.02% 96.73%     90240 2820    293344  9167 301073 org.apache.xerces.impl.XMLEntityManager$ByteBufferPool
  281  0.02% 96.75%     90240 2820    293344  9167 301077 org.apache.xerces.impl.XMLEntityManager$CharacterBuffer[]
  282  0.02% 96.77%     90240 2820    293344  9167 301078 org.apache.xerces.impl.XMLEntityScanner
  283  0.02% 96.79%     90240 2820    293344  9167 301103 int[]
  284  0.02% 96.80%     90240 2820    293344  9167 301108 org.apache.xerces.xni.QName
  285  0.02% 96.82%     90240 2820    293344  9167 301109 org.apache.xerces.xni.QName
  286  0.02% 96.84%     90240 2820    293344  9167 301119 java.lang.String[]
  287  0.02% 96.86%     90240 2820    293344  9167 301124 org.apache.xerces.xni.QName
  288  0.02% 96.87%     90240 2820    293344  9167 301135 java.lang.String[]
  289  0.02% 96.89%     90240 2820    293344  9167 301151 org.apache.xerces.util.XMLResourceIdentifierImpl
  290  0.02% 96.91%     90240 2820    293344  9167 301155 java.lang.String[]
  291  0.02% 96.93%     90240 2820    293344  9167 301188 org.apache.xerces.xni.QName
  292  0.02% 96.94%     90240 2820    293344  9167 301189 org.apache.xerces.xni.QName
  293  0.02% 96.96%     90240 2820    293344  9167 301195 org.apache.xerces.impl.dtd.XMLElementDecl
  294  0.02% 96.98%     90240 2820    293344  9167 301196 org.apache.xerces.xni.QName
  295  0.02% 97.00%     90240 2820    293344  9167 301199 org.apache.xerces.xni.QName
  296  0.02% 97.01%     90240 2820    293344  9167 301202 org.apache.xerces.xni.QName
  297  0.02% 97.03%     90240 2820    293344  9167 301209 org.apache.xerces.xni.QName
  298  0.02% 97.05%     90240 2820    293344  9167 301241 org.apache.xerces.impl.XMLVersionDetector
  299  0.02% 97.07%     90240 2820    293248  9164 309282 org.apache.xerces.xni.QName
  300  0.02% 97.08%     90240 2820    293248  9164 309283 org.apache.xerces.xni.QName
  301  0.02% 97.10%     90240 2820    293248  9164 309284 org.apache.xerces.xni.QName
  302  0.02% 97.12%     90176 2818    292832  9151 309789 org.apache.xerces.util.NamespaceSupport
  303  0.02% 97.14%     90144 2817    525024 16407 300274 sun.misc.URLClassPath$JarLoader$2
  304  0.02% 97.15%     90112 2816    293216  9163 301267 org.apache.xerces.util.XMLResourceIdentifierImpl
  305  0.02% 97.17%     90112 2816    293184  9162 301308 java.io.EOFException
  306  0.02% 97.19%     90112 2816    293184  9162 308493 int[]
  307  0.02% 97.21%     90112 2816    293184  9162 308497 org.apache.xerces.xni.QName
  308  0.02% 97.22%     90112 2816    293184  9162 308498 org.apache.xerces.xni.QName
  309  0.02% 97.24%     90112 2816    293184  9162 308501 java.lang.String[]
  310  0.02% 97.26%     90112 2816    293184  9162 308502 org.apache.xerces.xni.QName
  311  0.02% 97.28%     90112 2816    293184  9162 308512 java.lang.String[]
  312  0.02% 97.29%     90112 2816    293184  9162 308518 org.apache.xerces.xni.QName
  313  0.02% 97.31%     90112 2816    293184  9162 308519 org.apache.xerces.xni.QName
  314  0.02% 97.33%     90112 2816    293184  9162 308525 org.apache.xerces.impl.dtd.XMLElementDecl
  315  0.02% 97.35%     90112 2816    293184  9162 308526 org.apache.xerces.xni.QName
  316  0.02% 97.36%     90112 2816    293184  9162 308529 org.apache.xerces.xni.QName
  317  0.02% 97.38%     90112 2816    293184  9162 308532 org.apache.xerces.xni.QName
  318  0.02% 97.40%     90080 2815    489088 15284 300371 java.io.File
  319  0.02% 97.41%     90080 5630    488784 30549 300521 java.net.URLClassLoader$3$1
  320  0.02% 97.43%     90080 2815    488768 15274 300527 java.io.File
  321  0.02% 97.45%     90080 2815    293344  9167 300950 java.util.ServiceLoader
  322  0.02% 97.47%     90080 2815    488736 15273 300959 java.util.LinkedHashMap$LinkedEntryIterator
  323  0.02% 97.48%     90080 2815    488640 15270 301002 java.util.ArrayList$Itr
  324  0.02% 97.50%     90080 2815    293344  9167 301127 org.apache.xerces.util.NamespaceSupport
  325  0.02% 97.52%     90080 2815    489056 15283 302994 java.io.FilePermission
  326  0.02% 97.54%     90080 2815    293184  9162 308504 org.apache.xerces.util.NamespaceSupport
  327  0.02% 97.55%     90080 2815    293248  9164 309278 java.io.File
  328  0.02% 97.57%     90080 2815    292832  9151 309787 java.lang.String[]
  329  0.02% 97.59%     90048 2814    292896  9153 309729 java.util.ArrayList$Itr
  330  0.02% 97.61%     90048 2814    292896  9153 309731 org.xml.sax.InputSource
  331  0.02% 97.62%     89496 3729    391776 16324 306852 java.lang.String
  332  0.02% 97.64%     81648 3402    498096 20754 309892 org.apache.xerces.dom.AttributeMap
  333  0.01% 97.65%     73944    9    566904    69 309870 int[]
  334  0.01% 97.67%     73944    9    566904    69 309871 java.lang.Object[]
  335  0.01% 97.68%     73944    9    566904    69 309872 java.lang.Object[]
  336  0.01% 97.70%     73944    9    566904    69 309873 int[]
  337  0.01% 97.71%     73944    9    566904    69 309874 int[]
  338  0.01% 97.73%     73944    9    566904    69 309875 int[]
  339  0.01% 97.74%     73944    9    566904    69 309876 java.lang.Object[]
  340  0.01% 97.75%     73944    9    566904    69 309877 int[]
  341  0.01% 97.77%     73224 3051     73224  3051 309290 java.lang.String
  342  0.01% 97.78%     73224 3051     73224  3051 309466 java.lang.String
  343  0.01% 97.80%     73224 3051    219672  9153 309727 org.apache.xerces.dom.AttributeMap
  344  0.01% 97.81%     67944 2831    223296  9304 309752 org.apache.xerces.dom.DeferredDocumentImpl$RefCount
  345  0.01% 97.82%     67944 2831    223296  9304 309754 org.apache.xerces.dom.DeferredDocumentImpl$RefCount
  346  0.01% 97.84%     67944 2831    223296  9304 309759 org.apache.xerces.dom.DeferredDocumentImpl$RefCount
  347  0.01% 97.85%     67680 2820    220008  9167 301041 java.util.ArrayList
  348  0.01% 97.86%     67680 2820    220008  9167 301042 java.util.ArrayList
  349  0.01% 97.88%     67680 2820    220008  9167 301043 java.util.ArrayList
  350  0.01% 97.89%     67680 2820    220008  9167 301044 java.util.ArrayList
  351  0.01% 97.90%     67680 2820    220008  9167 301045 java.util.ArrayList
  352  0.01% 97.92%     67680 2820    220008  9167 301104 org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$ElementStack
  353  0.01% 97.93%     67680 2820    220008  9167 301107 org.apache.xerces.impl.XMLNSDocumentScannerImpl$NSContentDispatcher
  354  0.01% 97.94%     67680 2820    220008  9167 301117 org.apache.xerces.xni.XMLString
  355  0.01% 97.95%     67680 2820    220008  9167 301118 org.apache.xerces.xni.XMLString
  356  0.01% 97.97%     67680 2820    220008  9167 301125 char[]
  357  0.01% 97.98%     67680 2820    220008  9167 301136 org.apache.xerces.xni.XMLString
  358  0.01% 97.99%     67680 2820    220008  9167 301147 org.apache.xerces.xni.XMLString
  359  0.01% 98.01%     67680 2820    220008  9167 301154 boolean[]
  360  0.01% 98.02%     67680 2820    220008  9167 301156 org.apache.xerces.xni.XMLString
  361  0.01% 98.03%     67680 2820    220008  9167 301157 org.apache.xerces.util.XMLStringBuffer
  362  0.01% 98.05%     67680 2820    220008  9167 301159 org.apache.xerces.util.XMLStringBuffer
  363  0.01% 98.06%     67680 2820    220008  9167 301161 org.apache.xerces.xni.XMLString
  364  0.01% 98.07%     67680 2820    220008  9167 301162 org.apache.xerces.xni.XMLString
  365  0.01% 98.09%     67680 2820    220008  9167 301164 org.apache.xerces.util.XMLStringBuffer
  366  0.01% 98.10%     67680 2820    220008  9167 301198 org.apache.xerces.impl.dtd.XMLAttributeDecl
  367  0.01% 98.11%     67680 2820    220008  9167 301203 java.lang.StringBuffer
  368  0.01% 98.12%     67680 2820    220008  9167 301206 org.apache.xerces.impl.dtd.DTDGrammarBucket
  369  0.01% 98.14%     67680 2820    220008  9167 301238 org.apache.xerces.impl.validation.ValidationManager
  370  0.01% 98.15%     67680 2820    220008  9167 301243 org.apache.xerces.impl.msg.XMLMessageFormatter
  371  0.01% 98.16%     67680 2820    219936  9164 309280 java.lang.StringBuffer
  372  0.01% 98.18%     67608 2817    393768 16407 300255 java.lang.String
  373  0.01% 98.19%     67608 2817    393792 16408 300258 java.lang.String
  374  0.01% 98.20%     67608 2817    393792 16408 300259 char[]
  375  0.01% 98.22%     67608 2817    393768 16407 300264 java.lang.String
  376  0.01% 98.23%     67608 2817    393768 16407 300266 java.lang.String
  377  0.01% 98.24%     67608 2817    367008 15292 300532 java.lang.String
  378  0.01% 98.26%     67608 2817    367008 15292 300533 char[]
  379  0.01% 98.27%     67584 2816    366984 15291 300534 java.lang.String
  380  0.01% 98.28%     67584 2816    219912  9163 301269 org.apache.xerces.impl.XMLEntityManager$CharacterBuffer
  381  0.01% 98.29%     67584 2816    219888  9162 308494 org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$ElementStack
  382  0.01% 98.31%     67584 2816    219888  9162 308496 org.apache.xerces.impl.XMLDocumentScannerImpl$ContentDispatcher
  383  0.01% 98.32%     67584 2816    219888  9162 308499 org.apache.xerces.xni.XMLString
  384  0.01% 98.33%     67584 2816    219888  9162 308500 org.apache.xerces.xni.XMLString
  385  0.01% 98.35%     67584 2816    219888  9162 308503 char[]
  386  0.01% 98.36%     67584 2816    219888  9162 308513 org.apache.xerces.xni.XMLString
  387  0.01% 98.37%     67584 2816    219888  9162 308528 org.apache.xerces.impl.dtd.XMLAttributeDecl
  388  0.01% 98.39%     67584 2816    219888  9162 308533 java.lang.StringBuffer
  389  0.01% 98.40%     67584 2816    219888  9162 308536 org.apache.xerces.impl.dtd.DTDGrammarBucket
  390  0.01% 98.41%     67584 2816    219840  9160 309739 java.lang.StringBuffer
  391  0.01% 98.43%     67560 2815    366528 15272 300244 java.lang.StringBuffer
  392  0.01% 98.44%     67560 2815    366528 15272 300511 java.net.URLClassLoader$3
  393  0.01% 98.45%     67560 2815    220560  9190 300870 java.net.URLClassLoader$2
  394  0.01% 98.47%     67560 2815    220008  9167 300955 java.util.ServiceLoader$1
  395  0.01% 98.48%     67560 2815    366552 15273 300960 java.lang.StringBuilder
  396  0.01% 98.49%     67560 2815    366552 15273 300962 java.lang.String
  397  0.01% 98.50%     67560 2815    366552 15273 300964 java.util.Enumeration[]
  398  0.01% 98.52%     67560 2815    366480 15270 300965 java.util.Enumeration[]
  399  0.01% 98.53%     67560 2815    366480 15270 300966 sun.misc.CompoundEnumeration
  400  0.01% 98.54%     67560 2815    366552 15273 300967 java.net.URLClassLoader$3
  401  0.01% 98.56%     67560 2815    366552 15273 300968 sun.misc.CompoundEnumeration
  402  0.01% 98.57%     67560 2815    366480 15270 300969 java.util.ArrayList
  403  0.01% 98.58%     67560 2815    366816 15284 300976 java.lang.String
  404  0.01% 98.60%     67560 2815    366816 15284 300979 java.lang.String
  405  0.01% 98.61%     67560 2815    366840 15285 300981 java.lang.StringBuilder
  406  0.01% 98.62%     67560 2815    366840 15285 300983 java.lang.String
  407  0.01% 98.64%     67560 2815    366816 15284 300997 sun.net.www.protocol.jar.JarURLConnection$JarURLInputStream
  408  0.01% 98.65%     67560 2815    366480 15270 300998 java.io.InputStreamReader
  409  0.01% 98.66%     67560 2815    366480 15270 301001 java.lang.String
  410  0.01% 98.67%     67560 2815    220008  9167 301016 org.apache.xerces.parsers.SecuritySupport$4
  411  0.01% 98.69%     67560 2815    220008  9167 301017 org.apache.xerces.parsers.SecuritySupport$4
  412  0.01% 98.70%     67560 2815    220008  9167 301023 org.apache.xerces.parsers.SecuritySupport$7
  413  0.01% 98.71%     67560 2815    220008  9167 301030 org.apache.xerces.parsers.SecuritySupport$6
  414  0.01% 98.73%     67560 2815    220440  9185 301031 java.net.URLClassLoader$2
  415  0.01% 98.74%     67560 2815    221208  9217 301032 java.lang.String
  416  0.01% 98.75%     67560 2815    220008  9167 301037 java.util.ArrayList
  417  0.01% 98.77%     67560 2815    220008  9167 301038 java.util.ArrayList
  418  0.01% 98.78%     67560 2815    219936  9164 309270 javax.xml.parsers.SecuritySupport$2
  419  0.01% 98.79%     67560 2815    219624  9151 309788 java.lang.String[]
  420  0.01% 98.80%     65552    1     65552     1 301271 byte[]
  421  0.01% 98.82%     61584    9    110512    43 309234 java.util.Hashtable$Entry[]
  422  0.01% 98.83%     60264 2511     60264  2511 310003 java.lang.Double
  423  0.01% 98.84%     60264 2511     60264  2511 310032 ome.units.quantity.Time
  424  0.01% 98.85%     60264 2511     60264  2511 310033 java.lang.Double
  425  0.01% 98.86%     60264 2511     60264  2511 310034 ome.units.quantity.Length
  426  0.01% 98.88%     60264 2511     60264  2511 310038 java.lang.Double
  427  0.01% 98.89%     60264 2511     60264  2511 310039 ome.units.quantity.Length
  428  0.01% 98.90%     60264 2511     60264  2511 310040 java.lang.Double
  429  0.01% 98.91%     60264 2511     60264  2511 310041 ome.units.quantity.Length
  430  0.01% 98.92%     60264 2511     60264  2511 310042 java.lang.Double
  431  0.01% 98.93%     60264 2511     60264  2511 310043 ome.units.quantity.Time
  432  0.01% 98.94%     57000    7  13234168  2849 300342 byte[]
  433  0.01% 98.96%     55968 1183     57400  1216 302331 char[]
  434  0.01% 98.97%     53568 2232     53568  2232 308758 java.lang.Double
  435  0.01% 98.98%     53568 2232     53568  2232 308759 ome.units.quantity.Length
  436  0.01% 98.99%     53568 2232     53568  2232 308760 java.lang.Double
  437  0.01% 99.00%     53568 2232     53568  2232 308761 ome.units.quantity.Length
  438  0.01% 99.01%     53568 2232     53568  2232 308762 java.lang.Double
  439  0.01% 99.02%     53568 2232     53568  2232 308763 ome.units.quantity.Length
  440  0.01% 99.03%     53568 2232     53568  2232 308780 java.lang.Double
  441  0.01% 99.04%     53568 2232     53568  2232 308781 java.lang.Double
  442  0.01% 99.05%     53568 2232     53568  2232 309033 java.lang.Double
  443  0.01% 99.06%     53568 2232     53568  2232 309034 ome.units.quantity.Time
  444  0.01% 99.07%     53568 2232     53568  2232 309035 ome.units.quantity.Time
  445  0.01% 99.08%     53568 2232     53568  2232 309243 java.lang.String
  446  0.01% 99.09%     53568 2232     53568  2232 309250 java.lang.String
SITES END