If you download Arnold 5.1.0.1 or later, you get a version of maketx that uses OpenImageIO 1.7.17 and which has no problem hashing
If you download HtoA, you'll find a copy of oiiotool in the scripts/bin folder. On Mon, Jun 4, 2018 at 2:34 PM, Stephen Blair <[email protected]> wrote: > No, those flags ( -v --runstats --oiio --threads 7 --compression zip > --format exr -d half ) won't make a difference. > > The MtoA maketx used to support two additional flags, which you aren't > using. And I don't think MtoA even uses those two extra flags anymore. > > > If you can't use the maketx from the Arnold distribution, then the only > other workaround right now is threads 1 > > > Yes, it's on the radar. > > > > > > On Mon, Jun 4, 2018 at 1:33 PM, Will Anielewicz <[email protected]> > wrote: > >> Hi Stephen, >> >> Are you mentioning the difference between maketx in MtoA as opposed to >> Arnold5.1.0.1 >> because we may see unexpected results when using these options >> >> maketx -v --runstats --oiio --threads 7 --compression zip --format exr -d >> half >> >> thanks >> >> On Mon, Jun 4, 2018 at 9:36 AM, Stephen Blair <[email protected]> >> wrote: >> >>> The maketx that comes with Arnold 5.1.0.1 uses OpenImageIO 1.7.17 >>> >>> MtoA includes an older maketx that has been customized (to work with >>> syncolor, iirc) >>> >>> On Mon, Jun 4, 2018 at 12:28 PM, Will Anielewicz < >>> [email protected]> wrote: >>> >>>> Hi Thiago, >>>> >>>> Thanks for the suggestion of -threads 1 ( and yes it did make the hash >>>> processing take 13s on my workstation) >>>> Maya about Arnold is Arnold Core 5.1.0.1 which I think would include >>>> the "newer" maketx >>>> which is exhibiting the slow processing >>>> my maketx is reporting >>>> OpenImageIO 1.7.7 >>>> Does that match the version you are using? >>>> >>>> On Mon, Jun 4, 2018 at 8:08 AM, Thiago Ize <[email protected]> >>>> wrote: >>>> >>>>> Thanks for the repro! I was able to get similarly poor hashing times >>>>> using the same older maketx that you reported in the other email list. >>>>> Changing to "--threads 1" fixes the slowdown (hashing takes 5.8s and the >>>>> total maketx time is 33s). Using a newer maketx (as supplied from at least >>>>> Arnold 5.1.0) gives a big speedup in "--threads 1" mode, and hashing is >>>>> now >>>>> expectedly faster with "--threads 7" (the entire maketx run takes less >>>>> than >>>>> 13s on my laptop). >>>>> >>>>> So either switch to single threaded maketx, or better yet, upgrade >>>>> your maketx to that supplied in a newer Arnold. >>>>> >>>>> On Mon, Jun 4, 2018 at 8:36 AM, Will Anielewicz < >>>>> [email protected]> wrote: >>>>> >>>>>> This is a cross posting with 3d-pro. Larry Gritz suggested I post >>>>>> this here as well. >>>>>> We are using many openexr 8k textures for some CG production. >>>>>> Several of them can take many minutes to convert to .tx >>>>>> It seems to be correlated to image complexity. >>>>>> >>>>>> Example openexr image on googledrive: >>>>>> https://drive.google.com/open?id=118ucgUMlUjxuDg0z_kLoDpMEA8Cu6F7c >>>>>> >>>>>> >>>>>> Here are some runstats >>>>>> >>>>>> >>>>>> Notice this stat in particular >>>>>> >>>>>> SHA-1 hash 4m 52.17s (492.6 MB) >>>>>> >>>>>> >>>>>> maketx -v --runstats --oiio --threads 7 --compression zip --format >>>>>> exr -d half testEXR_Mari_16bit_8K.exr >>>>>> >>>>>> I have a 16bit float exr test image which is taking 5 minutes on my >>>>>> workstation >>>>>> >>>>>> prep 0.00s (10.6 MB) >>>>>> Reading file: testEXR_Mari_16bit_8K.exr >>>>>> read "testEXR_Mari_16bit_8K.exr" 0.00s (10.7 MB) >>>>>> misc2 16.32s (274.7 MB) >>>>>> misc3 0.00s (274.7 MB) >>>>>> resize & data convert 0.00s (274.7 MB) >>>>>> SHA-1: 2F36DD66063B77836B264CEBEA56B1A9B5064FA8 >>>>>> SHA-1 hash 4m 52.17s (492.6 MB) >>>>>> AverageColor: 0.531764,0.510344,0.514165,1 >>>>>> misc4 0.00s (492.6 MB) >>>>>> Writing file: testEXR_Mari_16bit_8K.898d81fa.temp.tx >>>>>> Filter "box" >>>>>> Top level is 8192x8192 >>>>>> Mipmapping... >>>>>> 4096x4096 (1018.4 MB) >>>>>> 2048x2048 (1018.4 MB) >>>>>> 1024x1024 (778.4 MB) >>>>>> 512x512 (778.4 MB) >>>>>> 256x256 (762.4 MB) >>>>>> 128x128 (762.4 MB) >>>>>> 64x64 (762.4 MB) >>>>>> 32x32 (762.4 MB) >>>>>> 16x16 (762.4 MB) >>>>>> 8x8 (762.4 MB) >>>>>> 4x4 (762.4 MB) >>>>>> 2x2 (762.4 MB) >>>>>> 1x1 (762.4 MB) >>>>>> Wrote file: testEXR_Mari_16bit_8K.898d81fa.temp.tx (762.4 MB) >>>>>> maketx run time (seconds): 333.31 >>>>>> file read: 0.00 >>>>>> file write: 10.36 >>>>>> initial resize: 0.00 >>>>>> hash: 292.17 >>>>>> mip computation: 14.45 >>>>>> color convert: 0.00 >>>>>> unaccounted: 16.33 ( 0.00 16.32 0.00 0.00) >>>>>> maketx peak memory used: 1018.4 MB >>>>>> >>>>>> workstation specs >>>>>> >>>>>> CPU op-mode(s): 32-bit, 64-bit >>>>>> Byte Order: Little Endian >>>>>> CPU(s): 12 >>>>>> On-line CPU(s) list: 0-11 >>>>>> Thread(s) per core: 2 >>>>>> Core(s) per socket: 6 >>>>>> Socket(s): 1 >>>>>> NUMA node(s): 1 >>>>>> Vendor ID: GenuineIntel >>>>>> CPU family: 6 >>>>>> Model: 63 >>>>>> Model name: Intel(R) Core(TM) i7-5930K CPU @ 3.50GHz >>>>>> >>>>>> >>>>>> >>> >>> >> >> _______________________________________________ >> Oiio-dev mailing list >> [email protected] >> http://lists.openimageio.org/listinfo.cgi/oiio-dev-openimageio.org >> >> >
_______________________________________________ Oiio-dev mailing list [email protected] http://lists.openimageio.org/listinfo.cgi/oiio-dev-openimageio.org
