Oh, so it's even older? That would certainly explain why I was unable to reproduce the problem with 1.7.17!
On June 4, 2018 12:27:56 PM PDT, Stephen Blair <[email protected]> wrote: >If you download Arnold 5.1.0.1 or later, you get a version of maketx >that >uses OpenImageIO 1.7.17 and which has no problem hashing > >If you download HtoA, you'll find a copy of oiiotool in the scripts/bin >folder. > >On Mon, Jun 4, 2018 at 2:34 PM, Stephen Blair <[email protected]> >wrote: > >> No, those flags ( -v --runstats --oiio --threads 7 --compression zip >> --format exr -d half ) won't make a difference. >> >> The MtoA maketx used to support two additional flags, which you >aren't >> using. And I don't think MtoA even uses those two extra flags >anymore. >> >> >> If you can't use the maketx from the Arnold distribution, then the >only >> other workaround right now is threads 1 >> >> >> Yes, it's on the radar. >> >> >> >> >> >> On Mon, Jun 4, 2018 at 1:33 PM, Will Anielewicz ><[email protected]> >> wrote: >> >>> Hi Stephen, >>> >>> Are you mentioning the difference between maketx in MtoA as opposed >to >>> Arnold5.1.0.1 >>> because we may see unexpected results when using these options >>> >>> maketx -v --runstats --oiio --threads 7 --compression zip --format >exr -d >>> half >>> >>> thanks >>> >>> On Mon, Jun 4, 2018 at 9:36 AM, Stephen Blair ><[email protected]> >>> wrote: >>> >>>> The maketx that comes with Arnold 5.1.0.1 uses OpenImageIO 1.7.17 >>>> >>>> MtoA includes an older maketx that has been customized (to work >with >>>> syncolor, iirc) >>>> >>>> On Mon, Jun 4, 2018 at 12:28 PM, Will Anielewicz < >>>> [email protected]> wrote: >>>> >>>>> Hi Thiago, >>>>> >>>>> Thanks for the suggestion of -threads 1 ( and yes it did make the >hash >>>>> processing take 13s on my workstation) >>>>> Maya about Arnold is Arnold Core 5.1.0.1 which I think would >include >>>>> the "newer" maketx >>>>> which is exhibiting the slow processing >>>>> my maketx is reporting >>>>> OpenImageIO 1.7.7 >>>>> Does that match the version you are using? >>>>> >>>>> On Mon, Jun 4, 2018 at 8:08 AM, Thiago Ize <[email protected]> >>>>> wrote: >>>>> >>>>>> Thanks for the repro! I was able to get similarly poor hashing >times >>>>>> using the same older maketx that you reported in the other email >list. >>>>>> Changing to "--threads 1" fixes the slowdown (hashing takes 5.8s >and the >>>>>> total maketx time is 33s). Using a newer maketx (as supplied from >at least >>>>>> Arnold 5.1.0) gives a big speedup in "--threads 1" mode, and >hashing is now >>>>>> expectedly faster with "--threads 7" (the entire maketx run takes >less than >>>>>> 13s on my laptop). >>>>>> >>>>>> So either switch to single threaded maketx, or better yet, >upgrade >>>>>> your maketx to that supplied in a newer Arnold. >>>>>> >>>>>> On Mon, Jun 4, 2018 at 8:36 AM, Will Anielewicz < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> This is a cross posting with 3d-pro. Larry Gritz suggested I >post >>>>>>> this here as well. >>>>>>> We are using many openexr 8k textures for some CG production. >>>>>>> Several of them can take many minutes to convert to .tx >>>>>>> It seems to be correlated to image complexity. >>>>>>> >>>>>>> Example openexr image on googledrive: >>>>>>> >https://drive.google.com/open?id=118ucgUMlUjxuDg0z_kLoDpMEA8Cu6F7c >>>>>>> >>>>>>> >>>>>>> Here are some runstats >>>>>>> >>>>>>> >>>>>>> Notice this stat in particular >>>>>>> >>>>>>> SHA-1 hash 4m 52.17s (492.6 MB) >>>>>>> >>>>>>> >>>>>>> maketx -v --runstats --oiio --threads 7 --compression zip >--format >>>>>>> exr -d half testEXR_Mari_16bit_8K.exr >>>>>>> >>>>>>> I have a 16bit float exr test image which is taking 5 minutes on >my >>>>>>> workstation >>>>>>> >>>>>>> prep 0.00s (10.6 MB) >>>>>>> Reading file: testEXR_Mari_16bit_8K.exr >>>>>>> read "testEXR_Mari_16bit_8K.exr" 0.00s (10.7 MB) >>>>>>> misc2 16.32s (274.7 MB) >>>>>>> misc3 0.00s (274.7 MB) >>>>>>> resize & data convert 0.00s (274.7 MB) >>>>>>> SHA-1: 2F36DD66063B77836B264CEBEA56B1A9B5064FA8 >>>>>>> SHA-1 hash 4m 52.17s (492.6 MB) >>>>>>> AverageColor: 0.531764,0.510344,0.514165,1 >>>>>>> misc4 0.00s (492.6 MB) >>>>>>> Writing file: testEXR_Mari_16bit_8K.898d81fa.temp.tx >>>>>>> Filter "box" >>>>>>> Top level is 8192x8192 >>>>>>> Mipmapping... >>>>>>> 4096x4096 (1018.4 MB) >>>>>>> 2048x2048 (1018.4 MB) >>>>>>> 1024x1024 (778.4 MB) >>>>>>> 512x512 (778.4 MB) >>>>>>> 256x256 (762.4 MB) >>>>>>> 128x128 (762.4 MB) >>>>>>> 64x64 (762.4 MB) >>>>>>> 32x32 (762.4 MB) >>>>>>> 16x16 (762.4 MB) >>>>>>> 8x8 (762.4 MB) >>>>>>> 4x4 (762.4 MB) >>>>>>> 2x2 (762.4 MB) >>>>>>> 1x1 (762.4 MB) >>>>>>> Wrote file: testEXR_Mari_16bit_8K.898d81fa.temp.tx (762.4 MB) >>>>>>> maketx run time (seconds): 333.31 >>>>>>> file read: 0.00 >>>>>>> file write: 10.36 >>>>>>> initial resize: 0.00 >>>>>>> hash: 292.17 >>>>>>> mip computation: 14.45 >>>>>>> color convert: 0.00 >>>>>>> unaccounted: 16.33 ( 0.00 16.32 0.00 0.00) >>>>>>> maketx peak memory used: 1018.4 MB >>>>>>> >>>>>>> workstation specs >>>>>>> >>>>>>> CPU op-mode(s): 32-bit, 64-bit >>>>>>> Byte Order: Little Endian >>>>>>> CPU(s): 12 >>>>>>> On-line CPU(s) list: 0-11 >>>>>>> Thread(s) per core: 2 >>>>>>> Core(s) per socket: 6 >>>>>>> Socket(s): 1 >>>>>>> NUMA node(s): 1 >>>>>>> Vendor ID: GenuineIntel >>>>>>> CPU family: 6 >>>>>>> Model: 63 >>>>>>> Model name: Intel(R) Core(TM) i7-5930K CPU @ 3.50GHz >>>>>>> >>>>>>> >>>>>>> >>>> >>>> >>> >>> _______________________________________________ >>> Oiio-dev mailing list >>> [email protected] >>> http://lists.openimageio.org/listinfo.cgi/oiio-dev-openimageio.org >>> >>> >> -- Larry Gritz [email protected]
_______________________________________________ Oiio-dev mailing list [email protected] http://lists.openimageio.org/listinfo.cgi/oiio-dev-openimageio.org
