Hi, No i have a I7 2600K (4core/8 thread) & 8Go of Ram. & darktable never use all my ram.
It's not problem with xmp file, as i have tested with a fresh database & import a test directory without xmp file > It's can be a problem of mixing use of stable & git version ? i don't think i have try with a fresh database & start darktable after a clean : PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 1368 roumano 20 0 2479m 761m 32m S 788 9.6 15:19.61 darktable 519 rm -rf ./.cache/darktable ./.config/darktable 520 cd bin/darktable/ 521 git pull 522 ./build.sh 523 cd "./build"; sudo make install then : LANC=C rm -rf /tmp/dt /opt/darktable/bin/darktable -d perf --configdir /tmp/dt > /tmp/darktable_perf4 [defaults] found a 64-bit system with 8145292 kb ram and 8 cores (0 atom based) [defaults] setting high quality defaults [mipmap_cache] cache is empty, file `/home/roumano/.cache/darktable/mipmaps-607893dafb23007a99f43d77116ba49377a19761' doesn't exist ... ... [dev_process_image] pixel pipeline processing took 0.006 secs (0.026 CPU) [dev] took 0.000 secs (-0.000 CPU) to load the image. [dev_pixelpipe] took 0.000 secs (0.000 CPU) initing base buffer [preview] [dev_pixelpipe] took 0.003 secs (0.018 CPU) processing `balance des blancs' [preview] [dev_pixelpipe] took 0.002 secs (0.006 CPU) processing `récupération des hautes lumières' [preview] [dev_pixelpipe] took 0.004 secs (0.018 CPU) processing `courbe de base' [preview] [dev_pixelpipe] took 0.008 secs (0.037 CPU) processing `profil de couleur d'entrée' [preview] [dev_pixelpipe] took 0.043 secs (0.226 CPU) processing `ombres et hautes lumières' [preview] [dev_pixelpipe] took 0.000 secs (0.000 CPU) initing base buffer [full] [dev_pixelpipe] took 3.207 secs (0.185 CPU) processing `contraste local' [preview] [dev_pixelpipe] took 34.224 secs (0.046 CPU) processing `renforcer la netteté' [preview] [dev_pixelpipe] took 37.433 secs (0.237 CPU) processing `balance des blancs' [full] [dev_pixelpipe] took 0.013 secs (0.087 CPU) processing `profil de couleur de sortie ' [preview] [dev_pixelpipe] took 0.008 secs (0.056 CPU) processing `récupération des hautes lumières' [full] [dev_pixelpipe] took 0.004 secs (0.018 CPU) processing `velvia' [preview] [dev_pixelpipe] took 0.003 secs (0.002 CPU) processing `sous- et sur-exposition' [preview] [dev_pixelpipe] took 0.003 secs (0.009 CPU) processing `gamma' [preview] [dev_process_preview] pixel pipeline processing took 37.563 secs (0.707 CPU) [dev_pixelpipe] took 0.454 secs (2.445 CPU) processing `dématriçage' [full] [dev_pixelpipe] took 0.003 secs (0.014 CPU) processing `courbe de base' [full] [dev_pixelpipe] took 0.005 secs (0.032 CPU) processing `profil de couleur d'entrée' [full] [dev_pixelpipe] took 0.025 secs (0.150 CPU) processing `ombres et hautes lumières' [full] [dev_pixelpipe] took 0.022 secs (0.172 CPU) processing `contraste local' [full] [dev_pixelpipe] took 0.006 secs (0.033 CPU) processing `renforcer la netteté' [full] [dev_pixelpipe] took 0.005 secs (0.033 CPU) processing `profil de couleur de sortie ' [full] [dev_pixelpipe] took 0.003 secs (0.012 CPU) processing `velvia' [full] [dev_pixelpipe] took 0.002 secs (0.002 CPU) processing `sous- et sur-exposition' [full] [dev_pixelpipe] took 0.002 secs (0.013 CPU) processing `gamma' [full] [dev_process_image] pixel pipeline processing took 37.971 secs (3.213 CPU) [dev_pixelpipe] took 0.000 secs (-0.000 CPU) initing base buffer [full] [dev_pixelpipe] took 0.007 secs (0.041 CPU) processing `balance des blancs' [full] [dev_pixelpipe] took 0.007 secs (0.032 CPU) processing `récupération des hautes lumières' [full] [dev_pixelpipe] took 0.000 secs (0.000 CPU) initing base buffer [preview] [dev_pixelpipe] took 0.003 secs (0.018 CPU) processing `balance des blancs' [preview] [dev_pixelpipe] took 0.002 secs (0.010 CPU) processing `récupération des hautes lumières' [preview] [dev_pixelpipe] took 0.004 secs (0.019 CPU) processing `courbe de base' [preview] [dev_pixelpipe] took 0.010 secs (0.039 CPU) processing `profil de couleur d'entrée' [preview] [dev_pixelpipe] took 101.679 secs (0.104 CPU) processing `ombres et hautes lumières' [preview] [dev_pixelpipe] took 0.047 secs (0.033 CPU) processing `renforcer la netteté' [preview] [dev_pixelpipe] took 0.011 secs (0.041 CPU) processing `profil de couleur de sortie ' [preview] [dev_pixelpipe] took 0.004 secs (0.014 CPU) processing `velvia' [preview] [dev_pixelpipe] took 0.003 secs (0.003 CPU) processing `sous- et sur-exposition' [preview] [dev_pixelpipe] took 0.003 secs (0.008 CPU) processing `gamma' [preview] [dev_process_preview] pixel pipeline processing took 101.767 secs (0.290 CPU) [dev_pixelpipe] took 102.246 secs (2.592 CPU) processing `dématriçage' [full] [dev_pixelpipe] took 0.002 secs (0.016 CPU) processing `courbe de base' [full] [dev_pixelpipe] took 0.004 secs (0.031 CPU) processing `profil de couleur d'entrée' [full] [dev_pixelpipe] took 0.025 secs (0.138 CPU) processing `ombres et hautes lumières' [full] [dev_pixelpipe] took 0.007 secs (0.029 CPU) processing `renforcer la netteté' [full] [dev_pixelpipe] took 0.005 secs (0.040 CPU) processing `profil de couleur de sortie ' [full] [dev_pixelpipe] took 0.003 secs (0.016 CPU) processing `velvia' [full] [dev_pixelpipe] took 0.002 secs (0.001 CPU) processing `sous- et sur-exposition' [full] [dev_pixelpipe] took 0.001 secs (0.015 CPU) processing `gamma' [full] [dev_process_image] pixel pipeline processing took 102.312 secs (2.951 CPU) ... So, with a fresh version it's still very slow (but not for all images, i don't see why) Regards Le mercredi 27 f�vrier 2013 à 10:05 +1300, johannes hanika a écrit : > what computer is that? shadows/highlights is a bit expensive, but not > _that_ expensive. also the randomness of which module is slow is a > little worrying. do you have very little ram maybe? > > On Wed, Feb 27, 2013 at 10:00 AM, Roumano <[email protected]> wrote: > > Hi, > > > > Same things with a fresh database & only 50 pictures: > > > > :( > > > > [dev_process_thumbnail] pixel pipeline processing took 0.120 secs (0.730 > > CPU) > > [export] creating pixelpipe took 0.148 secs (0.154 CPU) > > [dev_pixelpipe] took 0.042 secs (0.037 CPU) initing base buffer > > [thumbnail] > > [dev_pixelpipe] took 0.008 secs (0.015 CPU) processing `balance des > > blancs' [thumbnail] > > [dev_pixelpipe] took 0.003 secs (0.016 CPU) processing `récupération des > > hautes lumières' [thumbnail] > > [dev_pixelpipe] took 0.011 secs (0.055 CPU) processing > > `dématriçage' [thumbnail] > > [dev_pixelpipe] took 0.006 secs (0.021 CPU) processing `profil de > > couleur d'entrée' [thumbnail] > > [dev_pixelpipe] took 0.026 secs (0.130 CPU) processing `recadrer et > > pivoter' [thumbnail] > > [dev_pixelpipe] took 17.741 secs (0.000 CPU) processing `ombres et > > hautes lumières' [thumbnail] > > [dev_pixelpipe] took 0.023 secs (0.114 CPU) processing `contraste > > local' [thumbnail] > > [dev_pixelpipe] took 0.004 secs (0.021 CPU) processing > > `niveaux' [thumbnail] > > [dev_pixelpipe] took 0.009 secs (0.044 CPU) processing `profil de > > couleur de sortie ' [thumbnail] > > [dev_pixelpipe] took 0.002 secs (0.009 CPU) processing > > `velvia' [thumbnail] > > [dev_pixelpipe] took 0.001 secs (0.002 CPU) processing `sous- et > > sur-exposition' [thumbnail] > > [dev_pixelpipe] took 0.001 secs (0.005 CPU) processing > > `gamma' [thumbnail] > > [dev_process_thumbnail] pixel pipeline processing took 17.878 secs > > (0.469 CPU) > > > > Le mercredi 27 f�vrier 2013 à 09:42 +1300, johannes hanika a écrit : > >> the only thing that looks weird to me are the sql queries in between? > >> maybe those take a long time just to determine the file name? can you > >> try it again with 'darktable --configdir /tmp/dt' to see how a fresh > >> database reacts? how many pictures do you have in that? > >> > >> On Wed, Feb 27, 2013 at 9:26 AM, Roumano <[email protected]> wrote: > >> > Hi Johannes, > >> > > >> > My problem come back again. > >> > > >> > So i have try : > >> > remove all /usr/lib/darktable (also remove complete the package from my > >> > OS), recompile & install the last git version... > >> > > >> > I don't use the opencl as i have a old graphical card & darktable > >> > disable it automaticaly. > >> > > >> > I have try with this option (on .config/darktable/darktablerc ) > >> > > >> > plugins/lighttable/low_quality_thumbnails=true > >> > never_use_embedded_thumb=false > >> >> Same issue > >> > My darkroom is not faster, at this moment, i only see freeze on darkroom > >> > mode when i make some modification . > >> > My file are local (& on a ssd...) > >> > > >> > Interesting thing on these files ? : (sorry i forgot a LANG=C > >> > before ...) > >> > > >> > > >> > /opt/darktable/bin/darktable -d perf > /tmp/darktable_perf > >> > [dev_pixelpipe] took 14.512 secs (0.000 CPU) processing `récupération > >> > des hautes lumières' [full] > >> > > >> > /opt/darktable/bin/darktable -d all > /tmp/darktable_perf2 > >> > [dev_pixelpipe] took 30.358 secs (0.000 CPU) processing `balance des > >> > blancs' [full] > >> > [dev_pixelpipe] took 24.694 secs (0.000 CPU) processing `récupération > >> > des hautes lumières' [full] > >> > [dev_pixelpipe] took 10.768 secs (0.036 CPU) processing `renforcer la > >> > netteté' [preview] > >> > > >> > & the max of memory use : (take form cmd line) > >> > [memory] before pixelpipe process > >> > [memory] max address space (vmpeak): 2202060 kB > >> > [memory] cur address space (vmsize): 1943652 kB > >> > [memory] max used memory (vmhwm ): 895056 kB > >> > [memory] cur used memory (vmrss ): 664756 kB > >> > > >> > Regards > >> > > >> > Le lundi 11 f�vrier 2013 à 09:29 +1300, johannes hanika a écrit : > >> >> never saw anything like your output there. looks very broken. do you > >> >> have old dsos in /usr/lib/darktable/ maybe? are you using opencl for > >> >> another pipeline in parallel? do you have the full log maybe? > >> >> > >> >> these are all thumbnail processes.. you could experiment with the > >> >> options > >> >> > >> >> plugins/lighttable/low_quality_thumbnails=true > >> >> never_use_embedded_thumb=false > >> >> > >> >> (try one at a time) in your darktablerc and see if that makes any > >> >> difference. > >> >> > >> >> is darkroom mode faster? are your files on a remote host? > >> >> > >> >> -jo > >> >> > >> >> On Sun, Feb 10, 2013 at 12:20 PM, Roumano <[email protected]> wrote: > >> >> > Hi, > >> >> > > >> >> > Actualy my darktable ( git version of 09/02/2013 & stable version > >> >> > 1.1.2 ) is > >> >> > very slow (for some operation) & my PC is like frozen > >> >> > i have tested to launch it with a fresh database : it's the same. > >> >> > > >> >> > I'm using it on a gentoo machine with 8core, 8Go ram & SSD for the OS > >> >> > & raw > >> >> > image data ... > >> >> > > >> >> > If i launch it with "-d perf" : > >> >> > i saw many time the "white balance" and shadow & lighlights (but more > >> >> > rarely) take lot of time but nearly all the time, O CPU, strange > >> >> > isn't it ? > >> >> > > >> >> > [defaults] found a 64-bit system with 8145292 kb ram and 8 cores (0 > >> >> > atom > >> >> > based) > >> >> > [defaults] setting high quality defaults > >> >> > > >> >> > ... > >> >> > [dev_pixelpipe] took 8.614 secs (0.350 CPU) processing `shadows and > >> >> > highlights' [preview] > >> >> > > >> >> > ... > >> >> > [dev_pixelpipe] took 0.009 secs (0.029 CPU) processing `balance des > >> >> > blancs' > >> >> > [thumbnail] > >> >> > [dev_pixelpipe] took 10.727 secs (0.000 CPU) processing `récupération > >> >> > des > >> >> > hautes lumières' [thumbnail] > >> >> > ... > >> >> > [dev_pixelpipe] took 0.148 secs (0.077 CPU) initing base buffer > >> >> > [thumbnail] > >> >> > [dev_pixelpipe] took 6.682 secs (-0.000 CPU) processing `white > >> >> > balance' > >> >> > [thumbnail] > >> >> > [dev_pixelpipe] took 0.007 secs (-0.000 CPU) processing `highlight > >> >> > reconstruction' [thumbnail] > >> >> > ... > >> >> > ... > >> >> > [export] creating pixelpipe took 0.151 secs (0.173 CPU) > >> >> > [dev_pixelpipe] took 0.072 secs (0.037 CPU) initing base buffer > >> >> > [thumbnail] > >> >> > [dev_pixelpipe] took 14.433 secs (0.000 CPU) processing `balance des > >> >> > blancs' > >> >> > [thumbnail] > >> >> > [dev_pixelpipe] took 0.003 secs (0.000 CPU) processing `récupération > >> >> > des > >> >> > hautes lumières' [thumbnail] > >> >> > ... > >> >> > ... > >> >> > [dev_pixelpipe] took 1.691 secs (0.255 CPU) initing base buffer > >> >> > [thumbnail] > >> >> > [dev_pixelpipe] took 5.598 secs (0.010 CPU) processing `balance des > >> >> > blancs' > >> >> > [thumbnail] > >> >> > [dev_pixelpipe] took 0.007 secs (0.025 CPU) processing `récupération > >> >> > des > >> >> > hautes lumières' [thumbnail] > >> >> > ... > >> >> > .... > >> >> > dev_pixelpipe] took 0.000 secs (-0.000 CPU) initing base buffer > >> >> > [thumbnail] > >> >> > [dev_pixelpipe] took 50.678 secs (26.228 CPU) processing > >> >> > `récupération des > >> >> > hautes lumières' [thumbnail] > >> >> > ... > >> >> > [dev_pixelpipe] took 0.000 secs (0.001 CPU) processing `gamma' > >> >> > [thumbnail] > >> >> > [dev_process_thumbnail] pixel pipeline processing took 50.703 secs > >> >> > (26.311 > >> >> > CPU) > >> >> > [dev_pixelpipe] took 49.118 secs (24.735 CPU) processing `balance des > >> >> > blancs' [thumbnail] > >> >> > ... > >> >> > [dev_pixelpipe] took 17.581 secs (16.482 CPU) processing > >> >> > `récupération des > >> >> > hautes lumières' [thumbnail] > >> >> > [dev_pixelpipe] took 0.006 secs (0.035 CPU) processing `dématriçage' > >> >> > [thumbnail] > >> >> > ... > >> >> > [dev_pixelpipe] took 0.038 secs (0.055 CPU) processing `récupération > >> >> > des > >> >> > hautes lumières' [full] > >> >> > [dev_pixelpipe] took 20.670 secs (15.234 CPU) processing `balance des > >> >> > blancs' [thumbnail] > >> >> > [dev_pixelpipe] took 21.441 secs (15.708 CPU) processing `balance des > >> >> > blancs' [thumbnail] > >> >> > [dev_pixelpipe] took 2.050 secs (1.508 CPU) processing `récupération > >> >> > des > >> >> > hautes lumières' [thumbnail] > >> >> > ... > >> >> >> But not all the time : > >> >> > [dev_pixelpipe] took 0.017 secs (0.026 CPU) processing `balance des > >> >> > blancs' > >> >> > [thumbnail] > >> >> > [dev_pixelpipe] took 1.520 secs (0.042 CPU) processing `récupération > >> >> > des > >> >> > hautes lumières' [thumbnail] > >> >> > [dev_pixelpipe] took 0.007 secs (0.034 CPU) processing `dématriçage' > >> >> > [thumbnail] > >> >> > [dev_pixelpipe] took 0.015 secs (0.005 CPU) processing `réduction du > >> >> > bruit > >> >> > (profil)' [thumbnail] > >> >> > > >> >> > Do you known why ? or it's impact only me ? > >> >> > > >> >> > > >> >> > ------------------------------------------------------------------------------ > >> >> > Free Next-Gen Firewall Hardware Offer > >> >> > Buy your Sophos next-gen firewall before the end March 2013 > >> >> > and get the hardware for free! Learn more. > >> >> > http://p.sf.net/sfu/sophos-d2d-feb > >> >> > _______________________________________________ > >> >> > darktable-devel mailing list > >> >> > [email protected] > >> >> > https://lists.sourceforge.net/lists/listinfo/darktable-devel > >> >> > > >> > > > > > ------------------------------------------------------------------------------ Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_feb _______________________________________________ darktable-devel mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/darktable-devel
