On Wed, 2016-05-18 at 13:55 +0200, A Mennucc1 wrote: > > As it stands now, it looks like debdelta is threaded only to parallelize > > download and patching of deltas. Other than that, it seems to be a > > single thread application. > > > > This really shows up when you have multiple cores waiting, while > > debdelta only utilizes a single core to patch a giant deb package. > > > > It would be nicer to have debdelta (or maybe attack the underneath > > archive library) spawn and utilize all available logical CPUs. > > > yes it would be nice and not really difficult to implement. Altough I am > afraid that debdelta is mostly HD bound, so there may be only marginal > benefits.
Are you sure about this ? From the looks, it seems you are using xz for deltas. When patching, I see only one xz process running, and it consumes only 1 core. The same is reflected in the output below. I don't think this part of debdelta's operation is bound by disk. But then reading xz-util's manpage, I don't think they have multithread support. rrs@chutzpah:~$ dstat -c -C 0,1,2,3,total -d -------cpu0-usage--------------cpu1-usage--------------cpu2-usage--------------cpu3-usage-----------total-cpu-usage---- -dsk/total- usr sys idl wai hiq siq:usr sys idl wai hiq siq:usr sys idl wai hiq siq:usr sys idl wai hiq siq:usr sys idl wai hiq siq| read writ 73 1 23 3 0 0: 3 1 87 9 0 0: 15 1 80 4 0 0: 2 1 96 1 0 0: 23 1 71 4 0 0| 10M 0 100 0 0 0 0 0: 1 0 99 0 0 0: 1 1 98 0 0 0: 1 1 97 1 0 0: 26 1 73 1 0 0| 64k 0 100 0 0 0 0 0: 1 1 97 0 0 1: 2 0 98 0 0 0: 1 0 99 0 0 0: 26 1 74 0 0 0| 0 0 100 0 0 0 0 0: 0 0 100 0 0 0: 1 1 95 3 0 0: 2 1 97 0 0 0: 26 0 73 1 0 0| 0 16k 90 1 9 0 0 0: 0 2 94 4 0 0: 5 1 88 6 0 0: 1 2 97 0 0 0: 24 2 72 2 0 0|6144k 0 2 0 98 0 0 0: 1 0 99 0 0 0:100 0 0 0 0 0: 2 1 97 0 0 0: 26 1 73 0 0 0| 0 0 2 1 78 19 0 0: 8 0 92 0 0 0: 99 1 0 0 0 0: 1 1 98 0 0 0: 28 1 67 5 0 0| 240k 0 1 0 99 0 0 0: 1 1 97 1 0 0:100 0 0 0 0 0: 1 2 97 0 0 0: 26 1 73 0 0 0| 96k 0 0 2 98 0 0 0: 0 1 97 2 0 0:100 0 0 0 0 0: 1 1 96 2 0 0: 26 1 72 1 0 0| 64k 12k 35 0 57 8 0 0: 2 1 96 0 0 1: 56 1 39 4 0 0: 4 2 94 0 0 0: 24 1 72 3 0 0|8312k 0 100 0 0 0 0 0: 0 1 99 0 0 0: 1 0 99 0 0 0: 0 2 95 3 0 0: 26 1 73 1 0 0| 128k 64k 100 0 0 0 0 0: 3 0 97 0 0 0: 1 1 98 0 0 0: 0 1 98 1 0 0: 26 1 73 0 0 0| 0 0 100 0 0 0 0 0: 0 0 100 0 0 0: 2 1 97 0 0 0: 2 1 97 0 0 0: 26 1 74 0 0 0| 128k 0 100 0 0 0 0 0: 1 0 99 0 0 0: 2 0 98 0 0 0: 0 1 99 0 0 0: 26 0 74 0 0 0| 0 0 85 0 12 3 0 0: 2 2 91 5 0 0: 1 2 94 3 0 0: 3 5 90 2 0 0: 22 2 72 3 0 0|8008k 0 100 0 0 0 0 0: 1 1 98 0 0 0: 0 1 99 0 0 0: 1 1 97 1 0 0: 25 1 73 1 0 0| 0 60k 99 1 0 0 0 0: 2 1 97 0 0 0: 1 0 99 0 0 0: 0 1 99 0 0 0: 26 1 73 0 0 0| 0 0 100 0 0 0 0 0: 1 1 98 0 0 0: 0 0 100 0 0 0: 2 0 98 0 0 0: 26 0 74 0 0 0| 0 0 100 0 0 0 0 0: 0 0 100 0 0 0: 0 1 97 2 0 0: 3 0 97 0 0 0: 26 1 73 1 0 0| 64k 0 71 1 14 14 0 0: 2 3 77 17 0 1: 1 3 96 0 0 0: 1 3 95 1 0 0: 19 2 71 8 0 0| 14M 0 100 0 0 0 0 0: 1 0 99 0 0 0: 1 1 95 3 0 0: 3 2 95 0 0 0: 26 1 73 0 0 0| 0 28k 100 0 0 0 0 0: 1 1 98 0 0 0: 1 0 99 0 0 0: 1 1 98 0 0 0: 26 1 73 0 0 0| 0 0 100 0 0 0 0 0: 1 1 96 0 0 2: 0 1 99 0 0 0: 3 2 95 0 0 0: 26 1 73 0 0 0| 0 0 89 1 8 2 0 0: 6 2 92 0 0 0: 4 1 90 4 0 1: 1 1 98 0 0 0: 25 1 72 2 0 0|4480k 104k 100 0 0 0 0 0: 1 2 97 0 0 0: 0 1 99 0 0 0: 2 3 95 0 0 0: 26 1 73 0 0 0| 0 0 100 0 0 0 0 0: 0 1 98 0 0 1: 1 1 96 2 0 0: 2 1 97 0 0 0: 26 1 73 1 0 0| 0 16k 100 0 0 0 0 0: 2 0 98 0 0 0: 1 0 99 0 0 0: 0 1 99 0 0 0: 26 1 74 0 0 0| 128k 0 100 0 0 0 0 0: 2 1 96 1 0 0: 4 2 94 0 0 0: 1 0 98 1 0 0: 27 0 72 0 0 0| 0 0 60 1 34 5 0 0: 3 2 94 0 0 1: 36 3 58 3 0 0: 2 3 95 0 0 0: 25 2 70 2 0 0|6332k 76k 1 0 99 0 0 0: 2 1 97 0 0 0:100 0 0 0 0 0: 3 0 97 0 0 0: 26 0 73 0 0 0| 0 0 3 2 92 3 0 0: 1 0 97 2 0 0:100 0 0 0 0 0: 2 1 97 0 0 0: 26 1 72 1 0 0| 128k 32k 1 1 98 0 0 0: 1 1 98 0 0 0:100 0 0 0 0 0: 1 0 99 0 0 0: 26 1 73 0 0 0| 0 0 3 1 96 0 0 0: 1 1 95 3 0 0:100 0 0 0 0 0: 0 1 99 0 0 0: 26 1 73 1 0 0| 128k 0 2 3 85 10 0 0: 2 0 98 0 0 0: 89 1 10 0 0 0: 3 2 93 2 0 0: 24 2 71 3 0 0|5748k 0 25 1 74 0 0 0: 1 1 96 0 0 2: 5 0 92 3 0 0: 67 1 27 5 0 0: 24 1 72 2 0 1|2684k 4096B 0 0 97 3 0 0: 1 2 97 0 0 0: 1 2 97 0 0 0:100 0 0 0 0 0: 26 1 73 1 0 0| 0 60k^C 16:46 ___ _ -- Ritesh Raj Sarraf | http://people.debian.org/~rrs Debian - The Universal Operating System
signature.asc
Description: This is a digitally signed message part