Note on that - you want to maximize throughput, not maximize the number of
running dumpers.
More dumpers moving data is usually good, but more isn't always better.
-----Original Message-----
From: owner-amanda-us...@amanda.org <owner-amanda-us...@amanda.org> On Behalf
Of Cuttler, Brian R (HEALTH)
Sent: Tuesday, November 6, 2018 11:11 AM
To: Chris Nighswonger <cnighswon...@foundations.edu>; amanda-users@amanda.org
Subject: RE: dumporder
ATTENTION: This email came from an external source. Do not open attachments or
click on links from unknown senders or unexpected emails.
Chris,
There is an amplot utility that I used to run a lot, it would show me what I
was constrained on, often holding space, which if you are running a bunch of
large dumps to start off with could constrain dumping later on.
-----Original Message-----
From: owner-amanda-us...@amanda.org <owner-amanda-us...@amanda.org> On Behalf
Of Chris Nighswonger
Sent: Tuesday, November 6, 2018 11:02 AM
To: amanda-users@amanda.org
Subject: Re: dumporder
ATTENTION: This email came from an external source. Do not open attachments or
click on links from unknown senders or unexpected emails.
On Mon, Nov 5, 2018 at 1:31 PM Chris Nighswonger <cnighswon...@foundations.edu>
wrote:
>
> Is there any wisdom available on optimization of dumporder?
>
After looking over the feedback from Brian and Austin and reviewing the actual
sizes of the DLEs, I ended up with this sort of thing:
inparallel 15
dumporder "SSSSSTTTTTsssss"
Which resulted in a reduced time over what I have been seeing. Here are some
stats from amstatus for this config. It looks like I could drop about half of
the dumpers and still be fine. Any idea what causes the dumpers over the first
five to be utilized less?
dumper0 busy : 5:13:42 ( 97.98%)
dumper1 busy : 1:12:09 ( 22.54%)
dumper2 busy : 0:40:30 ( 12.65%)
dumper3 busy : 0:33:44 ( 10.54%)
dumper4 busy : 0:03:47 ( 1.19%)
dumper5 busy : 0:37:32 ( 11.73%)
dumper6 busy : 0:02:00 ( 0.62%)
dumper7 busy : 0:00:57 ( 0.30%)
dumper8 busy : 0:05:54 ( 1.85%)
dumper9 busy : 0:04:38 ( 1.45%)
dumper10 busy : 0:00:16 ( 0.08%)
dumper11 busy : 0:01:39 ( 0.52%)
dumper12 busy : 0:00:01 ( 0.01%)
0 dumpers busy : 0:02:43 ( 0.85%) 0: 0:02:43 (100.00%)
1 dumper busy : 3:39:13 ( 68.47%) 0: 3:39:13 (100.00%)
2 dumpers busy : 0:23:10 ( 7.24%) 0: 0:23:10 (100.00%)
3 dumpers busy : 1:07:57 ( 21.22%) 0: 1:07:57 (100.00%)
4 dumpers busy : 0:02:09 ( 0.67%) 0: 0:02:09 ( 99.99%)
5 dumpers busy : 0:01:07 ( 0.35%) 0: 0:01:07 ( 99.98%)
6 dumpers busy : 0:00:03 ( 0.02%) 0: 0:00:03 ( 99.59%)
7 dumpers busy : 0:00:43 ( 0.22%) 0: 0:00:24 ( 56.35%)
5: 0:00:09 ( 22.36%)
4: 0:00:08 ( 18.89%)
1: 0:00:01 ( 2.37%)
8 dumpers busy : 0:00:20 ( 0.10%) 0: 0:00:19 ( 96.50%)
9 dumpers busy : 0:01:51 ( 0.58%) 0: 0:01:51 ( 99.98%)
10 dumpers busy : 0:00:41 ( 0.22%) 0: 0:00:37 ( 89.71%)
5: 0:00:02 ( 7.13%)
4: 0:00:01 ( 3.09%)
11 dumpers busy : 0:00:07 ( 0.04%) 5: 0:00:07 ( 99.54%)
12 dumpers busy : 0:00:00 ( 0.00%)
13 dumpers busy : 0:00:00 ( 0.00%)
I am going to give things another week or so and then try breaking up some of
the very large DLEs in the config.
