Re: Amanda really blew up last night.

[Jon LaBadie]

On Mon, Feb 01, 2021 at 07:08:54PM +, Debra S Baddorf wrote:


I keep reading that there is less wasted space with tapes.   Just because you
allocate X space for each tape,  I believe they only use up the space that’s
actually used.


Certainly that is the case here.  I have 6 "over"subscribed disks
for my vtapes.  For example D1 is a 4 TB drive with 49 100 GB vtapes.
It currently is at 91% capacity.

--
Jon H. LaBadie j...@labadie.us
 11226 South Shore Rd.  (703) 787-0688 (H)
 Reston, VA  20190  (703) 935-6720 (C)

RE: Amanda really blew up last night.

[Cuttler, Brian R (HEALTH)]

I missed the early part of the discussion. Vtapes?

I had a large zpool I broke up into vtapes, found that if they where too small 
I'd waste space, if I recall because partial dumps were not removed from the 
'tape' to free up the disk, and if they where too large I'd run into a deadlock 
problem when the pool got full.

Yes, to unused capacity on a vtape is still available in the pool.

At this point I've got 2 zpools and a share on an nfs windows server, though at 
some point in the foreseeable future we will decommission the old Solaris boxes 
and decommission the Amanda server that has been backing them up.

Many thanks to the Amanda developers and community, you have all been wonderful 
to work with over the years.
I don’t know when my last Amanda server will shut down, but likely before I 
retire, still several years off.

-Original Message-
From: owner-amanda-us...@amanda.org  On Behalf 
Of Debra S Baddorf
Sent: Monday, February 1, 2021 2:09 PM
To: Gene Heskett 
Cc: Debra S Baddorf ; amanda-users@amanda.org
Subject: Re: Amanda really blew up last night.

ATTENTION: This email came from an external source. Do not open attachments or 
click on links from unknown senders or unexpected emails.


> On Jan 30, 2021, at 3:46 PM, Gene Heskett  wrote:
>
> On Friday 29 January 2021 17:13:39 Gene Heskett wrote:
>
>> On Saturday 23 January 2021 14:04:36 Gene Heskett wrote:
>>> On Saturday 23 January 2021 11:47:15 Jon LaBadie wrote:
>>>> ls -l /usr/local/libexec/amanda/ambind
>>>
>>> ls -l /usr/local/libexec/amanda/ambind
>>> -rwsr-x--x 1 root backup 26640 Jan 22
>>> 20:17 /usr/local/libexec/amanda/ambind
>>> So I changed it to root:disk, no change in the amcheck output, its
>>> still semi happy
>>> Chmod 4750 gets a no execute error out of ambind, must be 4751.
>>> amcheck then complains, but the backup runs just fine. And did last
>>> night, 6 minutes after it failed on a 29Gig dle.
>>>
>>> I'm going to write another dumptype pair today, breakiing that 29G
>>> directory up into two dle's.
>>>
>>> Cheers, Gene Heskett
>>
>> Actually, I broke it up into 7 dle's and its run fine for 3 nights in
>> a row, I should paint it on the wall but Murphy is watching. :)
>>
> And I knew I should not have bragged, it failed again last night,
> someplace in amstatus. But did a redo for recovery but that wastes space
> in the vtape, and leaves trash in the holding disk I have to clean up
> before it will do another GOOD backup.

I keep reading that there is less wasted space with tapes.   Just because you
allocate X space for each tape,  I believe they only use up the space that’s
actually used.
I does use up another number in your vtape roster, but those seem to me
to be free - just increase your vtape  count and number a few more.

Odd about the holding disk trash preventing further backups.
I find months old stuff in my holding disk, and only clear it out
occasionally when the mood arises.

Deb Baddorf
Fermilab




>
>
> Copyright 2019 by Maurice E. Heskett
> Cheers, Gene Heskett
> --
> "There are four boxes to be used in defense of liberty:
> soap, ballot, jury, and ammo. Please use in that order."
> -Ed Howdershelt (Author)
> If we desire respect for the law, we must first make the law respectable.
> - Louis D. Brandeis
> Genes Web page 
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__geneslinuxbox.net-3A6309_gene=DwICaQ=gRgGjJ3BkIsb5y6s49QqsA=HMrKaRiCv4jddln9fLPIOw=1V1sZBuvx7VZJjvOyYX10-n5O15_5FM3lvx2lqJMpmw=uO4WUpZ1ROoBEPc7sn8Dvp8FG2aK7Qmc-8hxQBdiGSY=
>  >

Re: Amanda really blew up last night.

[Gene Heskett]

On Monday 01 February 2021 14:08:54 Debra S Baddorf wrote:

> > On Jan 30, 2021, at 3:46 PM, Gene Heskett 
> > wrote:
> >
> > On Friday 29 January 2021 17:13:39 Gene Heskett wrote:
> >> On Saturday 23 January 2021 14:04:36 Gene Heskett wrote:
> >>> On Saturday 23 January 2021 11:47:15 Jon LaBadie wrote:
>  ls -l /usr/local/libexec/amanda/ambind
> >>>
> >>> ls -l /usr/local/libexec/amanda/ambind
> >>> -rwsr-x--x 1 root backup 26640 Jan 22
> >>> 20:17 /usr/local/libexec/amanda/ambind
> >>> So I changed it to root:disk, no change in the amcheck output, its
> >>> still semi happy
> >>> Chmod 4750 gets a no execute error out of ambind, must be 4751.
> >>> amcheck then complains, but the backup runs just fine. And did
> >>> last night, 6 minutes after it failed on a 29Gig dle.
> >>>
> >>> I'm going to write another dumptype pair today, breakiing that 29G
> >>> directory up into two dle's.
> >>>
> >>> Cheers, Gene Heskett
> >>
> >> Actually, I broke it up into 7 dle's and its run fine for 3 nights
> >> in a row, I should paint it on the wall but Murphy is watching. :)
> >
> > And I knew I should not have bragged, it failed again last night,
> > someplace in amstatus. But did a redo for recovery but that wastes
> > space in the vtape, and leaves trash in the holding disk I have to
> > clean up before it will do another GOOD backup.
>
> I keep reading that there is less wasted space with tapes.   Just
> because you allocate X space for each tape,  I believe they only use
> up the space that’s actually used.

With vtapes this is true. I keep track of overall drive usage with df, so 
that 2T drive hovers at about 80%, but is falling about 1% a run because 
one of the machines onboard video died and its dle's are commented out 
ATM. I have a couple boxes of old i5 dells optiplexes on a truck from 
pcliquidaters that should fix that if I don't fall over first. S/B here 
about Wednesday. ;-) Blank 250G hd's in them, junk drives I expect but I 
have more of that 240Gig SSD waiting on them. So they will get that same 
240G SSD installed to put LinuxCNC and a debian buster base on them.

I'm beatingthe hell out of SSD's on one of my rpi4b's, moved everything 
like swap off the 64G u-sd, and am running the pi as a buildbot, making 
a new set of debs out of linuxcnc from github, master branch quite a few 
times a week. After changing the name on the usb3 to sata adapter cable 
last spring, no problems since.  Obviously I'm pleased. :-)

> I does use up another number in your vtape roster, but those seem
> to me to be free - just increase your vtape  count and number a few
> more.
>
> Odd about the holding disk trash preventing further backups.
> I find months old stuff in my holding disk, and only clear it out
> occasionally when the mood arises.

I may have an autoflush in my config someplace. And that seems to be 
broken, so I have to clean house before the next run or it somehow mucks 
it up. Not to mention the constat flushing uses about 1% of the big 
drive for everytime it tries.

The holding disk is an SSD of 240G. Swapping it in for the spinning rust 
1T I was using, cut the backup time in half!  I wish I could afford to 
replace the spinning rust, all of it, with SSD's. I could use more of 
the 240's and will, everyplace but this machine. It has around 450G used 
ATM on another 2T.

Take care and stay well Deb. And from what I've read, the mRNA vaccine 
(Phizer,Moderna) is deadly after the 2nd shot, I suspect by plan. 
Exposed to the Wuhan flu after the 2nd shot, your immune system is 
primed to kill you from organ failure. Since Bill Gates paid for that 
vaccine, on purpose would not surprise me.  Load up your daily 
pilltainer with A,C,D bone food, selenium, resveratrol, and in my case 
since I'm a type II diabetic taking metformin by the gram a meal, lots 
and lots of B12.  If your urine isn't yellow, you aren't getting enough. 
B12 is water soluble so you can't OD on it. It just flushes on thru the 
kidneys. I value my friends or I wouldn't be on this soap box about 
skipping the vaccine until we get a non-mRNA version.

> Deb Baddorf
> Fermilab

Copyright 2019 by Maurice E. Heskett
Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
 - Louis D. Brandeis
Genes Web page 

Re: Amanda really blew up last night.

[Debra S Baddorf]

> On Jan 30, 2021, at 3:46 PM, Gene Heskett  wrote:
> 
> On Friday 29 January 2021 17:13:39 Gene Heskett wrote:
> 
>> On Saturday 23 January 2021 14:04:36 Gene Heskett wrote:
>>> On Saturday 23 January 2021 11:47:15 Jon LaBadie wrote:
 ls -l /usr/local/libexec/amanda/ambind
>>> 
>>> ls -l /usr/local/libexec/amanda/ambind
>>> -rwsr-x--x 1 root backup 26640 Jan 22
>>> 20:17 /usr/local/libexec/amanda/ambind
>>> So I changed it to root:disk, no change in the amcheck output, its
>>> still semi happy
>>> Chmod 4750 gets a no execute error out of ambind, must be 4751.
>>> amcheck then complains, but the backup runs just fine. And did last
>>> night, 6 minutes after it failed on a 29Gig dle.
>>> 
>>> I'm going to write another dumptype pair today, breakiing that 29G
>>> directory up into two dle's.
>>> 
>>> Cheers, Gene Heskett
>> 
>> Actually, I broke it up into 7 dle's and its run fine for 3 nights in
>> a row, I should paint it on the wall but Murphy is watching. :)
>> 
> And I knew I should not have bragged, it failed again last night, 
> someplace in amstatus. But did a redo for recovery but that wastes space 
> in the vtape, and leaves trash in the holding disk I have to clean up 
> before it will do another GOOD backup.

I keep reading that there is less wasted space with tapes.   Just because you
allocate X space for each tape,  I believe they only use up the space that’s 
actually used.
I does use up another number in your vtape roster, but those seem to me
to be free - just increase your vtape  count and number a few more.

Odd about the holding disk trash preventing further backups.
I find months old stuff in my holding disk, and only clear it out
occasionally when the mood arises.

Deb Baddorf
Fermilab




> 
> 
> Copyright 2019 by Maurice E. Heskett
> Cheers, Gene Heskett
> -- 
> "There are four boxes to be used in defense of liberty:
> soap, ballot, jury, and ammo. Please use in that order."
> -Ed Howdershelt (Author)
> If we desire respect for the law, we must first make the law respectable.
> - Louis D. Brandeis
> Genes Web page 
>   >

Re: Amanda really blew up last night.

[Gene Heskett]

On Friday 29 January 2021 17:13:39 Gene Heskett wrote:

> On Saturday 23 January 2021 14:04:36 Gene Heskett wrote:
> > On Saturday 23 January 2021 11:47:15 Jon LaBadie wrote:
> > > ls -l /usr/local/libexec/amanda/ambind
> >
> > ls -l /usr/local/libexec/amanda/ambind
> > -rwsr-x--x 1 root backup 26640 Jan 22
> > 20:17 /usr/local/libexec/amanda/ambind
> > So I changed it to root:disk, no change in the amcheck output, its
> > still semi happy
> > Chmod 4750 gets a no execute error out of ambind, must be 4751.
> > amcheck then complains, but the backup runs just fine. And did last
> > night, 6 minutes after it failed on a 29Gig dle.
> >
> > I'm going to write another dumptype pair today, breakiing that 29G
> > directory up into two dle's.
> >
> > Cheers, Gene Heskett
>
> Actually, I broke it up into 7 dle's and its run fine for 3 nights in
> a row, I should paint it on the wall but Murphy is watching. :)
>
And I knew I should not have bragged, it failed again last night, 
someplace in amstatus. But did a redo for recovery but that wastes space 
in the vtape, and leaves trash in the holding disk I have to clean up 
before it will do another GOOD backup.


Copyright 2019 by Maurice E. Heskett
Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
 - Louis D. Brandeis
Genes Web page 

Re: Amanda really blew up last night.

[Gene Heskett]

On Saturday 23 January 2021 14:04:36 Gene Heskett wrote:

> On Saturday 23 January 2021 11:47:15 Jon LaBadie wrote:
> > ls -l /usr/local/libexec/amanda/ambind
>
> ls -l /usr/local/libexec/amanda/ambind
> -rwsr-x--x 1 root backup 26640 Jan 22
> 20:17 /usr/local/libexec/amanda/ambind
> So I changed it to root:disk, no change in the amcheck output, its
> still semi happy
> Chmod 4750 gets a no execute error out of ambind, must be 4751.
> amcheck then complains, but the backup runs just fine. And did last
> night, 6 minutes after it failed on a 29Gig dle.
>
> I'm going to write another dumptype pair today, breakiing that 29G
> directory up into two dle's.
>
> Cheers, Gene Heskett

Actually, I broke it up into 7 dle's and its run fine for 3 nights in a 
row, I should paint it on the wall but Murphy is watching. :)

Copyright 2019 by Maurice E. Heskett
Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
 - Louis D. Brandeis
Genes Web page 

Re: Amanda really blew up last night.

[Gene Heskett]

On Saturday 23 January 2021 11:47:15 Jon LaBadie wrote:

> ls -l /usr/local/libexec/amanda/ambind
ls -l /usr/local/libexec/amanda/ambind
-rwsr-x--x 1 root backup 26640 Jan 22 
20:17 /usr/local/libexec/amanda/ambind
So I changed it to root:disk, no change in the amcheck output, its still 
semi happy
Chmod 4750 gets a no execute error out of ambind, must be 4751.
amcheck then complains, but the backup runs just fine. And did last 
night, 6 minutes after it failed on a 29Gig dle.

I'm going to write another dumptype pair today, breakiing that 29G 
directory up into two dle's.

Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
 - Louis D. Brandeis
Genes Web page 

Re: Amanda really blew up last night.

[Gene Heskett]

On Friday 22 January 2021 22:29:26 you wrote:

> On Fri, Jan 22, 2021 at 03:26:35PM -0500, Gene Heskett wrote:
> >installed /usr/local/libexec/amanda/ambind to be setuid and I have
> >forgotten how.
>
> Use chmod and add a "4" in front of other numbers.  So if you
> wanted rwxr-x--x, that would be 751.  You would do chmod 4751.
>
> jl

That worked, I think, but theemail claims it was redone, BUT IT WAS 
REDONE FROM THE SAME HOLDING DISK DATA.  fROM THE 
EMAIL:
FAILURE DUMP SUMMARY:
  coyote /GenesAmandaHelper-0.61/config-bak lev 0  partial taper: source 
server crc (1009f227:29959583741) and input 
server crc (7d222e7d:29959583741) differ)
  coyote /GenesAmandaHelper-0.61/config-bak lev 0  was successfully 
retried

root@coyote:sdb$ ls -lc /sdb/dumps/20210123001853/
total 29258452
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.1
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.10
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.11
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.12
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.13
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.14
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.15
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.16
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.17
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.18
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.19
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.2
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.20
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.21
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.22
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.23
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.24
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.25
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.26
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.27
-rw--- 1 amanda amanda  600406013 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.28
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.3
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.4
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.5
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.6
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.7
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.8
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.9

but it wasn't done with the 2nd copy of config-bak 
on /amandatapes/Dailys/data/ 
until nearly 1:20. Something is lying like a rug Jon.  And I don't think 
it is ls -lc unless it rewrote nearly 29 gigs in the same damned minute. 

So I'm going to nuke that data before the regular backup starts in 6 
minutes.

PS:

And I also changed the chunksize back to 2000Mb in amanda.conf since 
1000Mb didn't help. 
2nd PS:

The second copy is a different size this time, its 2172 bytes longer.
But the ending fractional chunksize piece left in the holding disk, was 
not added to by the redo.

Running out of hair. Not to mention patience.
And every one of these failures is costing me at least 2% of the 2T disk 
being used for amandatapes:

root@coyote:sdb$ df -h |grep /amandatapes
/dev/sdd1   1.8T  1.3T  411G  77% /amandatapes

Thanks Jon.

Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
 - Louis D. Brandeis
Genes Web page 

Re: Amanda really blew up last night.

[Gene Heskett]

On Friday 22 January 2021 22:29:26 you wrote:

> On Fri, Jan 22, 2021 at 03:26:35PM -0500, Gene Heskett wrote:
> >installed /usr/local/libexec/amanda/ambind to be setuid and I have
> >forgotten how.
>
> Use chmod and add a "4" in front of other numbers.  So if you
> wanted rwxr-x--x, that would be 751.  You would do chmod 4751.
>
> jl

That worked, I think, but theemail claims it was redone, BUT IT WAS REDONE FROM 
THE SAME HOLDING DISK DATA.  fROM THE 
EMAIL:
FAILURE DUMP SUMMARY:
  coyote /GenesAmandaHelper-0.61/config-bak lev 0  partial taper: source server 
crc (1009f227:29959583741) and input 
server crc (7d222e7d:29959583741) differ)
  coyote /GenesAmandaHelper-0.61/config-bak lev 0  was successfully retried

root@coyote:sdb$ ls -lc /sdb/dumps/20210123001853/
total 29258452
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.1
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.10
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.11
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.12
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.13
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.14
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.15
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.16
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.17
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.18
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.19
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.2
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.20
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.21
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.22
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.23
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.24
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.25
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.26
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.27
-rw--- 1 amanda amanda  600406013 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.28
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.3
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.4
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.5
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.6
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.7
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.8
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.9

but it wasn't done with the 2nd copy of config-bak on /amandatapes/Dailys/data/ 
until nearly 1:20. Something is lying like a rug Jon.  And I don't think it is 
ls -lc unless it rewrote nearly 29 gigs in the same damned minute. 

So I'm going to nuke that data before the regular backup starts in 6 minutes.

PS:

And I also changed the chunksize back to 2000Mb in amanda.conf since 1000Mb 
didn't help. 

Thanks Jon.

Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
 - Louis D. Brandeis
Genes Web page 

Re: Amanda really blew up last night.

[Gene Heskett]

On Friday 22 January 2021 22:29:26 you wrote:

> On Fri, Jan 22, 2021 at 03:26:35PM -0500, Gene Heskett wrote:
> >installed /usr/local/libexec/amanda/ambind to be setuid and I have
> >forgotten how.
>
> Use chmod and add a "4" in front of other numbers.  So if you
> wanted rwxr-x--x, that would be 751.  You would do chmod 4751.
>
> jl

That worked, I think, but theemail claims it was redone, BUT IT WAS REDONE FROM 
THE SAME HOLDING DISK DATA.  fROM THE 
EMAIL:
FAILURE DUMP SUMMARY:
  coyote /GenesAmandaHelper-0.61/config-bak lev 0  partial taper: source server 
crc (1009f227:29959583741) and input 
server crc (7d222e7d:29959583741) differ)
  coyote /GenesAmandaHelper-0.61/config-bak lev 0  was successfully retried

root@coyote:sdb$ ls -lc /sdb/dumps/20210123001853/
total 29258452
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.1
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.10
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.11
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.12
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.13
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.14
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.15
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.16
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.17
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.18
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.19
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.2
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.20
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.21
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.22
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.23
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.24
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.25
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.26
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.27
-rw--- 1 amanda amanda  600406013 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.28
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.3
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.4
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.5
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.6
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.7
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.8
-rw--- 1 amanda amanda 1048576000 Jan 23 00:45 
coyote._GenesAmandaHelper-0.61_config-bak.0.9

but it wasn't done with the 2nd copy of config-bak on /amandatapes/Dailys/data/ 
until nearly 1:20. Something is lying like a rug Jon.  And I don't think it is 
ls -lc unless it rewrote nearly 29 gigs in the same damned minute. 

So I'm going to nuke that data before the regular backup starts in 6 minutes

Thanks Jon.

Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
 - Louis D. Brandeis
Genes Web page 

Re: Amanda really blew up last night.

[Gene Heskett]

On Friday 22 January 2021 19:48:11 Debra S Baddorf wrote:

> I presume you are looking in  (your flavor's equivalent to)
>/var/log/messages
> to see if there are systems error messages about the CRC messages?
>
> Deb Baddorf

I would look at the tail output but its all going to syslog these days 
and gets log-rotated out from under tail in a day or less because it got 
too big, so I cannot find the correct timestamps w/o ungziping 50 megs 
worth of it. I start a tail on it at reboot, but its gone in 12 to 15 
hours with all the other useless BS & excess verbosity.

> > On Jan 22, 2021, at 5:21 AM, Gene Heskett 
> > wrote:
> >
> > from the email:
> >
> > FAILURE DUMP SUMMARY:
> >  coyote /GenesAmandaHelper-0.61/config-bak lev 0  partial taper:
> > source server crc (6158b8f5:29861110032) and input server crc
> > (4f171223:29861110032) differ)
> >  coyote /GenesAmandaHelper-0.61/config-bak lev 0  FAILED [data
> > timeout] coyote /GenesAmandaHelper-0.61/config-bak lev 0  partial
> > taper: successfully taped a partial dump
> >  coyote /opt lev 0  partial taper: source server crc
> > (1f484cf4:15602100421) and input server crc (a7bc8db8:15602100421)
> > differ)
> >  coyote /opt lev 0  FAILED [data timeout]
> >  coyote /opt lev 0  FAILED [failed to set shm-ring]
> >  coyote /usr/movies lev 0  partial taper: source server crc
> > (55338628:13370009600) and input server crc (feecb660:13370009600)
> > differ)
> >  coyote /usr/movies lev 0  was successfully retried
> >
> > And:
> >
> > FAILED DUMP DETAILS:
> >  /-- coyote /GenesAmandaHelper-0.61/config-bak lev 0 FAILED [data
> > timeout]
> >  sendbackup: info BACKUP=APPLICATION
> >  sendbackup: info APPLICATION=amgtar
> >  sendbackup: info
> > RECOVER_CMD=/bin/gzip -dc
> > |/usr/local/libexec/amanda/application/amgtar restore
> > [./file-to-restore]+
> >  sendbackup: info COMPRESS_SUFFIX=.gz
> >  sendbackup: info end
> >  \
> >  /-- coyote /opt lev 0 FAILED [data timeout]
> >  sendbackup: info BACKUP=APPLICATION
> >  sendbackup: info APPLICATION=amgtar
> >  sendbackup: info
> > RECOVER_CMD=/bin/gzip -dc
> > |/usr/local/libexec/amanda/application/amgtar restore
> > [./file-to-restore]+
> >  sendbackup: info COMPRESS_SUFFIX=.gz
> >  sendbackup: info end
> >  \
> >
> >
> > NOTES:
> >  planner: Incremental of coyote:/usr/local bumped to level 2.
> >  driver: coyote /GenesAmandaHelper-0.61/config-bak 20210122020104 0
> > [Will retry dump because of holding disk error: source server crc
> > (6158b8f5:29861110032) and input server crc (4f171223:29861110032)
> > differ)]
> >  driver: coyote /opt 20210122020104 0 [Will retry dump because of
> > holding disk error: source server crc (1f484cf4:15602100421) and
> > input server crc (a7bc8db8:15602100421) differ)]
> >  driver: coyote /usr/movies 20210122020104 0 [Will retry dump
> > because of holding disk error: source server crc
> > (55338628:13370009600) and input server crc (feecb660:13370009600)
> > differ)]
> >  taper: tape Dailys-2 kb 73355394 fm 79 [OK]
> >  big estimate: coyote /GenesAmandaHelper-0.61/config-bak 0
> >  est: 28000Mout 0M
> >
> > left in the holding disk:
> >
> > root@coyote:data$ ls -l /sdb/dumps/20210122020104/
> > total 57456372
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:31
> > coyote._GenesAmandaHelper-0.61_config-bak.0
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:08
> > coyote._GenesAmandaHelper-0.61_config-bak.0.1
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:16
> > coyote._GenesAmandaHelper-0.61_config-bak.0.10
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:17
> > coyote._GenesAmandaHelper-0.61_config-bak.0.11
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:18
> > coyote._GenesAmandaHelper-0.61_config-bak.0.12
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:19
> > coyote._GenesAmandaHelper-0.61_config-bak.0.13
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:20
> > coyote._GenesAmandaHelper-0.61_config-bak.0.14
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:21
> > coyote._GenesAmandaHelper-0.61_config-bak.0.15
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:22
> > coyote._GenesAmandaHelper-0.61_config-bak.0.16
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:23
> > coyote._GenesAmandaHelper-0.61_config-bak.0.17
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:23
> > coyote._GenesAmandaHelper-0.61_config-bak.0.18
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:24
> > coyote._GenesAmandaHelper-0.61_config-bak.0.19
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:09
> > coyote._GenesAmandaHelper-0.61_config-bak.0.2
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:25
> > coyote._GenesAmandaHelper-0.61_config-bak.0.20
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:26
> > coyote._GenesAmandaHelper-0.61_config-bak.0.21
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:27
> > coyote._GenesAmandaHelper-0.61_config-bak.0.22
> > -rw--- 1 amanda amanda 1048576000 Jan 22 02:28
> > 

Re: Amanda really blew up last night.

[Debra S Baddorf]

I presume you are looking in  (your flavor's equivalent to)
   /var/log/messages
to see if there are systems error messages about the CRC messages?

Deb Baddorf

> On Jan 22, 2021, at 5:21 AM, Gene Heskett  wrote:
> 
> from the email:
> 
> FAILURE DUMP SUMMARY:
>  coyote /GenesAmandaHelper-0.61/config-bak lev 0  partial taper: source 
> server crc (6158b8f5:29861110032) and input server crc 
> (4f171223:29861110032) differ)
>  coyote /GenesAmandaHelper-0.61/config-bak lev 0  FAILED [data timeout]
>  coyote /GenesAmandaHelper-0.61/config-bak lev 0  partial taper: 
> successfully taped a partial dump
>  coyote /opt lev 0  partial taper: source server crc 
> (1f484cf4:15602100421) and input server crc (a7bc8db8:15602100421) 
> differ)
>  coyote /opt lev 0  FAILED [data timeout]
>  coyote /opt lev 0  FAILED [failed to set shm-ring]
>  coyote /usr/movies lev 0  partial taper: source server crc 
> (55338628:13370009600) and input server crc (feecb660:13370009600) 
> differ)
>  coyote /usr/movies lev 0  was successfully retried
> 
> And:
> 
> FAILED DUMP DETAILS:
>  /-- coyote /GenesAmandaHelper-0.61/config-bak lev 0 FAILED [data 
> timeout]
>  sendbackup: info BACKUP=APPLICATION
>  sendbackup: info APPLICATION=amgtar
>  sendbackup: info 
> RECOVER_CMD=/bin/gzip -dc |/usr/local/libexec/amanda/application/amgtar 
> restore [./file-to-restore]+
>  sendbackup: info COMPRESS_SUFFIX=.gz
>  sendbackup: info end
>  \
>  /-- coyote /opt lev 0 FAILED [data timeout]
>  sendbackup: info BACKUP=APPLICATION
>  sendbackup: info APPLICATION=amgtar
>  sendbackup: info 
> RECOVER_CMD=/bin/gzip -dc |/usr/local/libexec/amanda/application/amgtar 
> restore [./file-to-restore]+
>  sendbackup: info COMPRESS_SUFFIX=.gz
>  sendbackup: info end
>  \
> 
> 
> NOTES:
>  planner: Incremental of coyote:/usr/local bumped to level 2.
>  driver: coyote /GenesAmandaHelper-0.61/config-bak 20210122020104 0 
> [Will retry dump because of holding disk error: source server crc 
> (6158b8f5:29861110032) and input server crc (4f171223:29861110032) 
> differ)]
>  driver: coyote /opt 20210122020104 0 [Will retry dump because of 
> holding disk error: source server crc (1f484cf4:15602100421) and input 
> server crc (a7bc8db8:15602100421) differ)]
>  driver: coyote /usr/movies 20210122020104 0 [Will retry dump because of 
> holding disk error: source server crc (55338628:13370009600) and input 
> server crc (feecb660:13370009600) differ)]
>  taper: tape Dailys-2 kb 73355394 fm 79 [OK]
>  big estimate: coyote /GenesAmandaHelper-0.61/config-bak 0
>  est: 28000Mout 0M
> 
> left in the holding disk:
> 
> root@coyote:data$ ls -l /sdb/dumps/20210122020104/
> total 57456372
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:31 
> coyote._GenesAmandaHelper-0.61_config-bak.0
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:08 
> coyote._GenesAmandaHelper-0.61_config-bak.0.1
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:16 
> coyote._GenesAmandaHelper-0.61_config-bak.0.10
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:17 
> coyote._GenesAmandaHelper-0.61_config-bak.0.11
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:18 
> coyote._GenesAmandaHelper-0.61_config-bak.0.12
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:19 
> coyote._GenesAmandaHelper-0.61_config-bak.0.13
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:20 
> coyote._GenesAmandaHelper-0.61_config-bak.0.14
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:21 
> coyote._GenesAmandaHelper-0.61_config-bak.0.15
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:22 
> coyote._GenesAmandaHelper-0.61_config-bak.0.16
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:23 
> coyote._GenesAmandaHelper-0.61_config-bak.0.17
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:23 
> coyote._GenesAmandaHelper-0.61_config-bak.0.18
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:24 
> coyote._GenesAmandaHelper-0.61_config-bak.0.19
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:09 
> coyote._GenesAmandaHelper-0.61_config-bak.0.2
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:25 
> coyote._GenesAmandaHelper-0.61_config-bak.0.20
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:26 
> coyote._GenesAmandaHelper-0.61_config-bak.0.21
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:27 
> coyote._GenesAmandaHelper-0.61_config-bak.0.22
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:28 
> coyote._GenesAmandaHelper-0.61_config-bak.0.23
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:28 
> coyote._GenesAmandaHelper-0.61_config-bak.0.24
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:29 
> coyote._GenesAmandaHelper-0.61_config-bak.0.25
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:30 
> coyote._GenesAmandaHelper-0.61_config-bak.0.26
> -rw--- 1 amanda amanda 1048576000 Jan 22 02:31 
> coyote._GenesAmandaHelper-0.61_config-bak.0.27
> -rw--- 1 amanda amanda  501932304 Jan 22 02:31 
> coyote._GenesAmandaHelper-0.61_config-bak.0.28
> -rw--- 1 amanda amanda 

Re: Amanda really blew up last night.

[Gene Heskett]

On Friday 22 January 2021 13:40:43 Jon LaBadie wrote:

> I don't see how your post-amdump script could be
> affecting things, but consider eliminating it from
> consideration entirely by running without the post-
> amdump processing for a while (or until next error).
>
I do not see how that can be involved, it doesn't run until amanda is 
finished, I even leave time for the disks to sync before it runs.

> Clutching at straws now.
>
> I'm beginning to feel it might be a hardware problem.
> cables, controller, ???

Its random Jon, and this problem actually precedes the fire in an onboard 
usb port on the old asus phenom mobo, which was replaced with another 
asus x370 which now carries a 6 core I5 and 32gigs of dram. It existed 
with a spinning rust holding disk, and replacing it with an SSD of 
240Gigs also replaced the cable. And the original amandatapes drive of 
1Tbyte was replaced with a 2Tbyte, along with a new cable since this 
problem stated. I was maybe 1 time a month and now has become a twice a 
week problem.  And its gotten worse with a perl upgrade by stretch about 
90 days back.  Looking at the file sizes of the failures put 
in /amandatapes and then redoes, they are often exactly the same size, 
but the diffs are bigger than the files. And the redone backups headers 
never contain the *-CRC entries.

Since I have the src's, I am half tempted to go back to 3.3.1.p7. But it 
won't build now, a perl error IIRC. But let me check.

configure is fine, make fails:

glib-util.c:68:20: fatal error: gcrypt.h: No such file or directory
 #include 
^
compilation terminated.
Makefile:2362: recipe for target 'glib-util.lo' failed
make[3]: *** [glib-util.lo] Error 1
make[3]: Leaving directory '/home/amanda/amanda-3.3.7p1/common-src'
Makefile:2023: recipe for target 'all' failed
make[2]: *** [all] Error 2
make[2]: Leaving directory '/home/amanda/amanda-3.3.7p1/common-src'
Makefile:1652: recipe for target 'all-recursive' failed
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory '/home/amanda/amanda-3.3.7p1'
Makefile:1575: recipe for target 'all' failed
make: *** [all] Error 2

So lets try 3.4.3: but added --without-ipv6 to the config and its 
building ok so far. Getting rid of ipv6 locally has been a problem but 
there is not a workng ipv6 here in West Virginia within 120 miles of the 
far side of my router. 3.4.3 builds, 3.3.7p1 still won't because of the 
crypt error. So I'll try a rebuild without ipv6 support, of 3.5.1 just 
for shits and grins.
And I've forgot if amanda needs a make setuid? amcheck fails with a bunch 
of perms errors:
root@coyote:amanda-3.5.1$ su amanda -c "/usr/local/sbin/amcheck Daily"
Amanda Tape Server Host Check
-
ERROR: program /usr/local/libexec/amanda/ambind: not executable
NOTE: Holding disk '/sdb/dumps': 212792 MB disk space available, using 
212292 MB
Searching for label 'Dailys-3':found in slot 3: volume 'Dailys-3'
Will write to volume 'Dailys-3' in slot 3.
NOTE: skipping tape-writable test
Server check took 0.790 seconds
Amanda Backup Client Hosts Check

ERROR: coyote: selfcheck request failed: amcheck-clients: error 
[exec /usr/local/libexec/amanda/ambind: Permission denied]
ERROR: shop: selfcheck request failed: amcheck-clients: error 
[exec /usr/local/libexec/amanda/ambind: Permission denied]
ERROR: lathe: selfcheck request failed: amcheck-clients: error 
[exec /usr/local/libexec/amanda/ambind: Permission denied]
ERROR: GO704: selfcheck request failed: amcheck-clients: error 
[exec /usr/local/libexec/amanda/ambind: Permission denied]
ERROR: rpi4: selfcheck request failed: amcheck-clients: error 
[exec /usr/local/libexec/amanda/ambind: Permission denied]
Client check: 5 hosts checked in 11.282 seconds.  5 problems found.
(brought to you by Amanda 3.5.1)

but adding +x to ambind is a big mess. Now it wants rwsr-x--- perms.
mc doesn't seem to be able to satisfy that, so how is it done from the 
cli

Thanks cuz now I am completely screwed.
 
> Jon


Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
 - Louis D. Brandeis
Genes Web page 

Amanda really blew up last night.

[Gene Heskett]

from the email:

FAILURE DUMP SUMMARY:
  coyote /GenesAmandaHelper-0.61/config-bak lev 0  partial taper: source 
server crc (6158b8f5:29861110032) and input server crc 
(4f171223:29861110032) differ)
  coyote /GenesAmandaHelper-0.61/config-bak lev 0  FAILED [data timeout]
  coyote /GenesAmandaHelper-0.61/config-bak lev 0  partial taper: 
successfully taped a partial dump
  coyote /opt lev 0  partial taper: source server crc 
(1f484cf4:15602100421) and input server crc (a7bc8db8:15602100421) 
differ)
  coyote /opt lev 0  FAILED [data timeout]
  coyote /opt lev 0  FAILED [failed to set shm-ring]
  coyote /usr/movies lev 0  partial taper: source server crc 
(55338628:13370009600) and input server crc (feecb660:13370009600) 
differ)
  coyote /usr/movies lev 0  was successfully retried

And:

FAILED DUMP DETAILS:
  /-- coyote /GenesAmandaHelper-0.61/config-bak lev 0 FAILED [data 
timeout]
  sendbackup: info BACKUP=APPLICATION
  sendbackup: info APPLICATION=amgtar
  sendbackup: info 
RECOVER_CMD=/bin/gzip -dc |/usr/local/libexec/amanda/application/amgtar 
restore [./file-to-restore]+
  sendbackup: info COMPRESS_SUFFIX=.gz
  sendbackup: info end
  \
  /-- coyote /opt lev 0 FAILED [data timeout]
  sendbackup: info BACKUP=APPLICATION
  sendbackup: info APPLICATION=amgtar
  sendbackup: info 
RECOVER_CMD=/bin/gzip -dc |/usr/local/libexec/amanda/application/amgtar 
restore [./file-to-restore]+
  sendbackup: info COMPRESS_SUFFIX=.gz
  sendbackup: info end
  \


NOTES:
  planner: Incremental of coyote:/usr/local bumped to level 2.
  driver: coyote /GenesAmandaHelper-0.61/config-bak 20210122020104 0 
[Will retry dump because of holding disk error: source server crc 
(6158b8f5:29861110032) and input server crc (4f171223:29861110032) 
differ)]
  driver: coyote /opt 20210122020104 0 [Will retry dump because of 
holding disk error: source server crc (1f484cf4:15602100421) and input 
server crc (a7bc8db8:15602100421) differ)]
  driver: coyote /usr/movies 20210122020104 0 [Will retry dump because of 
holding disk error: source server crc (55338628:13370009600) and input 
server crc (feecb660:13370009600) differ)]
  taper: tape Dailys-2 kb 73355394 fm 79 [OK]
  big estimate: coyote /GenesAmandaHelper-0.61/config-bak 0
  est: 28000Mout 0M

left in the holding disk:

root@coyote:data$ ls -l /sdb/dumps/20210122020104/
total 57456372
-rw--- 1 amanda amanda 1048576000 Jan 22 02:31 
coyote._GenesAmandaHelper-0.61_config-bak.0
-rw--- 1 amanda amanda 1048576000 Jan 22 02:08 
coyote._GenesAmandaHelper-0.61_config-bak.0.1
-rw--- 1 amanda amanda 1048576000 Jan 22 02:16 
coyote._GenesAmandaHelper-0.61_config-bak.0.10
-rw--- 1 amanda amanda 1048576000 Jan 22 02:17 
coyote._GenesAmandaHelper-0.61_config-bak.0.11
-rw--- 1 amanda amanda 1048576000 Jan 22 02:18 
coyote._GenesAmandaHelper-0.61_config-bak.0.12
-rw--- 1 amanda amanda 1048576000 Jan 22 02:19 
coyote._GenesAmandaHelper-0.61_config-bak.0.13
-rw--- 1 amanda amanda 1048576000 Jan 22 02:20 
coyote._GenesAmandaHelper-0.61_config-bak.0.14
-rw--- 1 amanda amanda 1048576000 Jan 22 02:21 
coyote._GenesAmandaHelper-0.61_config-bak.0.15
-rw--- 1 amanda amanda 1048576000 Jan 22 02:22 
coyote._GenesAmandaHelper-0.61_config-bak.0.16
-rw--- 1 amanda amanda 1048576000 Jan 22 02:23 
coyote._GenesAmandaHelper-0.61_config-bak.0.17
-rw--- 1 amanda amanda 1048576000 Jan 22 02:23 
coyote._GenesAmandaHelper-0.61_config-bak.0.18
-rw--- 1 amanda amanda 1048576000 Jan 22 02:24 
coyote._GenesAmandaHelper-0.61_config-bak.0.19
-rw--- 1 amanda amanda 1048576000 Jan 22 02:09 
coyote._GenesAmandaHelper-0.61_config-bak.0.2
-rw--- 1 amanda amanda 1048576000 Jan 22 02:25 
coyote._GenesAmandaHelper-0.61_config-bak.0.20
-rw--- 1 amanda amanda 1048576000 Jan 22 02:26 
coyote._GenesAmandaHelper-0.61_config-bak.0.21
-rw--- 1 amanda amanda 1048576000 Jan 22 02:27 
coyote._GenesAmandaHelper-0.61_config-bak.0.22
-rw--- 1 amanda amanda 1048576000 Jan 22 02:28 
coyote._GenesAmandaHelper-0.61_config-bak.0.23
-rw--- 1 amanda amanda 1048576000 Jan 22 02:28 
coyote._GenesAmandaHelper-0.61_config-bak.0.24
-rw--- 1 amanda amanda 1048576000 Jan 22 02:29 
coyote._GenesAmandaHelper-0.61_config-bak.0.25
-rw--- 1 amanda amanda 1048576000 Jan 22 02:30 
coyote._GenesAmandaHelper-0.61_config-bak.0.26
-rw--- 1 amanda amanda 1048576000 Jan 22 02:31 
coyote._GenesAmandaHelper-0.61_config-bak.0.27
-rw--- 1 amanda amanda  501932304 Jan 22 02:31 
coyote._GenesAmandaHelper-0.61_config-bak.0.28
-rw--- 1 amanda amanda 1048576000 Jan 22 02:10 
coyote._GenesAmandaHelper-0.61_config-bak.0.3
-rw--- 1 amanda amanda 1048576000 Jan 22 02:11 
coyote._GenesAmandaHelper-0.61_config-bak.0.4
-rw--- 1 amanda amanda 1048576000 Jan 22 02:12 
coyote._GenesAmandaHelper-0.61_config-bak.0.5
-rw--- 1 amanda amanda 1048576000 Jan 22 02:13 
coyote._GenesAmandaHelper-0.61_config-bak.0.6
-rw--- 1 amanda amanda 1048576000 Jan 22