Re: amvault configoptions failing

2018-11-30 Thread Nathan Stratton Treadway
On Thu, Nov 29, 2018 at 09:25:16 -0800, Chris Deiss wrote:
> On 3.3.6, I???m exec???ing:
> 
> `amvault -o tapedev=vtape-fs1 -o tapetype=LTO6-2Gbfc -o tapecycle=1 -o 
> diskfile=/usr/local/etc/amanda/daily/disklist.drs \
> --autolabel any --latest-fulls --label-template "drs-tape-%" --dst-changer 
> tapelib2 daily`
> 
> On 3.5.1, I???m exec'ing:
> 
> `amvault -o tapedev=vtape-fs1 -o tapecycle=2 -o 
> diskfile=/usr/local/etc/amanda/daily/disklist.drs --src-storage=daily \
> --dest-storage s3-vault --latest-fulls daily`

Okay, thanks for sending these.  As you already noticed, a lot has
changed between 3.3 and 3.5 in terms of the vaulting functionality. 
I'll try to figure out what part of those changes affects what you are
doing, but it probably won't be until over the weekend

Nathan


Nathan Stratton Treadway  -  natha...@ontko.com  -  Mid-Atlantic region
Ray Ontko & Co.  -  Software consulting services  -   http://www.ontko.com/
 GPG Key: http://www.ontko.com/~nathanst/gpg_key.txt   ID: 1023D/ECFB6239
 Key fingerprint = 6AD8 485E 20B9 5C71 231C  0C32 15F3 ADCD ECFB 6239


Re: amvault configoptions failing

2018-11-29 Thread Chris Deiss
Hi Nathan,

Thanks for the response!

> On Nov 28, 2018, at 7:02 PM, Nathan Stratton Treadway  
> wrote:
> 
> On Wed, Nov 28, 2018 at 16:54:08 -0800, Chris Deiss wrote:
>> Hi,
>> 
>> Under previous version of amvault, I was able to do this:
>> 
>> 
>> amvault -o diskfile=/usr/local/etc/amanda/daily/disklist.drs . . .
>> 
>> 
>> and it worked great!  Was an excellent was to vault only a subset of DLEs to 
>> special media/storage.
> 
> What version were you using when this worked?

I have two active AMANDA servers, one running 3.3.6, the other at 3.5.1.  The 
“-o diskfile=...” option works as desired in 3.3.6.

>> It???s not working under 3.5.1, instead it defaults to the disklist
>> parameter defined in amanda.conf.  Other options like '-o tapecycle=2'
>> _do_ work with the latest amvault, so it???s not a total failure to
>> modify the config, just appears to be a problem which includes the
>> ???disklist' parameter.
> 
> There were some fixes to config-parameter processing in the versions
> leading up to v3.5.1.  Off hand I wouldn't expect those changes to cause
> the symptoms you describe, but it's possible.  I will try to look at the
> code for amvault and see if anything obvious is going on.
> 
> I take it there is no error message?

Nope, no error.  Instead, when I specify “-o 
diskfile=/usr/local/etc/amanda/daily/disklist.drs“ on the command-line under 
3.5.1, amvault vaults all DLEs in the file specified by the default ‘diskfile’ 
parameter defined in amanda.conf (that file is 
"/usr/local/etc/amanda/daily/disklist").

> What happens if you specify a path to a non-existant file, or something
> like that?

In that case (e.g. “disklist.foo" which doesn’t exist), it produces "errors 
processing disklist” and exits.

> Depending on what I find in the code for amvault, it might help narrow
> in on the problem to have the full command line you are trying to run,
> as well as a bit more information on what list of DLEs you want to vault
> and which ones are actually getting vaulted instead….

On 3.3.6, I’m exec’ing:

`amvault -o tapedev=vtape-fs1 -o tapetype=LTO6-2Gbfc -o tapecycle=1 -o 
diskfile=/usr/local/etc/amanda/daily/disklist.drs \
--autolabel any --latest-fulls --label-template "drs-tape-%" --dst-changer 
tapelib2 daily`

On 3.5.1, I’m exec'ing:

`amvault -o tapedev=vtape-fs1 -o tapecycle=2 -o 
diskfile=/usr/local/etc/amanda/daily/disklist.drs --src-storage=daily \
--dest-storage s3-vault --latest-fulls daily`

When I issue that, amvault vaults all DLEs in the default ‘diskfile' file 
("/usr/local/etc/amanda/daily/disklist”), which BTW contains the line:

includefile disklist.drs

That way, a normal amdump run includes all DLEs, both the ones I want vaulted 
offsite (listed in “disklist.drs”) and all the rest (listed in the default file 
“disklist”).

Another aside: it doesn’t seem to matter whether I specify the full path of the 
diskfile file or not . . . presumably AMANDA commands prepend the path at which 
amanda.conf resides if a relative filename is given?  All of my diskfile files 
are in the same directory as amanda.conf.

>> If anyone has alternative ways to vault a subset of DLEs, or an
> 
> 
> Well, amvault does accept a number of parameters and arguments to
> control what gets vaulted, but I guess those might not be sufficient if
> your disklist.drs list is long and arbitrary…

Yes, in this use-case, we’re trying to send an arbitrary set of DLE’s off-site 
for DRS, and the DLEs span multiple hosts but not all filesystems on any given 
host.

> 
>> effective way to report a bug, please let me know.
> 
> (This mailing list is currently the best way to report a bug...)
> 
>   Nathan
> 
> 
> Nathan Stratton Treadway  -  natha...@ontko.com  -  Mid-Atlantic region
> Ray Ontko & Co.  -  Software consulting services  -   http://www.ontko.com/
> GPG Key: http://www.ontko.com/~nathanst/gpg_key.txt   ID: 1023D/ECFB6239
> Key fingerprint = 6AD8 485E 20B9 5C71 231C  0C32 15F3 ADCD ECFB 6239




Re: amvault configoptions failing

2018-11-29 Thread Nathan Stratton Treadway
On Wed, Nov 28, 2018 at 22:02:30 -0500, Nathan Stratton Treadway wrote:
> Depending on what I find in the code for amvault, it might help narrow
> in on the problem to have the full command line you are trying to run,
> as well as a bit more information on what list of DLEs you want to vault
> and which ones are actually getting vaulted instead
> 

Looking at the code (in amvault v3.5.1 as installed from the
amanda_3.5.1-4_WIP_4 Debian source package), amvault does apear to
process configuration overrides on the command line before trying to
load the diskfile, as one would expect.

And when I try running amvault specifying an invalid diskfile name I get
a run-time error, while a valid file name does not:

==
# su backup -c "amvault -odiskfile=asdf TestBackup dummyhost"
errors processing disklist

# su backup -c "amvault -odiskfile=/dev/null TestBackup dummyhost"
No dumps to vault
=-

So it seems like the basic processing of the -odiskfile= command-line
option hasn't changed in v3.5.1

Maybe some broader aspect of amvault's functioning has changed between
3.5 and your earlier versions?


Nathan



Nathan Stratton Treadway  -  natha...@ontko.com  -  Mid-Atlantic region
Ray Ontko & Co.  -  Software consulting services  -   http://www.ontko.com/
 GPG Key: http://www.ontko.com/~nathanst/gpg_key.txt   ID: 1023D/ECFB6239
 Key fingerprint = 6AD8 485E 20B9 5C71 231C  0C32 15F3 ADCD ECFB 6239


Re: amvault configoptions failing

2018-11-28 Thread Nathan Stratton Treadway
On Wed, Nov 28, 2018 at 16:54:08 -0800, Chris Deiss wrote:
> Hi,
> 
> Under previous version of amvault, I was able to do this:
> 
> 
> amvault -o diskfile=/usr/local/etc/amanda/daily/disklist.drs . . .
> 
> 
> and it worked great!  Was an excellent was to vault only a subset of DLEs to 
> special media/storage.

What version were you using when this worked?

> 
> It???s not working under 3.5.1, instead it defaults to the disklist
> parameter defined in amanda.conf.  Other options like '-o tapecycle=2'
> _do_ work with the latest amvault, so it???s not a total failure to
> modify the config, just appears to be a problem which includes the
> ???disklist' parameter.

There were some fixes to config-parameter processing in the versions
leading up to v3.5.1.  Off hand I wouldn't expect those changes to cause
the symptoms you describe, but it's possible.  I will try to look at the
code for amvault and see if anything obvious is going on.

I take it there is no error message?  

What happens if you specify a path to a non-existant file, or something
like that?

Depending on what I find in the code for amvault, it might help narrow
in on the problem to have the full command line you are trying to run,
as well as a bit more information on what list of DLEs you want to vault
and which ones are actually getting vaulted instead

> 
> If anyone has alternative ways to vault a subset of DLEs, or an


Well, amvault does accept a number of parameters and arguments to
control what gets vaulted, but I guess those might not be sufficient if
your disklist.drs list is long and arbitrary...

> effective way to report a bug, please let me know.

(This mailing list is currently the best way to report a bug...)

Nathan


Nathan Stratton Treadway  -  natha...@ontko.com  -  Mid-Atlantic region
Ray Ontko & Co.  -  Software consulting services  -   http://www.ontko.com/
 GPG Key: http://www.ontko.com/~nathanst/gpg_key.txt   ID: 1023D/ECFB6239
 Key fingerprint = 6AD8 485E 20B9 5C71 231C  0C32 15F3 ADCD ECFB 6239


amvault configoptions failing

2018-11-28 Thread Chris Deiss
Hi,

Under previous version of amvault, I was able to do this:


amvault -o diskfile=/usr/local/etc/amanda/daily/disklist.drs . . .


and it worked great!  Was an excellent was to vault only a subset of DLEs to 
special media/storage.

It’s not working under 3.5.1, instead it defaults to the disklist parameter 
defined in amanda.conf.  Other options like '-o tapecycle=2' _do_ work with the 
latest amvault, so it’s not a total failure to modify the config, just appears 
to be a problem which includes the ‘disklist' parameter.

If anyone has alternative ways to vault a subset of DLEs, or an effective way 
to report a bug, please let me know.

Thanks!
Chris