Re: [Bacula-users] Unable to recover data using bscan

2014-10-31 Thread Keith T
Hi Ana, 
Thanks for the point! I think I could not avoid setup the previous old version 
for this recovery when the new version currently use seems not working.
I had already tried bextract command and failed as it seems to be not possible 
for encrypted data referring to some posts.
Thanks much again for your helps!

Best regards,Keith

 On Thursday, October 30, 2014 9:17 PM, Ana Emília M. Arruda 
 wrote:
   

 Hi Keith,
I'm affraid it's a database version problem. Your 2012 backups have database 
vesion=12 and your current catalog uses version 14. If this is the problem, I'm 
not sure it is, then you can solve it creating an 5.0.3 director virtual 
machine with an empty database and restore the 8 volumes and jobs with bscan.
For old backups, I normally use bextract for restores, mainly because I don't 
have file retention times too long and with bextract I can easly do full 
restores or select folders/files I want be restored (and you can use only one 
volume or all of them).
Best regards,Ana
On Thu, Oct 30, 2014 at 1:23 AM, Keith T  wrote:

Hi Ana,
Thanks for your kind advise! Will post after tried.
But I would ask whether it is possible to restore data with one volume instead 
of multiple volume since the full backup done for eight volumes (and seems not 
able to restore it without creating the first volume). Besides, if possible, I 
shall use the job id (e.g.7) that has created when bscan multiple volumes as 
bscan one volume did not see a new job ID created? When use job ID 7, no more 
folders recovered after only bscan volume 7 even volfiles has value 232 now 
(re-run bscan -V COMHKOB2012HDD7 -v -s -S -m -c /etc/bacula/bacula-sd.conf 
/mnt/usb3docking1).

[root@BSVR iscsi]# echo "list media"|bconsole
Connecting to Director BSVR:9101
1000 OK: bacula-dir Version: 5.2.13 (19 February 2013)
Enter a period to cancel a command.
list media
Automatically selected Catalog: MyCatalog
Using Catalog "MyCatalog"
Pool: Default
No results to list.
Pool: YearlyPool
+-+-+---+-+-+--+--+-+--+---+---+-+
| mediaid | volumename  | volstatus | enabled | volbytes    | volfiles 
| volretention | recycle | slot | inchanger | mediatype | lastwritten |
+-+-+---+-+-+--+--+-+--+---+---+-+
|  11 | COMHKOB2012HDD1 | Archive   |   1 | 998,951,619,932 |    0 
|   31,536,000 |   0 |    0 | 0 | File  | 2013-02-18 09:56:26 |
|  12 | COMHKOB2012HDD2 | Archive   |   1 | 999,122,570,931 |    0 
|   31,536,000 |   0 |    0 | 0 | File  | 2013-02-19 01:13:42 |
|  13 | COMHKOB2012HDD3 | Archive   |   1 | 999,118,420,008 |    0 
|   31,536,000 |   0 |    0 | 0 | File  | 2013-02-19 10:16:15 |
|  14 | COMHKOB2012HDD4 | Archive   |   1 | 999,122,062,160 |  232 
|   31,536,000 |   0 |    0 | 0 | File  | 2013-02-19 22:43:03 |
|  15 | COMHKOB2012HDD5 | Archive   |   1 | 999,126,549,297 |    0 
|   31,536,000 |   0 |    0 | 0 | File  | |
|  16 | COMHKOB2012HDD6 | Archive   |   1 | 999,121,777,768 |  232 
|   31,536,000 |   0 |    0 | 0 | File  | |
|  17 | COMHKOB2012HDD7 | Archive   |   1 | 999,126,642,823 |  232 
|   31,536,000 |   0 |    0 | 0 | File  | |
|  18 | COMHKOB2012HDD8 | Archive   |   1 | 398,969,357,878 |   92 
|   31,536,000 |   0 |    0 | 0 | File  | |
+-+-+---+-+-+--+--+-+--+---+---+-+
 
Best regards,Keith

 On Wednesday, October 29, 2014 7:17 PM, Ana Emília M. Arruda 
 wrote:
   

 Hi Keith,
Have you checked with "bls" the contents of these volumes?
Best regards,Ana
On Wed, Oct 29, 2014 at 6:34 AM, Keith T  wrote:

Dear All,
I was trying to restore data that had been backup on year 2012 but some folders 
not found after recreated Catalog using the command bscan as described on 
below. Appreciate if you have any idea to fix this.

#Tried recovery catalog by bscan command
bscan -V 
COMHKOB2012HDD1\|COMHKOB2012HDD2\|COMHKOB2012HDD3\|COMHKOB2012HDD4\|COMHKOB2012HDD5\|COMHKOB2012HDD6\|COMHKOB2012HDD7\|COMHKOB2012HDD8
 -v -s -S -m -c /etc/bacula/bacula-sd.conf /mnt/usb3docking1

All the eight medias have been created but some have 0 volfiles?

Pool: YearlyPool
+-+-+---+-+-+--+--+-+--+---+---+-+
| mediaid | volumename  | volstatus | enabled | volbytes    | volfiles 
| volretention | recycle | slot | inchanger | mediatype | l

Re: [Bacula-users] Job transfer rate

2014-10-31 Thread Jeff MacDonald
Its def disk IO on the client OR disk/database io on the bacula director.

Its all a symptom of too much VM on not enough hardware.

Jeff.

> On Oct 30, 2014, at 2:26 PM, John Lockard  wrote:
> 
> Yes, but which IO?
> 
> Disk IO on the client?
> Network IO from the client to the network?
> Network IO from the network to the Bacula Director?
> Network IO from the Bacula Director to the Bacula SD?
> Disk IO on the Bacula SD?
> Database IO on the Bacula Director?
> 
> 
> Seems like you have more work to do than just saying "it's the IO".  Not sure 
> of the tools on Windows to interrogate IO at disk or network, but on 
> Linux/Unix a good place to start is the sar (sysstat) utilities.
> 
> -John
> 
> On Thu, Oct 30, 2014 at 12:20 PM, Jeff MacDonald  > wrote:
>>> 
>> Just be aware that you might not see a dramatic increase in speed just 
>> moving Bacula itself!
>> 
>> If you are using VMWare with VMDK files on a VMFS volume you need to be 
>> aware that any IO by a guest requires a reservation of the entire VMFS 
>> volume.  Locking is happening at the SCSI layer - if one guest wants to 
>> read one byte of data nobody else can do anything until its IO operation 
>> is complete.  Remembering that you probably are only going to get around 
>> 75 IOPs you can see how a VMFS volume with more than a handful of 
>> virtual machines on it can very quickly end up performing very poorly, 
>> especially with spinning rust underneath it.  A good RAID card with a 
>> LOT of cache memory can help with overall system performance, but 
>> backups by definition are going to be touching lots of areas of data 
>> that aren't likely to be in cache.
>> 
>> What I'm getting at is you might actually need to focus your efforts and 
>> dollars on the storage underneath your VMs before you do too much with 
>> your backup system.  A great big nice happy dedicated Bacula server 
>> would be nice, but if the VMs are still IOP constrained ESPECIALLY if 
>> they are actively in use while being backed up you probably won't see 
>> that much of an improvement.
>> 
>> An easy way to validate this would be to ensure you have attribute 
>> spooling turned on and to set up the attribute spooling to write to your 
>> NAS rather than to local storage.  That will get the VM storage 
>> infrastructure out of your backup pathway.
>> 
>> Bryn
> 
> This has been a fantastic education. Thanks. I’ll recommend to the client 
> that their IO is slow.. and I’ll get told “Oh! It seems fine to us!” :)
> 
> 
> I googled and found documentation about turning on Data Spooling, but not 
> indepnedantly turning on Attribute Spooling.
> 
> Could you point me at that please.. ( I know I Know.. I’ll keep looking :) )
> 
> Jeff.
> 
> 
> 
> --
> 
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net 
> https://lists.sourceforge.net/lists/listinfo/bacula-users 
> 
> 
> 
> 
> 
> -- 
> ---
>  John M. Lockard |  U of Michigan - School of Information
>   Unix Sys Admin |  105 South State St. | 4325 North Quad
>   jlock...@umich.edu  |Ann Arbor, MI  
> 48109-1285
>  www.umich.edu/~jlockard  | 
> 734-936-7255 | 734-764-2475 FAX
> ---
> - The University of Michigan will never ask you for your password -
> 

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] bacula 7 list volumes

2014-10-31 Thread Tim Dunphy
Hey guys,

 I seem to remember being able to 'list volumes' in older versions of
bconsole. But now that I'm on bacula 7 on the server it doesn't seem to
understand that command.

*list volumes;
Unknown list keyword: volumes;

And I've even dug through some bacula documentation that seems to suggest
that's a valid command. So while I have lost my mind, I don't think it's to
the extent that I'm just making up commands that I thought I could use.

Can I get some help here as to why this is happening?

Thanks
Tim

-- 
GPG me!!

gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula 7 list volumes

2014-10-31 Thread Luc Van der Veken
Not running bacula 7 here, but have you tried ‘list volume’?

Both work in 5.2, but the online help (“h list”) only mentions ‘volume’.

*h list
  Command   Description
  ===   ===
  list  List objects from catalog

Arguments:
pools | jobs | jobtotals | volume | media  | files 
jobid= | copies jobid=


From: Tim Dunphy [mailto:bluethu...@gmail.com]
Sent: 31 October 2014 15:19
To: bacula-users@lists.sourceforge.net
Subject: [Bacula-users] bacula 7 list volumes

Hey guys,

 I seem to remember being able to 'list volumes' in older versions of bconsole. 
But now that I'm on bacula 7 on the server it doesn't seem to understand that 
command.

*list volumes;
Unknown list keyword: volumes;

And I've even dug through some bacula documentation that seems to suggest 
that's a valid command. So while I have lost my mind, I don't think it's to the 
extent that I'm just making up commands that I thought I could use.

Can I get some help here as to why this is happening?

Thanks
Tim

--
GPG me!!

gpg --keyserver pool.sks-keyservers.net 
--recv-keys F186197B
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula 7 list volumes

2014-10-31 Thread Luc Van der Veken
And sorry for the double reply, but I only noticed this after hitting send: 
you’re not at a MySQL prompt, try omitting that semicolon an the end ;)


From: Luc Van der Veken
Sent: 31 October 2014 15:31
To: bacula-users@lists.sourceforge.net
Cc: 'Tim Dunphy'
Subject: RE: [Bacula-users] bacula 7 list volumes

Not running bacula 7 here, but have you tried ‘list volume’?

Both work in 5.2, but the online help (“h list”) only mentions ‘volume’.

*h list
  Command   Description
  ===   ===
  list  List objects from catalog

Arguments:
pools | jobs | jobtotals | volume | media  | files 
jobid= | copies jobid=


From: Tim Dunphy [mailto:bluethu...@gmail.com]
Sent: 31 October 2014 15:19
To: 
bacula-users@lists.sourceforge.net
Subject: [Bacula-users] bacula 7 list volumes

Hey guys,

 I seem to remember being able to 'list volumes' in older versions of bconsole. 
But now that I'm on bacula 7 on the server it doesn't seem to understand that 
command.

*list volumes;
Unknown list keyword: volumes;

And I've even dug through some bacula documentation that seems to suggest 
that's a valid command. So while I have lost my mind, I don't think it's to the 
extent that I'm just making up commands that I thought I could use.

Can I get some help here as to why this is happening?

Thanks
Tim

--
GPG me!!

gpg --keyserver pool.sks-keyservers.net 
--recv-keys F186197B
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula 7 list volumes

2014-10-31 Thread Bill Arlofski
On 10/31/2014 10:19 AM, Tim Dunphy wrote:
> Hey guys,
> 
>  I seem to remember being able to 'list volumes' in older versions of
> bconsole. But now that I'm on bacula 7 on the server it doesn't seem to
> understand that command.
> 
> *list volumes;
> Unknown list keyword: volumes;
> 
> And I've even dug through some bacula documentation that seems to suggest
> that's a valid command. So while I have lost my mind, I don't think it's to
> the extent that I'm just making up commands that I thought I could use.
> 
> Can I get some help here as to why this is happening?
> 
> Thanks
> Tim

Hi Tim

The only reason I can think of is that you are treating the bconsole command
prompt as if you were at a mysql command prompt and are appending a semi-colon
to the end of the command.

drop the semi-colon. :)

Bill





-- 
Bill Arlofski
Reverse Polarity, LLC
http://www.revpol.com/
-- Not responsible for anything below this line --

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula 7 list volumes

2014-10-31 Thread Tim Dunphy
Hey guys,

Yup that was it!! The stupid semi-colon.. Sorry I don't know why I was
thinking I was at a mysql prompt. But it works now and thanks for your help!

TIm

On Fri, Oct 31, 2014 at 10:31 AM, Bill Arlofski 
wrote:

> On 10/31/2014 10:19 AM, Tim Dunphy wrote:
> > Hey guys,
> >
> >  I seem to remember being able to 'list volumes' in older versions of
> > bconsole. But now that I'm on bacula 7 on the server it doesn't seem to
> > understand that command.
> >
> > *list volumes;
> > Unknown list keyword: volumes;
> >
> > And I've even dug through some bacula documentation that seems to suggest
> > that's a valid command. So while I have lost my mind, I don't think it's
> to
> > the extent that I'm just making up commands that I thought I could use.
> >
> > Can I get some help here as to why this is happening?
> >
> > Thanks
> > Tim
>
> Hi Tim
>
> The only reason I can think of is that you are treating the bconsole
> command
> prompt as if you were at a mysql command prompt and are appending a
> semi-colon
> to the end of the command.
>
> drop the semi-colon. :)
>
> Bill
>
>
>
>
>
> --
> Bill Arlofski
> Reverse Polarity, LLC
> http://www.revpol.com/
> -- Not responsible for anything below this line --
>
>
> --
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>



-- 
GPG me!!

gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] filter output of list jobs

2014-10-31 Thread Jeff MacDonald
Hi,

Can I do something like

list jobs status=successful 

or 

list jobs job=job123

I’m looking for better ways to be able to filter jobs on the command line etc.

Jeff


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] filter output of list jobs

2014-10-31 Thread Bill Arlofski
On 10/31/14 13:56, Jeff MacDonald wrote:
> Hi,
> 
> Can I do something like
> 
> list jobs status=successful 
> 
> or 
> 
> list jobs job=job123
> 
> I’m looking for better ways to be able to filter jobs on the command line etc.
> 
> Jeff


Jeff, from a shell prompt or a script you can do this:


echo "list jobs" | bconsole -c /path/to/bconsole.conf  | grep " T "

or


echo "list jobs" | bconsole -c /path/to/bconsole.conf  | grep " 1,234 "


And then a little tr, sed, and/or awk to format it

Bill



--
Bill Arlofski
Reverse Polarity, LLC
http://www.revpol.com/
-- Not responsible for anything below this line --

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem installing bacula on Solaris 10

2014-10-31 Thread Kenneth Garges
Thanks for the suggestion. I avoided it because everyone in the office here 
said stay away from SunStudio, gcc is way better, Solaris compilers are evil, 
blah blah.

But I tried it and it did clear up that error. Got past the configure stage and 
most of make ran. Still not all the way there but further.


Kenneth Garges
gar...@ucsc.edu



On 25Oct 2014, at 9:03 AM, Phil Stracchino  wrote:

> 
> Ken,
> For what it's worth, I have found it to be better on Solaris to compile
> Bacula using Sun Studio.  The last release Sun Studio packages for
> Solaris 10 are, to the best of my knowledge, still a free download.
> 
> This is my Solaris 10 configure line.  At this point, the Solaris 10
> machine runs only a client and an SD, but this may help you.
> 
> 
> CC=/usr/bin/CC CXX=${CC} LDFLAGS=-m64 CFLAGS='-fast -xarch=generic
> -xtarget=generic -xcache=generic -m64' CPPFLAGS=${CFLAGS} ./configure
> --prefix=/opt/bacula --with-dump-email=r...@caerllewys.net
> --with-job-email=r...@caerllewys.net
> --with-smtp-host=smtp.caerllewys.net --with-subsys-dir=/opt/bacula/var
> --with-working-dir=/opt/bacula/var --disable-build-dird
> --with-mysql=/opt/mysql/mysql
> 
> 
> Make is gmake 3.81.
> 
> 
> -- 
>  Phil Stracchino
>  Babylon Communications
>  ph...@caerllewys.net
>  p...@co.ordinate.org
>  Landline: 603.293.8485
> 
> --
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users



signature.asc
Description: Message signed with OpenPGP using GPGMail
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users