date:20070214

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread WEAVER, Simon


I must admit, when reading the emails from them, it sounded as if they
either did not care, did not have a clue, or was simply passing the blame to
HP !

Regards

Simon Weaver
3rd Line Technical Support
Windows Domain Administrator

EADS Astrium Limited, B23AA IM (DCS)
Anchorage Road, Portsmouth, PO3 5PU

Email: [EMAIL PROTECTED]



-Original Message-
From: Hampus Lind [mailto:[EMAIL PROTECTED]
Sent: 15 February 2007 07:34
To: WEAVER, Simon; 'Geyer, Gregory'
Cc: Veritas-bu@mailman.eng.auburn.edu
Subject: SV: [Veritas-bu] Serious master issue...


Now, its morning here in Sweden...

I haven't heard from that guy, or any other support engineer sins the mail
where he told me he couldn't communicate with me... :-(


We cant us a software with this kind of support...

Anyhow, I would like to thank you all. You have been wonderful in all your
suggestions.

I will post the solution here when we find it.

Thanks and regards,



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: WEAVER, Simon [mailto:[EMAIL PROTECTED]
Skickat: den 15 februari 2007 08:13
Till: 'Hampus Lind'; 'Geyer, Gregory'
Kopia: Veritas-bu@mailman.eng.auburn.edu
Ämne: RE: [Veritas-bu] Serious master issue...


Did you get the problem sorted out, or dealt with by another Symantec
Engineer?

Regards

Simon Weaver
3rd Line Technical Support
Windows Domain Administrator


EADS Astrium Limited, B23AA IM (DCS)
Anchorage Road, Portsmouth, PO3 5PU

Email: [EMAIL PROTECTED]



-Original Message-
From: Hampus Lind [mailto:[EMAIL PROTECTED]

Sent: 14 February 2007 23:01
To: 'Geyer, Gregory'
Cc: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...


Thanks Greg,

I will check the oracle scripts...

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Geyer, Gregory [mailto:[EMAIL PROTECTED]

Skickat: den 14 februari 2007 23:57
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...

Hampus,

We had a serious issue with the RMAN backups which would cause each
individual RMAN stream to traverse the entire NB catalog for that client.
They were using an incorrect format, with a 'T' at the beginnig rather than
the end.  See the text below, from an email summary from the DBA after it
was over.

The proper format was in the Oracle NBU Admin guide all along: run {
allocate channel t1 type 'sbt_tape'; allocate channel t2 type 'sbt_tape';
send 'NB_ORA_POLICY=your_policy, NB_ORA_SERV=your_server'; Chapter 4,
Configuration 105 Configuring the Run-Time Environment backup (database
format 'bk_%U_%t'); }

=
The issue of the NetBackup Oracle Client returning 'AVAILABLE' for tape
media known to have been recycle has been identified. Symantec Support
believes the problem is in RMAN and I believe the problem is in the
NetBackup Oracle Client.  Whichever is the case, Symantec helped me
determine the issue is related to the 'T' format in the backup file name
formats.


Some of you may recall the NetBackup slow downs in Q4CY05, when GG
discovered that NetBackup has a requirement to use the RMAN 'T' format in
the backup file name as a trailing format. Prior to learning this fact, I
had been using the 'T" format as a leading portion of the file name.
NetBackup uses the 'T' format as a selective date index to the NB image
catalog database. I changed the 'T' format to trailing in the backup file
name and performance returned to normal response times.

The 'T' format came back to haunt me once more when we recently started
purging old data from the RMAN/OBK catalog repository. Either RMAN or
NetBackup never talks to the NB image database when it encounters an RMAN
backup file name that doesn't contain a trailing 'T' format. This is either
a NB server administration setting or a bug in the NB Oracle Client.
Whatever the case is, the workaround is to manually purge out all OBK data
with non-trailing 'T' file name formats. When this is done and only trailing
'T' formatted RMAN backup file names remain in the OBK catalog, then RMAN
CROSSCHECK with the NetBackup media catalog works 100% reliably.



We also had serious performance problems because we had the images
filesystem on the same relatively slow array where we also had 10TB of DSSU.
Once we separated those onto complete different fibre cards and arrays
things helped a bunch.

One more thing is we were using a bladestore from STK, and they actual
downrev'd the firmware on it, which caused a massive slowdown (the drives
were spinning to fast, which meant more failures).

Probably nothing to help you but there it is.  Good luck!

Greg



-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Hampus Lind
Sent: Wednesday, February 14, 2007 3:26 PM
To:

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

Now, its morning here in Sweden...

I havent heard from that guy, or any other support engineer sins the mail
where he told me he couldnt communicate with me... :-(


We cant us a software with this kind of support... 

Anyhow, I would like to thank you all. You have been wonderful in all your
suggestions.

I will post the solution here when we find it.

Thanks and regards,



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: WEAVER, Simon [mailto:[EMAIL PROTECTED] 
Skickat: den 15 februari 2007 08:13
Till: 'Hampus Lind'; 'Geyer, Gregory'
Kopia: Veritas-bu@mailman.eng.auburn.edu
Ämne: RE: [Veritas-bu] Serious master issue...


Did you get the problem sorted out, or dealt with by another Symantec
Engineer?

Regards

Simon Weaver
3rd Line Technical Support
Windows Domain Administrator


EADS Astrium Limited, B23AA IM (DCS)
Anchorage Road, Portsmouth, PO3 5PU

Email: [EMAIL PROTECTED]



-Original Message-
From: Hampus Lind [mailto:[EMAIL PROTECTED]

Sent: 14 February 2007 23:01
To: 'Geyer, Gregory'
Cc: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...


Thanks Greg,

I will check the oracle scripts...

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Geyer, Gregory [mailto:[EMAIL PROTECTED]

Skickat: den 14 februari 2007 23:57
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...

Hampus,

We had a serious issue with the RMAN backups which would cause each
individual RMAN stream to traverse the entire NB catalog for that client.
They were using an incorrect format, with a 'T' at the beginnig rather than
the end.  See the text below, from an email summary from the DBA after it
was over.

The proper format was in the Oracle NBU Admin guide all along: run {
allocate channel t1 type 'sbt_tape'; allocate channel t2 type 'sbt_tape';
send 'NB_ORA_POLICY=your_policy, NB_ORA_SERV=your_server'; Chapter 4,
Configuration 105 Configuring the Run-Time Environment backup (database
format 'bk_%U_%t'); }

=
The issue of the NetBackup Oracle Client returning 'AVAILABLE' for tape
media known to have been recycle has been identified. Symantec Support
believes the problem is in RMAN and I believe the problem is in the
NetBackup Oracle Client.  Whichever is the case, Symantec helped me
determine the issue is related to the 'T' format in the backup file name
formats.


Some of you may recall the NetBackup slow downs in Q4CY05, when GG
discovered that NetBackup has a requirement to use the RMAN 'T' format in
the backup file name as a trailing format. Prior to learning this fact, I
had been using the 'T" format as a leading portion of the file name.
NetBackup uses the 'T' format as a selective date index to the NB image
catalog database. I changed the 'T' format to trailing in the backup file
name and performance returned to normal response times.

The 'T' format came back to haunt me once more when we recently started
purging old data from the RMAN/OBK catalog repository. Either RMAN or
NetBackup never talks to the NB image database when it encounters an RMAN
backup file name that doesn't contain a trailing 'T' format. This is either
a NB server administration setting or a bug in the NB Oracle Client.
Whatever the case is, the workaround is to manually purge out all OBK data
with non-trailing 'T' file name formats. When this is done and only trailing
'T' formatted RMAN backup file names remain in the OBK catalog, then RMAN
CROSSCHECK with the NetBackup media catalog works 100% reliably.



We also had serious performance problems because we had the images
filesystem on the same relatively slow array where we also had 10TB of DSSU.
Once we separated those onto complete different fibre cards and arrays
things helped a bunch.

One more thing is we were using a bladestore from STK, and they actual
downrev'd the firmware on it, which caused a massive slowdown (the drives
were spinning to fast, which meant more failures).

Probably nothing to help you but there it is.  Good luck!

Greg



-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Hampus Lind
Sent: Wednesday, February 14, 2007 3:26 PM
To: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...

And this is the last mail I have a problem, and we are not
communicating.. So then he turns over the case to some one else...



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-


Hampus, it's clear we are not communicating.  I've spent a lot of time on
your case and am not getting anywhere.  I'll redispatch this case and
someone else will co

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread WEAVER, Simon


Did you get the problem sorted out, or dealt with by another Symantec
Engineer?

Regards

Simon Weaver
3rd Line Technical Support
Windows Domain Administrator

EADS Astrium Limited, B23AA IM (DCS)
Anchorage Road, Portsmouth, PO3 5PU

Email: [EMAIL PROTECTED]



-Original Message-
From: Hampus Lind [mailto:[EMAIL PROTECTED]
Sent: 14 February 2007 23:01
To: 'Geyer, Gregory'
Cc: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...


Thanks Greg,

I will check the oracle scripts...

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Geyer, Gregory [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 23:57
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...

Hampus,

We had a serious issue with the RMAN backups which would cause each
individual RMAN stream to traverse the entire NB catalog for that client.
They were using an incorrect format, with a 'T' at the beginnig rather than
the end.  See the text below, from an email summary from the DBA after it
was over.

The proper format was in the Oracle NBU Admin guide all along: run {
allocate channel t1 type 'sbt_tape'; allocate channel t2 type 'sbt_tape';
send 'NB_ORA_POLICY=your_policy, NB_ORA_SERV=your_server'; Chapter 4,
Configuration 105 Configuring the Run-Time Environment backup (database
format 'bk_%U_%t'); }

=
The issue of the NetBackup Oracle Client returning 'AVAILABLE' for tape
media known to have been recycle has been identified. Symantec Support
believes the problem is in RMAN and I believe the problem is in the
NetBackup Oracle Client.  Whichever is the case, Symantec helped me
determine the issue is related to the 'T' format in the backup file name
formats.

Some of you may recall the NetBackup slow downs in Q4CY05, when GG
discovered that NetBackup has a requirement to use the RMAN 'T' format in
the backup file name as a trailing format. Prior to learning this fact, I
had been using the 'T" format as a leading portion of the file name.
NetBackup uses the 'T' format as a selective date index to the NB image
catalog database. I changed the 'T' format to trailing in the backup file
name and performance returned to normal response times.

The 'T' format came back to haunt me once more when we recently started
purging old data from the RMAN/OBK catalog repository. Either RMAN or
NetBackup never talks to the NB image database when it encounters an RMAN
backup file name that doesn't contain a trailing 'T' format. This is either
a NB server administration setting or a bug in the NB Oracle Client.
Whatever the case is, the workaround is to manually purge out all OBK data
with non-trailing 'T' file name formats. When this is done and only trailing
'T' formatted RMAN backup file names remain in the OBK catalog, then RMAN
CROSSCHECK with the NetBackup media catalog works 100% reliably.


We also had serious performance problems because we had the images
filesystem on the same relatively slow array where we also had 10TB of DSSU.
Once we separated those onto complete different fibre cards and arrays
things helped a bunch.

One more thing is we were using a bladestore from STK, and they actual
downrev'd the firmware on it, which caused a massive slowdown (the drives
were spinning to fast, which meant more failures).

Probably nothing to help you but there it is.  Good luck!

Greg



-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Hampus Lind
Sent: Wednesday, February 14, 2007 3:26 PM
To: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...

And this is the last mail I have a problem, and we are not
communicating.. So then he turns over the case to some one else...



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-

Hampus, it's clear we are not communicating.  I've spent a lot of time on
your case and am not getting anywhere.  I'll redispatch this case and
someone else will continue to work it.

I am sorry I was not able to help you here.  It's never my intention to
mislead people or give them bad information.  But if I can't get my message
across, there's nothing further I can do.

Have a nice day.

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

This email (including any attachments) may contain confidential and/or 
privileged information or information otherwise protected from disclosure.
If you are not the intended recipient, please notify the sender imme

Re: [Veritas-bu] Using Windows SMTP to send email notifications

2007-02-14 Thread WEAVER, Simon


We use BLAT too !
 
 

Regards

Simon Weaver
3rd Line Technical Support
Windows Domain Administrator 

EADS Astrium Limited, B23AA IM (DCS)
Anchorage Road, Portsmouth, PO3 5PU

Email:   [EMAIL PROTECTED]

-Original Message-
From: Dave Brown [mailto:[EMAIL PROTECTED] 
Sent: 12 February 2007 20:52
To: Koster, Phil; NB List Mail
Subject: Re: [Veritas-bu] Using Windows SMTP to send email notifications


Yes,  but that only states that the nbmail.cmd in bin directory may need to
be configured.  When looking at that script,  it only refers to using BLAT.
No info on SMTP

  _  

From: Koster, Phil [mailto:[EMAIL PROTECTED] 
Sent: Monday, February 12, 2007 2:50 PM
To: Dave Brown; NB List Mail
Subject: RE: [Veritas-bu] Using Windows SMTP to send email notifications


Veritas/Syamtenc uses the technical term "e-mail" instead of SMTP.  Check
your admin guide vol 1 pg 434.
 

Phil Koster
Network Administrator
City of Grand Rapids, MI
Direct: 456-3136
Helpdesk: 456-3999

  _  

From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Dave Brown
Sent: Monday, February 12, 2007 3:38 PM
To: NB List Mail
Subject: [Veritas-bu] Using Windows SMTP to send email notifications


NetBackup 6.0 MP4 on Windows 2003
 
Anyone have documentation or point me to the docs on how to set this up ?
Everything I see talks about using BLAT or some other 3rd party app,  but
why install 3rd party when SMTP is there ?
 
Thanks
 
Dave Brown
Worknetinc
 
 
This message (including any attachments) is intended for the sole use of the
individual to whom it is addressed and may contain confidential information.
You are hereby notified that any dissemination, distribution, or duplication
of this message by someone other than the intended addressee or their
designated agent is strictly prohibited. Information included in this
message that does not relate to the specified business of Worknet shall be
understood as neither given by nor endorsed by Worknet or its employees.
Any cost estimates or estimated quotes included in this message are
considered non-binding estimates only and must not be considered final costs
unless contained within an official proposal document. 



This email (including any attachments) may contain confidential and/or 
privileged information or information otherwise protected from disclosure.
If you are not the intended recipient, please notify the sender immediately, do 
not copy this message or any attachments and do not use it for any purpose or 
disclose its content to any person, but delete this message and any attachments 
from your system.
Astrium disclaims any and all liability if this email transmission was virus 
corrupted, altered or falsified.
-
Astrium Limited, Registered in England and Wales No. 2449259
Registered Office: Gunnels Wood Road, Stevenage, Hertfordshire, SG1 2AS, England___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] VSP on windows Clients

2007-02-14 Thread David Rock

* Justin Piszcz <[EMAIL PROTECTED]> [2007-02-14 15:15]:
> Yes, you click master server properties -> add the windows client to the 
> 'client settings part' and then you can turn vsp off in the second tab.

The CLI version of this is bpclient.  You will want to set the
WOFB_enable to no (0).

-- 
David Rock
[EMAIL PROTECTED]
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] FW: BPRECOVER

2007-02-14 Thread Ed Wilts

On 2/14/2007 2:15 PM, James Soliday wrote:
> So I am trying to recover a catalog from a Solaris Master server to a 
> Windows box that will become the master once I get everything moved 
> over.  

This isn't going to work.  Don't even try.  You can not migrate a master 
server from Solaris to Windows (or the other way around).

.../Ed

-- 
Ed Wilts, Mounds View, MN, USA
mailto:[EMAIL PROTECTED]
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

Thanks Greg,

I will check the oracle scripts...

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Geyer, Gregory [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 23:57
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...

Hampus,

We had a serious issue with the RMAN backups which would cause each
individual RMAN stream to traverse the entire NB catalog for that
client.  They were using an incorrect format, with a 'T' at the beginnig
rather than the end.  See the text below, from an email summary from the
DBA after it was over.

The proper format was in the Oracle NBU Admin guide all along:
run {
allocate channel t1 type 'sbt_tape';
allocate channel t2 type 'sbt_tape';
send 'NB_ORA_POLICY=your_policy, NB_ORA_SERV=your_server';
Chapter 4, Configuration 105
Configuring the Run-Time Environment
backup
(database format 'bk_%U_%t');
}

=
The issue of the NetBackup Oracle Client returning 'AVAILABLE' for tape
media known to have been recycle has been identified. Symantec Support
believes the problem is in RMAN and I believe the problem is in the
NetBackup Oracle Client.  Whichever is the case, Symantec helped me
determine the issue is related to the 'T' format in the backup file name
formats. 

Some of you may recall the NetBackup slow downs in Q4CY05, when GG
discovered that NetBackup has a requirement to use the RMAN 'T' format
in the backup file name as a trailing format. Prior to learning this
fact, I had been using the 'T" format as a leading portion of the file
name. NetBackup uses the 'T' format as a selective date index to the NB
image catalog database. I changed the 'T' format to trailing in the
backup file name and performance returned to normal response times.

The 'T' format came back to haunt me once more when we recently started
purging old data from the RMAN/OBK catalog repository. Either RMAN or
NetBackup never talks to the NB image database when it encounters an
RMAN backup file name that doesn't contain a trailing 'T' format. This
is either a NB server administration setting or a bug in the NB Oracle
Client. Whatever the case is, the workaround is to manually purge out
all OBK data with non-trailing 'T' file name formats. When this is done
and only trailing 'T' formatted RMAN backup file names remain in the OBK
catalog, then RMAN CROSSCHECK with the NetBackup media catalog works
100% reliably. 


We also had serious performance problems because we had the images
filesystem on the same relatively slow array where we also had 10TB of
DSSU.  Once we separated those onto complete different fibre cards and
arrays things helped a bunch.

One more thing is we were using a bladestore from STK, and they actual
downrev'd the firmware on it, which caused a massive slowdown (the
drives were spinning to fast, which meant more failures).

Probably nothing to help you but there it is.  Good luck!

Greg



-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Hampus
Lind
Sent: Wednesday, February 14, 2007 3:26 PM
To: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...

And this is the last mail I have a problem, and we are not
communicating.. So then he turns over the case to some one else...



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
 
Hampus, it's clear we are not communicating.  I've spent a lot of time
on
your case and am not getting anywhere.  I'll redispatch this case and
someone else will continue to work it.

I am sorry I was not able to help you here.  It's never my intention to
mislead people or give them bad information.  But if I can't get my
message
across, there's nothing further I can do.

Have a nice day.

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Preston, Douglas L

 How much memory is in your master server,  is the swap area used growing?  


Doug Preston
Systems Engineer
Land America Tax and Flood Services
Phone 626-339-5221 Ext 104
Email  [EMAIL PROTECTED]



NOTICE: This electronic mail transmission may constitute a communication that 
is legally privileged. It is not intended for transmission to, or receipt by, 
any unauthorized persons. If you have received this electronic mail 
transmission in error, please delete it from your system without copying it, 
and notify the sender by reply e-mail, so that our address record can be 
corrected.



-Original Message-
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Hampus Lind
Sent: Wednesday, February 14, 2007 2:25 PM
To: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...

This is the help I am getting from Symantec... hang tight, next mail is soon to 
arrive...


Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
 
> You haven't really answered anything, just talked about how things 
> should work when everything is OK.


That's just it; NetBackup is not doing anything abnormal here (a.k.a. it's 
operating as designed given the environment it's running in).  There's nothing 
we can do at the software level to "fix" performance bottlenecks at the 
filesystem level; it'll operate as quickly as the system calls allow it to.  
Every problem you brought up can be traced back to this one core issue.

Think of it this way:  if you fill your gas tank with the wrong type of petrol 
and as a result the vehicle starts sputtering, when you bring it to the 
mechanic, they'll make the assessment that the engine is working as well as it 
can given the circumstances.  The problem is the petrol, not the engine.

> 1. I could have a problem with my db, but if the bpdbm -consistency 2
check
> wont finish who can I tell? If the bpdbm -consistency 2 check hangs, 
> again how can I tell whats wrong?

Like I said previously, bpdbm -consistency is the tool... we don't have 
"alternate" tools or anything like that (what's the point in re-inventing the 
wheel?).  You only other option is to manually check each and every image for 
oddities.  And even then there's no guarantee you'll spot the corruption if it 
exists because over half of your images files are going to be in binary format, 
which is impossible to examine using your eyeballs.

> 2. Maybe I haven?t been clear with my problem. The bpdbm processes 
> don?t
go
> away, they are always there and are always working with something... 
> So
how
> can I move on?

I didn't find any evidence that bpdbm was caught in an infinite loop.  All 
PID's are making progress with their respective tasks, albiet slow progress.
I even checked to make sure the bpdbm's weren't stepping on each other's feet.  
They're all doing seperate tasks independently of each other, and no process 
was performing a redundant task that another bpdbm was processing.
All evidnce points to file-read operations taking a lot of time to complete, 
and that's a problem that can be fixed by an application.

Let's say for the sake of argument we could change NetBackup's behavior so that 
it doesn't spawn so many processes at once (which isn't actually possible, but 
let's just assume for a second).  Will that solve the problem?
No.  It will still have to perform the same number of operations because it 
still has to go through the same data set as in the present situation.  In 
fact, the process might be made *worse* not better, because the entire 
operation would in fact take longer.

Disabling it entirely is not possible under NetBackup without shutting down 
bpdbm entirely (and it would be a bad idea anyways as the images cleanup 
process is vital for the application to function), which means of course then 
just about nothing would work under NetBackup.  You will get no backups, and 
defintely no restores.

So in summary, you have to wait until it finishes on its own.  If the process 
takes more than 12 hours to complete, that means you're really stuck.  
Absolutely nothing can be done at the software level until something is done 
with the images database or the filesystem it resides on is fixed.

> 4. Our db is about 60-65 GB, there are netbackup customers with much
bigger
> nbu databases. And this should by a enterprise solution and therefore 
> be able to handle this payload.

Not many customers have as many individual images.  Keep in mind here that 
there's more to this than "how much data am I backing up".  If the bulk of your 
backups are Oracle RMAN, then the number of inodes in your environment 
increases dramaticly.  I can almost always tell the difference between RMAN 
b

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

This is the help I am getting from Symantec... hang tight, next mail is soon
to arrive...


Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
 
> You haven't really answered anything, just talked about how things should
> work when everything is OK.


That's just it; NetBackup is not doing anything abnormal here (a.k.a. it's
operating as designed given the environment it's running in).  There's
nothing we can do at the software level to "fix" performance bottlenecks at
the filesystem level; it'll operate as quickly as the system calls allow it
to.  Every problem you brought up can be traced back to this one core issue.

Think of it this way:  if you fill your gas tank with the wrong type of
petrol and as a result the vehicle starts sputtering, when you bring it to
the mechanic, they'll make the assessment that the engine is working as well
as it can given the circumstances.  The problem is the petrol, not the
engine.

> 1. I could have a problem with my db, but if the bpdbm -consistency 2
check
> wont finish who can I tell? If the bpdbm -consistency 2 check hangs, again
> how can I tell whats wrong?

Like I said previously, bpdbm -consistency is the tool... we don't have
"alternate" tools or anything like that (what's the point in re-inventing
the wheel?).  You only other option is to manually check each and every
image for oddities.  And even then there's no guarantee you'll spot the
corruption if it exists because over half of your images files are going to
be in binary format, which is impossible to examine using your eyeballs.

> 2. Maybe I haven?t been clear with my problem. The bpdbm processes don?t
go
> away, they are always there and are always working with something... So
how
> can I move on?

I didn't find any evidence that bpdbm was caught in an infinite loop.  All
PID's are making progress with their respective tasks, albiet slow progress.
I even checked to make sure the bpdbm's weren't stepping on each other's
feet.  They're all doing seperate tasks independently of each other, and no
process was performing a redundant task that another bpdbm was processing.
All evidnce points to file-read operations taking a lot of time to complete,
and that's a problem that can be fixed by an application.

Let's say for the sake of argument we could change NetBackup's behavior so
that it doesn't spawn so many processes at once (which isn't actually
possible, but let's just assume for a second).  Will that solve the problem?
No.  It will still have to perform the same number of operations because it
still has to go through the same data set as in the present situation.  In
fact, the process might be made *worse* not better, because the entire
operation would in fact take longer.

Disabling it entirely is not possible under NetBackup without shutting down
bpdbm entirely (and it would be a bad idea anyways as the images cleanup
process is vital for the application to function), which means of course
then just about nothing would work under NetBackup.  You will get no
backups, and defintely no restores.

So in summary, you have to wait until it finishes on its own.  If the
process takes more than 12 hours to complete, that means you're really
stuck.  Absolutely nothing can be done at the software level until something
is done with the images database or the filesystem it resides on is fixed.

> 4. Our db is about 60-65 GB, there are netbackup customers with much
bigger
> nbu databases. And this should by a enterprise solution and therefore be
> able to handle this payload.

Not many customers have as many individual images.  Keep in mind here that
there's more to this than "how much data am I backing up".  If the bulk of
your backups are Oracle RMAN, then the number of inodes in your environment
increases dramaticly.  I can almost always tell the difference between RMAN
backups and regular backups when looking at the images database just by
looking at the number of streams being generated at one go.  The difference
is not insignificant.

Since images databases are unique to each and every customer (no two images
databases are the same in a production environment), I can't give you the
cookie-cutter solution that I am certain you would like to have.  These
sorts of things have to be analyzed in a case-by-case basis, and even
Enterprise solutions are limited by the environment they are running in.
You could own the nicest, most expensive BMW in the world, but if you don't
have a road to drive it on, it probably won't work as well as you'd like.

> 5. I have followed HP´s suggestings:
> - I have patched the OS

Recently?

> - I have run defrag on that filesystem

That's not a bad idea, but that usually has a minimal effect with modern-day
UNIX operating systems, including HP, because the filesystem driver does
that on the fly during normal operation anyways.

> - I have increased scsi_queue

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

And this is the last mail I have a problem, and we are not
communicating.. So then he turns over the case to some one else...



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
 
Hampus, it's clear we are not communicating.  I've spent a lot of time on
your case and am not getting anywhere.  I'll redispatch this case and
someone else will continue to work it.

I am sorry I was not able to help you here.  It's never my intention to
mislead people or give them bad information.  But if I can't get my message
across, there's nothing further I can do.

Have a nice day.

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Justin Piszcz

Even more strange, with 6.0 I may expect something like this but 5.1 MP4 
for us has been rock solid.. HMm...


On Wed, 14 Feb 2007, Hampus Lind wrote:


5.1 MP4



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 23:11
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: SV: SV: SV: [Veritas-bu] Serious master issue...

Also are you using 5.x or 6.0?

On Wed, 14 Feb 2007, Hampus Lind wrote:


I will try that tomorrow. But I dont think the problem reside there..

Iostat and sar dont show any strange values.. sar -d 1 10 report under

50%

average usage.

But, still I will try with the fastest FC array/disk we have...


Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 23:05
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: SV: SV: [Veritas-bu] Serious master issue...

Is it possible for you to move the db/images volume to another set of
disks/raid array?

then ln -s /other/location/db/images /usr/openv/netbackup/db/images

That would rule out your array/FC.

On Wed, 14 Feb 2007, Hampus Lind wrote:


Because of the heavy IO produced by all my bpdbm processes there are now

way

that i can find anything in those logs...

But support has got the all and says everything seems normal.. So what

can

I

do.. ? I am helpless...

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 23:01
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: SV: [Veritas-bu] Serious master issue...

With VERBOSE = 5

cd /usr/openv/netbackup/logs
tail -f */*date_of_today*

Do you see anything weird relating to memory or corruption?


On Wed, 14 Feb 2007, Hampus Lind wrote:


I can't tell I think it has been there for a while and got worse

with

time..



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 22:58
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: [Veritas-bu] Serious master issue...

When did this problem happen? Out of the blue or after a patch?

On Wed, 14 Feb 2007, Hampus Lind wrote:


I have run a couple of tests... And it seems that if a want any info at

all

from bpdbm -consistensy 2 I have to shutdown netbackup and then run the
check when everything is down.

Even then it takes forever.. Sometime it gets further then other...


Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 22:47
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: [Veritas-bu] Serious master issue...

Another option is turn off backups, move the old images out of the way

one

by one and find what is causing the consistency to choke, does it stop

on

one set of images or does it run through them all but just very slowly?

On Wed, 14 Feb 2007, Hampus Lind wrote:


The NBCC doesnt look at the image db, and they keep saying we have a
problem there.. But I dont know how we can fix it or even collect the

info

from the db when bpdbm consistensy 2 wont runt..



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Steven L. Sesar [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:53
Till: Hampus Lind
Kopia: 'Justin Piszcz'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...



bpdbm -consistency 2 is useless to you, based on the amount of data

that

you

back up nightly and my own presumption of how long backups run in your
environment. It will take longer to run than your backup domain will

remain

idle. If I recall, they have a process which does a better job at

finding

catalog/db corruption/inconsistency. I think that it's called NBCC.

The problem with NBCC is similar, though. You send them the output of

three

commands:

vmquery -a, bpmedia

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

5.1 MP4



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 23:11
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: SV: SV: SV: [Veritas-bu] Serious master issue...

Also are you using 5.x or 6.0?

On Wed, 14 Feb 2007, Hampus Lind wrote:

> I will try that tomorrow. But I dont think the problem reside there..
>
> Iostat and sar dont show any strange values.. sar -d 1 10 report under
50%
> average usage.
>
> But, still I will try with the fastest FC array/disk we have...
>
>
> Hampus Lind
> Rikspolisstyrelsen
> National Police Board
> Tel dir: +46 (0)8 - 401 99 43
> Tel mob: +46 (0)70 - 217 92 66
> E-mail: [EMAIL PROTECTED]
>
>
> -Ursprungligt meddelande-
> Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
> Skickat: den 14 februari 2007 23:05
> Till: Hampus Lind
> Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
> Veritas-bu@mailman.eng.auburn.edu
> Ämne: Re: SV: SV: SV: SV: [Veritas-bu] Serious master issue...
>
> Is it possible for you to move the db/images volume to another set of
> disks/raid array?
>
> then ln -s /other/location/db/images /usr/openv/netbackup/db/images
>
> That would rule out your array/FC.
>
> On Wed, 14 Feb 2007, Hampus Lind wrote:
>
>> Because of the heavy IO produced by all my bpdbm processes there are now
> way
>> that i can find anything in those logs...
>>
>> But support has got the all and says everything seems normal.. So what
can
> I
>> do.. ? I am helpless...
>>
>> Hampus Lind
>> Rikspolisstyrelsen
>> National Police Board
>> Tel dir: +46 (0)8 - 401 99 43
>> Tel mob: +46 (0)70 - 217 92 66
>> E-mail: [EMAIL PROTECTED]
>>
>>
>> -Ursprungligt meddelande-
>> Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
>> Skickat: den 14 februari 2007 23:01
>> Till: Hampus Lind
>> Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
>> Veritas-bu@mailman.eng.auburn.edu
>> Ämne: Re: SV: SV: SV: [Veritas-bu] Serious master issue...
>>
>> With VERBOSE = 5
>>
>> cd /usr/openv/netbackup/logs
>> tail -f */*date_of_today*
>>
>> Do you see anything weird relating to memory or corruption?
>>
>>
>> On Wed, 14 Feb 2007, Hampus Lind wrote:
>>
>>> I can't tell I think it has been there for a while and got worse
with
>>> time..
>>>
>>>
>>>
>>> Hampus Lind
>>> Rikspolisstyrelsen
>>> National Police Board
>>> Tel dir: +46 (0)8 - 401 99 43
>>> Tel mob: +46 (0)70 - 217 92 66
>>> E-mail: [EMAIL PROTECTED]
>>>
>>>
>>> -Ursprungligt meddelande-
>>> Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
>>> Skickat: den 14 februari 2007 22:58
>>> Till: Hampus Lind
>>> Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
>>> Veritas-bu@mailman.eng.auburn.edu
>>> Ämne: Re: SV: SV: [Veritas-bu] Serious master issue...
>>>
>>> When did this problem happen? Out of the blue or after a patch?
>>>
>>> On Wed, 14 Feb 2007, Hampus Lind wrote:
>>>
 I have run a couple of tests... And it seems that if a want any info at
>>> all
 from bpdbm -consistensy 2 I have to shutdown netbackup and then run the
 check when everything is down.

 Even then it takes forever.. Sometime it gets further then other...


 Hampus Lind
 Rikspolisstyrelsen
 National Police Board
 Tel dir: +46 (0)8 - 401 99 43
 Tel mob: +46 (0)70 - 217 92 66
 E-mail: [EMAIL PROTECTED]


 -Ursprungligt meddelande-
 Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
 Skickat: den 14 februari 2007 22:47
 Till: Hampus Lind
 Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
 Veritas-bu@mailman.eng.auburn.edu
 Ämne: Re: SV: [Veritas-bu] Serious master issue...

 Another option is turn off backups, move the old images out of the way
>> one
 by one and find what is causing the consistency to choke, does it stop
> on
 one set of images or does it run through them all but just very slowly?

 On Wed, 14 Feb 2007, Hampus Lind wrote:

> The NBCC doesnt look at the image db, and they keep saying we have a
> problem there.. But I dont know how we can fix it or even collect the
 info
> from the db when bpdbm consistensy 2 wont runt..
>
>
>
> Hampus Lind
> Rikspolisstyrelsen
> National Police Board
> Tel dir: +46 (0)8 - 401 99 43
> Tel mob: +46 (0)70 - 217 92 66
> E-mail: [EMAIL PROTECTED]
>
> -Ursprungligt meddelande-
> Från: Steven L. Sesar [mailto:[EMAIL PROTECTED]
> Skickat: den 14 februari 2007 20:53
> Till: Hampus Lind
> Kopia: 'Justin Piszcz'; 'Bahnmiller, Bryan';
> Veritas-bu@mailman.eng.auburn.edu
> Ämne: Re: [Veritas-bu] Serious master issue...
>
>
>
> bpdbm -consistency 2 is useless to you, based on the amount of data
> that
 you
> back up nightly and my own presumption of

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Justin Piszcz


Also are you using 5.x or 6.0?

On Wed, 14 Feb 2007, Hampus Lind wrote:


I will try that tomorrow. But I dont think the problem reside there..

Iostat and sar dont show any strange values.. sar -d 1 10 report under 50%
average usage.

But, still I will try with the fastest FC array/disk we have...


Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 23:05
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: SV: SV: [Veritas-bu] Serious master issue...

Is it possible for you to move the db/images volume to another set of
disks/raid array?

then ln -s /other/location/db/images /usr/openv/netbackup/db/images

That would rule out your array/FC.

On Wed, 14 Feb 2007, Hampus Lind wrote:


Because of the heavy IO produced by all my bpdbm processes there are now

way

that i can find anything in those logs...

But support has got the all and says everything seems normal.. So what can

I

do.. ? I am helpless...

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 23:01
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: SV: [Veritas-bu] Serious master issue...

With VERBOSE = 5

cd /usr/openv/netbackup/logs
tail -f */*date_of_today*

Do you see anything weird relating to memory or corruption?


On Wed, 14 Feb 2007, Hampus Lind wrote:


I can't tell I think it has been there for a while and got worse with
time..



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 22:58
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: [Veritas-bu] Serious master issue...

When did this problem happen? Out of the blue or after a patch?

On Wed, 14 Feb 2007, Hampus Lind wrote:


I have run a couple of tests... And it seems that if a want any info at

all

from bpdbm -consistensy 2 I have to shutdown netbackup and then run the
check when everything is down.

Even then it takes forever.. Sometime it gets further then other...


Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 22:47
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: [Veritas-bu] Serious master issue...

Another option is turn off backups, move the old images out of the way

one

by one and find what is causing the consistency to choke, does it stop

on

one set of images or does it run through them all but just very slowly?

On Wed, 14 Feb 2007, Hampus Lind wrote:


The NBCC doesnt look at the image db, and they keep saying we have a
problem there.. But I dont know how we can fix it or even collect the

info

from the db when bpdbm consistensy 2 wont runt..



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Steven L. Sesar [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:53
Till: Hampus Lind
Kopia: 'Justin Piszcz'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...



bpdbm -consistency 2 is useless to you, based on the amount of data

that

you

back up nightly and my own presumption of how long backups run in your
environment. It will take longer to run than your backup domain will

remain

idle. If I recall, they have a process which does a better job at

finding

catalog/db corruption/inconsistency. I think that it's called NBCC.

The problem with NBCC is similar, though. You send them the output of

three

commands:

vmquery -a, bpmedialist -ls, and bpimmedia

Then, they munge the output of the above commands through a reporting

tool

that Symantec will NOT share with end users. At some point later in the

day

(hopefully, sooner rather than later), they will send you a report. You

must

then take certain actions to correct any discrepancies found. The

backup

system must be completely idle during this time. Restores are ok, but

no

backup activity can be taking place.

Afterwards, you 'll run those commands again, they'll generate the

report

again, and you'll see how you're doing. It may take you several passes

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

I will try that tomorrow. But I dont think the problem reside there..

Iostat and sar dont show any strange values.. sar -d 1 10 report under 50%
average usage.

But, still I will try with the fastest FC array/disk we have... 


Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 23:05
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: SV: SV: [Veritas-bu] Serious master issue...

Is it possible for you to move the db/images volume to another set of 
disks/raid array?

then ln -s /other/location/db/images /usr/openv/netbackup/db/images

That would rule out your array/FC.

On Wed, 14 Feb 2007, Hampus Lind wrote:

> Because of the heavy IO produced by all my bpdbm processes there are now
way
> that i can find anything in those logs...
>
> But support has got the all and says everything seems normal.. So what can
I
> do.. ? I am helpless...
>
> Hampus Lind
> Rikspolisstyrelsen
> National Police Board
> Tel dir: +46 (0)8 - 401 99 43
> Tel mob: +46 (0)70 - 217 92 66
> E-mail: [EMAIL PROTECTED]
>
>
> -Ursprungligt meddelande-
> Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
> Skickat: den 14 februari 2007 23:01
> Till: Hampus Lind
> Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
> Veritas-bu@mailman.eng.auburn.edu
> Ämne: Re: SV: SV: SV: [Veritas-bu] Serious master issue...
>
> With VERBOSE = 5
>
> cd /usr/openv/netbackup/logs
> tail -f */*date_of_today*
>
> Do you see anything weird relating to memory or corruption?
>
>
> On Wed, 14 Feb 2007, Hampus Lind wrote:
>
>> I can't tell I think it has been there for a while and got worse with
>> time..
>>
>>
>>
>> Hampus Lind
>> Rikspolisstyrelsen
>> National Police Board
>> Tel dir: +46 (0)8 - 401 99 43
>> Tel mob: +46 (0)70 - 217 92 66
>> E-mail: [EMAIL PROTECTED]
>>
>>
>> -Ursprungligt meddelande-
>> Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
>> Skickat: den 14 februari 2007 22:58
>> Till: Hampus Lind
>> Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
>> Veritas-bu@mailman.eng.auburn.edu
>> Ämne: Re: SV: SV: [Veritas-bu] Serious master issue...
>>
>> When did this problem happen? Out of the blue or after a patch?
>>
>> On Wed, 14 Feb 2007, Hampus Lind wrote:
>>
>>> I have run a couple of tests... And it seems that if a want any info at
>> all
>>> from bpdbm -consistensy 2 I have to shutdown netbackup and then run the
>>> check when everything is down.
>>>
>>> Even then it takes forever.. Sometime it gets further then other...
>>>
>>>
>>> Hampus Lind
>>> Rikspolisstyrelsen
>>> National Police Board
>>> Tel dir: +46 (0)8 - 401 99 43
>>> Tel mob: +46 (0)70 - 217 92 66
>>> E-mail: [EMAIL PROTECTED]
>>>
>>>
>>> -Ursprungligt meddelande-
>>> Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
>>> Skickat: den 14 februari 2007 22:47
>>> Till: Hampus Lind
>>> Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
>>> Veritas-bu@mailman.eng.auburn.edu
>>> Ämne: Re: SV: [Veritas-bu] Serious master issue...
>>>
>>> Another option is turn off backups, move the old images out of the way
> one
>>> by one and find what is causing the consistency to choke, does it stop
on
>>> one set of images or does it run through them all but just very slowly?
>>>
>>> On Wed, 14 Feb 2007, Hampus Lind wrote:
>>>
 The NBCC doesnt look at the image db, and they keep saying we have a
 problem there.. But I dont know how we can fix it or even collect the
>>> info
 from the db when bpdbm consistensy 2 wont runt..



 Hampus Lind
 Rikspolisstyrelsen
 National Police Board
 Tel dir: +46 (0)8 - 401 99 43
 Tel mob: +46 (0)70 - 217 92 66
 E-mail: [EMAIL PROTECTED]

 -Ursprungligt meddelande-
 Från: Steven L. Sesar [mailto:[EMAIL PROTECTED]
 Skickat: den 14 februari 2007 20:53
 Till: Hampus Lind
 Kopia: 'Justin Piszcz'; 'Bahnmiller, Bryan';
 Veritas-bu@mailman.eng.auburn.edu
 Ämne: Re: [Veritas-bu] Serious master issue...



 bpdbm -consistency 2 is useless to you, based on the amount of data
that
>>> you
 back up nightly and my own presumption of how long backups run in your
 environment. It will take longer to run than your backup domain will
>>> remain
 idle. If I recall, they have a process which does a better job at
> finding
 catalog/db corruption/inconsistency. I think that it's called NBCC.

 The problem with NBCC is similar, though. You send them the output of
>>> three
 commands:

 vmquery -a, bpmedialist -ls, and bpimmedia

 Then, they munge the output of the above commands through a reporting
>> tool
 that Symantec will NOT share with end users. At some point later in the
>>> day
 (hopefully, sooner rather than later), they will send you a report. You
>>> must

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Justin Piszcz

Is it possible for you to move the db/images volume to another set of 
disks/raid array?


then ln -s /other/location/db/images /usr/openv/netbackup/db/images

That would rule out your array/FC.

On Wed, 14 Feb 2007, Hampus Lind wrote:


Because of the heavy IO produced by all my bpdbm processes there are now way
that i can find anything in those logs...

But support has got the all and says everything seems normal.. So what can I
do.. ? I am helpless...

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 23:01
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: SV: [Veritas-bu] Serious master issue...

With VERBOSE = 5

cd /usr/openv/netbackup/logs
tail -f */*date_of_today*

Do you see anything weird relating to memory or corruption?


On Wed, 14 Feb 2007, Hampus Lind wrote:


I can't tell I think it has been there for a while and got worse with
time..



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 22:58
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: [Veritas-bu] Serious master issue...

When did this problem happen? Out of the blue or after a patch?

On Wed, 14 Feb 2007, Hampus Lind wrote:


I have run a couple of tests... And it seems that if a want any info at

all

from bpdbm -consistensy 2 I have to shutdown netbackup and then run the
check when everything is down.

Even then it takes forever.. Sometime it gets further then other...


Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 22:47
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: [Veritas-bu] Serious master issue...

Another option is turn off backups, move the old images out of the way

one

by one and find what is causing the consistency to choke, does it stop on
one set of images or does it run through them all but just very slowly?

On Wed, 14 Feb 2007, Hampus Lind wrote:


The NBCC doesnt look at the image db, and they keep saying we have a
problem there.. But I dont know how we can fix it or even collect the

info

from the db when bpdbm consistensy 2 wont runt..



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Steven L. Sesar [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:53
Till: Hampus Lind
Kopia: 'Justin Piszcz'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...



bpdbm -consistency 2 is useless to you, based on the amount of data that

you

back up nightly and my own presumption of how long backups run in your
environment. It will take longer to run than your backup domain will

remain

idle. If I recall, they have a process which does a better job at

finding

catalog/db corruption/inconsistency. I think that it's called NBCC.

The problem with NBCC is similar, though. You send them the output of

three

commands:

vmquery -a, bpmedialist -ls, and bpimmedia

Then, they munge the output of the above commands through a reporting

tool

that Symantec will NOT share with end users. At some point later in the

day

(hopefully, sooner rather than later), they will send you a report. You

must

then take certain actions to correct any discrepancies found. The backup
system must be completely idle during this time. Restores are ok, but no
backup activity can be taking place.

Afterwards, you 'll run those commands again, they'll generate the

report

again, and you'll see how you're doing. It may take you several passes

to

get things squared away.

The problem is that most of us don't have a completely idle backup
infrastructure - at least for long enough for this process to complete.

I

didn't when I was NBU customer. Once you take backups, the reports

become

obsolete, as do the results of bpdbm -consistency 2.

It would not surprise me if bpdbm was leaking memory on your platform.

--Steve


Hampus Lind wrote:

Hi,

I cant don anything

Bpdbm -consistecny 2 has been running for over 12 hours and havent

checked

more than 4-5 clients.

It was the first thing support told me. Your db is corrupted... So I

tried

to run bpdbm -consistency 2 check. The check found some issues, like

expired

images which where not removed etc. But wh

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

Because of the heavy IO produced by all my bpdbm processes there are now way
that i can find anything in those logs...

But support has got the all and says everything seems normal.. So what can I
do.. ? I am helpless...

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 23:01
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: SV: [Veritas-bu] Serious master issue...

With VERBOSE = 5

cd /usr/openv/netbackup/logs
tail -f */*date_of_today*

Do you see anything weird relating to memory or corruption?


On Wed, 14 Feb 2007, Hampus Lind wrote:

> I can't tell I think it has been there for a while and got worse with
> time..
>
>
>
> Hampus Lind
> Rikspolisstyrelsen
> National Police Board
> Tel dir: +46 (0)8 - 401 99 43
> Tel mob: +46 (0)70 - 217 92 66
> E-mail: [EMAIL PROTECTED]
>
>
> -Ursprungligt meddelande-
> Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
> Skickat: den 14 februari 2007 22:58
> Till: Hampus Lind
> Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
> Veritas-bu@mailman.eng.auburn.edu
> Ämne: Re: SV: SV: [Veritas-bu] Serious master issue...
>
> When did this problem happen? Out of the blue or after a patch?
>
> On Wed, 14 Feb 2007, Hampus Lind wrote:
>
>> I have run a couple of tests... And it seems that if a want any info at
> all
>> from bpdbm -consistensy 2 I have to shutdown netbackup and then run the
>> check when everything is down.
>>
>> Even then it takes forever.. Sometime it gets further then other...
>>
>>
>> Hampus Lind
>> Rikspolisstyrelsen
>> National Police Board
>> Tel dir: +46 (0)8 - 401 99 43
>> Tel mob: +46 (0)70 - 217 92 66
>> E-mail: [EMAIL PROTECTED]
>>
>>
>> -Ursprungligt meddelande-
>> Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
>> Skickat: den 14 februari 2007 22:47
>> Till: Hampus Lind
>> Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
>> Veritas-bu@mailman.eng.auburn.edu
>> Ämne: Re: SV: [Veritas-bu] Serious master issue...
>>
>> Another option is turn off backups, move the old images out of the way
one
>> by one and find what is causing the consistency to choke, does it stop on
>> one set of images or does it run through them all but just very slowly?
>>
>> On Wed, 14 Feb 2007, Hampus Lind wrote:
>>
>>> The NBCC doesnt look at the image db, and they keep saying we have a
>>> problem there.. But I dont know how we can fix it or even collect the
>> info
>>> from the db when bpdbm consistensy 2 wont runt..
>>>
>>>
>>>
>>> Hampus Lind
>>> Rikspolisstyrelsen
>>> National Police Board
>>> Tel dir: +46 (0)8 - 401 99 43
>>> Tel mob: +46 (0)70 - 217 92 66
>>> E-mail: [EMAIL PROTECTED]
>>>
>>> -Ursprungligt meddelande-
>>> Från: Steven L. Sesar [mailto:[EMAIL PROTECTED]
>>> Skickat: den 14 februari 2007 20:53
>>> Till: Hampus Lind
>>> Kopia: 'Justin Piszcz'; 'Bahnmiller, Bryan';
>>> Veritas-bu@mailman.eng.auburn.edu
>>> Ämne: Re: [Veritas-bu] Serious master issue...
>>>
>>>
>>>
>>> bpdbm -consistency 2 is useless to you, based on the amount of data that
>> you
>>> back up nightly and my own presumption of how long backups run in your
>>> environment. It will take longer to run than your backup domain will
>> remain
>>> idle. If I recall, they have a process which does a better job at
finding
>>> catalog/db corruption/inconsistency. I think that it's called NBCC.
>>>
>>> The problem with NBCC is similar, though. You send them the output of
>> three
>>> commands:
>>>
>>> vmquery -a, bpmedialist -ls, and bpimmedia
>>>
>>> Then, they munge the output of the above commands through a reporting
> tool
>>> that Symantec will NOT share with end users. At some point later in the
>> day
>>> (hopefully, sooner rather than later), they will send you a report. You
>> must
>>> then take certain actions to correct any discrepancies found. The backup
>>> system must be completely idle during this time. Restores are ok, but no
>>> backup activity can be taking place.
>>>
>>> Afterwards, you 'll run those commands again, they'll generate the
report
>>> again, and you'll see how you're doing. It may take you several passes
to
>>> get things squared away.
>>>
>>> The problem is that most of us don't have a completely idle backup
>>> infrastructure - at least for long enough for this process to complete.
I
>>> didn't when I was NBU customer. Once you take backups, the reports
become
>>> obsolete, as do the results of bpdbm -consistency 2.
>>>
>>> It would not surprise me if bpdbm was leaking memory on your platform.
>>>
>>> --Steve
>>>
>>>
>>> Hampus Lind wrote:
>>>
>>> Hi,
>>>
>>> I cant don anything
>>>
>>> Bpdbm -consistecny 2 has been running for over 12 hours and havent
> checked
>>> more than 4-5 clients.
>>>
>>> It was the first thing support told me. Your db is corrupted... So I
> tried
>>> to

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

I can't tell I think it has been there for a while and got worse with
time..



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 22:58
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: [Veritas-bu] Serious master issue...

When did this problem happen? Out of the blue or after a patch?

On Wed, 14 Feb 2007, Hampus Lind wrote:

> I have run a couple of tests... And it seems that if a want any info at
all
> from bpdbm -consistensy 2 I have to shutdown netbackup and then run the
> check when everything is down.
>
> Even then it takes forever.. Sometime it gets further then other...
>
>
> Hampus Lind
> Rikspolisstyrelsen
> National Police Board
> Tel dir: +46 (0)8 - 401 99 43
> Tel mob: +46 (0)70 - 217 92 66
> E-mail: [EMAIL PROTECTED]
>
>
> -Ursprungligt meddelande-
> Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
> Skickat: den 14 februari 2007 22:47
> Till: Hampus Lind
> Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
> Veritas-bu@mailman.eng.auburn.edu
> Ämne: Re: SV: [Veritas-bu] Serious master issue...
>
> Another option is turn off backups, move the old images out of the way one
> by one and find what is causing the consistency to choke, does it stop on
> one set of images or does it run through them all but just very slowly?
>
> On Wed, 14 Feb 2007, Hampus Lind wrote:
>
>> The NBCC doesnt look at the image db, and they keep saying we have a
>> problem there.. But I dont know how we can fix it or even collect the
> info
>> from the db when bpdbm consistensy 2 wont runt..
>>
>>
>>
>> Hampus Lind
>> Rikspolisstyrelsen
>> National Police Board
>> Tel dir: +46 (0)8 - 401 99 43
>> Tel mob: +46 (0)70 - 217 92 66
>> E-mail: [EMAIL PROTECTED]
>>
>> -Ursprungligt meddelande-
>> Från: Steven L. Sesar [mailto:[EMAIL PROTECTED]
>> Skickat: den 14 februari 2007 20:53
>> Till: Hampus Lind
>> Kopia: 'Justin Piszcz'; 'Bahnmiller, Bryan';
>> Veritas-bu@mailman.eng.auburn.edu
>> Ämne: Re: [Veritas-bu] Serious master issue...
>>
>>
>>
>> bpdbm -consistency 2 is useless to you, based on the amount of data that
> you
>> back up nightly and my own presumption of how long backups run in your
>> environment. It will take longer to run than your backup domain will
> remain
>> idle. If I recall, they have a process which does a better job at finding
>> catalog/db corruption/inconsistency. I think that it's called NBCC.
>>
>> The problem with NBCC is similar, though. You send them the output of
> three
>> commands:
>>
>> vmquery -a, bpmedialist -ls, and bpimmedia
>>
>> Then, they munge the output of the above commands through a reporting
tool
>> that Symantec will NOT share with end users. At some point later in the
> day
>> (hopefully, sooner rather than later), they will send you a report. You
> must
>> then take certain actions to correct any discrepancies found. The backup
>> system must be completely idle during this time. Restores are ok, but no
>> backup activity can be taking place.
>>
>> Afterwards, you 'll run those commands again, they'll generate the report
>> again, and you'll see how you're doing. It may take you several passes to
>> get things squared away.
>>
>> The problem is that most of us don't have a completely idle backup
>> infrastructure - at least for long enough for this process to complete. I
>> didn't when I was NBU customer. Once you take backups, the reports become
>> obsolete, as do the results of bpdbm -consistency 2.
>>
>> It would not surprise me if bpdbm was leaking memory on your platform.
>>
>> --Steve
>>
>>
>> Hampus Lind wrote:
>>
>> Hi,
>>
>> I cant don anything
>>
>> Bpdbm -consistecny 2 has been running for over 12 hours and havent
checked
>> more than 4-5 clients.
>>
>> It was the first thing support told me. Your db is corrupted... So I
tried
>> to run bpdbm -consistency 2 check. The check found some issues, like
> expired
>> images which where not removed etc. But when I was about to remove them
>> manually the netbackup db clean process already had took care of them..
>>
>> So what I understand you can have some level of corruption in your db
> which
>> nbu cleans out when the clean job runs.
>>
>> I am not compressing my catalogs.
>>
>> Thanks,
>>
>> Hampus Lind
>> Rikspolisstyrelsen
>> National Police Board
>> Tel dir: +46 (0)8 - 401 99 43
>> Tel mob: +46 (0)70 - 217 92 66
>> E-mail: [EMAIL PROTECTED]
>>
>>
>> -Ursprungligt meddelande-
>> Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
>> Skickat: den 14 februari 2007 20:31
>> Till: Hampus Lind
>> Kopia: 'Bahnmiller, Bryan'; Veritas-bu@mailman.eng.auburn.edu
>> Ämne: Re: [Veritas-bu] Serious master issue...
>>
>> Have you run the check_db_consistency? There is a command that checks to
>> make sure your images are not corrupted!
>>
>> I

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Justin Piszcz


With VERBOSE = 5

cd /usr/openv/netbackup/logs
tail -f */*date_of_today*

Do you see anything weird relating to memory or corruption?


On Wed, 14 Feb 2007, Hampus Lind wrote:


I can't tell I think it has been there for a while and got worse with
time..



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 22:58
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: SV: [Veritas-bu] Serious master issue...

When did this problem happen? Out of the blue or after a patch?

On Wed, 14 Feb 2007, Hampus Lind wrote:


I have run a couple of tests... And it seems that if a want any info at

all

from bpdbm -consistensy 2 I have to shutdown netbackup and then run the
check when everything is down.

Even then it takes forever.. Sometime it gets further then other...


Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 22:47
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: [Veritas-bu] Serious master issue...

Another option is turn off backups, move the old images out of the way one
by one and find what is causing the consistency to choke, does it stop on
one set of images or does it run through them all but just very slowly?

On Wed, 14 Feb 2007, Hampus Lind wrote:


The NBCC doesnt look at the image db, and they keep saying we have a
problem there.. But I dont know how we can fix it or even collect the

info

from the db when bpdbm consistensy 2 wont runt..



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Steven L. Sesar [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:53
Till: Hampus Lind
Kopia: 'Justin Piszcz'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...



bpdbm -consistency 2 is useless to you, based on the amount of data that

you

back up nightly and my own presumption of how long backups run in your
environment. It will take longer to run than your backup domain will

remain

idle. If I recall, they have a process which does a better job at finding
catalog/db corruption/inconsistency. I think that it's called NBCC.

The problem with NBCC is similar, though. You send them the output of

three

commands:

vmquery -a, bpmedialist -ls, and bpimmedia

Then, they munge the output of the above commands through a reporting

tool

that Symantec will NOT share with end users. At some point later in the

day

(hopefully, sooner rather than later), they will send you a report. You

must

then take certain actions to correct any discrepancies found. The backup
system must be completely idle during this time. Restores are ok, but no
backup activity can be taking place.

Afterwards, you 'll run those commands again, they'll generate the report
again, and you'll see how you're doing. It may take you several passes to
get things squared away.

The problem is that most of us don't have a completely idle backup
infrastructure - at least for long enough for this process to complete. I
didn't when I was NBU customer. Once you take backups, the reports become
obsolete, as do the results of bpdbm -consistency 2.

It would not surprise me if bpdbm was leaking memory on your platform.

--Steve


Hampus Lind wrote:

Hi,

I cant don anything

Bpdbm -consistecny 2 has been running for over 12 hours and havent

checked

more than 4-5 clients.

It was the first thing support told me. Your db is corrupted... So I

tried

to run bpdbm -consistency 2 check. The check found some issues, like

expired

images which where not removed etc. But when I was about to remove them
manually the netbackup db clean process already had took care of them..

So what I understand you can have some level of corruption in your db

which

nbu cleans out when the clean job runs.

I am not compressing my catalogs.

Thanks,

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:31
Till: Hampus Lind
Kopia: 'Bahnmiller, Bryan'; Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...

Have you run the check_db_consistency? There is a command that checks to
make sure your images are not corrupted!

I would recommend checking that.

Also, are you running compression on your catalogs?


On Wed, 14 Feb 2007, Hampus Lind

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Justin Piszcz


When did this problem happen? Out of the blue or after a patch?

On Wed, 14 Feb 2007, Hampus Lind wrote:


I have run a couple of tests... And it seems that if a want any info at all
from bpdbm -consistensy 2 I have to shutdown netbackup and then run the
check when everything is down.

Even then it takes forever.. Sometime it gets further then other...


Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 22:47
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: [Veritas-bu] Serious master issue...

Another option is turn off backups, move the old images out of the way one
by one and find what is causing the consistency to choke, does it stop on
one set of images or does it run through them all but just very slowly?

On Wed, 14 Feb 2007, Hampus Lind wrote:


The NBCC doesnt look at the image db, and they keep saying we have a
problem there.. But I dont know how we can fix it or even collect the

info

from the db when bpdbm consistensy 2 wont runt..



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Steven L. Sesar [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:53
Till: Hampus Lind
Kopia: 'Justin Piszcz'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...



bpdbm -consistency 2 is useless to you, based on the amount of data that

you

back up nightly and my own presumption of how long backups run in your
environment. It will take longer to run than your backup domain will

remain

idle. If I recall, they have a process which does a better job at finding
catalog/db corruption/inconsistency. I think that it's called NBCC.

The problem with NBCC is similar, though. You send them the output of

three

commands:

vmquery -a, bpmedialist -ls, and bpimmedia

Then, they munge the output of the above commands through a reporting tool
that Symantec will NOT share with end users. At some point later in the

day

(hopefully, sooner rather than later), they will send you a report. You

must

then take certain actions to correct any discrepancies found. The backup
system must be completely idle during this time. Restores are ok, but no
backup activity can be taking place.

Afterwards, you 'll run those commands again, they'll generate the report
again, and you'll see how you're doing. It may take you several passes to
get things squared away.

The problem is that most of us don't have a completely idle backup
infrastructure - at least for long enough for this process to complete. I
didn't when I was NBU customer. Once you take backups, the reports become
obsolete, as do the results of bpdbm -consistency 2.

It would not surprise me if bpdbm was leaking memory on your platform.

--Steve


Hampus Lind wrote:

Hi,

I cant don anything

Bpdbm -consistecny 2 has been running for over 12 hours and havent checked
more than 4-5 clients.

It was the first thing support told me. Your db is corrupted... So I tried
to run bpdbm -consistency 2 check. The check found some issues, like

expired

images which where not removed etc. But when I was about to remove them
manually the netbackup db clean process already had took care of them..

So what I understand you can have some level of corruption in your db

which

nbu cleans out when the clean job runs.

I am not compressing my catalogs.

Thanks,

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:31
Till: Hampus Lind
Kopia: 'Bahnmiller, Bryan'; Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...

Have you run the check_db_consistency? There is a command that checks to
make sure your images are not corrupted!

I would recommend checking that.

Also, are you running compression on your catalogs?


On Wed, 14 Feb 2007, Hampus Lind wrote:



Thanks Bryan,



It happens directly after reboot..



The thing is:

-  I have deactivated all polices

-  Stop our media server

-  And then restarted netbackup on the master.



So there are absolutely no action going on (no backup, no user backup, no
restore, no staging) only internal netbackup work.

At once when netbackup on the master gets active, it starts bpdbm process
after bpdbm process. It consume 100% of both my CPU`s and write/read


heavily


to the /usr/openv/netbackup/db filesystem.

When I have no action at all after a clean start, we have about 42 bpdbm
processes and nearly as many bprd processes



I cant figure this on

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

I have run a couple of tests... And it seems that if a want any info at all
from bpdbm -consistensy 2 I have to shutdown netbackup and then run the
check when everything is down.

Even then it takes forever.. Sometime it gets further then other...


Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 22:47
Till: Hampus Lind
Kopia: 'Steven L. Sesar'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: [Veritas-bu] Serious master issue...

Another option is turn off backups, move the old images out of the way one 
by one and find what is causing the consistency to choke, does it stop on 
one set of images or does it run through them all but just very slowly?

On Wed, 14 Feb 2007, Hampus Lind wrote:

> The NBCC doesnt look at the image db, and they keep saying we have a
> problem there.. But I dont know how we can fix it or even collect the
info
> from the db when bpdbm consistensy 2 wont runt..
>
>
>
> Hampus Lind
> Rikspolisstyrelsen
> National Police Board
> Tel dir: +46 (0)8 - 401 99 43
> Tel mob: +46 (0)70 - 217 92 66
> E-mail: [EMAIL PROTECTED]
>
> -Ursprungligt meddelande-
> Från: Steven L. Sesar [mailto:[EMAIL PROTECTED]
> Skickat: den 14 februari 2007 20:53
> Till: Hampus Lind
> Kopia: 'Justin Piszcz'; 'Bahnmiller, Bryan';
> Veritas-bu@mailman.eng.auburn.edu
> Ämne: Re: [Veritas-bu] Serious master issue...
>
>
>
> bpdbm -consistency 2 is useless to you, based on the amount of data that
you
> back up nightly and my own presumption of how long backups run in your
> environment. It will take longer to run than your backup domain will
remain
> idle. If I recall, they have a process which does a better job at finding
> catalog/db corruption/inconsistency. I think that it's called NBCC.
>
> The problem with NBCC is similar, though. You send them the output of
three
> commands:
>
> vmquery -a, bpmedialist -ls, and bpimmedia
>
> Then, they munge the output of the above commands through a reporting tool
> that Symantec will NOT share with end users. At some point later in the
day
> (hopefully, sooner rather than later), they will send you a report. You
must
> then take certain actions to correct any discrepancies found. The backup
> system must be completely idle during this time. Restores are ok, but no
> backup activity can be taking place.
>
> Afterwards, you 'll run those commands again, they'll generate the report
> again, and you'll see how you're doing. It may take you several passes to
> get things squared away.
>
> The problem is that most of us don't have a completely idle backup
> infrastructure - at least for long enough for this process to complete. I
> didn't when I was NBU customer. Once you take backups, the reports become
> obsolete, as do the results of bpdbm -consistency 2.
>
> It would not surprise me if bpdbm was leaking memory on your platform.
>
> --Steve
>
>
> Hampus Lind wrote:
>
> Hi,
>
> I cant don anything
>
> Bpdbm -consistecny 2 has been running for over 12 hours and havent checked
> more than 4-5 clients.
>
> It was the first thing support told me. Your db is corrupted... So I tried
> to run bpdbm -consistency 2 check. The check found some issues, like
expired
> images which where not removed etc. But when I was about to remove them
> manually the netbackup db clean process already had took care of them..
>
> So what I understand you can have some level of corruption in your db
which
> nbu cleans out when the clean job runs.
>
> I am not compressing my catalogs.
>
> Thanks,
>
> Hampus Lind
> Rikspolisstyrelsen
> National Police Board
> Tel dir: +46 (0)8 - 401 99 43
> Tel mob: +46 (0)70 - 217 92 66
> E-mail: [EMAIL PROTECTED]
>
>
> -Ursprungligt meddelande-
> Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
> Skickat: den 14 februari 2007 20:31
> Till: Hampus Lind
> Kopia: 'Bahnmiller, Bryan'; Veritas-bu@mailman.eng.auburn.edu
> Ämne: Re: [Veritas-bu] Serious master issue...
>
> Have you run the check_db_consistency? There is a command that checks to
> make sure your images are not corrupted!
>
> I would recommend checking that.
>
> Also, are you running compression on your catalogs?
>
>
> On Wed, 14 Feb 2007, Hampus Lind wrote:
>
>
>
> Thanks Bryan,
>
>
>
> It happens directly after reboot..
>
>
>
> The thing is:
>
> -  I have deactivated all polices
>
> -  Stop our media server
>
> -  And then restarted netbackup on the master.
>
>
>
> So there are absolutely no action going on (no backup, no user backup, no
> restore, no staging) only internal netbackup work.
>
> At once when netbackup on the master gets active, it starts bpdbm process
> after bpdbm process. It consume 100% of both my CPU`s and write/read
>
>
> heavily
>
>
> to the /usr/openv/netbackup/db filesystem.
>
> When I have no action at all after a clean start

[Veritas-bu] Fiber Drive Question

2007-02-14 Thread Erik Strom

Each time our vendor comes in and updates the firmware on our 25 tape drives
most of them have to be deleted and re-added to my windows x64 media servers.
The Linux ones don't seem to have this issue. is there a way to lock in the
tape drives so that I don't have to re-scan because of firmware revisions?

Also have problems whenever two or more drives are taken offline at one time.

Quote
We've been running 9940B drives for nearly 3 years now, and I've never
heard of a table of addresses to control access to the drive. I've been
through the menus on the drive and looked through the drive manual and
never saw a reference to such a "feature". Are you having a problem at
this moment? Can you provide more information about your setup and the
problem?

Erik Strom wrote:

Quote:
Has anyone heard about a table of wwn/addresses located inside of a 9940B or
similiar fiber tape drives? I heard a rumor but cannot find any documentation
that said,.

The tape drive has a table of addresses that it will allow read/write access to
the tape drive. There is only 16 slots available for these entries. This means
that in order for a 17th media server to access this drive that it must wait
for one of the existing 16 to drop out of the table. This is suppose to be the
explaination as to why tape drives seem to disappear or become no longer
functional to a media server.

I've heard stranger things but I wanted to see if this is an urban myth or if
someone can supply me with documentation about this. 


 

Now that's room service!  Choose from over 150,000 hotels
in 45,000 destinations on Yahoo! Travel to find your fit.
http://farechase.yahoo.com/promo-generic-14795097
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Justin Piszcz

Another option is turn off backups, move the old images out of the way one 
by one and find what is causing the consistency to choke, does it stop on 
one set of images or does it run through them all but just very slowly?


On Wed, 14 Feb 2007, Hampus Lind wrote:


The NBCC doesnt look at the image db, and they keep saying we have a
problem there.. But I dont know how we can fix it or even collect the info
from the db when bpdbm consistensy 2 wont runt..



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Steven L. Sesar [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:53
Till: Hampus Lind
Kopia: 'Justin Piszcz'; 'Bahnmiller, Bryan';
Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...



bpdbm -consistency 2 is useless to you, based on the amount of data that you
back up nightly and my own presumption of how long backups run in your
environment. It will take longer to run than your backup domain will remain
idle. If I recall, they have a process which does a better job at finding
catalog/db corruption/inconsistency. I think that it's called NBCC.

The problem with NBCC is similar, though. You send them the output of three
commands:

vmquery -a, bpmedialist -ls, and bpimmedia

Then, they munge the output of the above commands through a reporting tool
that Symantec will NOT share with end users. At some point later in the day
(hopefully, sooner rather than later), they will send you a report. You must
then take certain actions to correct any discrepancies found. The backup
system must be completely idle during this time. Restores are ok, but no
backup activity can be taking place.

Afterwards, you 'll run those commands again, they'll generate the report
again, and you'll see how you're doing. It may take you several passes to
get things squared away.

The problem is that most of us don't have a completely idle backup
infrastructure - at least for long enough for this process to complete. I
didn't when I was NBU customer. Once you take backups, the reports become
obsolete, as do the results of bpdbm -consistency 2.

It would not surprise me if bpdbm was leaking memory on your platform.

--Steve


Hampus Lind wrote:

Hi,

I cant don anything

Bpdbm -consistecny 2 has been running for over 12 hours and havent checked
more than 4-5 clients.

It was the first thing support told me. Your db is corrupted... So I tried
to run bpdbm -consistency 2 check. The check found some issues, like expired
images which where not removed etc. But when I was about to remove them
manually the netbackup db clean process already had took care of them..

So what I understand you can have some level of corruption in your db which
nbu cleans out when the clean job runs.

I am not compressing my catalogs.

Thanks,

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:31
Till: Hampus Lind
Kopia: 'Bahnmiller, Bryan'; Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...

Have you run the check_db_consistency? There is a command that checks to
make sure your images are not corrupted!

I would recommend checking that.

Also, are you running compression on your catalogs?


On Wed, 14 Feb 2007, Hampus Lind wrote:



Thanks Bryan,



It happens directly after reboot..



The thing is:

-  I have deactivated all polices

-  Stop our media server

-  And then restarted netbackup on the master.



So there are absolutely no action going on (no backup, no user backup, no
restore, no staging) only internal netbackup work.

At once when netbackup on the master gets active, it starts bpdbm process
after bpdbm process. It consume 100% of both my CPU`s and write/read


heavily


to the /usr/openv/netbackup/db filesystem.

When I have no action at all after a clean start, we have about 42 bpdbm
processes and nearly as many bprd processes



I cant figure this one out, and support points to disk config or something
else that sounds good in there ears



Thanks for all help,



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Bahnmiller, Bryan [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:04
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...



Hampus,



How quickly does this behaviour start happening after a recycle/reboot? I
worked with an N4000 master running 11i. We did have 8 cpus and 8 GB RAM.


We


were running over 15,000 backup jobs daily though. Our catalog was over
400GB. (Catalog was on EMC DMX disk.) Running good old 3.4 we would have


to


reboot the syst

Re: [Veritas-bu] Fiber Drive Question

2007-02-14 Thread Jack Forester, Jr.

We've been running 9940B drives for nearly 3 years now, and I've never 
heard of a table of addresses to control access to the drive.  I've been 
through the menus on the drive and looked through the drive manual and 
never saw a reference to such a "feature".  Are you having a problem at 
this moment?  Can you provide more information about your setup and the 
problem?

Erik Strom wrote:

>Has anyone heard about a table of wwn/addresses located inside of a 9940B or
>similiar fiber tape drives? I heard a rumor but cannot find any documentation
>that said,.
>
>The tape drive has a table of addresses that it will allow read/write access to
>the tape drive. There is only 16 slots available for these entries. This means
>that in order for a 17th media server to access this drive that it must wait
>for one of the existing 16 to drop out of the table. This is suppose to be the
>explaination as to why tape drives seem to disappear or become no longer
>functional to a media server.
>
>I've heard stranger things but I wanted to see if this is an urban myth or if
>someone can supply me with documentation about this.
>
>
> 
>
>Need a quick answer? Get one in minutes from people who know.
>Ask your question on www.Answers.yahoo.com
>___
>Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
>http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
>  
>


-- 
Jack L. Forester, Jr.
UNIX Systems Administrator, Stf
Lockheed Martin Information Technology
(304) 625-3946

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

[Veritas-bu] LRE: NBU and Aptare custom reports ..

2007-02-14 Thread Green, Steven

For what it's worth I have also had a strong need for the same report 
functionality. We use the Notes field to document failures for critical servers 
as part of SOX compliance reporting. Having a simple way to generate a list of 
failures for a server group with any attached Notes is part of our need during 
SOX audits. The shortcoming of the portal (GUI) interface is that you cannot 
get a concise summary of backup job failures with the Note field included. This 
is particularly problematic for backup jobs that are multistreamed and may (in 
our case) contain 150-200 individual job streams. When such a job fails, for 
whatever reason, the challenge becomes deciding which of the multitude of 
failed jobs to assign a Note, then identifying which of those failures had the 
note text during an audit. 

 

What I requested from APTARE was the ability to create (or they could be nice 
and create one for me  :-)) a custom automated report that would include all 
backup failures (something similar to the job summary report) and for each job 
failure, include any note text associated with the job. At the time of my 
inquiry I was told the Notes field was not an "exposed" field through the 
auto-report SQL queries. Supposedly APTARE has acknowledged my request as being 
a useful suggestion and the request has gone to into the bowels of the 
organization as a future enhancement. I have no idea when/if it will ever see 
the light of day, but I'm hopeful. For us, this would make our lives immensely 
easier for compliance reporting and SOX auditing.

 

(BTW ... I really wish APTARE would "simplify" the XML report designer for 
those of us who do not have the time to become SQL/XML programmers in addition 
to our myriad other duties.)

 

 

~~

#!/usr/local/man/steve green :: Storage Administration

Telephone & Data Systems, Inc.

608.664.8210 (immobile) :: 608.219.2106 (mobile)

 

What can be asserted without evidence may be dismissed without evidence.



From: Philip McDougal [mailto:[EMAIL PROTECTED] 
Sent: Tuesday, February 13, 2007 12:04 PM
To: Paul Keating; veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] NBU and Aptare custom reports ..

 

Thanks Paul.  I've tried that already ;-)  but they want a commitment from my 
company before they "allocate resources" to do this.  So I'm almost forced to 
do this myself.  

 

I love the product and want to have the company purchase it but there's no way 
they're gonna like me telling them that the most important report we need is 
one that WE have to create.

 

Thanks again!

Phil.

 

 

From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Paul Keating
Sent: Tuesday, February 13, 2007 11:57 AM
To: Philip McDougal; veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] NBU and Aptare custom reports ..

 

Definately contact the aptare guys.

 

they've been very helpful with that sort of stuff.

 

Gives you a chance to test out the support while you're evaluating the product.

;o)

 

Paul

 

 

-- 

-Original Message-
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Philip 
McDougal
Sent: February 13, 2007 12:55 PM
To: veritas-bu@mailman.eng.auburn.edu
Subject: [Veritas-bu] NBU and Aptare custom reports ..

Hey all,  I know this is more of an Aptare question but I don't know of 
any other source of information to pull from.

 

I have been evaluating Aptare StorageConsole for a few weeks now and 
love it!  Unfortunately, the one report I need for auditing isn't canned and 
I'm not an XML or SQL guru.  Has anyone created some custom reports where 
they've added a column or a way to export the Notes that can be attached to the 
Job Summary Report or Backup Summary?  I've looked at the XML Report 
Customization and it's not helpful to me (as I've no history in XML or 
development).  If anyone has done this or can point me to some other pools of 
knowledge, I'd be greatly appreciated!

 

Thank you in advance!

Phil.

 


CALAMOS INVESTMENTS CANNOT ACT UPON, AND WILL NOT ACCEPT, ANY 
TIME-SENSITIVE ELECTRONIC MESSAGES, SUCH AS TRANSACTION ORDERS AND FUND 
TRANSFER INSTRUCTIONS. ALSO, FOR YOUR PROTECTION, PLEASE DO NOT SEND ANY 
IDENTIFYING INFORMATION, SUCH AS ACCOUNT NUMBERS OR SOCIAL SECURITY NUMBERS, 
THROUGH THE INTERNET.

CONFIDENTIALITY NOTICE: This message is intended only for the use of 
the individual or entity to which it is addressed and may contain information 
that is confidential . If the reader of this message is not the intended 
recipient, you are hereby notified that any dissemination, distribution or 
copying of this communication is prohibited. Please notify the sender 
immediately if this message was transmitted in error. Thank you.

==

[Veritas-bu] Fiber Drive Question

2007-02-14 Thread Erik Strom

Has anyone heard about a table of wwn/addresses located inside of a 9940B or
similiar fiber tape drives? I heard a rumor but cannot find any documentation
that said,.

The tape drive has a table of addresses that it will allow read/write access to
the tape drive. There is only 16 slots available for these entries. This means
that in order for a 17th media server to access this drive that it must wait
for one of the existing 16 to drop out of the table. This is suppose to be the
explaination as to why tape drives seem to disappear or become no longer
functional to a media server.

I've heard stranger things but I wanted to see if this is an urban myth or if
someone can supply me with documentation about this.


 

Need a quick answer? Get one in minutes from people who know.
Ask your question on www.Answers.yahoo.com
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Replacing tape drives

2007-02-14 Thread Dave Brown

If you change the density on the LT02 drive to HCART,  it will be able
to read and write LTO media 

-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Don
Klebba
Sent: Wednesday, February 14, 2007 11:41 AM
To: veritas-bu@mailman.eng.auburn.edu
Subject: [Veritas-bu] Replacing tape drives

We're in the process of replacing our LTO tape drives (HCART) with LTO2
drives (HCART2). We have 2 LTO drives left that we're using in case a
restore is needed. I was wondering if anyone knew of a way to use the
LTO2 drives to read the LTO tapes.
--
Don Klebba
Quicken Loans
Storage Management Team
[EMAIL PROTECTED] 
phone: (734)805-7791
cell: (734)634-7486
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu 

This message (including any attachments) is intended for the sole use of the 
individual to whom it is addressed and may contain confidential information. 
You are hereby notified that any dissemination, distribution, or duplication of 
this message by someone other than the intended addressee or their designated 
agent is strictly prohibited. Information included in this message that does 
not relate to the specified business of Worknet shall be understood as neither 
given by nor endorsed by Worknet or its employees.  Any cost estimates or 
estimated quotes included in this message are considered non-binding estimates 
only and must not be considered final costs unless contained within an official 
proposal document.

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread john_rickus

Increasing the filesperset will result in fewer NetBackup savesets - less files 
to scan when NetBackup does its cleanup.  Also, make sure the format parameter 
is correct .

From: Hampus Lind [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, February 14, 2007 3:07 PM
To: Rickus John; [EMAIL PROTECTED]
Cc: Veritas-bu@mailman.eng.auburn.edu
Subject: SV: [Veritas-bu] Serious master issue...

Can you explain more about what this will results in? I am not so familiar with 
oracle. Will it backup more often or more seldom but with bigger "chunks"?

Should we do these changes in the archive log scripts on each oracle client?

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:58
Till: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Kopia: Veritas-bu@mailman.eng.auburn.edu
Ämne: RE: [Veritas-bu] Serious master issue...

2 changes with regards to archive logs:

 - set the filesperset parameter back to 20

 - changed the format parameter to "oracle_arch_%p_%s_%t"

From: Hampus Lind [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, February 14, 2007 2:50 PM
To: Rickus John; [EMAIL PROTECTED]
Cc: Veritas-bu@mailman.eng.auburn.edu
Subject: SV: [Veritas-bu] Serious master issue...

We run 4 channels four our oracle archive log backups.. It backups 1000-2000 
transactions a day...

How did you solve your problems?

Thanks,

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:43
Till: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Kopia: Veritas-bu@mailman.eng.auburn.edu
Ämne: RE: [Veritas-bu] Serious master issue...

We had a similar problem with our master server ( rp4440) that backs up oracle 
databases.  Found that the rman script *.rcv had the filesperset set too low ( 
we had turned it down from 20 to 5 for the archive logs), causing hundreds of 
backup images.  This resulted in the disk I/O being high when the cleanup ran, 
and loads of bpdbm processes.

John Rickus 
Storage Analyst 
Dofasco Inc. 
905-548-7200 ext. 6004 

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] re serious master server problem

2007-02-14 Thread Hampus Lind

Hi Chris,

 

Thanks for your ideas..

 

-  No our master server is not a media server as well.

-  Yes we have 2 media server.

-  It`s possible that we have some kind of corruption in the db, but
as long as bpdbm consistency 2 check wont run fast enough there is now way
of knowing right now..

 

Life sucks :-(

 

 

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 21:10
Till: [EMAIL PROTECTED]
Ämne: re serious master server problem

 


Hi, Hampus, 

I get the netbackup forum in digest form, so this may be out of date
already. 

Does your master server do any media server work? Do you have media servers?


We run NBU on HP-UX 11.11 also. We did see huge amounts of disk activity at
one time, despite going to 146GB/15K disk on SAN. There were some media
moves going on, as we had replaced media servers and needed to transfer
ownership of tapes from the old to the new (part of decommisioning the old
media server). 

Or, could you possibly have data corruption in the catalog? 

Just a couple of random ideas from a fairly new NBU user. 

Chris 
=
Chris Amley
3M IT
+1.651.736.9461
[EMAIL PROTECTED]
224-4N-27 3M Center
St Paul, MN 55144 US

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] VSP on windows Clients

2007-02-14 Thread Justin Piszcz

Yes, you click master server properties -> add the windows client to the 
'client settings part' and then you can turn vsp off in the second tab.

On Wed, 14 Feb 2007, Hudson, Steve wrote:

> I am running Netbackup 5.1 MP5 and want to shutoff VSP for some clients.
> In the properties from the gui for the client I don't see a way to shut
> VSP off. ( No check box that I can see) Anyone know how to do this ???
> Thanks...
>
>
>
> Steven R. Hudson
>
> Systems Consultant
>
> Iron Mountain
>
> 745 Atlantic Ave.
>
> Boston, MA.
>
> Work: 617-535-2849
>
> Mobile: 617-719-5465
>
> [EMAIL PROTECTED]
>
>
>
>
>
>
> -
> The information contained in this email message and its attachments
> is intended only for the private and confidential use of the
> recipient(s) named above, unless the sender expressly agrees
> otherwise.
> Transmission of email over the Internet is not a secure
> communications medium. If you are requesting or have requested the
> transmittal of personal data, as defined in applicable privacy laws
> by means of email or in an attachment to email, you must select a
> more secure alternate means of transmittal that supports your
> obligations to protect such personal data.
> If the reader of this message is not the intended recipient and/or
> you have received this email in error, you must take no action
> based on the information in this email and you are hereby notified
> that any dissemination, misuse or copying or disclosure of this
> communication is strictly prohibited. If you have received this
> communication in error, please notify us immediately by email and
> delete the original message.
>
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

[Veritas-bu] FW: BPRECOVER

2007-02-14 Thread James Soliday

So I am trying to recover a catalog from a Solaris Master server to a
Windows box that will become the master once I get everything moved
over.  I am able to run bprecover with the -dhost switch, and it
completes successfully (see out put below).   But when I open the admin
GUI on the new Windows server I have nothing? No images, not catalog
fiels, etc...Both servers are on 5.0 MP3 and the Windows box is a fresh
install.  Am I missing something here to get the Windows GUI to have all
the files moved over???

 

Any suggestions.  Thanks.

 

 

***FROM WINDOWS COMMAND PROMPT ***

 

 

F:\Program Files\NetBackup\bin\admincmd>bprecover -l -dpath
F:\Veritas\Catalogs

Database Backup Information from C:\Catalogs

 

Created:  02/14/07 08:46:19

Server:   scw2k3dc02

 

Path



IMAGE1  SOLARIS_MASTER:/veritas/openv/netbackup/db

IMAGE2  SOLARIS_MASTER:/veritas/openv/volmgr/database

IMAGE3  SOLARIS_MASTER:/veritas/openv/var

 

F:\Program Files\NetBackup\bin\admincmd>bprecover -r -dpath
F:\Veritas\Catalogs

-dhost WINDOWS_SOON_TO_BE_MASTER

 

Recover SOLARIS_MASTER:/veritas/openv/netbackup/db to host
WINDOWS_SOON_TO_BE_MASTER y/n (n)? y

 

Recovering SOLARIS_MASTER:/veritas/openv/netbackup/db to host
WINDOWS_SOON_TO_BE_MASTER

 

Recover SOLARIS_MASTER:/veritas/openv/volmgr/database to host
WINDOWS_SOON_TO_BE_MASTER y/n (n)? y

 

Recovering SOLARIS_MASTER:/veritas/openv/volmgr/database to host
WINDOWS_SOON_TO_BE_MASTER

 

Recover SOLARIS_MASTER:/veritas/openv/var to host
WINDOWS_SOON_TO_BE_MASTER y/n (n)? y

 

Recovering SOLARIS_MASTER:/veritas/openv/var to host
WINDOWS_SOON_TO_BE_MASTER

 

F:\Program Files\NetBackup\bin\admincmd>cd ..

 

F:\Program Files\NetBackup\bin>bpup -f

 

NetBackup 5.0GA -- Startup Utility

 

Starting services

 

Start up completed successfully.
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

Can you explain more about what this will results in? I am not so familiar
with oracle. Will it backup more often or more seldom but with bigger
chunks?

 

Should we do these changes in the archive log scripts on each oracle client?

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:58
Till: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Kopia: Veritas-bu@mailman.eng.auburn.edu
Ämne: RE: [Veritas-bu] Serious master issue...

 

2 changes with regards to archive logs:

 - set the filesperset parameter back to 20

 - changed the format parameter to "oracle_arch_%p_%s_%t"

 

  _  

From: Hampus Lind [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, February 14, 2007 2:50 PM
To: Rickus John; [EMAIL PROTECTED]
Cc: Veritas-bu@mailman.eng.auburn.edu
Subject: SV: [Veritas-bu] Serious master issue...

We run 4 channels four our oracle archive log backups.. It backups 1000-2000
transactions a day

 

How did you solve your problems?

 

Thanks,

 

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:43
Till: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Kopia: Veritas-bu@mailman.eng.auburn.edu
Ämne: RE: [Veritas-bu] Serious master issue...

 

We had a similar problem with our master server ( rp4440) that backs up
oracle databases.  Found that the rman script *.rcv had the filesperset set
too low ( we had turned it down from 20 to 5 for the archive logs), causing
hundreds of backup images.  This resulted in the disk I/O being high when
the cleanup ran, and loads of bpdbm processes.

 

John Rickus 
Storage Analyst 
Dofasco Inc. 
905-548-7200 ext. 6004 

 

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread john_rickus

2 changes with regards to archive logs:
 - set the filesperset parameter back to 20
 - changed the format parameter to "oracle_arch_%p_%s_%t"

From: Hampus Lind [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, February 14, 2007 2:50 PM
To: Rickus John; [EMAIL PROTECTED]
Cc: Veritas-bu@mailman.eng.auburn.edu
Subject: SV: [Veritas-bu] Serious master issue...

We run 4 channels four our oracle archive log backups.. It backups 1000-2000 
transactions a day...

How did you solve your problems?

Thanks,

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:43
Till: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Kopia: Veritas-bu@mailman.eng.auburn.edu
Ämne: RE: [Veritas-bu] Serious master issue...

We had a similar problem with our master server ( rp4440) that backs up oracle 
databases.  Found that the rman script *.rcv had the filesperset set too low ( 
we had turned it down from 20 to 5 for the archive logs), causing hundreds of 
backup images.  This resulted in the disk I/O being high when the cleanup ran, 
and loads of bpdbm processes.

John Rickus 
Storage Analyst 
Dofasco Inc. 
905-548-7200 ext. 6004 

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] VSP on windows Clients

2007-02-14 Thread Major, Rusty

They moved it and it's not all that intuitive now: Host
Properties>Master Server>Properties>Client Attributes. You have to add
in the client and then highlight and select the Windows Open File Backup
tab and then set it however you want. This way really makes it a pain to
make changes. You can also remove/not select VSP during the install.
 
-Rusty



From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Hudson,
Steve
Sent: Wednesday, February 14, 2007 1:43 PM
To: nbu
Subject: [Veritas-bu] VSP on windows Clients



I am running Netbackup 5.1 MP5 and want to shutoff VSP for some clients.
In the properties from the gui for the client I don't see a way to shut
VSP off. ( No check box that I can see) Anyone know how to do this ???
Thanks...

 

Steven R. Hudson

Systems Consultant

Iron Mountain 

745 Atlantic Ave.

Boston, MA.

Work: 617-535-2849

Mobile: 617-719-5465

[EMAIL PROTECTED]

 





The information contained in this email message and its attachments
is intended only for the private and confidential use of the
recipient(s) named above, unless the sender expressly agrees
otherwise.
Transmission of email over the Internet is not a secure
communications medium. If you are requesting or have requested the
transmittal of personal data, as defined in applicable privacy laws
by means of email or in an attachment to email, you must select a
more secure alternate means of transmittal that supports your
obligations to protect such personal data.
If the reader of this message is not the intended recipient and/or
you have received this email in error, you must take no action
based on the information in this email and you are hereby notified
that any dissemination, misuse or copying or disclosure of this
communication is strictly prohibited. If you have received this
communication in error, please notify us immediately by email and
delete the original message.


___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] VSP on windows Clients

2007-02-14 Thread Paul Keating



bash-2.03# echo "VSP_USE = NO" |bpsetconfig -h 

Then, to confirm:

bash-2.03# bpgetconfig -M |grep VSP

and look for the line that says:
VSP_Use = NO


Otherwise, if you want to use the GUI, you need to go to "Host
Propertines -> Master Server -> Client Attributes", then add in the name
of the client you're concerned with, and enable/disable the VSP settings
there.

However, if you're dealing with the status 156 errors, you could just
set the client to "continue on snapshot error".
You might get a good open file backup sometimes, but even when you
didn't, the backup jobs wouldn't fail.

Paul


-- 
-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Hudson,
Steve
Sent: February 14, 2007 2:43 PM
To: nbu
Subject: [Veritas-bu] VSP on windows Clients


I am running Netbackup 5.1 MP5 and want to shutoff VSP for some clients.
In the properties from the gui for the client I don't see a way to shut
VSP off. ( No check box that I can see) Anyone know how to do this ???
Thanks...
 
Steven R. Hudson
Systems Consultant
Iron Mountain 
745 Atlantic Ave.
Boston, MA.
Work: 617-535-2849
Mobile: 617-719-5465
[EMAIL PROTECTED]
 






The information contained in this email message and its attachments
is intended only for the private and confidential use of the
recipient(s) named above, unless the sender expressly agrees
otherwise.
Transmission of email over the Internet is not a secure
communications medium. If you are requesting or have requested the
transmittal of personal data, as defined in applicable privacy laws
by means of email or in an attachment to email, you must select a
more secure alternate means of transmittal that supports your
obligations to protect such personal data.
If the reader of this message is not the intended recipient and/or
you have received this email in error, you must take no action
based on the information in this email and you are hereby notified
that any dissemination, misuse or copying or disclosure of this
communication is strictly prohibited. If you have received this
communication in error, please notify us immediately by email and
delete the original message.


La version française suit le texte anglais.



This email may contain privileged and/or confidential information, and the Bank 
of
Canada does not waive any related rights. Any distribution, use, or copying of 
this
email or the information it contains by other than the intended recipient is
unauthorized. If you received this email in error please delete it immediately 
from
your system and notify the sender promptly by email that you have done so. 



Le présent courriel peut contenir de l'information privilégiée ou 
confidentielle.
La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute 
diffusion,
utilisation ou copie de ce courriel ou des renseignements qu'il contient par une
personne autre que le ou les destinataires désignés est interdite. Si vous 
recevez
ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans 
délai à
l'expéditeur un message électronique pour l'aviser que vous avez éliminé de 
votre
ordinateur toute copie du courriel reçu.

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

It`s on a SAN, RAID 5. 146 GB FC disks.

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] För Khurram Tariq
Skickat: den 14 februari 2007 20:29
Till: veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...

 

Where is ur /usr/openv/netbackup/db located? Local disk or SAN? What RAID
level is configured there? Maybe the disks on which /usr/openv/netbackup/db
is located are not performing optimally.

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Steven L. Sesar

bpdbm -consistency 2 is useless to you, based on the amount of data that 
you back up nightly and my own presumption of how long backups run in 
your environment. It will take longer to run than your backup domain 
will remain idle. If I recall, they have a process which does a better 
job at finding catalog/db corruption/inconsistency. I think that it's 
called NBCC.


The problem with NBCC is similar, though. You send them the output of 
three commands:


vmquery -a, bpmedialist -ls, and bpimmedia

Then, they munge the output of the above commands through a reporting 
tool that Symantec will NOT share with end users. At some point later in 
the day (hopefully, sooner rather than later), they will send you a 
report. You must then take certain actions to correct any discrepancies 
found. The backup system must be completely idle during this time. 
Restores are ok, but no backup activity can be taking place.


Afterwards, you 'll run those commands again, they'll generate the 
report again, and you'll see how you're doing. It may take you several 
passes to get things squared away.


The problem is that most of us don't have a completely idle backup 
infrastructure - at least for long enough for this process to complete. 
I didn't when I was NBU customer. Once you take backups, the reports 
become obsolete, as do the results of bpdbm -consistency 2.


It would not surprise me if bpdbm was leaking memory on your platform.

--Steve


Hampus Lind wrote:

Hi,

I cant don anything

Bpdbm -consistecny 2 has been running for over 12 hours and havent checked
more than 4-5 clients.

It was the first thing support told me. Your db is corrupted... So I tried
to run bpdbm -consistency 2 check. The check found some issues, like expired
images which where not removed etc. But when I was about to remove them
manually the netbackup db clean process already had took care of them..

So what I understand you can have some level of corruption in your db which
nbu cleans out when the clean job runs.

I am not compressing my catalogs.

Thanks,

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:31

Till: Hampus Lind
Kopia: 'Bahnmiller, Bryan'; Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...

Have you run the check_db_consistency? There is a command that checks to 
make sure your images are not corrupted!


I would recommend checking that.

Also, are you running compression on your catalogs?


On Wed, 14 Feb 2007, Hampus Lind wrote:

  

Thanks Bryan,



It happens directly after reboot..



The thing is:

-  I have deactivated all polices

-  Stop our media server

-  And then restarted netbackup on the master.



So there are absolutely no action going on (no backup, no user backup, no
restore, no staging) only internal netbackup work

At once when netbackup on the master gets active, it starts bpdbm process
after bpdbm process. It consume 100% of both my CPU`s and write/read


heavily
  

to the /usr/openv/netbackup/db filesystem.

When I have no action at all after a clean start, we have about 42 bpdbm
processes and nearly as many bprd processes...



I cant figure this one out, and support points to disk config or something
else that sounds good in there ears...



Thanks for all help,



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Bahnmiller, Bryan [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:04
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...



Hampus,



 How quickly does this behaviour start happening after a recycle/reboot? I
worked with an N4000 master running 11i. We did have 8 cpus and 8 GB RAM.


We
  

were running over 15,000 backup jobs daily though. Our catalog was over
400GB. (Catalog was on EMC DMX disk.) Running good old 3.4 we would have


to
  

reboot the system almost every week. If you can cleanly re-cycle NetBackup


-
  

shut it down, kill all NBU processes, and then restart it, that should be
almost as good.



 Here we are running NBU 5.1mp4 on a Win2K3 master - 2 cpus, 4 GB RAM. (I
inherited the system - not my choice.) We run about 5000 jobs per day, we
have a 280 GB catalog on EMC Clariion. The system will stay stable for 2
weeks pretty easily. 4 weeks starts pushing things. So we usually reboot


our
  

Windows master and media servers every 2 weeks.



 It seems like you will have cumulative problems with NetBackup that can
build up over time. It is way more pronounced on busy systems. We have
another NetBackup system that has 1 Master and 1 Media server. It runs


about
  

40 jobs per day max. I hardly ever have to reboot those servers.

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

We run 4 channels four our oracle archive log backups.. It backups 1000-2000
transactions a day

 

How did you solve your problems?

 

Thanks,

 

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:43
Till: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Kopia: Veritas-bu@mailman.eng.auburn.edu
Ämne: RE: [Veritas-bu] Serious master issue...

 

We had a similar problem with our master server ( rp4440) that backs up
oracle databases.  Found that the rman script *.rcv had the filesperset set
too low ( we had turned it down from 20 to 5 for the archive logs), causing
hundreds of backup images.  This resulted in the disk I/O being high when
the cleanup ran, and loads of bpdbm processes.

 

John Rickus 
Storage Analyst 
Dofasco Inc. 
905-548-7200 ext. 6004 

 

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Justin Piszcz

That is my guess as well.

On Thu, 15 Feb 2007, Khurram Tariq wrote:

> Where is ur /usr/openv/netbackup/db located? Local disk or SAN? What RAID
> level is configured there? Maybe the disks on which /usr/openv/netbackup/db
> is located are not performing optimally.
>
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

Yes as good as a can..

No errors in the array or so... Patched the OS with IO patches etc..

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:41
Till: Hampus Lind
Kopia: 'Bahnmiller, Bryan'; Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: SV: [Veritas-bu] Serious master issue...

Have you checked the underying hardware for any I/O problems? Degraded 
array/etc?

On Wed, 14 Feb 2007, Hampus Lind wrote:

> Hi,
>
> I cant don anything
>
> Bpdbm -consistecny 2 has been running for over 12 hours and havent checked
> more than 4-5 clients.
>
> It was the first thing support told me. Your db is corrupted... So I tried
> to run bpdbm -consistency 2 check. The check found some issues, like
expired
> images which where not removed etc. But when I was about to remove them
> manually the netbackup db clean process already had took care of them..
>
> So what I understand you can have some level of corruption in your db
which
> nbu cleans out when the clean job runs.
>
> I am not compressing my catalogs.
>
> Thanks,
>
> Hampus Lind
> Rikspolisstyrelsen
> National Police Board
> Tel dir: +46 (0)8 - 401 99 43
> Tel mob: +46 (0)70 - 217 92 66
> E-mail: [EMAIL PROTECTED]
>
>
> -Ursprungligt meddelande-
> Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
> Skickat: den 14 februari 2007 20:31
> Till: Hampus Lind
> Kopia: 'Bahnmiller, Bryan'; Veritas-bu@mailman.eng.auburn.edu
> Ämne: Re: [Veritas-bu] Serious master issue...
>
> Have you run the check_db_consistency? There is a command that checks to
> make sure your images are not corrupted!
>
> I would recommend checking that.
>
> Also, are you running compression on your catalogs?
>
>
> On Wed, 14 Feb 2007, Hampus Lind wrote:
>
>> Thanks Bryan,
>>
>>
>>
>> It happens directly after reboot..
>>
>>
>>
>> The thing is:
>>
>> -  I have deactivated all polices
>>
>> -  Stop our media server
>>
>> -  And then restarted netbackup on the master.
>>
>>
>>
>> So there are absolutely no action going on (no backup, no user backup, no
>> restore, no staging) only internal netbackup work.
>>
>> At once when netbackup on the master gets active, it starts bpdbm process
>> after bpdbm process. It consume 100% of both my CPU`s and write/read
> heavily
>> to the /usr/openv/netbackup/db filesystem.
>>
>> When I have no action at all after a clean start, we have about 42 bpdbm
>> processes and nearly as many bprd processes
>>
>>
>>
>> I cant figure this one out, and support points to disk config or
something
>> else that sounds good in there ears
>>
>>
>>
>> Thanks for all help,
>>
>>
>>
>> Hampus Lind
>> Rikspolisstyrelsen
>> National Police Board
>> Tel dir: +46 (0)8 - 401 99 43
>> Tel mob: +46 (0)70 - 217 92 66
>> E-mail: [EMAIL PROTECTED]
>>
>> -Ursprungligt meddelande-
>> Från: Bahnmiller, Bryan [mailto:[EMAIL PROTECTED]
>> Skickat: den 14 februari 2007 20:04
>> Till: Hampus Lind
>> Ämne: RE: [Veritas-bu] Serious master issue...
>>
>>
>>
>> Hampus,
>>
>>
>>
>>  How quickly does this behaviour start happening after a recycle/reboot?
I
>> worked with an N4000 master running 11i. We did have 8 cpus and 8 GB RAM.
> We
>> were running over 15,000 backup jobs daily though. Our catalog was over
>> 400GB. (Catalog was on EMC DMX disk.) Running good old 3.4 we would have
> to
>> reboot the system almost every week. If you can cleanly re-cycle
NetBackup
> -
>> shut it down, kill all NBU processes, and then restart it, that should be
>> almost as good.
>>
>>
>>
>>  Here we are running NBU 5.1mp4 on a Win2K3 master - 2 cpus, 4 GB RAM. (I
>> inherited the system - not my choice.) We run about 5000 jobs per day, we
>> have a 280 GB catalog on EMC Clariion. The system will stay stable for 2
>> weeks pretty easily. 4 weeks starts pushing things. So we usually reboot
> our
>> Windows master and media servers every 2 weeks.
>>
>>
>>
>>  It seems like you will have cumulative problems with NetBackup that can
>> build up over time. It is way more pronounced on busy systems. We have
>> another NetBackup system that has 1 Master and 1 Media server. It runs
> about
>> 40 jobs per day max. I hardly ever have to reboot those servers.
>>
>>
>>
>>   Bryan
>>
>>
>>
>> Bryan Bahnmiller
>>
>> ISD Business Continuity
>>
>> Pier 1 Imports, Inc
>>
>> 817-252-8570
>>
>>
>>
>>
>>
>>
>>  _
>>
>>
>> From: [EMAIL PROTECTED]
>> [mailto:[EMAIL PROTECTED] On Behalf Of Hampus
> Lind
>> Sent: Wednesday, February 14, 2007 12:17 PM
>> To: Veritas-bu@mailman.eng.auburn.edu
>> Subject: Re: [Veritas-bu] Serious master issue...
>> Importance: High
>>
>> All,
>>
>>
>>
>> Now I have been transferred to USA support God bless America!
>>
>>
>>
>> They have told me that they havent seen such a big installation in over
a
>> year. Strange, I have about 200 clients and backup a couple a TB per

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

Bryan,

 

Yes, i have defraged the filesystem and patched hpux and such I have tried
with all media server taken offline, so no staging jobs are active..

 

 

I just got a tips that it could be our RMAN server doing to many
crosschecks.. Anyone knowing anything about this?

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Bahnmiller, Bryan [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:31
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...

 

Hampus,

 

  Wow... One other thing I would suggest, but I don't think it will help,
would be to defrag the catalog volumes. VxFS can get fragmented. On the HP
master I worked with, we defragged the catalog volume twice a week. On our
Windoze server here I defrag it daily.

 

But I don't think that is your problem at all. Heck, you might not even be
able to defrag it with NetBackup running the way it sounds.

 

Good luck!

 

Bryan

 

p.s. One other thought, if you are using DSSU's, have you turned off the
de-staging when you reboot or when you are working on this?

 

 


  _  


From: Hampus Lind [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, February 14, 2007 1:12 PM
To: Bahnmiller, Bryan
Cc: Veritas-bu@mailman.eng.auburn.edu
Subject: SV: [Veritas-bu] Serious master issue...

Thanks Bryan,

 

It happens directly after reboot.. 

 

The thing is:

-  I have deactivated all polices

-  Stop our media server

-  And then restarted netbackup on the master.

 

So there are absolutely no action going on (no backup, no user backup, no
restore, no staging) only internal netbackup work.

At once when netbackup on the master gets active, it starts bpdbm process
after bpdbm process. It consume 100% of both my CPU`s and write/read heavily
to the /usr/openv/netbackup/db filesystem.

When I have no action at all after a clean start, we have about 42 bpdbm
processes and nearly as many bprd processes

 

I cant figure this one out, and support points to disk config or something
else that sounds good in there ears

 

Thanks for all help,

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Bahnmiller, Bryan [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:04
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...

 

Hampus,

 

  How quickly does this behaviour start happening after a recycle/reboot? I
worked with an N4000 master running 11i. We did have 8 cpus and 8 GB RAM. We
were running over 15,000 backup jobs daily though. Our catalog was over
400GB. (Catalog was on EMC DMX disk.) Running good old 3.4 we would have to
reboot the system almost every week. If you can cleanly re-cycle NetBackup -
shut it down, kill all NBU processes, and then restart it, that should be
almost as good.

 

  Here we are running NBU 5.1mp4 on a Win2K3 master - 2 cpus, 4 GB RAM. (I
inherited the system - not my choice.) We run about 5000 jobs per day, we
have a 280 GB catalog on EMC Clariion. The system will stay stable for 2
weeks pretty easily. 4 weeks starts pushing things. So we usually reboot our
Windows master and media servers every 2 weeks.

 

  It seems like you will have cumulative problems with NetBackup that can
build up over time. It is way more pronounced on busy systems. We have
another NetBackup system that has 1 Master and 1 Media server. It runs about
40 jobs per day max. I hardly ever have to reboot those servers.

 

   Bryan

 

Bryan Bahnmiller

ISD Business Continuity

Pier 1 Imports, Inc

817-252-8570

 

 


  _  


From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Hampus Lind
Sent: Wednesday, February 14, 2007 12:17 PM
To: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...
Importance: High

All,

 

Now I have been transferred to USA support God bless America!

 

They have told me that they havent seen such a big installation in over a
year. Strange, I have about 200 clients and backup a couple a TB per day..
I was under the impression that this was kinda small installation..??

 

However, they have told me that this is perfectly normal behaviour with
netbackup. That it produces heavy disk IO and eat all CPU power. And I was
really stupid and told them that I also had an case with HP earlier on this
disk IO problem, so now Symantec support are pointing all there fingers at
HP and our disk setup.

 

Our DB is about 60-65 GB and resides on a StorageTek Flexline 380 disk array
(SAN). We run a RAID 5 on 146GB FC drives.. I dont really see the
bottleneck there, but I will create a RAID 5 on 73GB 15K FC drives just to
shut netbackup support up

 

We run a two CPU HP rp2470  with HP-UX 11.11 as a master server. Shouldnt
this be enough for this installation?

 

Ooh

[Veritas-bu] VSP on windows Clients

2007-02-14 Thread Hudson, Steve

I am running Netbackup 5.1 MP5 and want to shutoff VSP for some clients.
In the properties from the gui for the client I don't see a way to shut
VSP off. ( No check box that I can see) Anyone know how to do this ???
Thanks...

 

Steven R. Hudson

Systems Consultant

Iron Mountain 

745 Atlantic Ave.

Boston, MA.

Work: 617-535-2849

Mobile: 617-719-5465

[EMAIL PROTECTED]

 




-
The information contained in this email message and its attachments
is intended only for the private and confidential use of the
recipient(s) named above, unless the sender expressly agrees
otherwise.
Transmission of email over the Internet is not a secure
communications medium. If you are requesting or have requested the
transmittal of personal data, as defined in applicable privacy laws
by means of email or in an attachment to email, you must select a
more secure alternate means of transmittal that supports your
obligations to protect such personal data.
If the reader of this message is not the intended recipient and/or
you have received this email in error, you must take no action
based on the information in this email and you are hereby notified
that any dissemination, misuse or copying or disclosure of this
communication is strictly prohibited. If you have received this
communication in error, please notify us immediately by email and
delete the original message.
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread john_rickus

We had a similar problem with our master server ( rp4440) that backs up
oracle databases.  Found that the rman script *.rcv had the filesperset
set too low ( we had turned it down from 20 to 5 for the archive logs),
causing hundreds of backup images.  This resulted in the disk I/O being
high when the cleanup ran, and loads of bpdbm processes.
 
John Rickus 
Storage Analyst 
Dofasco Inc. 
905-548-7200 ext. 6004 

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Justin Piszcz

Have you checked the underying hardware for any I/O problems? Degraded 
array/etc?


On Wed, 14 Feb 2007, Hampus Lind wrote:


Hi,

I cant don anything

Bpdbm -consistecny 2 has been running for over 12 hours and havent checked
more than 4-5 clients.

It was the first thing support told me. Your db is corrupted... So I tried
to run bpdbm -consistency 2 check. The check found some issues, like expired
images which where not removed etc. But when I was about to remove them
manually the netbackup db clean process already had took care of them..

So what I understand you can have some level of corruption in your db which
nbu cleans out when the clean job runs.

I am not compressing my catalogs.

Thanks,

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:31
Till: Hampus Lind
Kopia: 'Bahnmiller, Bryan'; Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...

Have you run the check_db_consistency? There is a command that checks to
make sure your images are not corrupted!

I would recommend checking that.

Also, are you running compression on your catalogs?


On Wed, 14 Feb 2007, Hampus Lind wrote:


Thanks Bryan,



It happens directly after reboot..



The thing is:

-  I have deactivated all polices

-  Stop our media server

-  And then restarted netbackup on the master.



So there are absolutely no action going on (no backup, no user backup, no
restore, no staging) only internal netbackup work.

At once when netbackup on the master gets active, it starts bpdbm process
after bpdbm process. It consume 100% of both my CPU`s and write/read

heavily

to the /usr/openv/netbackup/db filesystem.

When I have no action at all after a clean start, we have about 42 bpdbm
processes and nearly as many bprd processes



I cant figure this one out, and support points to disk config or something
else that sounds good in there ears



Thanks for all help,



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Bahnmiller, Bryan [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:04
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...



Hampus,



 How quickly does this behaviour start happening after a recycle/reboot? I
worked with an N4000 master running 11i. We did have 8 cpus and 8 GB RAM.

We

were running over 15,000 backup jobs daily though. Our catalog was over
400GB. (Catalog was on EMC DMX disk.) Running good old 3.4 we would have

to

reboot the system almost every week. If you can cleanly re-cycle NetBackup

-

shut it down, kill all NBU processes, and then restart it, that should be
almost as good.



 Here we are running NBU 5.1mp4 on a Win2K3 master - 2 cpus, 4 GB RAM. (I
inherited the system - not my choice.) We run about 5000 jobs per day, we
have a 280 GB catalog on EMC Clariion. The system will stay stable for 2
weeks pretty easily. 4 weeks starts pushing things. So we usually reboot

our

Windows master and media servers every 2 weeks.



 It seems like you will have cumulative problems with NetBackup that can
build up over time. It is way more pronounced on busy systems. We have
another NetBackup system that has 1 Master and 1 Media server. It runs

about

40 jobs per day max. I hardly ever have to reboot those servers.



  Bryan



Bryan Bahnmiller

ISD Business Continuity

Pier 1 Imports, Inc

817-252-8570






 _


From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Hampus

Lind

Sent: Wednesday, February 14, 2007 12:17 PM
To: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...
Importance: High

All,



Now I have been transferred to USA support God bless America!



They have told me that they havent seen such a big installation in over a
year. Strange, I have about 200 clients and backup a couple a TB per

day..

I was under the impression that this was kinda small installation..??



However, they have told me that this is perfectly normal behaviour with
netbackup. That it produces heavy disk IO and eat all CPU power. And I was
really stupid and told them that I also had an case with HP earlier on

this

disk IO problem, so now Symantec support are pointing all there fingers at
HP and our disk setup.



Our DB is about 60-65 GB and resides on a StorageTek Flexline 380 disk

array

(SAN). We run a RAID 5 on 146GB FC drives.. I dont really see the
bottleneck there, but I will create a RAID 5 on 73GB 15K FC drives just to
shut netbackup support up



We run a two CPU HP rp2470  with HP-UX 11.11 as a master server. Shouldnt
this be enough for this installation?



Ooh well



If support cant help me, what should I do?? I am desperate!!!

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Justin Piszcz

Have you run the check_db_consistency? There is a command that checks to 
make sure your images are not corrupted!


I would recommend checking that.

Also, are you running compression on your catalogs?


On Wed, 14 Feb 2007, Hampus Lind wrote:


Thanks Bryan,



It happens directly after reboot..



The thing is:

-  I have deactivated all polices

-  Stop our media server

-  And then restarted netbackup on the master.



So there are absolutely no action going on (no backup, no user backup, no
restore, no staging) only internal netbackup work.

At once when netbackup on the master gets active, it starts bpdbm process
after bpdbm process. It consume 100% of both my CPU`s and write/read heavily
to the /usr/openv/netbackup/db filesystem.

When I have no action at all after a clean start, we have about 42 bpdbm
processes and nearly as many bprd processes



I cant figure this one out, and support points to disk config or something
else that sounds good in there ears



Thanks for all help,



Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Bahnmiller, Bryan [mailto:[EMAIL PROTECTED]
Skickat: den 14 februari 2007 20:04
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...



Hampus,



 How quickly does this behaviour start happening after a recycle/reboot? I
worked with an N4000 master running 11i. We did have 8 cpus and 8 GB RAM. We
were running over 15,000 backup jobs daily though. Our catalog was over
400GB. (Catalog was on EMC DMX disk.) Running good old 3.4 we would have to
reboot the system almost every week. If you can cleanly re-cycle NetBackup -
shut it down, kill all NBU processes, and then restart it, that should be
almost as good.



 Here we are running NBU 5.1mp4 on a Win2K3 master - 2 cpus, 4 GB RAM. (I
inherited the system - not my choice.) We run about 5000 jobs per day, we
have a 280 GB catalog on EMC Clariion. The system will stay stable for 2
weeks pretty easily. 4 weeks starts pushing things. So we usually reboot our
Windows master and media servers every 2 weeks.



 It seems like you will have cumulative problems with NetBackup that can
build up over time. It is way more pronounced on busy systems. We have
another NetBackup system that has 1 Master and 1 Media server. It runs about
40 jobs per day max. I hardly ever have to reboot those servers.



  Bryan



Bryan Bahnmiller

ISD Business Continuity

Pier 1 Imports, Inc

817-252-8570






 _


From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Hampus Lind
Sent: Wednesday, February 14, 2007 12:17 PM
To: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...
Importance: High

All,



Now I have been transferred to USA support God bless America!



They have told me that they havent seen such a big installation in over a
year. Strange, I have about 200 clients and backup a couple a TB per day..
I was under the impression that this was kinda small installation..??



However, they have told me that this is perfectly normal behaviour with
netbackup. That it produces heavy disk IO and eat all CPU power. And I was
really stupid and told them that I also had an case with HP earlier on this
disk IO problem, so now Symantec support are pointing all there fingers at
HP and our disk setup.



Our DB is about 60-65 GB and resides on a StorageTek Flexline 380 disk array
(SAN). We run a RAID 5 on 146GB FC drives.. I dont really see the
bottleneck there, but I will create a RAID 5 on 73GB 15K FC drives just to
shut netbackup support up



We run a two CPU HP rp2470  with HP-UX 11.11 as a master server. Shouldnt
this be enough for this installation?



Ooh well



If support cant help me, what should I do?? I am desperate!!!





Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] För Hampus Lind
Skickat: den 14 februari 2007 12:48
Till: Veritas-bu@mailman.eng.auburn.edu
Ämne: [Veritas-bu] Serious master issue...
Prioritet: Hög



Hi,



We have a serious issue here with our master server. The problem occurred a
couple of weeks ago, or at least I found out about it then..



I was looking at IO`s and scsi queue depth on my master (hp-ux 11.11) when a
say that we had 4000-6000 SCSI commands in que, and a disk utilisation of
100% for the /usr/openv/netbackup/db disk.



I have patched hpux to the latest patch bundle and we run NBU 5.1 MP4.



HP support sad that bpdbm was leaking memory.



Veritas support still investigating.. But we have about 30 bpdbm and bprd
processes active on our master which eats both my CPU`s and produces tons of
IO against our db disk.



I actived verbose = 5 on the master, and after 15 minutes the bpdbm log had
reached the file si

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

Hi,

I cant don anything

Bpdbm -consistecny 2 has been running for over 12 hours and havent checked
more than 4-5 clients.

It was the first thing support told me. Your db is corrupted... So I tried
to run bpdbm -consistency 2 check. The check found some issues, like expired
images which where not removed etc. But when I was about to remove them
manually the netbackup db clean process already had took care of them..

So what I understand you can have some level of corruption in your db which
nbu cleans out when the clean job runs.

I am not compressing my catalogs.

Thanks,

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]


-Ursprungligt meddelande-
Från: Justin Piszcz [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:31
Till: Hampus Lind
Kopia: 'Bahnmiller, Bryan'; Veritas-bu@mailman.eng.auburn.edu
Ämne: Re: [Veritas-bu] Serious master issue...

Have you run the check_db_consistency? There is a command that checks to 
make sure your images are not corrupted!

I would recommend checking that.

Also, are you running compression on your catalogs?


On Wed, 14 Feb 2007, Hampus Lind wrote:

> Thanks Bryan,
>
>
>
> It happens directly after reboot..
>
>
>
> The thing is:
>
> -  I have deactivated all polices
>
> -  Stop our media server
>
> -  And then restarted netbackup on the master.
>
>
>
> So there are absolutely no action going on (no backup, no user backup, no
> restore, no staging) only internal netbackup work.
>
> At once when netbackup on the master gets active, it starts bpdbm process
> after bpdbm process. It consume 100% of both my CPU`s and write/read
heavily
> to the /usr/openv/netbackup/db filesystem.
>
> When I have no action at all after a clean start, we have about 42 bpdbm
> processes and nearly as many bprd processes
>
>
>
> I cant figure this one out, and support points to disk config or something
> else that sounds good in there ears
>
>
>
> Thanks for all help,
>
>
>
> Hampus Lind
> Rikspolisstyrelsen
> National Police Board
> Tel dir: +46 (0)8 - 401 99 43
> Tel mob: +46 (0)70 - 217 92 66
> E-mail: [EMAIL PROTECTED]
>
> -Ursprungligt meddelande-
> Från: Bahnmiller, Bryan [mailto:[EMAIL PROTECTED]
> Skickat: den 14 februari 2007 20:04
> Till: Hampus Lind
> Ämne: RE: [Veritas-bu] Serious master issue...
>
>
>
> Hampus,
>
>
>
>  How quickly does this behaviour start happening after a recycle/reboot? I
> worked with an N4000 master running 11i. We did have 8 cpus and 8 GB RAM.
We
> were running over 15,000 backup jobs daily though. Our catalog was over
> 400GB. (Catalog was on EMC DMX disk.) Running good old 3.4 we would have
to
> reboot the system almost every week. If you can cleanly re-cycle NetBackup
-
> shut it down, kill all NBU processes, and then restart it, that should be
> almost as good.
>
>
>
>  Here we are running NBU 5.1mp4 on a Win2K3 master - 2 cpus, 4 GB RAM. (I
> inherited the system - not my choice.) We run about 5000 jobs per day, we
> have a 280 GB catalog on EMC Clariion. The system will stay stable for 2
> weeks pretty easily. 4 weeks starts pushing things. So we usually reboot
our
> Windows master and media servers every 2 weeks.
>
>
>
>  It seems like you will have cumulative problems with NetBackup that can
> build up over time. It is way more pronounced on busy systems. We have
> another NetBackup system that has 1 Master and 1 Media server. It runs
about
> 40 jobs per day max. I hardly ever have to reboot those servers.
>
>
>
>   Bryan
>
>
>
> Bryan Bahnmiller
>
> ISD Business Continuity
>
> Pier 1 Imports, Inc
>
> 817-252-8570
>
>
>
>
>
>
>  _
>
>
> From: [EMAIL PROTECTED]
> [mailto:[EMAIL PROTECTED] On Behalf Of Hampus
Lind
> Sent: Wednesday, February 14, 2007 12:17 PM
> To: Veritas-bu@mailman.eng.auburn.edu
> Subject: Re: [Veritas-bu] Serious master issue...
> Importance: High
>
> All,
>
>
>
> Now I have been transferred to USA support God bless America!
>
>
>
> They have told me that they havent seen such a big installation in over a
> year. Strange, I have about 200 clients and backup a couple a TB per
day..
> I was under the impression that this was kinda small installation..??
>
>
>
> However, they have told me that this is perfectly normal behaviour with
> netbackup. That it produces heavy disk IO and eat all CPU power. And I was
> really stupid and told them that I also had an case with HP earlier on
this
> disk IO problem, so now Symantec support are pointing all there fingers at
> HP and our disk setup.
>
>
>
> Our DB is about 60-65 GB and resides on a StorageTek Flexline 380 disk
array
> (SAN). We run a RAID 5 on 146GB FC drives.. I dont really see the
> bottleneck there, but I will create a RAID 5 on 73GB 15K FC drives just to
> shut netbackup support up
>
>
>
> We run a two CPU HP rp2470  with HP-UX 11.11 as a master server. Shouldnt
> this be enough for this installation?
>
>
>
> Ooh well

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Khurram Tariq


Where is ur /usr/openv/netbackup/db located? Local disk or SAN? What RAID
level is configured there? Maybe the disks on which /usr/openv/netbackup/db
is located are not performing optimally.
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

I have no idea

 

I have sent tons of bpdbm logs to support and the cant see whats wrong And
now the support guy in US says that this is perfectly normal

 

We cant do any larger restore because bpdbm takes all CPU from our master..

 

I am going mad!!

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Jeff Lightner [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:25
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...

 

So youre running 42 bpdbm processes without any backups running?   What
kicks off that number  as I noted we only have 5 running.

 

  _  

From: Hampus Lind [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, February 14, 2007 2:24 PM
To: Jeff Lightner
Subject: SV: [Veritas-bu] Serious master issue...

 

Okay.. Thanks anyway..

 

We have the db placed on a StorageTek Flexline 380 (LSI Logic`s engenio),
and I dont really see the problem there, but we also have a DMX 2000, so I
can move netbackup on to that one and see if it solves the problem. But as a
said, I dont think the problem is on the array.

 

We use LVM and vxfs.

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Jeff Lightner [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:16
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...

 

The NetBackup storage is all done over fibre to an EMC Symmetrix DMX.   If
youre on internal drives or something less than a DMX my stats wouldnt
help because it is top of the line EMC storage (read $Millions) so most of
the performance for I/O is there rather than in box..   Also because we
mount the BCVs I previously mentioned it would take a fair amount of output
(798 disks) to give it to you or a fair amount of work for me to separate
out what was part of /usr/openv from what was part of the BCV mounted DB.

 

By the way we use VxVM rather than LVM.   We dont stripe at that level  we
use concatenation.

 

  _  

From: Hampus Lind [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, February 14, 2007 2:05 PM
To: Jeff Lightner
Subject: SV: [Veritas-bu] Serious master issue...

 

And how are your CPU usage? 

 

Could you also check a sar d 1 10 and iostat 1. Do you have busy
netbackup disks?

 

Have you stiped tour netbackup disk at the os level? 

 

 

Thank you very much for helping.. I really appreciate it..

 

 

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Jeff Lightner [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 19:57
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...

 

5 and 2 respectively at the moment.

 

  _  

From: Hampus Lind [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, February 14, 2007 1:39 PM
To: Jeff Lightner
Subject: SV: [Veritas-bu] Serious master issue...

 

Thanks,

 

On your master server How man bpdbm and bprd processes are active?

 

 

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Jeff Lightner [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 19:35
Till: Hampus Lind; Veritas-bu@mailman.eng.auburn.edu
Ämne: RE: [Veritas-bu] Serious master issue...

 

We use an RP4440 as the master.   We also have 18 media servers.   For the
Databases (4 TB in size each) we do the backup using the host on which the
database resides (or BCV to the RP4440 and do the backup from the BCV
mounts) so that all the backups are going fibre from the host to the Library
rather than backing up via the network.   For the hundreds of smaller
clients we have we do backup over the network but most of our windows
clients are on a dedicated backup network for that purpose.

 

  _  

From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Hampus Lind
Sent: Wednesday, February 14, 2007 1:17 PM
To: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...
Importance: High

 

All,

 

Now I have been transferred to USA support God bless America!

 

They have told me that they havent seen such a big installation in over a
year. Strange, I have about 200 clients and backup a couple a TB per day..
I was under the impression that this was kinda small installation..??

 

However, they have told me that this is perfectly normal behaviour with
netbackup. That it produces heavy disk IO and eat all CPU power. And I was
really stupid and told them that I also had an case with HP earlier on this
disk IO problem, so now Symantec support are pointing all there fingers at
HP and our disk setup.

 

Our DB is about 60-65 GB and resides on a S

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

Thanks Bryan,

 

It happens directly after reboot.. 

 

The thing is:

-  I have deactivated all polices

-  Stop our media server

-  And then restarted netbackup on the master.

 

So there are absolutely no action going on (no backup, no user backup, no
restore, no staging) only internal netbackup work.

At once when netbackup on the master gets active, it starts bpdbm process
after bpdbm process. It consume 100% of both my CPU`s and write/read heavily
to the /usr/openv/netbackup/db filesystem.

When I have no action at all after a clean start, we have about 42 bpdbm
processes and nearly as many bprd processes

 

I cant figure this one out, and support points to disk config or something
else that sounds good in there ears

 

Thanks for all help,

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: Bahnmiller, Bryan [mailto:[EMAIL PROTECTED] 
Skickat: den 14 februari 2007 20:04
Till: Hampus Lind
Ämne: RE: [Veritas-bu] Serious master issue...

 

Hampus,

 

  How quickly does this behaviour start happening after a recycle/reboot? I
worked with an N4000 master running 11i. We did have 8 cpus and 8 GB RAM. We
were running over 15,000 backup jobs daily though. Our catalog was over
400GB. (Catalog was on EMC DMX disk.) Running good old 3.4 we would have to
reboot the system almost every week. If you can cleanly re-cycle NetBackup -
shut it down, kill all NBU processes, and then restart it, that should be
almost as good.

 

  Here we are running NBU 5.1mp4 on a Win2K3 master - 2 cpus, 4 GB RAM. (I
inherited the system - not my choice.) We run about 5000 jobs per day, we
have a 280 GB catalog on EMC Clariion. The system will stay stable for 2
weeks pretty easily. 4 weeks starts pushing things. So we usually reboot our
Windows master and media servers every 2 weeks.

 

  It seems like you will have cumulative problems with NetBackup that can
build up over time. It is way more pronounced on busy systems. We have
another NetBackup system that has 1 Master and 1 Media server. It runs about
40 jobs per day max. I hardly ever have to reboot those servers.

 

   Bryan

 

Bryan Bahnmiller

ISD Business Continuity

Pier 1 Imports, Inc

817-252-8570

 

 


  _  


From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Hampus Lind
Sent: Wednesday, February 14, 2007 12:17 PM
To: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...
Importance: High

All,

 

Now I have been transferred to USA support God bless America!

 

They have told me that they havent seen such a big installation in over a
year. Strange, I have about 200 clients and backup a couple a TB per day..
I was under the impression that this was kinda small installation..??

 

However, they have told me that this is perfectly normal behaviour with
netbackup. That it produces heavy disk IO and eat all CPU power. And I was
really stupid and told them that I also had an case with HP earlier on this
disk IO problem, so now Symantec support are pointing all there fingers at
HP and our disk setup.

 

Our DB is about 60-65 GB and resides on a StorageTek Flexline 380 disk array
(SAN). We run a RAID 5 on 146GB FC drives.. I dont really see the
bottleneck there, but I will create a RAID 5 on 73GB 15K FC drives just to
shut netbackup support up

 

We run a two CPU HP rp2470  with HP-UX 11.11 as a master server. Shouldnt
this be enough for this installation?

 

Ooh well 

 

If support cant help me, what should I do?? I am desperate!!!

 

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] För Hampus Lind
Skickat: den 14 februari 2007 12:48
Till: Veritas-bu@mailman.eng.auburn.edu
Ämne: [Veritas-bu] Serious master issue...
Prioritet: Hög

 

Hi,

 

We have a serious issue here with our master server. The problem occurred a
couple of weeks ago, or at least I found out about it then..

 

I was looking at IO`s and scsi queue depth on my master (hp-ux 11.11) when a
say that we had 4000-6000 SCSI commands in que, and a disk utilisation of
100% for the /usr/openv/netbackup/db disk.

 

I have patched hpux to the latest patch bundle and we run NBU 5.1 MP4.

 

HP support sad that bpdbm was leaking memory.

 

Veritas support still investigating.. But we have about 30 bpdbm and bprd
processes active on our master which eats both my CPU`s and produces tons of
IO against our db disk.

 

I actived verbose = 5 on the master, and after 15 minutes the bpdbm log had
reached the file size limit on our filsystem, 2 GB

 

Any one had similar problems? 

 

 

Thanks and regards,

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Jeff Lightner

We use an RP4440 as the master.   We also have 18 media servers.   For the 
Databases (4 TB in size each) we do the backup using the host on which the 
database resides (or BCV to the RP4440 and do the backup from the BCV mounts) 
so that all the backups are going fibre from the host to the Library rather 
than backing up via the network.   For the hundreds of smaller clients we have 
we do backup over the network but most of our windows clients are on a 
dedicated backup network for that purpose.

 



From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Hampus Lind
Sent: Wednesday, February 14, 2007 1:17 PM
To: Veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] Serious master issue...
Importance: High

 

All,

 

Now I have been transferred to USA support... God bless America!

 

They have told me that they haven't seen such a big installation in over a 
year Strange, I have about 200 clients and backup a couple a TB per day.. I 
was under the impression that this was kinda small installation..??

 

However, they have told me that this is perfectly normal behaviour with 
netbackup. That it produces heavy disk IO and eat all CPU power. And I was 
really stupid and told them that I also had an case with HP earlier on this 
disk IO problem, so now Symantec support are pointing all there fingers at HP 
and our disk setup.

 

Our DB is about 60-65 GB and resides on a StorageTek Flexline 380 disk array 
(SAN). We run a RAID 5 on 146GB FC drives.. I don't really see the bottleneck 
there, but I will create a RAID 5 on 73GB 15K FC drives just to shut netbackup 
support up...

 

We run a two CPU HP rp2470  with HP-UX 11.11 as a master server. Shouldn't this 
be enough for this installation?

 

Ooh well... 

 

If support cant help me, what should I do?? I am desperate!!!

 

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] För Hampus Lind
Skickat: den 14 februari 2007 12:48
Till: Veritas-bu@mailman.eng.auburn.edu
Ämne: [Veritas-bu] Serious master issue...
Prioritet: Hög

 

Hi,

 

We have a serious issue here with our master server. The problem occurred a 
couple of weeks ago, or at least I found out about it then..

 

I was looking at IO`s and scsi queue depth on my master (hp-ux 11.11) when a 
say that we had 4000-6000 SCSI commands in que, and a disk utilisation of 100% 
for the /usr/openv/netbackup/db disk.

 

I have patched hpux to the latest patch bundle and we run NBU 5.1 MP4.

 

HP support sad that bpdbm was leaking memory.

 

Veritas support still investigating.. But we have about 30 bpdbm and bprd 
processes active on our master which eats both my CPU`s and produces tons of IO 
against our db disk.

 

I actived verbose = 5 on the master, and after 15 minutes the bpdbm log had 
reached the file size limit on our filsystem, 2 GB...

 

Any one had similar problems? 

 

 

Thanks and regards,

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]  

 

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Replacing tape drives

2007-02-14 Thread Paul Keating

Configure an LTO2 drive as HCART and everything will just "work". ;o)

If you add all of your LTO2 drives and media as the same type (HCART) as
the LTO, and remove all of the LTO drives, the two media types will
happily co-exist.

Paul
-- 


> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf 
> Of Don Klebba
> Sent: February 14, 2007 12:41 PM
> To: veritas-bu@mailman.eng.auburn.edu
> Subject: [Veritas-bu] Replacing tape drives
> 
> 
> We're in the process of replacing our LTO tape drives (HCART) 
> with LTO2
> drives (HCART2). We have 2 LTO drives left that we're using in case a
> restore is needed. I was wondering if anyone knew of a way to 
> use the LTO2
> drives to read the LTO tapes.
> -- 
> Don Klebba
> Quicken Loans
> Storage Management Team
> [EMAIL PROTECTED] 
> phone: (734)805-7791
> cell: (734)634-7486 
> ___
> Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
> http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
> 


La version française suit le texte anglais.



This email may contain privileged and/or confidential information, and the Bank 
of
Canada does not waive any related rights. Any distribution, use, or copying of 
this
email or the information it contains by other than the intended recipient is
unauthorized. If you received this email in error please delete it immediately 
from
your system and notify the sender promptly by email that you have done so. 



Le présent courriel peut contenir de l'information privilégiée ou 
confidentielle.
La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute 
diffusion,
utilisation ou copie de ce courriel ou des renseignements qu'il contient par une
personne autre que le ou les destinataires désignés est interdite. Si vous 
recevez
ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans 
délai à
l'expéditeur un message électronique pour l'aviser que vous avez éliminé de 
votre
ordinateur toute copie du courriel reçu.

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

All,

 

Now I have been transferred to USA support God bless America!

 

They have told me that they havent seen such a big installation in over a
year. Strange, I have about 200 clients and backup a couple a TB per day..
I was under the impression that this was kinda small installation..??

 

However, they have told me that this is perfectly normal behaviour with
netbackup. That it produces heavy disk IO and eat all CPU power. And I was
really stupid and told them that I also had an case with HP earlier on this
disk IO problem, so now Symantec support are pointing all there fingers at
HP and our disk setup.

 

Our DB is about 60-65 GB and resides on a StorageTek Flexline 380 disk array
(SAN). We run a RAID 5 on 146GB FC drives.. I dont really see the
bottleneck there, but I will create a RAID 5 on 73GB 15K FC drives just to
shut netbackup support up

 

We run a two CPU HP rp2470  with HP-UX 11.11 as a master server. Shouldnt
this be enough for this installation?

 

Ooh well 

 

If support cant help me, what should I do?? I am desperate!!!

 

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail: [EMAIL PROTECTED]

-Ursprungligt meddelande-
Från: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] För Hampus Lind
Skickat: den 14 februari 2007 12:48
Till: Veritas-bu@mailman.eng.auburn.edu
Ämne: [Veritas-bu] Serious master issue...
Prioritet: Hög

 

Hi,

 

We have a serious issue here with our master server. The problem occurred a
couple of weeks ago, or at least I found out about it then..

 

I was looking at IO`s and scsi queue depth on my master (hp-ux 11.11) when a
say that we had 4000-6000 SCSI commands in que, and a disk utilisation of
100% for the /usr/openv/netbackup/db disk.

 

I have patched hpux to the latest patch bundle and we run NBU 5.1 MP4.

 

HP support sad that bpdbm was leaking memory.

 

Veritas support still investigating.. But we have about 30 bpdbm and bprd
processes active on our master which eats both my CPU`s and produces tons of
IO against our db disk.

 

I actived verbose = 5 on the master, and after 15 minutes the bpdbm log had
reached the file size limit on our filsystem, 2 GB

 

Any one had similar problems? 

 

 

Thanks and regards,

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail:   [EMAIL PROTECTED]

 

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

[Veritas-bu] Replacing tape drives

2007-02-14 Thread Don Klebba

We're in the process of replacing our LTO tape drives (HCART) with LTO2
drives (HCART2). We have 2 LTO drives left that we're using in case a
restore is needed. I was wondering if anyone knew of a way to use the LTO2
drives to read the LTO tapes.
-- 
Don Klebba
Quicken Loans
Storage Management Team
[EMAIL PROTECTED] 
phone: (734)805-7791
cell: (734)634-7486 
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] status 202, 205, 219 and 58

2007-02-14 Thread Preston, Douglas L

What I found out when I was getting tthese errors was someone on the
network was doing scans of the servers for hardware and software and it
was doing reset on the network card and sometimes on the HBA's on the
master server and the media servers.  We had them block scans on the
netbackup master and media servers and the problem went away on master
and three of the media servers.  The forth media server was a different
story.

I still had one server that sometimes has an issue but it is one of
those 900 million small files on 2 1tb and 5 500gb luns.  The error I
see is network error, but I really suspect the cpu and memory usage
creats a long delay for data communication and netbackup thinks the
network went down.  Even if the network went down the backup should
continue since this is a san media server with fiber connections to the
sso drives.  

What fixed this server was to break up the drives into multiple streams
so that the file list was not so large as to cause memeory swapping to
disk.  

Doug Preston
Systems Engineer
Land America Tax and Flood Services
Phone 626-339-5221 Ext 104
Email  [EMAIL PROTECTED]




NOTICE: This electronic mail transmission may constitute a communication
that is legally privileged. It is not intended for transmission to, or
receipt by, any unauthorized persons. If you have received this
electronic mail transmission in error, please delete it from your system
without copying it, and notify the sender by reply e-mail, so that our
address record can be corrected.




-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of David
Rock
Sent: Wednesday, February 14, 2007 9:28 AM
To: veritas-bu@mailman.eng.auburn.edu
Subject: Re: [Veritas-bu] status 202, 205, 219 and 58

* Paul Keating <[EMAIL PROTECTED]> [2007-02-14 10:32]:
> Yeah, that's definitely not the case.
> 
> So since our core network is not going down, I have no reason to 
> believe it's a network issue. ;o)

Our system is set up the same way, but we are seeing network-related
errors during vaulting between the master server and the media servers.
I doubt our 6509 is the cause for this, either ;-)

--
David Rock
[EMAIL PROTECTED]
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Moving to a different storage unit

2007-02-14 Thread David Rock

* Adeday <[EMAIL PROTECTED]> [2007-02-14 00:15]:
> I have 4 disk storage units and a robotic library configured. One of the
> disk storage units is full. I have 3 policies that are backing up to this
> storage unit. What is the safest way of moving these policies to another
> storage unit? Can I leave the old backups of these policies where they are
> now and start backing up to another disk or tape? Will NBU know where the
> old backups are?  This is NBU 5.1 on solaris master/media server.

Just change it in the policy.  The only dangers you have are related to
vaulting.  If you aren't vaulting, then it's a non-issue.  The original
backups will stay related to where they originally backed up.

-- 
David Rock
[EMAIL PROTECTED]
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] status 202, 205, 219 and 58

2007-02-14 Thread David Rock

* Paul Keating <[EMAIL PROTECTED]> [2007-02-14 10:32]:
> Yeah, that's definitely not the case.
> 
> So since our core network is not going down, I have no reason to believe
> it's a network issue. ;o)

Our system is set up the same way, but we are seeing network-related
errors during vaulting between the master server and the media servers.
I doubt our 6509 is the cause for this, either ;-)

-- 
David Rock
[EMAIL PROTECTED]
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] status 202, 205, 219 and 58

2007-02-14 Thread Paul Keating

Yeah, that's definitely not the case.

The Netbackup Master and Media servers are connected to their own VLANs,
but directly conencted to the core switch. Since we pull data in from
clients attached to edge switches, we did not want to congest things by
forcing traffic out through a truck to another edge switch where the
backup servers live.
So since our core network is not going down, I have no reason to believe
it's a network issue. ;o)

And no, not DSSU, this is in fact a pair of Storagetek L700 libraries,
pure fiber connectivityand both libraries (about 5 STUs per robot)
are going down. Even the NDMP backups (tapes connected direct to the
filers) get the 219, as well as the jobs that are running on the STUs
for the media server that lives on the master server.

The only thing that continues to run is the couple of remote WAN clients
that are writing to a DSSU that's on DAS on the master.

The 58s were the original poster, not me...

Paul

-- 


> -Original Message-
> From: Ed Wilts [mailto:[EMAIL PROTECTED] 
> Sent: February 13, 2007 8:26 PM
> To: Paul Keating
> Cc: nbu
> Subject: Re: [Veritas-bu] status 202, 205, 219 and 58
> 
> 
> All it takes is to lose the network between the master and 
> the media and 
> you're going to go down the toilet.  The 219 is a storage 
> unit full so 
> I'm guessing you're writing to a DSSU.  When the DSSU gets full, it 
> needs to clean up old images.  It can't do that if the master 
> and media 
> have lost communications.  The 58 is also a communcations error.
> 
> Start with fixing the network and the 219s will be better as 
> a result. 
> 6.0MP4 really helped with 219s too btw.
> 
>   .../Ed


La version française suit le texte anglais.



This email may contain privileged and/or confidential information, and the Bank 
of
Canada does not waive any related rights. Any distribution, use, or copying of 
this
email or the information it contains by other than the intended recipient is
unauthorized. If you received this email in error please delete it immediately 
from
your system and notify the sender promptly by email that you have done so. 



Le présent courriel peut contenir de l'information privilégiée ou 
confidentielle.
La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute 
diffusion,
utilisation ou copie de ce courriel ou des renseignements qu'il contient par une
personne autre que le ou les destinataires désignés est interdite. Si vous 
recevez
ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans 
délai à
l'expéditeur un message électronique pour l'aviser que vous avez éliminé de 
votre
ordinateur toute copie du courriel reçu.

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Justin Piszcz

On Wed, 14 Feb 2007, Ed Wilts wrote:

> On 2/14/2007 6:00 AM, Justin Piszcz wrote:
>> Also, I believe the (32bit) version of NetBackup in Linux also caps
>> sizes to 2GB as well.
>
> You are mistaken - the file size limit is not 2GB in RHEL 3 or later
> (and RHEL 3 is a few years old already).  This one is trivial to prove
> with something like (going from memory here)
>
> # dd if=/dev/null of=/filesystem/tmp.file bs=1MB count=4000
>
>   .../Ed
>
> -- 
> Ed Wilts, RHCE
> Mounds View, MN, USA
> mailto:[EMAIL PROTECTED]
>

The file limit by Veritas NetBackup is 2.0 gigabytes, not the OS.

Justin.
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Ed Wilts

On 2/14/2007 6:00 AM, Justin Piszcz wrote:
> Also, I believe the (32bit) version of NetBackup in Linux also caps
> sizes to 2GB as well.

You are mistaken - the file size limit is not 2GB in RHEL 3 or later
(and RHEL 3 is a few years old already).  This one is trivial to prove
with something like (going from memory here)

# dd if=/dev/null of=/filesystem/tmp.file bs=1MB count=4000

.../Ed

-- 
Ed Wilts, RHCE
Mounds View, MN, USA
mailto:[EMAIL PROTECTED]
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

Re: [Veritas-bu] Serious master issue...

2007-02-14 Thread Justin Piszcz

Ouch, sounds like you need to talk with someone who also runs HP-UX 11.11, 
I have not seen that on Linux or Solaris.  Also, I believe the (32bit) 
version of NetBackup in Linux also caps sizes to 2GB as well.

Justin.

On Wed, 14 Feb 2007, Hampus Lind wrote:

> Hi,
>
>
>
> We have a serious issue here with our master server. The problem occurred a
> couple of weeks ago, or at least I found out about it then..
>
>
>
> I was looking at IO`s and scsi queue depth on my master (hp-ux 11.11) when a
> say that we had 4000-6000 SCSI commands in que, and a disk utilisation of
> 100% for the /usr/openv/netbackup/db disk.
>
>
>
> I have patched hpux to the latest patch bundle and we run NBU 5.1 MP4.
>
>
>
> HP support sad that bpdbm was leaking memory.
>
>
>
> Veritas support still investigating.. But we have about 30 bpdbm and bprd
> processes active on our master which eats both my CPU`s and produces tons of
> IO against our db disk.
>
>
>
> I actived verbose = 5 on the master, and after 15 minutes the bpdbm log had
> reached the file size limit on our filsystem, 2 GB.
>
>
>
> Any one had similar problems?
>
>
>
>
>
> Thanks and regards,
>
>
>
> Hampus Lind
> Rikspolisstyrelsen
> National Police Board
> Tel dir: +46 (0)8 - 401 99 43
> Tel mob: +46 (0)70 - 217 92 66
> E-mail:   [EMAIL PROTECTED]
>
>
>
>
___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

[Veritas-bu] Serious master issue...

2007-02-14 Thread Hampus Lind

Hi,

 

We have a serious issue here with our master server. The problem occurred a
couple of weeks ago, or at least I found out about it then..

 

I was looking at IO`s and scsi queue depth on my master (hp-ux 11.11) when a
say that we had 4000-6000 SCSI commands in que, and a disk utilisation of
100% for the /usr/openv/netbackup/db disk.

 

I have patched hpux to the latest patch bundle and we run NBU 5.1 MP4.

 

HP support sad that bpdbm was leaking memory.

 

Veritas support still investigating.. But we have about 30 bpdbm and bprd
processes active on our master which eats both my CPU`s and produces tons of
IO against our db disk.

 

I actived verbose = 5 on the master, and after 15 minutes the bpdbm log had
reached the file size limit on our filsystem, 2 GB.

 

Any one had similar problems? 

 

 

Thanks and regards,

 

Hampus Lind
Rikspolisstyrelsen
National Police Board
Tel dir: +46 (0)8 - 401 99 43
Tel mob: +46 (0)70 - 217 92 66
E-mail:   [EMAIL PROTECTED]

 

___
Veritas-bu maillist  -  Veritas-bu@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu

60 matches

Mail list logo