Re: EMC Storage Array Issue
Hi Scott/All, We have been able to identify the root cause for the issues we had with EMC during the last 2 weeks. The root cause was an issue with EMC PowerPath in a SAN environment where it was not able to resolve alternate paths. We are upgrading from PowerPath Version 1.3 to Version 2.0 to resolve the problem. The frame didn't dial out to EMC and it took some time before "we" identified the root cause. Regards, Denny > Recently we had issues with EMC. Last week we started getting IO timeout on > one of our frames followed by files being accessed disappearing. We lost > controlfiles, redo log files and library files. EMC hasn't been able to tell us > why it happended. I would like to hear about solutions/explanation they come up > with for your problem. Quoting Scott Canaan <[EMAIL PROTECTED]>: > Since I started this thread, I thought I'd update everyone on what the > problem ended up being. There is a problem with one of the power > supplies > on the switch in the SAN. The other power supply was not plugged in, so > it > halted everything occasionally. We plugged the other power supply in, > and > haven't had the problem since. Now we need to get the power supply > replaced. Interesting that EMC tried to blame it on Oracle first. > > Scott Canaan wrote: > > > We have implemented a Sun Solaris Cluster (4 machines), connected > to > > an EMC storage array. The migration began last fall, and we now have > 15 > > Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there. > We > > recently have had 2 occurances of asynchronous I/O wait times > exceeded. > > When this occurs, every database crashes at the same time. The > solution > > from EMC is to turn asynchronous I/O off in all of the Oracle > instances > > (disk_async_io = false) and to increase the database writer slaves > > (dbwr_io_slaves = ) to emulate asynchronous I/O. > > Has anyone run into this problem before? If so, how did you > > "correct" it? My feeling is that EMC is trying to give us a bandage > to > > cover up the real problem, by trying to get Oracle to ignore it. > > > > Thank you. > > > > -- > > Scott Canaan ([EMAIL PROTECTED]) > > (585) 475-7886 -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Denny Koovakattu INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
Re: EMC Storage Array Issue
ROFLOL Gosh, we don't know why, must be the databases fault, all 15 of them. Thanx for giving me a Friday Funny..BOL Scott Canaan .rit.edu>cc: Sent by: Subject: Re: EMC Storage Array Issue [EMAIL PROTECTED] om 04/19/02 02:09 PM Please respond to ORACLE-L Since I started this thread, I thought I'd update everyone on what the problem ended up being. There is a problem with one of the power supplies on the switch in the SAN. The other power supply was not plugged in, so it halted everything occasionally. We plugged the other power supply in, and haven't had the problem since. Now we need to get the power supply replaced. Interesting that EMC tried to blame it on Oracle first. Scott Canaan wrote: > We have implemented a Sun Solaris Cluster (4 machines), connected to > an EMC storage array. The migration began last fall, and we now have 15 > Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there. We > recently have had 2 occurances of asynchronous I/O wait times exceeded. > When this occurs, every database crashes at the same time. The solution > from EMC is to turn asynchronous I/O off in all of the Oracle instances > (disk_async_io = false) and to increase the database writer slaves > (dbwr_io_slaves = ) to emulate asynchronous I/O. > Has anyone run into this problem before? If so, how did you > "correct" it? My feeling is that EMC is trying to give us a bandage to > cover up the real problem, by trying to get Oracle to ignore it. > > Thank you. > > -- > Scott Canaan ([EMAIL PROTECTED]) > (585) 475-7886 > "Life is like a sewer, what you get out of it depends on what you put > into it" - Tom Lehrer > > -- > Please see the official ORACLE-L FAQ: http://www.orafaq.com > -- > Author: Scott Canaan > INET: [EMAIL PROTECTED] > > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 > San Diego, California-- Public Internet access / Mailing Lists > > To REMOVE yourself from this mailing list, send an E-Mail message > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > the message BODY, include a line containing: UNSUB ORACLE-L > (or the name of mailing list you want to be removed from). You may > also send the HELP command for other information (like subscribing). -- Scott Canaan ([EMAIL PROTECTED]) (585) 475-7886 "Life is like a sewer, what you get out of it depends on what you put into it" - Tom Lehrer -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Scott Canaan INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing). -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Auth
RE: EMC Storage Array Issue
Very interesting. So the EMC box didn't 'phone home' like it was suppossed to, to report this problem? Thanks for sharing this Scott. Lisa Koivu Oracle Database Blue Softball Ankles Fairfield Resorts, Inc. Office: 954-935-4117 > -Original Message- > From: Scott Canaan [SMTP:[EMAIL PROTECTED]] > Sent: Friday, April 19, 2002 5:09 PM > To: Multiple recipients of list ORACLE-L > Subject: Re: EMC Storage Array Issue > > Since I started this thread, I thought I'd update everyone on what the > problem ended up being. There is a problem with one of the power supplies > on the switch in the SAN. The other power supply was not plugged in, so > it > halted everything occasionally. We plugged the other power supply in, and > haven't had the problem since. Now we need to get the power supply > replaced. Interesting that EMC tried to blame it on Oracle first. > > Scott Canaan wrote: > > > We have implemented a Sun Solaris Cluster (4 machines), connected to > > an EMC storage array. The migration began last fall, and we now have 15 > > Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there. We > > recently have had 2 occurances of asynchronous I/O wait times exceeded. > > When this occurs, every database crashes at the same time. The solution > > from EMC is to turn asynchronous I/O off in all of the Oracle instances > > (disk_async_io = false) and to increase the database writer slaves > > (dbwr_io_slaves = ) to emulate asynchronous I/O. > > Has anyone run into this problem before? If so, how did you > > "correct" it? My feeling is that EMC is trying to give us a bandage to > > cover up the real problem, by trying to get Oracle to ignore it. > > > > Thank you. > > > > -- > > Scott Canaan ([EMAIL PROTECTED]) > > (585) 475-7886 > > "Life is like a sewer, what you get out of it depends on what you put > > into it" - Tom Lehrer > > > > -- > > Please see the official ORACLE-L FAQ: http://www.orafaq.com > > -- > > Author: Scott Canaan > > INET: [EMAIL PROTECTED] > > > > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 > > San Diego, California-- Public Internet access / Mailing Lists > > > > To REMOVE yourself from this mailing list, send an E-Mail message > > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > > the message BODY, include a line containing: UNSUB ORACLE-L > > (or the name of mailing list you want to be removed from). You may > > also send the HELP command for other information (like subscribing). > > -- > Scott Canaan ([EMAIL PROTECTED]) > (585) 475-7886 > "Life is like a sewer, what you get out of it depends on what you put into > it" - Tom Lehrer > > > -- > Please see the official ORACLE-L FAQ: http://www.orafaq.com > -- > Author: Scott Canaan > INET: [EMAIL PROTECTED] > > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 > San Diego, California-- Public Internet access / Mailing Lists > > To REMOVE yourself from this mailing list, send an E-Mail message > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > the message BODY, include a line containing: UNSUB ORACLE-L > (or the name of mailing list you want to be removed from). You may > also send the HELP command for other information (like subscribing). -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Koivu, Lisa INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
Re: EMC Storage Array Issue
Since I started this thread, I thought I'd update everyone on what the problem ended up being. There is a problem with one of the power supplies on the switch in the SAN. The other power supply was not plugged in, so it halted everything occasionally. We plugged the other power supply in, and haven't had the problem since. Now we need to get the power supply replaced. Interesting that EMC tried to blame it on Oracle first. Scott Canaan wrote: > We have implemented a Sun Solaris Cluster (4 machines), connected to > an EMC storage array. The migration began last fall, and we now have 15 > Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there. We > recently have had 2 occurances of asynchronous I/O wait times exceeded. > When this occurs, every database crashes at the same time. The solution > from EMC is to turn asynchronous I/O off in all of the Oracle instances > (disk_async_io = false) and to increase the database writer slaves > (dbwr_io_slaves = ) to emulate asynchronous I/O. > Has anyone run into this problem before? If so, how did you > "correct" it? My feeling is that EMC is trying to give us a bandage to > cover up the real problem, by trying to get Oracle to ignore it. > > Thank you. > > -- > Scott Canaan ([EMAIL PROTECTED]) > (585) 475-7886 > "Life is like a sewer, what you get out of it depends on what you put > into it" - Tom Lehrer > > -- > Please see the official ORACLE-L FAQ: http://www.orafaq.com > -- > Author: Scott Canaan > INET: [EMAIL PROTECTED] > > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 > San Diego, California-- Public Internet access / Mailing Lists > > To REMOVE yourself from this mailing list, send an E-Mail message > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > the message BODY, include a line containing: UNSUB ORACLE-L > (or the name of mailing list you want to be removed from). You may > also send the HELP command for other information (like subscribing). -- Scott Canaan ([EMAIL PROTECTED]) (585) 475-7886 "Life is like a sewer, what you get out of it depends on what you put into it" - Tom Lehrer -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Scott Canaan INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
RE: EMC Storage Array Issue
I worked at a site that had problems with veritas file systems which caused OS-level locking problems on the extent map information in the file systems. (This was during a migration to 8i a couple of years back, so things may have changed). "Bug" 1301726 The 'resolution' was to move to quick io (coughing up additional license money of course)... hth connor --- "Jesse, Rich" <[EMAIL PROTECTED]> wrote: > Do you have any more info on this BUG? I can't find > anything that appears > close to this on Metaclink. > > Rich Jesse System/Database > Administrator > [EMAIL PROTECTED] Quad/Tech > International, Sussex, WI USA > > > > -Original Message- > > From: James A [mailto:[EMAIL PROTECTED]] > > Sent: Monday, April 15, 2002 1:24 PM > > To: Multiple recipients of list ORACLE-L > > Subject: RE: EMC Storage Array Issue > > > > > > We ran into a similar issue on 8.1.6.0 for Solaris > 32bit and Veritas > > Volumes. Oracle noted this as a bug in their > release and > > suggest go to > > 8.1.6.3 or better 8.1.7.3. > > We are testing this now. So far it seems to work. > -- > Please see the official ORACLE-L FAQ: > http://www.orafaq.com > -- > Author: Jesse, Rich > INET: [EMAIL PROTECTED] > > Fat City Network Services-- (858) 538-5051 FAX: > (858) 538-5051 > San Diego, California-- Public Internet > access / Mailing Lists > > To REMOVE yourself from this mailing list, send an > E-Mail message > to: [EMAIL PROTECTED] (note EXACT spelling of > 'ListGuru') and in > the message BODY, include a line containing: UNSUB > ORACLE-L > (or the name of mailing list you want to be removed > from). You may > also send the HELP command for other information > (like subscribing). = Connor McDonald http://www.oracledba.co.uk (mirrored at http://www.oradba.freeserve.co.uk) "Some days you're the pigeon, some days you're the statue" __ Do You Yahoo!? Everything you'll ever need on one web page from News and Sport to Email and Music Charts http://uk.my.yahoo.com -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: =?iso-8859-1?q?Connor=20McDonald?= INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
Re: EMC Storage Array Issue
I know the VOS (veritas-oracle-sun) team was actively troubleshooting this bug 6 months ago, you might want to ask to be escalated to them (supposedly all customers can ask to have their problems escalated to that team, and the team will troubleshoot issues across all 3 product lines). George On Tuesday, April 16, 2002, at 05:38 PM, James A wrote: > One Reply from Oracle > > Dear Customer, > > Please go to the Oracle MetaLink ( http://metalink.oracle.com/ ) site > to download the patch referenced below. > > Patch: 1685984 - DBWR TERMINATES WITH ORA-27062 AFTER ONE AIOWAIT > TIMEOUT WARNING > > Password = > Platform = Sun SPARC Solaris > Product= Oracle Server > Version= 8.1.6.3 > > Customers are reminded that one-off Oracle Server patches are not > subject to the same rigorous level of testing as done for Oracle > Server patch sets. Customers are encouraged to install and test this > patch in a test environment prior to full production implementation. > > > -Original Message- > Sent: Tuesday, April 16, 2002 12:59 PM > To: Multiple recipients of list ORACLE-L > > > Do you have any more info on this BUG? I can't find anything that > appears > close to this on Metaclink. > > Rich Jesse System/Database Administrator > [EMAIL PROTECTED] Quad/Tech International, Sussex, > WI USA > > >> -Original Message- >> From: James A [mailto:[EMAIL PROTECTED]] >> Sent: Monday, April 15, 2002 1:24 PM >> To: Multiple recipients of list ORACLE-L >> Subject: RE: EMC Storage Array Issue >> >> >> We ran into a similar issue on 8.1.6.0 for Solaris 32bit and Veritas >> Volumes. Oracle noted this as a bug in their release and >> suggest go to >> 8.1.6.3 or better 8.1.7.3. >> We are testing this now. So far it seems to work. > -- > Please see the official ORACLE-L FAQ: http://www.orafaq.com > -- > Author: Jesse, Rich > INET: [EMAIL PROTECTED] > > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 > San Diego, California-- Public Internet access / Mailing Lists > > To REMOVE yourself from this mailing list, send an E-Mail message > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > the message BODY, include a line containing: UNSUB ORACLE-L > (or the name of mailing list you want to be removed from). You may > also send the HELP command for other information (like subscribing). > > -- > Please see the official ORACLE-L FAQ: http://www.orafaq.com > -- > Author: James A > INET: [EMAIL PROTECTED] > > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 > San Diego, California-- Public Internet access / Mailing Lists > > To REMOVE yourself from this mailing list, send an E-Mail message > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > the message BODY, include a line containing: UNSUB ORACLE-L > (or the name of mailing list you want to be removed from). You may > also send the HELP command for other information (like subscribing). > > // George Schlossnagle // Principal Consultant // OmniTI, Inc http://www.omniti.com // (c) 301.343.6422 (e) [EMAIL PROTECTED] // 1024D/1100A5A0 1370 F70A 9365 96C9 2F5E 56C2 B2B9 262F 1100 A5A0 -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: George Schlossnagle INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
RE: EMC Storage Array Issue
One Reply from Oracle Dear Customer, Please go to the Oracle MetaLink ( http://metalink.oracle.com/ ) site to download the patch referenced below. Patch: 1685984 - DBWR TERMINATES WITH ORA-27062 AFTER ONE AIOWAIT TIMEOUT WARNING Password = Platform = Sun SPARC Solaris Product= Oracle Server Version= 8.1.6.3 Customers are reminded that one-off Oracle Server patches are not subject to the same rigorous level of testing as done for Oracle Server patch sets. Customers are encouraged to install and test this patch in a test environment prior to full production implementation. -Original Message- Sent: Tuesday, April 16, 2002 12:59 PM To: Multiple recipients of list ORACLE-L Do you have any more info on this BUG? I can't find anything that appears close to this on Metaclink. Rich Jesse System/Database Administrator [EMAIL PROTECTED] Quad/Tech International, Sussex, WI USA > -Original Message- > From: James A [mailto:[EMAIL PROTECTED]] > Sent: Monday, April 15, 2002 1:24 PM > To: Multiple recipients of list ORACLE-L > Subject: RE: EMC Storage Array Issue > > > We ran into a similar issue on 8.1.6.0 for Solaris 32bit and Veritas > Volumes. Oracle noted this as a bug in their release and > suggest go to > 8.1.6.3 or better 8.1.7.3. > We are testing this now. So far it seems to work. -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Jesse, Rich INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing). -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: James A INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
RE: EMC Storage Array Issue
Do you have any more info on this BUG? I can't find anything that appears close to this on Metaclink. Rich Jesse System/Database Administrator [EMAIL PROTECTED] Quad/Tech International, Sussex, WI USA > -Original Message- > From: James A [mailto:[EMAIL PROTECTED]] > Sent: Monday, April 15, 2002 1:24 PM > To: Multiple recipients of list ORACLE-L > Subject: RE: EMC Storage Array Issue > > > We ran into a similar issue on 8.1.6.0 for Solaris 32bit and Veritas > Volumes. Oracle noted this as a bug in their release and > suggest go to > 8.1.6.3 or better 8.1.7.3. > We are testing this now. So far it seems to work. -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Jesse, Rich INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
Re: EMC Storage Array Issue
It seems silly to get into a semantic argument over this. My point was
that Oracle in fact does use asynchronous io as far as the POSIX
definition of aio. Just because the ocntrolling thread looks in on the
status of the aiocb when it is signaled upon completion doesn't make it
any less asynchronous.
On Monday, April 15, 2002, at 06:23 PM, Anjo Kolk wrote:
> George,
>
> Those writes are unbuffered (so synchronous) and each thread will write
> them
> out and will wait for the write to finish and then update the AIO
> control
> block in the parent thread to indicate that the I/O took place. The
> parent
> thread will check this control block to make sure that the I/O really
> happened. If there is an error or some time out experid and the i/o
> didn't
> complete, the parent thread will assume an error.
>
> Anjo.
>
>
> George Schlossnagle wrote:
>
>> On Monday, April 15, 2002, at 02:08 PM, Anjo Kolk wrote:
>>
>>> Claudio,
>>>
>>> All writes in Oracle are synchronous, they are just fired
>>> asynchronously. So
>>> even the DBWR writes synchronously.
>>
>> My dbw uses asynchronous writes I'm writing to qio files, which
>> means that they bypass buffer cache, but I think it's misleading to
>> call
>> those 'synchronous writes', they're asynchronous, unbuffered writes.
>>
>> 14:28:09(george@core-0)[~]> truss -tkaio -twrite -tread -p `ps -ef |
>> grep dbw | grep -v grep | awk '{print $2}'`
>> kaio(AIOWRITE, 396, 0xB0258000, 8192, 0x4FBF6000, 0x01974EC8) = 0
>> kaio(AIOWRITE, 308, 0xB6BFE000, 8192, 0x48478000, 0x01B20518) = 0
>> kaio(AIOWRITE, 396, 0xB921A000, 8192, 0x249E8000, 0x019C5558) = 0
>> kaio(AIOWRITE, 396, 0xB4584000, 8192, 0x24F7E000, 0x0196CA84) = 0
>> kaio(AIOWRITE, 396, 0xB82BC000, 8192, 0x6D822000, 0x01B543CC) = 0
>> kaio(AIOWRITE, 313, 0xB5ED4000, 8192, 0x1FCD2000, 0x019EE1D8) = 0
>> kaio(AIOWRITE, 395, 0xBF256000, 8192, 0x21AE6000, 0x01971958) = 0
>> kaio(AIOWRITE, 313, 0xB170, 8192, 0x1FCD4000, 0x019B65D0) = 0
>> kaio(AIOWRITE, 396, 0xBA238000, 8192, 0x24F86000, 0x01B5E32C) = 0
>>
>>
>>> So individual writes are synchronously, they are just fired off
>>> asynchronously.
>>>
>>> Anjo Kolk.
>>>
>>> claudio cutelli wrote:
>>>
Hi,
which background process had the problem?
because if lgwr, it already write in sync mode ...
- Original Message -
To: "Multiple recipients of list ORACLE-L" <[EMAIL PROTECTED]>
Sent: Monday, April 15, 2002 5:33 PM
> We have implemented a Sun Solaris Cluster (4 machines),
> connected
> to
> an EMC storage array. The migration began last fall, and we now
> have
> 15
> Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there.
> We
> recently have had 2 occurances of asynchronous I/O wait times
> exceeded.
> When this occurs, every database crashes at the same time. The
> solution
> from EMC is to turn asynchronous I/O off in all of the Oracle
> instances
> (disk_async_io = false) and to increase the database writer slaves
> (dbwr_io_slaves = ) to emulate asynchronous I/O.
> Has anyone run into this problem before? If so, how did you
> "correct" it? My feeling is that EMC is trying to give us a bandage
> to
> cover up the real problem, by trying to get Oracle to ignore it.
>
> Thank you.
>
> --
> Scott Canaan ([EMAIL PROTECTED])
> (585) 475-7886
> "Life is like a sewer, what you get out of it depends on what you
> put
> into it" - Tom Lehrer
>
>
> --
> Please see the official ORACLE-L FAQ: http://www.orafaq.com
> --
> Author: Scott Canaan
> INET: [EMAIL PROTECTED]
>
> Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051
> San Diego, California-- Public Internet access / Mailing
> Lists
>
> To REMOVE yourself from this mailing list, send an E-Mail message
> to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in
> the message BODY, include a line containing: UNSUB ORACLE-L
> (or the name of mailing list you want to be removed from). You may
> also send the HELP command for other information (like subscribing).
>
--
Please see the official ORACLE-L FAQ: http://www.orafaq.com
--
Author: claudio cutelli
INET: [EMAIL PROTECTED]
Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051
San Diego, California-- Public Internet access / Mailing
Lists
To REMOVE yourself from this mailing list, send an E-Mail message
to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in
the message BODY, include a line containing: UNSUB ORACLE-L
(or the name of mailing list you want to be removed from). You may
also send the HELP command for ot
Re: EMC Storage Array Issue
George,
Those writes are unbuffered (so synchronous) and each thread will write them
out and will wait for the write to finish and then update the AIO control
block in the parent thread to indicate that the I/O took place. The parent
thread will check this control block to make sure that the I/O really
happened. If there is an error or some time out experid and the i/o didn't
complete, the parent thread will assume an error.
Anjo.
George Schlossnagle wrote:
> On Monday, April 15, 2002, at 02:08 PM, Anjo Kolk wrote:
>
> > Claudio,
> >
> > All writes in Oracle are synchronous, they are just fired
> > asynchronously. So
> > even the DBWR writes synchronously.
>
> My dbw uses asynchronous writes I'm writing to qio files, which
> means that they bypass buffer cache, but I think it's misleading to call
> those 'synchronous writes', they're asynchronous, unbuffered writes.
>
> 14:28:09(george@core-0)[~]> truss -tkaio -twrite -tread -p `ps -ef |
> grep dbw | grep -v grep | awk '{print $2}'`
> kaio(AIOWRITE, 396, 0xB0258000, 8192, 0x4FBF6000, 0x01974EC8) = 0
> kaio(AIOWRITE, 308, 0xB6BFE000, 8192, 0x48478000, 0x01B20518) = 0
> kaio(AIOWRITE, 396, 0xB921A000, 8192, 0x249E8000, 0x019C5558) = 0
> kaio(AIOWRITE, 396, 0xB4584000, 8192, 0x24F7E000, 0x0196CA84) = 0
> kaio(AIOWRITE, 396, 0xB82BC000, 8192, 0x6D822000, 0x01B543CC) = 0
> kaio(AIOWRITE, 313, 0xB5ED4000, 8192, 0x1FCD2000, 0x019EE1D8) = 0
> kaio(AIOWRITE, 395, 0xBF256000, 8192, 0x21AE6000, 0x01971958) = 0
> kaio(AIOWRITE, 313, 0xB170, 8192, 0x1FCD4000, 0x019B65D0) = 0
> kaio(AIOWRITE, 396, 0xBA238000, 8192, 0x24F86000, 0x01B5E32C) = 0
>
>
> > So individual writes are synchronously, they are just fired off
> > asynchronously.
> >
> > Anjo Kolk.
> >
> > claudio cutelli wrote:
> >
> >> Hi,
> >> which background process had the problem?
> >> because if lgwr, it already write in sync mode ...
> >>
> >> - Original Message -
> >> To: "Multiple recipients of list ORACLE-L" <[EMAIL PROTECTED]>
> >> Sent: Monday, April 15, 2002 5:33 PM
> >>
> >>> We have implemented a Sun Solaris Cluster (4 machines), connected
> >>> to
> >>> an EMC storage array. The migration began last fall, and we now have
> >>> 15
> >>> Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there.
> >>> We
> >>> recently have had 2 occurances of asynchronous I/O wait times
> >>> exceeded.
> >>> When this occurs, every database crashes at the same time. The
> >>> solution
> >>> from EMC is to turn asynchronous I/O off in all of the Oracle
> >>> instances
> >>> (disk_async_io = false) and to increase the database writer slaves
> >>> (dbwr_io_slaves = ) to emulate asynchronous I/O.
> >>> Has anyone run into this problem before? If so, how did you
> >>> "correct" it? My feeling is that EMC is trying to give us a bandage
> >>> to
> >>> cover up the real problem, by trying to get Oracle to ignore it.
> >>>
> >>> Thank you.
> >>>
> >>> --
> >>> Scott Canaan ([EMAIL PROTECTED])
> >>> (585) 475-7886
> >>> "Life is like a sewer, what you get out of it depends on what you put
> >>> into it" - Tom Lehrer
> >>>
> >>>
> >>> --
> >>> Please see the official ORACLE-L FAQ: http://www.orafaq.com
> >>> --
> >>> Author: Scott Canaan
> >>> INET: [EMAIL PROTECTED]
> >>>
> >>> Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051
> >>> San Diego, California-- Public Internet access / Mailing Lists
> >>>
> >>> To REMOVE yourself from this mailing list, send an E-Mail message
> >>> to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in
> >>> the message BODY, include a line containing: UNSUB ORACLE-L
> >>> (or the name of mailing list you want to be removed from). You may
> >>> also send the HELP command for other information (like subscribing).
> >>>
> >> --
> >> Please see the official ORACLE-L FAQ: http://www.orafaq.com
> >> --
> >> Author: claudio cutelli
> >> INET: [EMAIL PROTECTED]
> >>
> >> Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051
> >> San Diego, California-- Public Internet access / Mailing Lists
> >>
> >> To REMOVE yourself from this mailing list, send an E-Mail message
> >> to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in
> >> the message BODY, include a line containing: UNSUB ORACLE-L
> >> (or the name of mailing list you want to be removed from). You may
> >> also send the HELP command for other information (like subscribing).
> >
> >
> > --
> > Please see the official ORACLE-L FAQ: http://www.orafaq.com
> > --
> > Author: Anjo Kolk
> > INET: [EMAIL PROTECTED]
> >
> > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051
> > San Diego, California-- Public Internet access / Mailing Lists
> >
> > To REMOVE yourself from this mailing list, send an E-Mail m
Re: EMC Storage Array Issue
On Monday, April 15, 2002, at 02:08 PM, Anjo Kolk wrote:
> Claudio,
>
> All writes in Oracle are synchronous, they are just fired
> asynchronously. So
> even the DBWR writes synchronously.
My dbw uses asynchronous writes I'm writing to qio files, which
means that they bypass buffer cache, but I think it's misleading to call
those 'synchronous writes', they're asynchronous, unbuffered writes.
14:28:09(george@core-0)[~]> truss -tkaio -twrite -tread -p `ps -ef |
grep dbw | grep -v grep | awk '{print $2}'`
kaio(AIOWRITE, 396, 0xB0258000, 8192, 0x4FBF6000, 0x01974EC8) = 0
kaio(AIOWRITE, 308, 0xB6BFE000, 8192, 0x48478000, 0x01B20518) = 0
kaio(AIOWRITE, 396, 0xB921A000, 8192, 0x249E8000, 0x019C5558) = 0
kaio(AIOWRITE, 396, 0xB4584000, 8192, 0x24F7E000, 0x0196CA84) = 0
kaio(AIOWRITE, 396, 0xB82BC000, 8192, 0x6D822000, 0x01B543CC) = 0
kaio(AIOWRITE, 313, 0xB5ED4000, 8192, 0x1FCD2000, 0x019EE1D8) = 0
kaio(AIOWRITE, 395, 0xBF256000, 8192, 0x21AE6000, 0x01971958) = 0
kaio(AIOWRITE, 313, 0xB170, 8192, 0x1FCD4000, 0x019B65D0) = 0
kaio(AIOWRITE, 396, 0xBA238000, 8192, 0x24F86000, 0x01B5E32C) = 0
> So individual writes are synchronously, they are just fired off
> asynchronously.
>
> Anjo Kolk.
>
> claudio cutelli wrote:
>
>> Hi,
>> which background process had the problem?
>> because if lgwr, it already write in sync mode ...
>>
>> - Original Message -
>> To: "Multiple recipients of list ORACLE-L" <[EMAIL PROTECTED]>
>> Sent: Monday, April 15, 2002 5:33 PM
>>
>>> We have implemented a Sun Solaris Cluster (4 machines), connected
>>> to
>>> an EMC storage array. The migration began last fall, and we now have
>>> 15
>>> Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there.
>>> We
>>> recently have had 2 occurances of asynchronous I/O wait times
>>> exceeded.
>>> When this occurs, every database crashes at the same time. The
>>> solution
>>> from EMC is to turn asynchronous I/O off in all of the Oracle
>>> instances
>>> (disk_async_io = false) and to increase the database writer slaves
>>> (dbwr_io_slaves = ) to emulate asynchronous I/O.
>>> Has anyone run into this problem before? If so, how did you
>>> "correct" it? My feeling is that EMC is trying to give us a bandage
>>> to
>>> cover up the real problem, by trying to get Oracle to ignore it.
>>>
>>> Thank you.
>>>
>>> --
>>> Scott Canaan ([EMAIL PROTECTED])
>>> (585) 475-7886
>>> "Life is like a sewer, what you get out of it depends on what you put
>>> into it" - Tom Lehrer
>>>
>>>
>>> --
>>> Please see the official ORACLE-L FAQ: http://www.orafaq.com
>>> --
>>> Author: Scott Canaan
>>> INET: [EMAIL PROTECTED]
>>>
>>> Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051
>>> San Diego, California-- Public Internet access / Mailing Lists
>>>
>>> To REMOVE yourself from this mailing list, send an E-Mail message
>>> to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in
>>> the message BODY, include a line containing: UNSUB ORACLE-L
>>> (or the name of mailing list you want to be removed from). You may
>>> also send the HELP command for other information (like subscribing).
>>>
>> --
>> Please see the official ORACLE-L FAQ: http://www.orafaq.com
>> --
>> Author: claudio cutelli
>> INET: [EMAIL PROTECTED]
>>
>> Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051
>> San Diego, California-- Public Internet access / Mailing Lists
>>
>> To REMOVE yourself from this mailing list, send an E-Mail message
>> to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in
>> the message BODY, include a line containing: UNSUB ORACLE-L
>> (or the name of mailing list you want to be removed from). You may
>> also send the HELP command for other information (like subscribing).
>
>
> --
> Please see the official ORACLE-L FAQ: http://www.orafaq.com
> --
> Author: Anjo Kolk
> INET: [EMAIL PROTECTED]
>
> Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051
> San Diego, California-- Public Internet access / Mailing Lists
>
> To REMOVE yourself from this mailing list, send an E-Mail message
> to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in
> the message BODY, include a line containing: UNSUB ORACLE-L
> (or the name of mailing list you want to be removed from). You may
> also send the HELP command for other information (like subscribing).
>
>
// George Schlossnagle
// Principal Consultant
// OmniTI, Inc http://www.omniti.com
// (c) 301.343.6422 (e) [EMAIL PROTECTED]
// 1024D/1100A5A0 1370 F70A 9365 96C9 2F5E 56C2 B2B9 262F 1100 A5A0
--
Please see the official ORACLE-L FAQ: http://www.orafaq.com
--
Author: George Schlossnagle
INET: [EMAIL PROTECTED]
Fat City Network Services-- (858) 538-5051 FAX: (85
RE: EMC Storage Array Issue
We ran into a similar issue on 8.1.6.0 for Solaris 32bit and Veritas Volumes. Oracle noted this as a bug in their release and suggest go to 8.1.6.3 or better 8.1.7.3. We are testing this now. So far it seems to work. -Original Message- Canaan Sent: Monday, April 15, 2002 11:34 AM To: Multiple recipients of list ORACLE-L We have implemented a Sun Solaris Cluster (4 machines), connected to an EMC storage array. The migration began last fall, and we now have 15 Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there. We recently have had 2 occurances of asynchronous I/O wait times exceeded. When this occurs, every database crashes at the same time. The solution from EMC is to turn asynchronous I/O off in all of the Oracle instances (disk_async_io = false) and to increase the database writer slaves (dbwr_io_slaves = ) to emulate asynchronous I/O. Has anyone run into this problem before? If so, how did you "correct" it? My feeling is that EMC is trying to give us a bandage to cover up the real problem, by trying to get Oracle to ignore it. Thank you. -- Scott Canaan ([EMAIL PROTECTED]) (585) 475-7886 "Life is like a sewer, what you get out of it depends on what you put into it" - Tom Lehrer -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Scott Canaan INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing). -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: James A INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
Re: EMC Storage Array Issue
Claudio, All writes in Oracle are synchronous, they are just fired asynchronously. So even the DBWR writes synchronously. So individual writes are synchronously, they are just fired off asynchronously. Anjo Kolk. claudio cutelli wrote: > Hi, > which background process had the problem? > because if lgwr, it already write in sync mode ... > > - Original Message - > To: "Multiple recipients of list ORACLE-L" <[EMAIL PROTECTED]> > Sent: Monday, April 15, 2002 5:33 PM > > > We have implemented a Sun Solaris Cluster (4 machines), connected to > > an EMC storage array. The migration began last fall, and we now have 15 > > Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there. We > > recently have had 2 occurances of asynchronous I/O wait times exceeded. > > When this occurs, every database crashes at the same time. The solution > > from EMC is to turn asynchronous I/O off in all of the Oracle instances > > (disk_async_io = false) and to increase the database writer slaves > > (dbwr_io_slaves = ) to emulate asynchronous I/O. > > Has anyone run into this problem before? If so, how did you > > "correct" it? My feeling is that EMC is trying to give us a bandage to > > cover up the real problem, by trying to get Oracle to ignore it. > > > > Thank you. > > > > -- > > Scott Canaan ([EMAIL PROTECTED]) > > (585) 475-7886 > > "Life is like a sewer, what you get out of it depends on what you put > > into it" - Tom Lehrer > > > > > > -- > > Please see the official ORACLE-L FAQ: http://www.orafaq.com > > -- > > Author: Scott Canaan > > INET: [EMAIL PROTECTED] > > > > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 > > San Diego, California-- Public Internet access / Mailing Lists > > > > To REMOVE yourself from this mailing list, send an E-Mail message > > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > > the message BODY, include a line containing: UNSUB ORACLE-L > > (or the name of mailing list you want to be removed from). You may > > also send the HELP command for other information (like subscribing). > > > -- > Please see the official ORACLE-L FAQ: http://www.orafaq.com > -- > Author: claudio cutelli > INET: [EMAIL PROTECTED] > > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 > San Diego, California-- Public Internet access / Mailing Lists > > To REMOVE yourself from this mailing list, send an E-Mail message > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > the message BODY, include a line containing: UNSUB ORACLE-L > (or the name of mailing list you want to be removed from). You may > also send the HELP command for other information (like subscribing). -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Anjo Kolk INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
Re: EMC Storage Array Issue
Are you running Veritas as well? There are (I belive still outstanding) bugs with VXFS/VXVM on Oracle which cause these errors. Also, are you seeing high latency right times or experiencing 'hangs' in IO to your symmetrix? I've also seen faulty fiber cabling cause this problem (basically all IO to the symmetrix blocked, and the asynch io's timed-out. George On Monday, April 15, 2002, at 01:19 PM, Scott Canaan wrote: > Claudio, > I didn't think to mention the process. It is always the ckpt > (checkpoint) > background process that reports the problem. The database goes down > with an > ORA-27062. > > claudio cutelli wrote: > >> Hi, >> which background process had the problem? >> because if lgwr, it already write in sync mode ... >> >> - Original Message - >> To: "Multiple recipients of list ORACLE-L" <[EMAIL PROTECTED]> >> Sent: Monday, April 15, 2002 5:33 PM >> >>> We have implemented a Sun Solaris Cluster (4 machines), connected >>> to >>> an EMC storage array. The migration began last fall, and we now have >>> 15 >>> Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there. >>> We >>> recently have had 2 occurances of asynchronous I/O wait times >>> exceeded. >>> When this occurs, every database crashes at the same time. The >>> solution >>> from EMC is to turn asynchronous I/O off in all of the Oracle >>> instances >>> (disk_async_io = false) and to increase the database writer slaves >>> (dbwr_io_slaves = ) to emulate asynchronous I/O. >>> Has anyone run into this problem before? If so, how did you >>> "correct" it? My feeling is that EMC is trying to give us a bandage >>> to >>> cover up the real problem, by trying to get Oracle to ignore it. >>> >>> Thank you. >>> >>> -- >>> Scott Canaan ([EMAIL PROTECTED]) >>> (585) 475-7886 >>> "Life is like a sewer, what you get out of it depends on what you put >>> into it" - Tom Lehrer >>> >>> >>> -- >>> Please see the official ORACLE-L FAQ: http://www.orafaq.com >>> -- >>> Author: Scott Canaan >>> INET: [EMAIL PROTECTED] >>> >>> Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 >>> San Diego, California-- Public Internet access / Mailing Lists >>> >>> To REMOVE yourself from this mailing list, send an E-Mail message >>> to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in >>> the message BODY, include a line containing: UNSUB ORACLE-L >>> (or the name of mailing list you want to be removed from). You may >>> also send the HELP command for other information (like subscribing). >>> >> -- >> Please see the official ORACLE-L FAQ: http://www.orafaq.com >> -- >> Author: claudio cutelli >> INET: [EMAIL PROTECTED] >> >> Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 >> San Diego, California-- Public Internet access / Mailing Lists >> >> To REMOVE yourself from this mailing list, send an E-Mail message >> to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in >> the message BODY, include a line containing: UNSUB ORACLE-L >> (or the name of mailing list you want to be removed from). You may >> also send the HELP command for other information (like subscribing). > > -- > Scott Canaan ([EMAIL PROTECTED]) > (585) 475-7886 > "Life is like a sewer, what you get out of it depends on what you put > into it" > - Tom Lehrer > > > -- > Please see the official ORACLE-L FAQ: http://www.orafaq.com > -- > Author: Scott Canaan > INET: [EMAIL PROTECTED] > > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 > San Diego, California-- Public Internet access / Mailing Lists > > To REMOVE yourself from this mailing list, send an E-Mail message > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > the message BODY, include a line containing: UNSUB ORACLE-L > (or the name of mailing list you want to be removed from). You may > also send the HELP command for other information (like subscribing). > > // George Schlossnagle // Principal Consultant // OmniTI, Inc http://www.omniti.com // (c) 301.343.6422 (e) [EMAIL PROTECTED] // 1024D/1100A5A0 1370 F70A 9365 96C9 2F5E 56C2 B2B9 262F 1100 A5A0 -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: George Schlossnagle INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for
Re: EMC Storage Array Issue
Claudio, I didn't think to mention the process. It is always the ckpt (checkpoint) background process that reports the problem. The database goes down with an ORA-27062. claudio cutelli wrote: > Hi, > which background process had the problem? > because if lgwr, it already write in sync mode ... > > - Original Message - > To: "Multiple recipients of list ORACLE-L" <[EMAIL PROTECTED]> > Sent: Monday, April 15, 2002 5:33 PM > > > We have implemented a Sun Solaris Cluster (4 machines), connected to > > an EMC storage array. The migration began last fall, and we now have 15 > > Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there. We > > recently have had 2 occurances of asynchronous I/O wait times exceeded. > > When this occurs, every database crashes at the same time. The solution > > from EMC is to turn asynchronous I/O off in all of the Oracle instances > > (disk_async_io = false) and to increase the database writer slaves > > (dbwr_io_slaves = ) to emulate asynchronous I/O. > > Has anyone run into this problem before? If so, how did you > > "correct" it? My feeling is that EMC is trying to give us a bandage to > > cover up the real problem, by trying to get Oracle to ignore it. > > > > Thank you. > > > > -- > > Scott Canaan ([EMAIL PROTECTED]) > > (585) 475-7886 > > "Life is like a sewer, what you get out of it depends on what you put > > into it" - Tom Lehrer > > > > > > -- > > Please see the official ORACLE-L FAQ: http://www.orafaq.com > > -- > > Author: Scott Canaan > > INET: [EMAIL PROTECTED] > > > > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 > > San Diego, California-- Public Internet access / Mailing Lists > > > > To REMOVE yourself from this mailing list, send an E-Mail message > > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > > the message BODY, include a line containing: UNSUB ORACLE-L > > (or the name of mailing list you want to be removed from). You may > > also send the HELP command for other information (like subscribing). > > > -- > Please see the official ORACLE-L FAQ: http://www.orafaq.com > -- > Author: claudio cutelli > INET: [EMAIL PROTECTED] > > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 > San Diego, California-- Public Internet access / Mailing Lists > > To REMOVE yourself from this mailing list, send an E-Mail message > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > the message BODY, include a line containing: UNSUB ORACLE-L > (or the name of mailing list you want to be removed from). You may > also send the HELP command for other information (like subscribing). -- Scott Canaan ([EMAIL PROTECTED]) (585) 475-7886 "Life is like a sewer, what you get out of it depends on what you put into it" - Tom Lehrer -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Scott Canaan INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
RE: EMC Storage Array Issue
Getting an error means having i/o problems. Disabling async_io and increasing slaves means stopping the error but does not mean any performance gain since there are io issues. I think they have to find and trace the time out errors and try to fix them. Are you using raw or cooked (i assume raw)? -Original Message- To: Multiple recipients of list ORACLE-L Sent: 4/15/02 10:33 AM We have implemented a Sun Solaris Cluster (4 machines), connected to an EMC storage array. The migration began last fall, and we now have 15 Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there. We recently have had 2 occurances of asynchronous I/O wait times exceeded. When this occurs, every database crashes at the same time. The solution from EMC is to turn asynchronous I/O off in all of the Oracle instances (disk_async_io = false) and to increase the database writer slaves (dbwr_io_slaves = ) to emulate asynchronous I/O. Has anyone run into this problem before? If so, how did you "correct" it? My feeling is that EMC is trying to give us a bandage to cover up the real problem, by trying to get Oracle to ignore it. Thank you. -- Scott Canaan ([EMAIL PROTECTED]) (585) 475-7886 "Life is like a sewer, what you get out of it depends on what you put into it" - Tom Lehrer -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Scott Canaan INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing). -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Khedr, Waleed INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
Re: EMC Storage Array Issue
Which filesystem/volume manager are you using, if any? That is potentially where you would want to look if the async write queue is getting backed up. Just shutting off async is a terrible suggestion from EMC. I am suprised at them. -- Jeremiah Wilton http://www.speakeasy.net/~jwilton On Mon, 15 Apr 2002, Scott Canaan wrote: > We have implemented a Sun Solaris Cluster (4 machines), connected to > an EMC storage array. The migration began last fall, and we now have 15 > Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there. We > recently have had 2 occurances of asynchronous I/O wait times exceeded. > When this occurs, every database crashes at the same time. The solution > from EMC is to turn asynchronous I/O off in all of the Oracle instances > (disk_async_io = false) and to increase the database writer slaves > (dbwr_io_slaves = ) to emulate asynchronous I/O. > Has anyone run into this problem before? If so, how did you > "correct" it? My feeling is that EMC is trying to give us a bandage to > cover up the real problem, by trying to get Oracle to ignore it. -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Jeremiah Wilton INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
Re: EMC Storage Array Issue
Hi Scott, Recently we had issues with EMC. Last week we started getting IO timeout on one of our frames followed by files being accessed disappearing. We lost controlfiles, redo log files and library files. EMC hasn't been able to tell us why it happended. I would like to hear about solutions/explanation they come up with for your problem. Regards, Denny Quoting Scott Canaan <[EMAIL PROTECTED]>: > We have implemented a Sun Solaris Cluster (4 machines), connected > to > an EMC storage array. The migration began last fall, and we now have > 15 > Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there. > We > recently have had 2 occurances of asynchronous I/O wait times > exceeded. > When this occurs, every database crashes at the same time. The > solution > from EMC is to turn asynchronous I/O off in all of the Oracle > instances > (disk_async_io = false) and to increase the database writer slaves > (dbwr_io_slaves = ) to emulate asynchronous I/O. > Has anyone run into this problem before? If so, how did you > "correct" it? My feeling is that EMC is trying to give us a bandage > to > cover up the real problem, by trying to get Oracle to ignore it. > > Thank you. > > -- > Scott Canaan ([EMAIL PROTECTED]) > (585) 475-7886 > "Life is like a sewer, what you get out of it depends on what you put > into it" - Tom Lehrer -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Denny Koovakattu INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
Re: EMC Storage Array Issue
Hi, which background process had the problem? because if lgwr, it already write in sync mode ... - Original Message - To: "Multiple recipients of list ORACLE-L" <[EMAIL PROTECTED]> Sent: Monday, April 15, 2002 5:33 PM > We have implemented a Sun Solaris Cluster (4 machines), connected to > an EMC storage array. The migration began last fall, and we now have 15 > Oracle instances, with a mixture of 8.1.6 and 8.1.7, located there. We > recently have had 2 occurances of asynchronous I/O wait times exceeded. > When this occurs, every database crashes at the same time. The solution > from EMC is to turn asynchronous I/O off in all of the Oracle instances > (disk_async_io = false) and to increase the database writer slaves > (dbwr_io_slaves = ) to emulate asynchronous I/O. > Has anyone run into this problem before? If so, how did you > "correct" it? My feeling is that EMC is trying to give us a bandage to > cover up the real problem, by trying to get Oracle to ignore it. > > Thank you. > > -- > Scott Canaan ([EMAIL PROTECTED]) > (585) 475-7886 > "Life is like a sewer, what you get out of it depends on what you put > into it" - Tom Lehrer > > > -- > Please see the official ORACLE-L FAQ: http://www.orafaq.com > -- > Author: Scott Canaan > INET: [EMAIL PROTECTED] > > Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 > San Diego, California-- Public Internet access / Mailing Lists > > To REMOVE yourself from this mailing list, send an E-Mail message > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > the message BODY, include a line containing: UNSUB ORACLE-L > (or the name of mailing list you want to be removed from). You may > also send the HELP command for other information (like subscribing). > -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: claudio cutelli INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
