Re: Export Split Script (FAO LISA)

2003-11-03 Thread Pete Finnigan
Hi

Not sure what the original question was BUT the script offered splits
exports so you may be interested in a tool Kurt van Meerbeeck and
Kugendran Naidoo wrote called Ora*PePi availbale on sourceforge - the
description from there reads:

quote
Ora*PePi is a superset of the Oracle export/import tools - providing
simultaneous synchronised parallel export and import, NET8 load
balancing, at runtime adjustable parallel degree and large table run
ratio, down to partition level.
/quote

The link is http://sourceforge.net/projects/pepi

hth

kind regards
Pete
-- 
Pete Finnigan
email:[EMAIL PROTECTED]
Web site: http://www.petefinnigan.com - Oracle security audit specialists
Book:Oracle security step-by-step Guide - see http://store.sans.org for details.

-- 
Please see the official ORACLE-L FAQ: http://www.orafaq.net
-- 
Author: Pete Finnigan
  INET: [EMAIL PROTECTED]

Fat City Network Services-- 858-538-5051 http://www.fatcity.com
San Diego, California-- Mailing list and web hosting services
-
To REMOVE yourself from this mailing list, send an E-Mail message
to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in
the message BODY, include a line containing: UNSUB ORACLE-L
(or the name of mailing list you want to be removed from).  You may
also send the HELP command for other information (like subscribing).


RE: Export Split Script (FAO LISA)

2003-10-30 Thread Robertson Lee - lerobe
Also found this in my archives, courtesy of Rachel.

Regards

Lee

-Original Message-
Sent: 16 May 2001 22:28
To: Multiple recipients of list ORACLE-L


there is a note out on Metalink on how to do this. You can also break the 
export into separate files in later versions of Oracle8i. or you can run the

following script (modified to suit your system, it was last tested on 
Solaris/Oracle 7.3.4)

#!/bin/sh
#
cd $EXPORT_DIR
#
# set maximum file size for each chunk of the export file
#
MAXFILESIZE=2000m
export MAXFILESIZE
#
# create filenames for the parts of the backup... for now let's go to 3
#
FILENAME1=$EXPORT_DIR/backup1_$ORACLE_SID.dmp
FILENAME2=$EXPORT_DIR/backup2_$ORACLE_SID.dmp
FILENAME3=$EXPORT_DIR/backup3_$ORACLE_SID.dmp
LOGFILE=$EXPORT_DIR/backup_$ORACLE_SID.log
#
# save off the old ones
#
mv $FILENAME1 $FILENAME1.old
if [ -f $FILENAME2 ]
then
mv $FILENAME2 $FILENAME2.old
fi
if [ -f $FILENAME3 ]
then
mv $FILENAME3 $FILENAME3.old
fi
mv $LOGFILE $LOGFILE.old
#
# create the pipes
#
mkfifo exportpipeaa
mkfifo exportpipeab
mkfifo exportpipeac
mkfifo wrkpipe
umask 000
#
# start the readers from the pipes to create the export files
#
dd if=exportpipeaa of=$FILENAME1 
dd if=exportpipeab of=$FILENAME2 
dd if=exportpipeac of=$FILENAME3 
#
# start the reader from the wrkpipe to compress and split the export
#
dd if=wrkpipe|compress|split -b $MAXFILESIZE - exportpipe 
#
# start the export for real
#
exp / file=wrkpipe full=y compress=n buffer=4096000 LOG=$LOGFILE
#
# clean up after ourselves
#
rm exportpipeaa exportpipeab exportpipeac wrkpipe
#
# if you haven't used all the pipes, the dd may still linger on
# make sure to REALLY clean up
#
ps -ef|grep exportpipe|grep -vi grep|awk '{printf (kill -9 %d; 
\n,$2)}'kill.lst
chmod u+x kill.lst
sh kill.lst
rm kill.lst



now to import from those split files


#!/bin/sh
#
cd $EXPORT_DIR
#
# create filenames for the parts of the backup... for now let's go to 3
#
FILENAME1=$EXPORT_DIR/backup1_$ORACLE_SID.dmp
FILENAME2=$EXPORT_DIR/backup2_$ORACLE_SID.dmp
FILENAME3=$EXPORT_DIR/backup3_$ORACLE_SID.dmp
LOGFILE=$EXPORT_DIR/backup_$ORACLE_SID.log
#
# create the pipe to import from
#
mkfifo wrkpipe
umask 000
#
# start the reader from the import pipe
#
imp / file=wrkpipe full=y commit=y buffer=4096000 LOG=$LOGFILE 
#
# create the import stream coming from the pipes
#
cat $FILENAME1 $FILENAME2 $FILENAME3 | uncompress | dd of=wrkpipe
#
# clean up the import pipe
#
rm wrkpipe



From: Armstead, Michael A [EMAIL PROTECTED]
Reply-To: [EMAIL PROTECTED]
To: Multiple recipients of list ORACLE-L [EMAIL PROTECTED]
Subject: RE: Export Split Script
Date: Wed, 16 May 2001 13:07:24 -0800

Rajaram,

Please give me details on how to use mknod to split export files larger 
than
2 GB. We have broken our jobs into over 50 separate export jobs on the 
table
level just to keep our files less than 2GB.

Michael Armstead
Application Database Administrator, OCP-Certified
US Pharmaceuticals IT
Glaxo SmithKline

  -Original Message-
  From:   Rajaram [SMTP:[EMAIL PROTECTED]
  Sent:   Wednesday, May 16, 2001 4:31 PM
  To: Multiple recipients of list ORACLE-L
  Subject:RE: Export Split Script
 
  If you are using Oracle on Unix , You may want to use unix pipes ( 
mknod).
  - most people use this method to manage files  2GB.
 
  Rajaram
  (Now that I am at the top of a mountain - I dont know how to get down!)
 
  -Original Message-
  From:   Smith, Ron L. [SMTP:[EMAIL PROTECTED]
  Sent:   Wednesday, May 16, 2001 3:57 PM
  To: Multiple recipients of list ORACLE-L
  Subject:Export Split Script
 
  I tries using a compressed export and the output is still over 2G.  Does
  anyone have the export script that splits the export files into multiple
  files?
 
  Ron Smith
  Database Administration
  [EMAIL PROTECTED]
 
 
  NetZero Platinum
  No Banner Ads and Unlimited Access
  Sign Up Today - Only $9.95 per month!
  http://www.netzero.net
  --
  Please see the official ORACLE-L FAQ: http://www.orafaq.com
  --
  Author: Rajaram
INET: [EMAIL PROTECTED]
 
  Fat City Network Services-- (858) 538-5051  FAX: (858) 538-5051
  San Diego, California-- Public Internet access / Mailing Lists
  
  To REMOVE yourself from this mailing list, send an E-Mail message
  to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in
  the message BODY, include a line containing: UNSUB ORACLE-L
  (or the name of mailing list you want to be removed from).  You may
  also send the HELP command for other information (like subscribing).

--
Please see the official ORACLE-L FAQ: http://www.orafaq.com
--
Author: Armstead, Michael A
   INET: [EMAIL PROTECTED]

Fat City Network Services-- (858) 538-5051  FAX: (858) 538-5051
San Diego, California-- Public Internet access / Mailing Lists

To REMOVE yourself from this mailing list, 

RE: Export Split Script (FAO LISA)

2003-10-30 Thread Rachel Carmichael
you can also use the FILESIZE parameter available in export since 8i
 
(the only docs I have are for 8.1.7 so I'm not sure if it was available
before that release)


--- Robertson Lee - lerobe [EMAIL PROTECTED] wrote:
 Also found this in my archives, courtesy of Rachel.
 
 Regards
 
 Lee
 
 -Original Message-
 Sent: 16 May 2001 22:28
 To: Multiple recipients of list ORACLE-L
 
 
 there is a note out on Metalink on how to do this. You can also break
 the 
 export into separate files in later versions of Oracle8i. or you can
 run the
 
 following script (modified to suit your system, it was last tested on
 
 Solaris/Oracle 7.3.4)
 
 #!/bin/sh
 #
 cd $EXPORT_DIR
 #
 # set maximum file size for each chunk of the export file
 #
 MAXFILESIZE=2000m
 export MAXFILESIZE
 #
 # create filenames for the parts of the backup... for now let's go to
 3
 #
 FILENAME1=$EXPORT_DIR/backup1_$ORACLE_SID.dmp
 FILENAME2=$EXPORT_DIR/backup2_$ORACLE_SID.dmp
 FILENAME3=$EXPORT_DIR/backup3_$ORACLE_SID.dmp
 LOGFILE=$EXPORT_DIR/backup_$ORACLE_SID.log
 #
 # save off the old ones
 #
 mv $FILENAME1 $FILENAME1.old
 if [ -f $FILENAME2 ]
 then
 mv $FILENAME2 $FILENAME2.old
 fi
 if [ -f $FILENAME3 ]
 then
 mv $FILENAME3 $FILENAME3.old
 fi
 mv $LOGFILE $LOGFILE.old
 #
 # create the pipes
 #
 mkfifo exportpipeaa
 mkfifo exportpipeab
 mkfifo exportpipeac
 mkfifo wrkpipe
 umask 000
 #
 # start the readers from the pipes to create the export files
 #
 dd if=exportpipeaa of=$FILENAME1 
 dd if=exportpipeab of=$FILENAME2 
 dd if=exportpipeac of=$FILENAME3 
 #
 # start the reader from the wrkpipe to compress and split the export
 #
 dd if=wrkpipe|compress|split -b $MAXFILESIZE - exportpipe 
 #
 # start the export for real
 #
 exp / file=wrkpipe full=y compress=n buffer=4096000 LOG=$LOGFILE
 #
 # clean up after ourselves
 #
 rm exportpipeaa exportpipeab exportpipeac wrkpipe
 #
 # if you haven't used all the pipes, the dd may still linger on
 # make sure to REALLY clean up
 #
 ps -ef|grep exportpipe|grep -vi grep|awk '{printf (kill -9 %d; 
 \n,$2)}'kill.lst
 chmod u+x kill.lst
 sh kill.lst
 rm kill.lst
 
 
 
 now to import from those split files
 
 
 #!/bin/sh
 #
 cd $EXPORT_DIR
 #
 # create filenames for the parts of the backup... for now let's go to
 3
 #
 FILENAME1=$EXPORT_DIR/backup1_$ORACLE_SID.dmp
 FILENAME2=$EXPORT_DIR/backup2_$ORACLE_SID.dmp
 FILENAME3=$EXPORT_DIR/backup3_$ORACLE_SID.dmp
 LOGFILE=$EXPORT_DIR/backup_$ORACLE_SID.log
 #
 # create the pipe to import from
 #
 mkfifo wrkpipe
 umask 000
 #
 # start the reader from the import pipe
 #
 imp / file=wrkpipe full=y commit=y buffer=4096000 LOG=$LOGFILE 
 #
 # create the import stream coming from the pipes
 #
 cat $FILENAME1 $FILENAME2 $FILENAME3 | uncompress | dd of=wrkpipe
 #
 # clean up the import pipe
 #
 rm wrkpipe
 
 
 
 From: Armstead, Michael A [EMAIL PROTECTED]
 Reply-To: [EMAIL PROTECTED]
 To: Multiple recipients of list ORACLE-L [EMAIL PROTECTED]
 Subject: RE: Export Split Script
 Date: Wed, 16 May 2001 13:07:24 -0800
 
 Rajaram,
 
 Please give me details on how to use mknod to split export files
 larger 
 than
 2 GB. We have broken our jobs into over 50 separate export jobs on
 the 
 table
 level just to keep our files less than 2GB.
 
 Michael Armstead
 Application Database Administrator, OCP-Certified
 US Pharmaceuticals IT
 Glaxo SmithKline
 
   -Original Message-
   From: Rajaram [SMTP:[EMAIL PROTECTED]
   Sent: Wednesday, May 16, 2001 4:31 PM
   To:   Multiple recipients of list ORACLE-L
   Subject:  RE: Export Split Script
  
   If you are using Oracle on Unix , You may want to use unix pipes
 ( 
 mknod).
   - most people use this method to manage files  2GB.
  
   Rajaram
   (Now that I am at the top of a mountain - I dont know how to get
 down!)
  
   -Original Message-
   From: Smith, Ron L. [SMTP:[EMAIL PROTECTED]
   Sent: Wednesday, May 16, 2001 3:57 PM
   To:   Multiple recipients of list ORACLE-L
   Subject:  Export Split Script
  
   I tries using a compressed export and the output is still over
 2G.  Does
   anyone have the export script that splits the export files into
 multiple
   files?
  
   Ron Smith
   Database Administration
   [EMAIL PROTECTED]
  
  
   NetZero Platinum
   No Banner Ads and Unlimited Access
   Sign Up Today - Only $9.95 per month!
   http://www.netzero.net
   --
   Please see the official ORACLE-L FAQ: http://www.orafaq.com
   --
   Author: Rajaram
 INET: [EMAIL PROTECTED]
  
   Fat City Network Services-- (858) 538-5051  FAX: (858)
 538-5051
   San Diego, California-- Public Internet access / Mailing
 Lists
  
 
   To REMOVE yourself from this mailing list, send an E-Mail message
   to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and
 in
   the message BODY, include a line containing: UNSUB ORACLE-L
   (or the name of mailing list you want to be removed from).  You
 may
   also send the HELP command