Re: Export Split Script (FAO LISA)
Hi Not sure what the original question was BUT the script offered splits exports so you may be interested in a tool Kurt van Meerbeeck and Kugendran Naidoo wrote called Ora*PePi availbale on sourceforge - the description from there reads: quote Ora*PePi is a superset of the Oracle export/import tools - providing simultaneous synchronised parallel export and import, NET8 load balancing, at runtime adjustable parallel degree and large table run ratio, down to partition level. /quote The link is http://sourceforge.net/projects/pepi hth kind regards Pete -- Pete Finnigan email:[EMAIL PROTECTED] Web site: http://www.petefinnigan.com - Oracle security audit specialists Book:Oracle security step-by-step Guide - see http://store.sans.org for details. -- Please see the official ORACLE-L FAQ: http://www.orafaq.net -- Author: Pete Finnigan INET: [EMAIL PROTECTED] Fat City Network Services-- 858-538-5051 http://www.fatcity.com San Diego, California-- Mailing list and web hosting services - To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
RE: Export Split Script (FAO LISA)
Also found this in my archives, courtesy of Rachel. Regards Lee -Original Message- Sent: 16 May 2001 22:28 To: Multiple recipients of list ORACLE-L there is a note out on Metalink on how to do this. You can also break the export into separate files in later versions of Oracle8i. or you can run the following script (modified to suit your system, it was last tested on Solaris/Oracle 7.3.4) #!/bin/sh # cd $EXPORT_DIR # # set maximum file size for each chunk of the export file # MAXFILESIZE=2000m export MAXFILESIZE # # create filenames for the parts of the backup... for now let's go to 3 # FILENAME1=$EXPORT_DIR/backup1_$ORACLE_SID.dmp FILENAME2=$EXPORT_DIR/backup2_$ORACLE_SID.dmp FILENAME3=$EXPORT_DIR/backup3_$ORACLE_SID.dmp LOGFILE=$EXPORT_DIR/backup_$ORACLE_SID.log # # save off the old ones # mv $FILENAME1 $FILENAME1.old if [ -f $FILENAME2 ] then mv $FILENAME2 $FILENAME2.old fi if [ -f $FILENAME3 ] then mv $FILENAME3 $FILENAME3.old fi mv $LOGFILE $LOGFILE.old # # create the pipes # mkfifo exportpipeaa mkfifo exportpipeab mkfifo exportpipeac mkfifo wrkpipe umask 000 # # start the readers from the pipes to create the export files # dd if=exportpipeaa of=$FILENAME1 dd if=exportpipeab of=$FILENAME2 dd if=exportpipeac of=$FILENAME3 # # start the reader from the wrkpipe to compress and split the export # dd if=wrkpipe|compress|split -b $MAXFILESIZE - exportpipe # # start the export for real # exp / file=wrkpipe full=y compress=n buffer=4096000 LOG=$LOGFILE # # clean up after ourselves # rm exportpipeaa exportpipeab exportpipeac wrkpipe # # if you haven't used all the pipes, the dd may still linger on # make sure to REALLY clean up # ps -ef|grep exportpipe|grep -vi grep|awk '{printf (kill -9 %d; \n,$2)}'kill.lst chmod u+x kill.lst sh kill.lst rm kill.lst now to import from those split files #!/bin/sh # cd $EXPORT_DIR # # create filenames for the parts of the backup... for now let's go to 3 # FILENAME1=$EXPORT_DIR/backup1_$ORACLE_SID.dmp FILENAME2=$EXPORT_DIR/backup2_$ORACLE_SID.dmp FILENAME3=$EXPORT_DIR/backup3_$ORACLE_SID.dmp LOGFILE=$EXPORT_DIR/backup_$ORACLE_SID.log # # create the pipe to import from # mkfifo wrkpipe umask 000 # # start the reader from the import pipe # imp / file=wrkpipe full=y commit=y buffer=4096000 LOG=$LOGFILE # # create the import stream coming from the pipes # cat $FILENAME1 $FILENAME2 $FILENAME3 | uncompress | dd of=wrkpipe # # clean up the import pipe # rm wrkpipe From: Armstead, Michael A [EMAIL PROTECTED] Reply-To: [EMAIL PROTECTED] To: Multiple recipients of list ORACLE-L [EMAIL PROTECTED] Subject: RE: Export Split Script Date: Wed, 16 May 2001 13:07:24 -0800 Rajaram, Please give me details on how to use mknod to split export files larger than 2 GB. We have broken our jobs into over 50 separate export jobs on the table level just to keep our files less than 2GB. Michael Armstead Application Database Administrator, OCP-Certified US Pharmaceuticals IT Glaxo SmithKline -Original Message- From: Rajaram [SMTP:[EMAIL PROTECTED] Sent: Wednesday, May 16, 2001 4:31 PM To: Multiple recipients of list ORACLE-L Subject:RE: Export Split Script If you are using Oracle on Unix , You may want to use unix pipes ( mknod). - most people use this method to manage files 2GB. Rajaram (Now that I am at the top of a mountain - I dont know how to get down!) -Original Message- From: Smith, Ron L. [SMTP:[EMAIL PROTECTED] Sent: Wednesday, May 16, 2001 3:57 PM To: Multiple recipients of list ORACLE-L Subject:Export Split Script I tries using a compressed export and the output is still over 2G. Does anyone have the export script that splits the export files into multiple files? Ron Smith Database Administration [EMAIL PROTECTED] NetZero Platinum No Banner Ads and Unlimited Access Sign Up Today - Only $9.95 per month! http://www.netzero.net -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Rajaram INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing). -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Armstead, Michael A INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list,
RE: Export Split Script (FAO LISA)
you can also use the FILESIZE parameter available in export since 8i (the only docs I have are for 8.1.7 so I'm not sure if it was available before that release) --- Robertson Lee - lerobe [EMAIL PROTECTED] wrote: Also found this in my archives, courtesy of Rachel. Regards Lee -Original Message- Sent: 16 May 2001 22:28 To: Multiple recipients of list ORACLE-L there is a note out on Metalink on how to do this. You can also break the export into separate files in later versions of Oracle8i. or you can run the following script (modified to suit your system, it was last tested on Solaris/Oracle 7.3.4) #!/bin/sh # cd $EXPORT_DIR # # set maximum file size for each chunk of the export file # MAXFILESIZE=2000m export MAXFILESIZE # # create filenames for the parts of the backup... for now let's go to 3 # FILENAME1=$EXPORT_DIR/backup1_$ORACLE_SID.dmp FILENAME2=$EXPORT_DIR/backup2_$ORACLE_SID.dmp FILENAME3=$EXPORT_DIR/backup3_$ORACLE_SID.dmp LOGFILE=$EXPORT_DIR/backup_$ORACLE_SID.log # # save off the old ones # mv $FILENAME1 $FILENAME1.old if [ -f $FILENAME2 ] then mv $FILENAME2 $FILENAME2.old fi if [ -f $FILENAME3 ] then mv $FILENAME3 $FILENAME3.old fi mv $LOGFILE $LOGFILE.old # # create the pipes # mkfifo exportpipeaa mkfifo exportpipeab mkfifo exportpipeac mkfifo wrkpipe umask 000 # # start the readers from the pipes to create the export files # dd if=exportpipeaa of=$FILENAME1 dd if=exportpipeab of=$FILENAME2 dd if=exportpipeac of=$FILENAME3 # # start the reader from the wrkpipe to compress and split the export # dd if=wrkpipe|compress|split -b $MAXFILESIZE - exportpipe # # start the export for real # exp / file=wrkpipe full=y compress=n buffer=4096000 LOG=$LOGFILE # # clean up after ourselves # rm exportpipeaa exportpipeab exportpipeac wrkpipe # # if you haven't used all the pipes, the dd may still linger on # make sure to REALLY clean up # ps -ef|grep exportpipe|grep -vi grep|awk '{printf (kill -9 %d; \n,$2)}'kill.lst chmod u+x kill.lst sh kill.lst rm kill.lst now to import from those split files #!/bin/sh # cd $EXPORT_DIR # # create filenames for the parts of the backup... for now let's go to 3 # FILENAME1=$EXPORT_DIR/backup1_$ORACLE_SID.dmp FILENAME2=$EXPORT_DIR/backup2_$ORACLE_SID.dmp FILENAME3=$EXPORT_DIR/backup3_$ORACLE_SID.dmp LOGFILE=$EXPORT_DIR/backup_$ORACLE_SID.log # # create the pipe to import from # mkfifo wrkpipe umask 000 # # start the reader from the import pipe # imp / file=wrkpipe full=y commit=y buffer=4096000 LOG=$LOGFILE # # create the import stream coming from the pipes # cat $FILENAME1 $FILENAME2 $FILENAME3 | uncompress | dd of=wrkpipe # # clean up the import pipe # rm wrkpipe From: Armstead, Michael A [EMAIL PROTECTED] Reply-To: [EMAIL PROTECTED] To: Multiple recipients of list ORACLE-L [EMAIL PROTECTED] Subject: RE: Export Split Script Date: Wed, 16 May 2001 13:07:24 -0800 Rajaram, Please give me details on how to use mknod to split export files larger than 2 GB. We have broken our jobs into over 50 separate export jobs on the table level just to keep our files less than 2GB. Michael Armstead Application Database Administrator, OCP-Certified US Pharmaceuticals IT Glaxo SmithKline -Original Message- From: Rajaram [SMTP:[EMAIL PROTECTED] Sent: Wednesday, May 16, 2001 4:31 PM To: Multiple recipients of list ORACLE-L Subject: RE: Export Split Script If you are using Oracle on Unix , You may want to use unix pipes ( mknod). - most people use this method to manage files 2GB. Rajaram (Now that I am at the top of a mountain - I dont know how to get down!) -Original Message- From: Smith, Ron L. [SMTP:[EMAIL PROTECTED] Sent: Wednesday, May 16, 2001 3:57 PM To: Multiple recipients of list ORACLE-L Subject: Export Split Script I tries using a compressed export and the output is still over 2G. Does anyone have the export script that splits the export files into multiple files? Ron Smith Database Administration [EMAIL PROTECTED] NetZero Platinum No Banner Ads and Unlimited Access Sign Up Today - Only $9.95 per month! http://www.netzero.net -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Rajaram INET: [EMAIL PROTECTED] Fat City Network Services-- (858) 538-5051 FAX: (858) 538-5051 San Diego, California-- Public Internet access / Mailing Lists To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command