Re: archiving parts in linux.
On Tuesday 30 January 2007 16:19, Yehoshua (Shay) O'Hayon Suchar wrote: Tzahi Fadida said: I tried 7z but after about 12% of archiving it gives a weird error: Error: System error: Too many open files (and this file was never opened :). What can i do? Could be that the error has something to do with the limit of file descriptors in the system? Sorry for not responding earlier. My system crashed and i had to restore from backups. I did not really understand this. Are you saying there is a limit on the number of files i can tar gz? I also make backups of my emails and there can be as much as a million files, pherhaps more because of the mbox style(i think) of holding mails. Check out this: http://bcr2.uwaterloo.ca/~brecht/servers/openfiles.html = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED] -- Regards, Tzahi. -- Tzahi Fadida Blog: http://tzahi.blogsite.org | Home Site: http://tzahi.webhop.info WARNING TO SPAMMERS: see at http://members.lycos.co.uk/my2nis/spamwarning.html To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: archiving parts in linux.
On 01/02/07, Tzahi Fadida [EMAIL PROTECTED] wrote: On Tuesday 30 January 2007 16:19, Yehoshua (Shay) O'Hayon Suchar wrote: Tzahi Fadida said: I tried 7z but after about 12% of archiving it gives a weird error: Error: System error: Too many open files (and this file was never opened :). What can i do? Could be that the error has something to do with the limit of file descriptors in the system? Sorry for not responding earlier. My system crashed and i had to restore from backups. I did not really understand this. Are you saying there is a limit on the number of files i can tar gz? I also make backups of my emails and there can be as much as a million files, pherhaps more because of the mbox style(i think) of holding mails. Somebody please correct me if I'm wrong, but so far as I know mbox saves all the emails of a particular folder in one big file. So if you have 200 emails in 5 folders, then you will have 5 mbox files. Kmail has another two or three files per mbox folder, so you really will have 5*n folders, but you get the idea. It's not 200*n. Dotan Cohen http://what-is-what.com/what_is/firefox.html http://technology-sleuth.com/question/what_is_a_firewall.html = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: archiving parts in linux.
On Thursday 01 February 2007 14:55, Dotan Cohen wrote: On 01/02/07, Tzahi Fadida [EMAIL PROTECTED] wrote: On Tuesday 30 January 2007 16:19, Yehoshua (Shay) O'Hayon Suchar wrote: Tzahi Fadida said: I tried 7z but after about 12% of archiving it gives a weird error: Error: System error: Too many open files (and this file was never opened :). What can i do? Could be that the error has something to do with the limit of file descriptors in the system? Sorry for not responding earlier. My system crashed and i had to restore from backups. I did not really understand this. Are you saying there is a limit on the number of files i can tar gz? I also make backups of my emails and there can be as much as a million files, pherhaps more because of the mbox style(i think) of holding mails. Somebody please correct me if I'm wrong, but so far as I know mbox saves all the emails of a particular folder in one big file. So if you have 200 emails in 5 folders, then you will have 5 mbox files. Kmail has another two or three files per mbox folder, so you really will have 5*n folders, but you get the idea. It's not 200*n. Sorry, of course maildir. Dotan Cohen http://what-is-what.com/what_is/firefox.html http://technology-sleuth.com/question/what_is_a_firewall.html -- Regards, Tzahi. -- Tzahi Fadida Blog: http://tzahi.blogsite.org | Home Site: http://tzahi.webhop.info WARNING TO SPAMMERS: see at http://members.lycos.co.uk/my2nis/spamwarning.html To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: archiving parts in linux.
Tzahi Fadida said: I tried 7z but after about 12% of archiving it gives a weird error: Error: System error: Too many open files (and this file was never opened :). What can i do? Could be that the error has something to do with the limit of file descriptors in the system? Check out this: http://bcr2.uwaterloo.ca/~brecht/servers/openfiles.html = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: archiving parts in linux.
try DAR (Disk ARchiver), should be a good one although doesn't ship standardly with Linux. http://dar.sf.net or just apt-get install dar. The term for splitting files is called 'slice'. - Oren Tzahi Fadida wrote: Hi, I wish to archive a 50mb file into several parts of 5mb files in linux. I also need to be able to open the files in windows. For some unknown reason, i can't find a way (other than using a non-free rar) to do this. I tried zipsplit but it says something about the file being too large or something like this. I tried 7z but after about 12% of archiving it gives a weird error: Error: System error: Too many open files (and this file was never opened :). What can i do? Also, i am trying to backup my files (many thousands of them). is there a way to cause tar or something else not to use a local tmp directory (since i don't have enough room) and also, it seems to eat too much memory till my kde programs starts to close. 10x. = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: archiving parts in linux.
Tzahi Fadida wrote: Hi, I wish to archive a 50mb file into several parts of 5mb files in linux. I also need to be able to open the files in windows. For some unknown reason, i can't find a way (other than using a non-free rar) to do this. The canonical way (although maybe not the most comfortable one) is using dd. dd if=bigfile of=part1 bs=5m count=1 dd if=bigfile of=part2 bs=5m skip=1 count=1 dd if=bigfile of=part3 bs=5m skip=2 count=1 .. To reassemble them on unix, use 'cat part1 part2 part3 ... bigfile'. To reassemble on windows, use 'copy /b part1+part2+part3... bigfile'. You can also use the 'split' command. The GNU version has an option '-b' for that. Standard unix versions do not, and only split by lines. That's why traditionally dd is used. I also have a feeling (did not check) that dd is much faster. -- Didi
Re: archiving parts in linux.
On 29/01/07, Yedidyah Bar-David [EMAIL PROTECTED] wrote: I also have a feeling (did not check) that dd is much faster. -- Didi You're probably partial to dd because it's your name! Dotan Cohen http://what-is-what.com/what_is/computer.html http://slashedot.com = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: archiving parts in linux.
2007/1/29, Dotan Cohen [EMAIL PROTECTED]: On 29/01/07, Yedidyah Bar-David [EMAIL PROTECTED] wrote: I also have a feeling (did not check) that dd is much faster. -- Didi You're probably partial to dd because it's your name! Obviously :-) You can guess I heard by now many jokes regarding this ... And if we are getting this OT, I'll add that I thought for many years that dd is 'copy and convert' as it's manpage says, only 'cc' was already used for 'c compiler' so they took 'dd'. But the reality is that it's named after a OS 360 JCL command with the same name, similar functionality and similar syntax, which also explains the odd, non-unixy syntax it has. Google if you are interested. -- Didi
archiving parts in linux.
Hi, I wish to archive a 50mb file into several parts of 5mb files in linux. I also need to be able to open the files in windows. For some unknown reason, i can't find a way (other than using a non-free rar) to do this. I tried zipsplit but it says something about the file being too large or something like this. I tried 7z but after about 12% of archiving it gives a weird error: Error: System error: Too many open files (and this file was never opened :). What can i do? Also, i am trying to backup my files (many thousands of them). is there a way to cause tar or something else not to use a local tmp directory (since i don't have enough room) and also, it seems to eat too much memory till my kde programs starts to close. 10x. -- Regards, Tzahi. -- Tzahi Fadida Blog: http://tzahi.blogsite.org | Home Site: http://tzahi.webhop.info WARNING TO SPAMMERS: see at http://members.lycos.co.uk/my2nis/spamwarning.html To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: archiving parts in linux.
On Mon, 2007-01-29 at 01:38 +0200, Tzahi Fadida wrote: Hi, I wish to archive a 50mb file into several parts of 5mb files in linux. I also need to be able to open the files in windows. For some unknown reason, i can't find a way (other than using a non-free rar) to do this. I tried zipsplit but it says something about the file being too large or something like this. I never had any problem with zipsplit, but as unlike the zip command itself, it doesn't do stdio streaming, you need to make sure you have enough free space to do the work - to hold the original zip, the splitted files resulting from the operation and at most as much temporary space as the original large file. What can i do? tar -M creates multiple tar volumes, but managing them (using -F) is not straight forward, and you also can't compress them on the fly, so you'd have to compress them one by one after tarring, and uncompress all of them before untarring. Also - I don't know how windows software would handle multi-volume tars. You might also want to look at http://www.informatik-vollmer.de/software/split-tar.php which claims to generate standard tarballs, though I never tried it (#include std.disclaimer) Also, i am trying to backup my files (many thousands of them). is there a way to cause tar or something else not to use a local tmp directory (since i don't have enough room) and also, it seems to eat too much memory till my kde programs starts to close. I usually stream tars to standard out, and I never noticed it using any amount of tmp (/tmp is a rather small ramdisk on my server - I'm sure I would have noticed if it would eat out of that). -- Oded ::.. Brace yourselves. We're about to try something that borders on the unique: an actually rather serious technical book which is not only (gasp) vehemently anti-Solemn, but also (shudder) takes sides. I tend to think of it as `Constructive Snottiness.' -- Elements of Networking Style / Mike Padlipsky = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
