Re: Anyone have a favorite archive manager?

2018-07-31 Thread Patrick O'Callaghan
On Mon, 2018-07-30 at 14:57 -0700, Rick Stevens wrote:
> dump was designed to feed a streaming, non-random access device like a
> tape system and it won't cross source devices. For flat-out speed, dump
> is slightly slower than dd but it is file-aware (which dd isn't). I'd
> imagine dumping to a seekable device (e.g. a file) might speed up
> restores, but a restore still has to recreate paths and things from the
> inodes (after reading in the filelist from the dump archive). I've never
> done it as I stopped using dump/restore way back when (I think it was
> ESIX SVR4 using a 5150-type QIC tape device back in the mid 80s).

Exactly.

> Personally, I prefer doing a file-oriented backup using rsync to an
> external device mounted somewhere. I typically use locally-connected
> external ESATA or thunderbolt devices, but USB3 isn't _that_ horrible.
> I've even done it over network links to rsync servers, either using the
> native rsync protocol or via a VPN using UDR when going over the big,
> bad Internet (a bit trickier, but damned near wire speed over the
> network--depending on the stoutness of the VPN devices).

I use rsnapshot (based on rsync), but it works better when the
receiving end also has an rsync daemon. It's not much use if backing up
to (say) Google Drive or Dropbox.

I'm experimenting with Borgbackup, which has the additional advantage
of de-duping at block level (rsnapshot will detect duplicate files and
rsync only transfers the changes, but a changed file will cause a store
of the complete new file at the server end). It's also better with a
daemon at the server end, but if that's not available then rclone looks
like a possible option for this kind of thing.

poc
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/QUCDXZZEN3MBU775TRLBZK2L5QC772EL/


Re: Anyone have a favorite archive manager?

2018-07-30 Thread Rick Stevens
On 07/30/2018 02:06 PM, Patrick O'Callaghan wrote:
> On Mon, 2018-07-30 at 13:11 -0700, ToddAndMargo wrote:
>> dump is awesome for backing up servers in the middle of
>> the night.  dump/restore are also blazingly fast
> 
> IIRC one reason for that is that they don't walk the directory tree,
> they just go through the inode table. This means that restoring
> individual files can take a relatively long time (they have to be found
> first by reconstructing the path from the root, which can mean a lot of
> scanning back and forth), but as that's not the focus it's a reasonable
> tradeoff.

dump was designed to feed a streaming, non-random access device like a
tape system and it won't cross source devices. For flat-out speed, dump
is slightly slower than dd but it is file-aware (which dd isn't). I'd
imagine dumping to a seekable device (e.g. a file) might speed up
restores, but a restore still has to recreate paths and things from the
inodes (after reading in the filelist from the dump archive). I've never
done it as I stopped using dump/restore way back when (I think it was
ESIX SVR4 using a 5150-type QIC tape device back in the mid 80s).

Personally, I prefer doing a file-oriented backup using rsync to an
external device mounted somewhere. I typically use locally-connected
external ESATA or thunderbolt devices, but USB3 isn't _that_ horrible.
I've even done it over network links to rsync servers, either using the
native rsync protocol or via a VPN using UDR when going over the big,
bad Internet (a bit trickier, but damned near wire speed over the
network--depending on the stoutness of the VPN devices).

I take care to not back up things that may vary (e.g. /proc, /sys, /dev,
logs I don't care about, user browser caches, etc.). This gives me a
simple way to mount the external media and restore individual files or
entire directory trees pretty easily. Not as fast as dump or dd, but
running it at off hours (via cron or "at") makes it fairly painless.

This is just my preference. Do what you will.
--
- Rick Stevens, Systems Engineer, AllDigitalri...@alldigital.com -
- AIM/Skype: therps2ICQ: 226437340   Yahoo: origrps2 -
--
- ...Had this been an actual emergency, we would have fled in terror -
-  and you'd be on your own, pal!-
--
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/2RIIV727IQQNHQMG7MCZVOXLIKR5DMXC/


Re: Anyone have a favorite archive manager?

2018-07-30 Thread Patrick O'Callaghan
On Mon, 2018-07-30 at 13:11 -0700, ToddAndMargo wrote:
> dump is awesome for backing up servers in the middle of
> the night.  dump/restore are also blazingly fast

IIRC one reason for that is that they don't walk the directory tree,
they just go through the inode table. This means that restoring
individual files can take a relatively long time (they have to be found
first by reconstructing the path from the root, which can mean a lot of
scanning back and forth), but as that's not the focus it's a reasonable
tradeoff.

poc
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/WPOY6CXRQL5WLGGBOJF2UXLFD5FPAZDQ/


Re: Anyone have a favorite archive manager?

2018-07-30 Thread ToddAndMargo

On 07/30/2018 03:38 AM, Patrick O'Callaghan wrote:

On Sun, 2018-07-29 at 16:49 -0700, Samuel Sieb wrote:

On 07/29/2018 03:08 PM, ToddAndMargo wrote:

On 07/28/2018 11:13 PM, Samuel Sieb wrote:

On 07/28/2018 11:04 PM, ToddAndMargo wrote:

Actually it turned out not to be a typo.  I was trying to open
a "dump" file in file-roller.  When I open the actual tar file,
it worked perfectly.


What's a "dump" file?  I've never seen a ".gz2" extension.  What is it?



"dump" and "restore".  See "man dump"


Interesting.  I've never used that and probably never will either.


dump and restore are probably the oldest archiving utilities in the *ix
world, originally from UNIX in the 70's. They date from the bad old
days of tape decks, but can be used with other media and of course with
files. IIRC their advantage is that they don't assume the media (file)
is seekable, so can handle arbitrary length input.

Their disadvantage is that they're focused on archiving and restoring
entire filesystems, so may not be what the OP is looking for.

poc


If you are a fan of the command line, I can restore a single
file or group of files faster restore than with a gui.

Than being said, my original problem was of my own making.  I was
trying to load a dump file into file-roller thinking it was
one of my tar balls.

dump is awesome for backing up servers in the middle of
the night.  dump/restore are also blazingly fast
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/WILY65AGN7EURI4ZHDAI7YBMSOG7MESK/


Re: Anyone have a favorite archive manager?

2018-07-30 Thread Patrick O'Callaghan
On Sun, 2018-07-29 at 16:49 -0700, Samuel Sieb wrote:
> On 07/29/2018 03:08 PM, ToddAndMargo wrote:
> > On 07/28/2018 11:13 PM, Samuel Sieb wrote:
> > > On 07/28/2018 11:04 PM, ToddAndMargo wrote:
> > > > Actually it turned out not to be a typo.  I was trying to open
> > > > a "dump" file in file-roller.  When I open the actual tar file,
> > > > it worked perfectly.
> > > 
> > > What's a "dump" file?  I've never seen a ".gz2" extension.  What is it?
> > 
> > 
> > "dump" and "restore".  See "man dump"
> 
> Interesting.  I've never used that and probably never will either.

dump and restore are probably the oldest archiving utilities in the *ix
world, originally from UNIX in the 70's. They date from the bad old
days of tape decks, but can be used with other media and of course with
files. IIRC their advantage is that they don't assume the media (file)
is seekable, so can handle arbitrary length input.

Their disadvantage is that they're focused on archiving and restoring
entire filesystems, so may not be what the OP is looking for.

poc
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/5456B74OJAOQHRHO25WMIBBA7SPY5BWZ/


Re: Anyone have a favorite archive manager?

2018-07-29 Thread ToddAndMargo

On 07/29/2018 04:49 PM, Samuel Sieb wrote:

On 07/29/2018 03:08 PM, ToddAndMargo wrote:

On 07/28/2018 11:13 PM, Samuel Sieb wrote:

On 07/28/2018 11:04 PM, ToddAndMargo wrote:

Actually it turned out not to be a typo.  I was trying to open
a "dump" file in file-roller.  When I open the actual tar file,
it worked perfectly.


What's a "dump" file?  I've never seen a ".gz2" extension.  What is it?



"dump" and "restore".  See "man dump"


Interesting.  I've never used that and probably never will either.

That didn't explain the .gz2 extension though.  You said it wasn't a typo.


I had my head up my ...



___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/NZMO3ST6ROGNJKNJ4XFUK6XPMESR37KH/


Re: Anyone have a favorite archive manager?

2018-07-29 Thread Samuel Sieb

On 07/29/2018 03:08 PM, ToddAndMargo wrote:

On 07/28/2018 11:13 PM, Samuel Sieb wrote:

On 07/28/2018 11:04 PM, ToddAndMargo wrote:

Actually it turned out not to be a typo.  I was trying to open
a "dump" file in file-roller.  When I open the actual tar file,
it worked perfectly.


What's a "dump" file?  I've never seen a ".gz2" extension.  What is it?



"dump" and "restore".  See "man dump"


Interesting.  I've never used that and probably never will either.

That didn't explain the .gz2 extension though.  You said it wasn't a typo.
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/LETE3FHURBNUGCIDO3IPRBMBTL25T73T/


Re: Anyone have a favorite archive manager?

2018-07-29 Thread ToddAndMargo

On 07/28/2018 11:13 PM, Samuel Sieb wrote:

On 07/28/2018 11:04 PM, ToddAndMargo wrote:

Actually it turned out not to be a typo.  I was trying to open
a "dump" file in file-roller.  When I open the actual tar file,
it worked perfectly.


What's a "dump" file?  I've never seen a ".gz2" extension.  What is it?



"dump" and "restore".  See "man dump"

I can call the archive file whatever I want.

/usr/sbin/dump -0a -z -f $BakDir/$Date"_"rootExt4Dump.gz  $Partition3


$ dnf whatprovides dump
Last metadata expiration check: 8 days, 1:43:06 ago on Sat 21 Jul 2018 
01:23:38 PM PDT.

dump-1:0.4-0.36.b46.fc28.x86_64 : Programs for backing up and restoring
: ext2/ext3/ext4 filesystems
Repo: @System
Matched from:
Provide: dump = 1:0.4-0.36.b46.fc28

dump-1:0.4-0.36.b46.fc28.x86_64 : Programs for backing up and restoring
: ext2/ext3/ext4 filesystems
Repo: fedora
Matched from:
Provide: dump = 1:0.4-0.36.b46.fc28

___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/BAYQ2DR5SSZ7QBYBCF4IBD3YOSTUSRAV/


Re: Anyone have a favorite archive manager?

2018-07-28 Thread Samuel Sieb

On 07/28/2018 11:04 PM, ToddAndMargo wrote:

Actually it turned out not to be a typo.  I was trying to open
a "dump" file in file-roller.  When I open the actual tar file,
it worked perfectly.


What's a "dump" file?  I've never seen a ".gz2" extension.  What is it?
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/D34Z3TEHQVJ7PUOCMV62ZVFPAFZY7MTS/


Re: Anyone have a favorite archive manager?

2018-07-28 Thread ToddAndMargo

On 07/28/2018 01:47 PM, ToddAndMargo wrote:

On 07/28/2018 12:49 PM, Todd Zullinger wrote:

Is .gz2 a typo?  I've only ever seen .bz2 or .gz.  I doubt
that's related, but it's a curiosity.




It's a type.  I wonder if that is why file-roller
is having an issue.  I will have to check later on
today after all my backups are finished



Actually it turned out not to be a typo.  I was trying to open
a "dump" file in file-roller.  When I open the actual tar file,
it worked perfectly.

Cancel the question!


___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/RQOWDVQX54NDEHTLLCWMO5WSSOUH75TE/


Re: Anyone have a favorite archive manager?

2018-07-28 Thread ToddAndMargo

On 07/28/2018 04:40 PM, Fred Smith wrote:

On Sat, Jul 28, 2018 at 03:49:51PM -0400, Todd Zullinger wrote:

ToddAndMargo wrote:

Hi All,

Fedora 28
Xfce 4.12

I have several large tar balls

-rwxr-xr-x.  1 todd users   6359558528 Jul 12 10:51
2018-07-12_OurStuff.tar.gz2


Is .gz2 a typo?  I've only ever seen .bz2 or .gz.  I doubt
that's related, but it's a curiosity.


I have to deal with.  They only extract (t or x) with the
command line "tar" command and crash both file-roller
and xarchive manager.


Do they run out of memory?  That would be my guess.  I don't
use GUI archive tools much at all, so I don't know if
there's an option to have it simply extract the compressed
tarball rather than try to decompress it first and then
extract it from the .tar file.


gunzip -c tarfile.gz > tarfile

should do it.

but if the compressed tarball is that big, you'd be well advised to make
sure you've got ten or more gigs of free space before trying it because
both the compressed and uncmpressed files will stay there.  then check
again before extracting from the uncompressed archive.

Or:

gunzip tarfile.gz

which uncompresses the tarfile and removes the compressed one.  Probably
still needs enough space to hold both the compressed and uncompressed,
but only until it finishes decompressing, then deletes the compressed one.

then in either case, you should be able to just "tar xvf tarfile".





I use the command line all the time.  There are some times
I want to use a gui though

tar tjv | grep 
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/2VGODEBCMF4TIGUUXA7KNH5ZCFPUPUE4/


Re: Anyone have a favorite archive manager?

2018-07-28 Thread Fred Smith
On Sat, Jul 28, 2018 at 03:49:51PM -0400, Todd Zullinger wrote:
> ToddAndMargo wrote:
> > Hi All,
> > 
> > Fedora 28
> > Xfce 4.12
> > 
> > I have several large tar balls
> > 
> > -rwxr-xr-x.  1 todd users   6359558528 Jul 12 10:51
> > 2018-07-12_OurStuff.tar.gz2
> 
> Is .gz2 a typo?  I've only ever seen .bz2 or .gz.  I doubt
> that's related, but it's a curiosity.
> 
> > I have to deal with.  They only extract (t or x) with the
> > command line "tar" command and crash both file-roller
> > and xarchive manager.
> 
> Do they run out of memory?  That would be my guess.  I don't
> use GUI archive tools much at all, so I don't know if
> there's an option to have it simply extract the compressed
> tarball rather than try to decompress it first and then
> extract it from the .tar file.

gunzip -c tarfile.gz > tarfile

should do it.

but if the compressed tarball is that big, you'd be well advised to make
sure you've got ten or more gigs of free space before trying it because
both the compressed and uncmpressed files will stay there.  then check
again before extracting from the uncompressed archive.

Or:

gunzip tarfile.gz 

which uncompresses the tarfile and removes the compressed one.  Probably
still needs enough space to hold both the compressed and uncompressed,
but only until it finishes decompressing, then deletes the compressed one.

then in either case, you should be able to just "tar xvf tarfile".

-- 
 Fred Smith -- fre...@fcshome.stoneham.ma.us -
   I can do all things through Christ 
  who strengthens me.
-- Philippians 4:13 ---
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/NZK3LGHKMBNTL4VWCM72EGTSTGCCMRTS/


Re: Anyone have a favorite archive manager?

2018-07-28 Thread ToddAndMargo

On 07/28/2018 12:49 PM, Todd Zullinger wrote:

Is .gz2 a typo?  I've only ever seen .bz2 or .gz.  I doubt
that's related, but it's a curiosity.




It's a type.  I wonder if that is why file-roller
is having an issue.  I will have to check later on
today after all my backups are finished
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/OHWGBYGDZQZSG7IBX7WEUYXM27AHGA6D/


Re: Anyone have a favorite archive manager?

2018-07-28 Thread Todd Zullinger
ToddAndMargo wrote:
> Hi All,
> 
> Fedora 28
> Xfce 4.12
> 
> I have several large tar balls
> 
> -rwxr-xr-x.  1 todd users   6359558528 Jul 12 10:51
> 2018-07-12_OurStuff.tar.gz2

Is .gz2 a typo?  I've only ever seen .bz2 or .gz.  I doubt
that's related, but it's a curiosity.

> I have to deal with.  They only extract (t or x) with the
> command line "tar" command and crash both file-roller
> and xarchive manager.

Do they run out of memory?  That would be my guess.  I don't
use GUI archive tools much at all, so I don't know if
there's an option to have it simply extract the compressed
tarball rather than try to decompress it first and then
extract it from the .tar file.

-- 
Todd
~~
The cynics are right nine times out of ten.
-- H. L. Menchen (1880-1956)



signature.asc
Description: PGP signature
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/FB5CC2TDWQNR36AKO2GVXYZWPYCGIPAU/


Re: Anyone have a favorite archive manager?

2018-07-28 Thread Samuel Sieb

On 07/28/2018 12:23 PM, ToddAndMargo wrote:

I have several large tar balls

-rwxr-xr-x.  1 todd users   6359558528 Jul 12 10:51 
2018-07-12_OurStuff.tar.gz2


I have to deal with.  They only extract (t or x) with the
command line "tar" command and crash both file-roller
and xarchive manager.

Anyone have a favorite GUI tar ball reader that will work with
large files?


What are you trying to do with it?  For something that big I would only 
use the command line.

___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/PJ7Z5YDZRBFRTJGJPEQ2W5SEYMFP7ZDR/


Anyone have a favorite archive manager?

2018-07-28 Thread ToddAndMargo

Hi All,

Fedora 28
Xfce 4.12

I have several large tar balls

-rwxr-xr-x.  1 todd users   6359558528 Jul 12 10:51 
2018-07-12_OurStuff.tar.gz2


I have to deal with.  They only extract (t or x) with the
command line "tar" command and crash both file-roller
and xarchive manager.

Anyone have a favorite GUI tar ball reader that will work with
large files?

Many thanks,
-T
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/message/HQ2I5UYJZYZWTBCEY6HVFVXBOMLWBRH5/