Re: [OpenIndiana-discuss] auto-snapshot replicate problems
I had issues using the auto-snapshots for "syncing". I actually was just
sending regular snapshots from my OI laptop to my OI server.
I wrote a little perl script that might do what you need.
The basic concepts I use are to
1) Use a unique snapshot prefix for my "backup" snapshots
2) Only keep one "backup" snapshot on my laptop at any time
3) If the snapshot is missing anywhere, resend the whole filesystem
My script is a perl script, but below is a walk through of the zfs commands
I used. The script is run from the sending machine.
I gave up on using the auto-snapshots for this once I realized that I
couldn't reliably predict when snapshots got cleaned up and especially when
auto-snapshots failed to be created. I still use auto-snapshots for its
original purpose, to take frequent local snapshots. The local snapshots
don't interfere with my backup snapshots and vice versa.
Basic logic is below:
# Loop through all of my zfs filesystems
zfs list -o name | while read zfspart
# Create a new snapshot on my laptop to send over to my server
zfs snapshot ${zfspart}@backup-${timestamp}
#store the name of the new snapshot in $zfssnap
# Get the latest snapshot on my server for this filesystem
zfssnapold=`ssh $host /usr/sbin/zfs list -Ho name -t snapshot | grep
"backup/laptop/$zfspart\@backup-" | sort | tail -1 `
#Check that the latest snapshot matches the earliest snapshot on my laptop
#if they match then send an incremental backup and then delete the old
local snapshot
zfs send -i $zfssnapold $zfssnap | ssh -C $host pfexec /usr/sbin/zfs recv
-F backup/laptop/$zfspart
zfs destroy $zfssnapold
#if they don't match and there is no local snapshot (but there is one on
the server); delete the remote snapshot and send the whole filesystem
ssh $host pfexec /usr/sbin/zfs destroy backup/laptop/$zfssnapold
zfs send $zfssnap | ssh -C $host pfexec /usr/sbin/zfs recv -F
backup/laptop/$zfspart
#if there is no snapshot on the server, then just send the whole filesystem
zfs send $zfssnap | ssh -C $host /usr/sbin/zfs recv -F
backup/laptop/$zfspart
Best of luck John!
Jake
On Mon, Mar 26, 2012 at 10:37 AM, John McEntee <
jmcen...@stirling-dynamics.com> wrote:
> Just reply just in-case someone else comes across this post.
>
> Altering the time-slider daemon would be tricky, but writing my own with a
> crontab would still take some time to replicate all the features I would
> like (clearing up old snapshots etc.)
>
> As the auto-replicate script is use ( any other script would be the same)
> needs to know the last destination snapshot and the current sending
> snapshot. I have implemented a simple zfs hold and zfs release to lock the
> last snapshot sent (tag of destination hostname) and release the previous
> one.
>
> John
> -Original Message-
> From: Milan Jurik [mailto:milan.ju...@xylab.cz]
> Sent: 14 March 2012 11:01
> To: Discussion list for OpenIndiana
> Subject: Re: [OpenIndiana-discuss] auto-snapshot replicate problems
>
> Hi,
>
> I think time-slider daemon is in JDS consolidation. But the question is
> - why do you want to hack it and maintain own hack? Why not to create zfs
> snapshots by own crontab entry?
>
> Best regards,
>
> Milan
>
> On 14.03.2012 12:38, John McEntee wrote:
> > I have a problem trying to keep a second fileserver in sync with the
> > primary one.
> >
> >
> >
> > I have a script (auto-replicate) that I have slightly altered that
> > basically
> > checks the latest snapshot of the both master server and the dr
> > server. It
> > then does a send -I if there is a difference. This used to work fine
> > in the
> > old versions of the time-slider service.
> >
> >
> >
> > The problem I have is the later version of the time-slider service in
> > OpenIndiana cleans up old snapshots of zero size, which means the
> > latest
> > snapshot on the dr server no longer exists on the master server so
> > the send
> > -I fails.
> >
> >
> >
> > My fix would be to hack the time-slider service to not clean up the
> > zero
> > size snapshots. Please can anyone point me in the right direction? I
> > cannot
> > even find the code at the moment. I would also be interested in any
> > other
> > solutions
> >
> >
> >
> > Thanks
> >
> >
> >
> > John
> >
> >
> >
> >
>
> ___
> OpenIndiana-discuss mailing list
> OpenIndiana-discuss@openindiana.org
> http://openindiana.org/mailman/listinfo/openindiana-discuss
>
>
> ___
>
> The contents of this e-mail and any attachment(s) are strictly
> confidential and are solely for the person(s) at the e-mail address(es)
> above. If you are not an addressee, you may not disclose, distribute, copy
> or use this e-mail, and we request that you send an e-mail to
> ad...@stirling-dynamics.com and delete this e-mail. Stirling Dynamics
> Ltd. accepts no legal liability for the contents of this e-mail including
> any errors, interception or interference, as internet communi
Re: [OpenIndiana-discuss] Revive retired disks with data sets on them with vitual OI
On Mar 26, 2012, at 12:34 PM, Jonathan Adams wrote: > Probably not the most reliable, but definitely the easiest, way to get > access to your data is to use USB disks because VirtualBox allows > direct USB passthrough. > My boss uses OpenSolaris with USB drives to get access to the ZFS pool > running on his Linux system. USB drives tend to ignore cache flush commands, which can appear as unreliable disks. Shouldn't be much of a problem if you rarely plug them. -- richard -- DTrace Conference, April 3, 2012, http://wiki.smartos.org/display/DOC/dtrace.conf ZFS Performance and Training richard.ell...@richardelling.com +1-760-896-4422 ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [noob] smb via android
Hi,
I had the same issue with a few apps, but i finally came along to
"cifsmanager". It mounted everything in the right way.
I hope this helps. Best regards.
Pablo
On Mon, Mar 5, 2012 at 2:56 PM, Robbie Crash wrote:
> I had problems with non-Windows clients accessing SMB shares when the
> ACLMode of the FS was set to passthrough instead of discard. I don't
> remember where it was, but there was a tutorial I found for getting SMB
> setup for non-Windows boxes that got me to use passthrough instead of
> discard.
>
> If you're using ZFS ACLs check to make sure you've got the ZFS ACLs matched
> to the POSIX ones. Use /usr/bin/ls -lVh to see permissions as the default
> ls doesn't show them. For 0777 permissions it should look something like
> this:
>
> drwxrwxrwx+ 9 root root 12 Mar 3 05:14 temptest
> owner@:rwxpdDaARWcCos:fd-:allow
> group@:rwxpdDaARWcCos:fd-:allow
> everyone@:rwxpdDaARWcCos:fd-:allow
>
> Those permissions can be set with /usr/bin/chmod
>
> On Mon, Mar 5, 2012 at 07:31, Gordon Ross wrote:
>
> > The next step in debugging this kind of problem is to take a network
> > trace on the server, i.e.:
> > snoop -o outfile.snoop port 139 or port 445
> > then attempt the access from the android client, then examine the
> > trace with wireshark:
> > wireshark outfile.snoop
> >
> > That should tell you exactly what's failing.
> >
> > Gordon
> >
> > On Mon, Mar 5, 2012 at 2:16 AM, Open Indiana
> > wrote:
> > > Well i had to mix some things. The server is running in workgroupmode
> > but I
> > > have a officelaptop that has joined our officedomain. So to make sure
> > bith
> > > my home (and workgroup ) windows laptops and users and I (as a
> > domainmember)
> > > can use the shares I use username@{somedomain} as a login to the
> shares.
> > > This because username on the server is the same as the officelaptop
> > username
> > > but with different passwords. Windows is always sending the same
> > > office-domainpassword to the server when I don't use username@
> {somedomain}
> > .
> > > I also use a different password on my homecomputers then on the
> > openindiana
> > > server, and there I also had some troubles.
> > >
> > > But with this setup it all works fine from every windows computer, both
> > > workgroup and officedomain, so from that side it works without a flaw.
> > >
> > > I tried already 5 SMB clients but none of them could connect to my
> > > openindiana server.
> > > Some other thingie: I have also a share /mystorage/cifs0/{username}.
> > Within
> > > windows these shares are seen as /mystorage_cifs0/{username} so the "/"
> > is
> > > converted to a "_" in the sharename. I tried both on Android but none
> > works.
> > >
> > >
> > >
> > > -Original Message-
> > > From: Ignacio Marambio Catán [mailto:darkjo...@gmail.com]
> > > Sent: zondag 4 maart 2012 20:56
> > > To: Discussion list for OpenIndiana
> > > Subject: Re: [OpenIndiana-discuss] [noob] smb via android
> > >
> > > On Sun, Mar 4, 2012 at 4:50 PM, Open Indiana
> > > wrote:
> > >> Hi,
> > >>
> > >> I'm sorry. I was thinking, that "android" would do ;-) It's a Asus
> > >> transformer TF101G with honeycomb. I installed an app called AndSMB
> > >> (samba client)
> > >>
> > >> Created a new share just for test, so it is wide-open.
> > >>
> > >> basic unix and acl folder permissions /mystorage/smbshare: (set other
> > >> acl's from your windows computer)
> > >> drwxrwxrwx+ 3 root root3 Mar 4 13:43 /mystorage/smbshare
> > >> user:root:full_set:fd-:allow
> > >> everyone@:modify_set:fd-:allow
> > >>
> > >>
> > >>
> > >> basic share acl permissions on share /mystorage/smbshare for
> > >> everybody@
> > >> -rwxrwxrwx+ 1 root root0 Mar 4 10:56
> > >> /mystorage/smbshare/.zfs/shares/smbshare
> > >> everyone@:full_set:---:allow
> > >>
> > >> The strange thing is that if I browse my Openindiana box with this
> > >> AndSMB program and use "anonymous" as user then I can SEE the
> > >> different SMB folders but can't open them. I have tried all possible
> > >> passwords and usernames (with or without domainnames and/or
> > > workgroupnames) but no luck.
> > >>
> > > how exactly did you setup your smb server?
> > > if it was workgroup mode did you add the relevant PAM configuration and
> > > changed your user's password? see [1] you should see some
> administrative
> > > shares along side your own, administrative shares end with the $ sign
> > like
> > > IPC$
> > > [1]:
> > https://blogs.oracle.com/timthomas/entry/solaris_cifs_in_workgroup_mode
> > >
> > >
> > > nacho
> > >>
> > >>
> > >>
> > >> -Original Message-
> > >> From: Francois Dion [mailto:francois.d...@gmail.com]
> > >> Sent: zondag 4 maart 2012 19:48
> > >> To: Discussion list for OpenIndiana
> > >> Subject: Re: [OpenIndiana-discuss] [noob] smb via android
> > >>
> > >> It would help if you mentioned the device, which version of android
> > >> and what app you wanted t
Re: [OpenIndiana-discuss] Virtualbox on OpenIndiana
Hi, Geoff, On Fri, 2012-03-23 at 19:33 -0700, Geoff Nordli wrote: > It would think vbox running on an illumos host would work pretty well > since I assume Oracle runs their VDI solution on Solaris. Do we think > there is going to be a lot of difference between Solaris and Illumos? When last I checked with the developers, the primary Unix development platform for VirtualBox is Ubuntu. I'd be really surprised if Oracle was trying to position Solaris, which is sold on high-margin hardware, for a commodity deployment scenario like VDI hosting. Solaris's pricing model and hardware constraint fairly effectively limit it to the kind of fat trunk stuff around which the rest of Oracle's business is based, which I think is a shame, as the kind of general-purpose load you see from running on leaf nodes is what an OS should be able to do. For Oracle, though, that lacks a bit too much in the obvious cha-ching factor to have management take risks. I'd say it's hard to tell the difference between the positioning and sales model Oracle's given Solaris and what IBM does with AIX, and I don't mean that to flatter either one. Both sell IT to equity analysts, not customers, so nothing's interesting if it doesn't have an obvious 65% margin on it. > So what you are leaning towards is running Illumos as a guest is that right? I'm leaning against using it as a guest for systems development. As Milan's indicated elsewhere, people may be willing to pay what looks like a VBox tax for more modest compile loads, where you don't have to pay out in large lumps. I wouldn't want to deal with the order of magnitude loss of speed to compile something like illumos or gcc with it. Cheers, Bayard ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Revive retired disks with data sets on them with vitual OI
Probably not the most reliable, but definitely the easiest, way to get access to your data is to use USB disks because VirtualBox allows direct USB passthrough. My boss uses OpenSolaris with USB drives to get access to the ZFS pool running on his Linux system. Jon On 26 March 2012 01:52, Harry Putnam wrote: > I have several disks from a period when I had a hardware setup of OI > on its own physical machine. > > I'm now trying to run OI as a Virtualbox Guest on a 64bit win 7 > machine. I've had it running for some time but just using some small > virtual disks to play around with. > > The win7 box is a Sager (NP8760)Laptop with: > Inel Core i7 CPU Q820 @1.73 1.73 cpus (8) - Clevo W870CU mobo and 8GB > ram. > > (The setup described below is expected to be temporary until such time > as I can dedicate a physical machine to OI as before.. . probably a > good while) > > I would like to set up those retired disks (which were left exported > when I retired the machine) in some kind of exterior holder and access > them as disks for the virtual OI. > > How best to accomplish that? I have > 1 fire wire and > 3 usb2 ports > 1 esata > > on the win7 machine and the possibility of adding a second NIC by way > of the laptops expansion card slot. > > Just a bit lost as to how to set things up so that the virtual OI b151 > can see those disks, import and continue using them as its native > disks. > > Is there some kind of housing with no OS that would stand as the disk > holders, but the OS and controllers would be on the virtual OI guest, > running on win 7. > > Or really any way at all to accomplish the idea of using those disks > and data sets by way of a Virtual Guest running OI. > > There are actually 3 pair of disks that were set up in mirrored > zpools: 2 @ 500 gb (Older IDE) > 2 @ 500 gb (oldish sata) > 2 @ 750 gb (slightly newer sata) > > I'd like to be able to use them all from the Virtual guest OI setup. > > > ___ > OpenIndiana-discuss mailing list > OpenIndiana-discuss@openindiana.org > http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Bump Nvidia driver to 295.20
Sorry for the slow report back. On Thu, Mar 22, 2012 at 11:09 PM, Ron Parker wrote: > > Perhaps no major bugs, but if I undock going from two monitors to one, > redock going back to two monitors, I almost always get tossed out of > X. I'll have to test the newer one tomorrow and report back. I just retested this with 295.33 and still kills X most of the time. It did let me undock and redock once, which I'd only seen with the 288(?) driver on a single occasion. So it may be more stable in this respect. This is running on a Dell Latitude E6410. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Routing and avahi questions
Gary Gendel wrote: > I have my OpenIndiana box providing wan/lan routing with firewall/nat. > I was having some really slow wan performance so I started digging in. > The performance issue was a compromised user account and a machine on > the internet downloading everything from the account, pegging my upload > bandwidth quota. > > However, in my investigations, I've noticed a few things that was > wondering about... > > Using snoop, I'm seeing a steady flood of ARP request broadcast from my > ISP. As I only have one IP address/MAC allowed does it make sense to > filter out the "not-for-me" requests or doesn't it really matter? Is > there even a way to do this without breaking the WAN-side? I think that it's likely to be more work to filter these out than it is to let the system properly discard them as part of ARP processing. And if the filtering is not done right, there are certainly some correctness risks involved -- a "not for me" query that nonetheless indicates a source IP/mac mapping change actually must be processed, at least per the RFCs. But it's your machine. If you can figure a way to filter them, and if you can measure the result and show that it's worthwhile, go for it. I just think you're barking up the wrong tree. > The second question is that I noticed that Avahi has bound itself to > both my WAN and LAN nics. Is there a way to limit this to the LAN nic? > Does mdns have a similar issue? I discovered this by running "bssh" and > seeing the service both on my bge0 (WAN) and bge1 (LAN) nics. These should be the same thing -- just block UDP port 5353 in the places where you don't want Avahi/mDNS stuff to leak. -- James Carlson 42.703N 71.076W ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] auto-snapshot replicate problems
Just reply just in-case someone else comes across this post. Altering the time-slider daemon would be tricky, but writing my own with a crontab would still take some time to replicate all the features I would like (clearing up old snapshots etc.) As the auto-replicate script is use ( any other script would be the same) needs to know the last destination snapshot and the current sending snapshot. I have implemented a simple zfs hold and zfs release to lock the last snapshot sent (tag of destination hostname) and release the previous one. John -Original Message- From: Milan Jurik [mailto:milan.ju...@xylab.cz] Sent: 14 March 2012 11:01 To: Discussion list for OpenIndiana Subject: Re: [OpenIndiana-discuss] auto-snapshot replicate problems Hi, I think time-slider daemon is in JDS consolidation. But the question is - why do you want to hack it and maintain own hack? Why not to create zfs snapshots by own crontab entry? Best regards, Milan On 14.03.2012 12:38, John McEntee wrote: > I have a problem trying to keep a second fileserver in sync with the > primary one. > > > > I have a script (auto-replicate) that I have slightly altered that > basically > checks the latest snapshot of the both master server and the dr > server. It > then does a send -I if there is a difference. This used to work fine > in the > old versions of the time-slider service. > > > > The problem I have is the later version of the time-slider service in > OpenIndiana cleans up old snapshots of zero size, which means the > latest > snapshot on the dr server no longer exists on the master server so > the send > -I fails. > > > > My fix would be to hack the time-slider service to not clean up the > zero > size snapshots. Please can anyone point me in the right direction? I > cannot > even find the code at the moment. I would also be interested in any > other > solutions > > > > Thanks > > > > John > > > > ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ The contents of this e-mail and any attachment(s) are strictly confidential and are solely for the person(s) at the e-mail address(es) above. If you are not an addressee, you may not disclose, distribute, copy or use this e-mail, and we request that you send an e-mail to ad...@stirling-dynamics.com and delete this e-mail. Stirling Dynamics Ltd. accepts no legal liability for the contents of this e-mail including any errors, interception or interference, as internet communications are not secure. Any views or opinions presented are solely those of the author and do not necessarily represent those of Stirling Dynamics Ltd. Registered In England No. 2092114 Registered Office: 26 Regent Street, Clifton, Bristol. BS8 4HG VAT no. GB 464 6551 29 ___ This e-mail has been scanned for all viruses MessageLabs. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] Routing and avahi questions
I have my OpenIndiana box providing wan/lan routing with firewall/nat. I was having some really slow wan performance so I started digging in. The performance issue was a compromised user account and a machine on the internet downloading everything from the account, pegging my upload bandwidth quota. However, in my investigations, I've noticed a few things that was wondering about... Using snoop, I'm seeing a steady flood of ARP request broadcast from my ISP. As I only have one IP address/MAC allowed does it make sense to filter out the "not-for-me" requests or doesn't it really matter? Is there even a way to do this without breaking the WAN-side? The second question is that I noticed that Avahi has bound itself to both my WAN and LAN nics. Is there a way to limit this to the LAN nic? Does mdns have a similar issue? I discovered this by running "bssh" and seeing the service both on my bge0 (WAN) and bge1 (LAN) nics. I know that these are not necessarily OpenIndiana issues, but I haven't been able to google anything useful on these topics. I was hoping that I could get some insights here. Regards, Gary ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
