Re: Is Amazon AWS/EBS snapshotting just LVM, or what?

2017-09-28 Thread Tom Buskey
rote: > > > > I misspoke about LVM for Glance/Swift. The backend for the images are on > > top of a filesystem in the POC clouds. LVM is used for Cinder, the block > > image store. Ceph is often used to drop in replace LVM for Cinder and > files > > for Swift ob

Re: Is Amazon AWS/EBS snapshotting just LVM, or what?

2017-09-28 Thread Ted Roche
On Thu, Sep 28, 2017 at 2:32 PM, Tom Buskey <t...@buskey.name> wrote: > > I misspoke about LVM for Glance/Swift. The backend for the images are on > top of a filesystem in the POC clouds. LVM is used for Cinder, the block > image store. Ceph is often used to drop in repl

Re: Is Amazon AWS/EBS snapshotting just LVM, or what?

2017-09-28 Thread Tom Buskey
On Thu, Sep 28, 2017 at 2:00 PM, Joshua Judson Rosen <roz...@hackerposse.com > wrote: > On 09/28/2017 01:46 PM, Tom Buskey wrote: > > I work with OpenStack. It manages images in Glance which sit above its > object storage, Swift. > > > > On the POC clouds, you can u

Re: Is Amazon AWS/EBS snapshotting just LVM, or what?

2017-09-28 Thread Joshua Judson Rosen
On 09/28/2017 02:14 PM, mark wrote: > AWS/EBS is not LVM under the covers, it's more like NFS; and snapshots are > more like VMware & how it does snapshots. I have never used VMWare and have no idea how it does anything. Can you provide more insight on what that means? >

Re: Is Amazon AWS/EBS snapshotting just LVM, or what?

2017-09-28 Thread mark
AWS/EBS is not LVM under the covers, it's more like NFS; and snapshots are more like VMware & how it does snapshots. The OS cache exclusion refers to read-ahead and write caching going on in RAM. Mark On Sep 28, 2017 1:17 PM, "Joshua Judson Rosen" <roz...@hackerposse.com> w

Re: Is Amazon AWS/EBS snapshotting just LVM, or what?

2017-09-28 Thread Joshua Judson Rosen
On 09/28/2017 01:32 PM, Ken D'Ambrosio wrote: > I would say it's unlikely to be LVM, because LVM is content-ignorant; it > snapshots the entire volume, which is > inefficient, and when you're Amazon, you care a LOT about being efficient.  > Instead, I imagine they're using some >

Re: Is Amazon AWS/EBS snapshotting just LVM, or what?

2017-09-28 Thread Joshua Judson Rosen
On 09/28/2017 01:48 PM, Bill Ricker wrote: > The lack of coherence due to OS cave not being flushed should still be a > concern. In the general case, yes. In my particular case I'm specifically concerned only with data that's stored transactionally to the extent that (and I really hope that I'm

Re: Is Amazon AWS/EBS snapshotting just LVM, or what?

2017-09-28 Thread Joshua Judson Rosen
On 09/28/2017 01:46 PM, Tom Buskey wrote: > I work with OpenStack.  It manages images in Glance which sit above its > object storage, Swift. > > On the POC clouds, you can use LVM as a backend for Glance.  Snapshotting is > *very* slow.  30 minutes for a snap of a > 80GB VM th

Re: Is Amazon AWS/EBS snapshotting just LVM, or what?

2017-09-28 Thread Bill Ricker
The lack of coherence due to OS cave not being flushed should still be a concern. OTOH I saw a storage level replication system propagate corruption to the remote site's copy of the Production DBMS ... So it perfectly replicated the primary's failure. Oops. Easiest recovery was restoring a

Re: Is Amazon AWS/EBS snapshotting just LVM, or what?

2017-09-28 Thread Tom Buskey
I work with OpenStack. It manages images in Glance which sit above its object storage, Swift. On the POC clouds, you can use LVM as a backend for Glance. Snapshotting is *very* slow. 30 minutes for a snap of a 80GB VM that's shutdown. You can use other storage backends in OpenStack

Re: Is Amazon AWS/EBS snapshotting just LVM, or what?

2017-09-28 Thread Ken D'Ambrosio
I would say it's unlikely to be LVM, because LVM is content-ignorant; it snapshots the entire volume, which is inefficient, and when you're Amazon, you care a LOT about being efficient. Instead, I imagine they're using some content-aware CoW solution such as ZFS. But, whatever mechanism, I

Is Amazon AWS/EBS snapshotting just LVM, or what?

2017-09-28 Thread Joshua Judson Rosen
e information I've been able to find about how Amazon's stuff works >(either in terms of how it's _implemented_ [for which I'm finding basically no insight] or how it's _characterized_ [in the engineering sense, not the literary sense]...), it really sounds a _lot_ like Amazon is just using LV

Boston Linux Meeting Reminder, tomorrow, Wednesday, April 18, 2012 - Linux Soup XII.2: LVM Fundamentals and CGroups

2012-04-17 Thread Jerry Feldman
When: April 18, 2012 7PM (6:30PM for QA) Topic: Linux Soup XII.2: LVM Fundamentals and CGroups Moderators: Christoph Doerbeck, Gordon Keegan Location: MIT Building E51, Room 335 Summary Christoph discusses LVM volume management, and Gordon discusses CGroups for resource management Abstract

Boston Linux Meeting Wednesday, April 18, 2012 - Linux Soup XII.2: LVM Fundamentals and CGroups

2012-04-10 Thread Jerry Feldman
When: April 18, 2012 7PM (6:30PM for QA) Topic: Linux Soup XII.2: LVM Fundamentals and CGroups Moderators: Christoph Doerbeck, Gordon Keegan Location: MIT Building E51, Room 335 Summary Christoph discusses LVM volume management, and Gordon discusses CGroups for resource management Abstract

Re: LVM

2008-09-23 Thread Alan Johnson
sound like a broken record, but it also has a very nice interface for managing all your logical volume needs. That said, it sounds like you aready resized the LVM and just need to resize the file system. When I do this for xen LVM partitions, I do this: - webmin to create/resize LVM as needed

LVM

2008-09-22 Thread Bruce Labitt
A while back I added a 1TB drive to my mythtv box. My 500GB drive was about full so I thought I'd lvm the 1TB drive onto the existing. I did not do it correctly apparently. My system is only reporting the original 500GB. If, however, I open up the lvm gui I see a Volume Group 00

Re: LVM

2008-09-22 Thread Frank DiPrete
Bruce Labitt wrote: A while back I added a 1TB drive to my mythtv box. My 500GB drive was about full so I thought I'd lvm the 1TB drive onto the existing. I did not do it correctly apparently. My system is only reporting the original 500GB. If, however, I open up the lvm gui I see

Re: LVM

2008-09-22 Thread Lloyd Kvam
I've survived fiddling LVM stuff, so I think it is fairly fool-proof. pvdisplay will show the physical volumes lvdisplay will show the logical volumes vgdisplay will show the volume groups On Mon, 2008-09-22 at 20:16 -0400, Bruce Labitt wrote: A while back I added a 1TB drive to my mythtv box

Re: LVM

2008-09-22 Thread Bruce Labitt
Frank DiPrete wrote: Bruce Labitt wrote: A while back I added a 1TB drive to my mythtv box. My 500GB drive was about full so I thought I'd lvm the 1TB drive onto the existing. I did not do it correctly apparently. My system is only reporting the original 500GB. If, however, I open up

Re: LVM

2008-09-22 Thread Frank DiPrete
space on your root partition enjoy Bruce Labitt wrote: Frank DiPrete wrote: Bruce Labitt wrote: A while back I added a 1TB drive to my mythtv box. My 500GB drive was about full so I thought I'd lvm the 1TB drive onto the existing. I did not do it correctly apparently. My system is only

Re: LVM problem

2007-12-18 Thread Dan Coutu
that when doing LVM things and it threw me off. I figured it was an error of some sort and that I had to take some other action. Feh. Well, it was an error of some sort. LVM has no way of knowing what you have on your devices, and maybe you *did* expect that device to have something

Re: LVM problem

2007-12-18 Thread Dan Coutu
. I had never seen any message like that when doing LVM things and it threw me off. I figured it was an error of some sort and that I had to take some other action. Feh. Well, it was an error of some sort. LVM has no way of knowing what you have on your devices, and maybe you

Re: LVM problem

2007-12-18 Thread Ben Scott
display commands: Which all seem to indicate that the volume group named VolGroup00 is not working. You did say this system was running, right? I'm wondering just how screwed up things are. If what LVM is reporting is right, there shouldn't be a system to run... Have you rebooted since

Re: LVM problem

2007-12-18 Thread Dan Coutu
mapped to the damaged PV on sdb, then restoring the metadata of the damaged PV is what you want. Try the --partial switch to the various LVM commands. According to the man page, it will not allow modification of metadata, so it should be safe. There are also some words in there about re

Re: LVM problem

2007-12-18 Thread Dan Coutu
Dan Coutu wrote: Note: Red Hat does have some documentation that talks about recovering LVM metadata although not in exactly the same kind of situation. The command it mentions is something like this: pvcreate --uuid FmGRh3-zhok-iVI8-7qTD-S5BI-MAEN-NYM5Sk --restorefile /etc/lvm/archive

LVM problem

2007-12-14 Thread Dan Coutu
I'm extending an LVM volume in the same way that I did on an almost identical machine last week. Have an existing RAID array setup on /dev/sda with /dev/sda1 setup as the boot partition and /dev/sda2 as a logical volume. Added new RAID drives that show up as /dev/sdb. They show up on boot

Re: LVM problem

2007-12-14 Thread Dan Coutu
Ben Scott wrote: On Dec 14, 2007 10:45 AM, Dan Coutu [EMAIL PROTECTED] wrote: Do a pvcreate /dev/sdb and it reports that all is well. mkfs on /dev/sdb also goes well. Did you do those in that order? If so, you've likely overwritten the PV header (written by pvcreate) with a

Re: LVM problem

2007-12-14 Thread Mark Komarinski
blown away the LVM metadata on /dev/sdb and thus messed up that volume group. LVM still thinks that /dev/sdb is part of the volume group. I'm not sure how to fix this, but if you're using RHEL, contact Red Hat support and they may be able to help you. -Mark

Re: LVM problem

2007-12-14 Thread Ben Scott
error messages about not finding the signature or UUID are likely because LVM has copies of the metadata in other locations. So LVM knows there *should* be a PV there, but can't find it goes to look. (I know LVM caches metadata under /etc/lvm/, and I think it also keeps copies of all the metadata

Re: LVM problem

2007-12-14 Thread Shawn O'Shea
Looks like someone on the fedora forum had something similar happenthey seemed to be able to recover knowing the UUID of the lost drive and the file in /etc/lvm pvcreate -f –uuid Z4lh8H-G0e8-K8q1-4WB6-faac-39hk-b82MWU –restorefile /etc/lvm/backup/recover /dev/sdb http://fedoraforum.org/forum

Seacoast LUG notes, 10-Sept-2007, Ben Scott on RAID and LVM

2007-09-11 Thread Ted Roche
Twelve people attended last night's session of the Seacoast Linux User Group, a chapter of the Greater New Hampshire Linux User Group, held as usual on the second Monday of the month at the UNH Durham campus, Morse Hall room 301. Ben Scott had presented RAID and LVM and he had lots of information

[GNHLUG] SLUG/Durham / Mon 10 Sep / RAID and LVM storage management

2007-09-10 Thread Ben Scott
What : RAID and LVM storage management Date : Mon 10 Sep 2007 (TONIGHT) Time : 7 PM to 9 PM Where: Room 301, Morse Hall, UNH, Durham, NH For the September 2007 SLUG/Seacoast/UNH/Durham meeting, Ben Scott will be speaking on storage management using RAID and LVM. === About the presentation

[GNHLUG] SLUG/Durham / Mon 10 Sep / RAID and LVM storage management

2007-08-26 Thread Ben Scott
What : RAID and LVM storage management Date : Mon 10 Sep 2007 Time : 7 PM to 9 PM Where: Room 301, Morse Hall, UNH, Durham, NH For the September 2007 SLUG/Seacoast/UNH/Durham meeting, Ben Scott will be speaking on storage management using RAID and LVM. === About the presentation === RAID

CentraLUG Notes, 2-April-2007: Bill Stearns and LVM

2007-04-03 Thread Ted Roche
/gmane.org.user-groups.linux.gnhlug.announce Everyone got to introduce themselves and speak a little bit about what they're up to. I passed around a couple lists of topics and speakers from the wiki to find out what the attendees want to see for future sessions. Bill Stearns presented LVM: Logical Volume

Re: Solaris / Resizing LVM PVs (was: Debian experiences)

2006-11-05 Thread Ben Scott
pf wasn't adopted just because it was Not Invented Here. Does anyone know if there is a way to non-destructively resize a Linux LVM PV (Physical Volume)? Something like pvreduce? Does such a thing exist? I don't have a command by that name, and Google only finds thinkos for lvreduce

Re: Solaris / Resizing LVM PVs (was: Debian experiences)

2006-11-05 Thread Tom Buskey
was ported to Linux. IPF runs on almost everything else. MacOSX uses IPF. Does anyone know if there is a way to non-destructively resize a Linux LVM PV (Physical Volume)? Something like pvreduce? forgot joke /joke Does such a thing exist? I don't have a command by that name, and Google

Re: Solaris / Resizing LVM PVs (was: Debian experiences)

2006-11-05 Thread Ben Scott
On 11/5/06, Tom Buskey [EMAIL PROTECTED] wrote: I've been using VMware server for playing with OSes. Solaris works well ... Hmmm, that's a good thought. I went to all the trouble of setting up the nifty multi-boot system, and I think it's blinded me. I keep ignoring virtualization.

Re: Solaris / Resizing LVM PVs (was: Debian experiences)

2006-11-05 Thread Tom Buskey
On 11/5/06, Ben Scott [EMAIL PROTECTED] wrote: On 11/5/06, Tom Buskey [EMAIL PROTECTED] wrote: I've been using VMware server for playing with OSes. Solaris works well ... Hmmm, that's a good thought. I went to all the trouble of setting up the nifty multi-boot system, and I think it's

Re: Solaris / Resizing LVM PVs (was: Debian experiences)

2006-11-05 Thread Ben Scott
On 11/5/06, Tom Buskey [EMAIL PROTECTED] wrote: Who wants a half-height, 18 GB SCSI drive, these days? Someone who runs older hardware at home Yah, I used to do that, too. But when you can get a PATA disk that's two orders of magnitude larger in capacity, half the size physically, a

Re: Solaris / Resizing LVM PVs (was: Debian experiences)

2006-11-05 Thread Tom Buskey
(primaryies, not secondaries), controllers, fans and a gigabit ethernet card. Throw Linux in it w/ iSCSI target and RAID-5 and LVM the disks. Or not. Throw gigabit ethernet in your server and iSCSI initiator. You have a SAN. The hard part of that is cooling, power and monitoirng. But it works

Solaris / Resizing LVM PVs (was: Debian experiences)

2006-11-04 Thread Ben Scott
have lots of respect for them. But I've already got a T-shirt like that. ;-) Now, Solaris I haven't really used in just about forever, and the new free Solaris sounds interesting. Hmmm. That has some appeal to me. One problem. When I set-up the disks on my current PC, I used Linux LVM

Re: Solaris / Resizing LVM PVs (was: Debian experiences)

2006-11-04 Thread Tom Buskey
Binaries in a Zone too. One problem. When I set-up the disks on my current PC, I used Linux LVM for everything except the Wintendo partition. That lets me do things like try out three different distros at once, without needing to do much of anything to make room or reclaim it afterwards. I have