Re: [vox-tech] Memory addressing?
On Wed, Jun 23, 2010 at 06:37:41PM -0700, Bill Broadley wrote: On 06/23/2010 10:42 AM, timri...@appahost.com wrote: The reason for the discussion was Brian's intrusion detection implementation stored the incoming packets in a hash table. The key to the hash table was quite large -- inbound IP address, outbound IP address, inbound port, and outbound port. I thought to my self, on a very large implementation (say Google) the table could grow to a billion entries. Could a hash table store this amount in memory? Could you allocate an array of half the total memory? Could you allocate an array of a billion integers? Brian, on his laptop, couldn't allocate a billion integers. But he could allocate a billion characters (bytes). Since I thought both bytes and integers were words, and since I thought memory stored words like registers stored words, we had our discussion. Sounds like an interesting discussion, sorry I missed it. Kinda of amusing trying to handle such a hash table on a (older I assume) single 32 bit laptop. So, I am about to put up the code for my mods to nProbe. I believe it runs on 64 bit. I really haven't done any work on the hashing part, but I am sure that the work that Luca Deri has done works well. How do you put a public git repository online? Somewhat like the following. http://www.gtk.org/download.html I found the following link. Does it look like it has the correct details? http://toolmantim.com/thoughts/setting_up_a_new_remote_git_repository brian -- Brian Lavender http://www.brie.com/brian/ There are two ways of constructing a software design. One way is to make it so simple that there are obviously no deficiencies. And the other way is to make it so complicated that there are no obvious deficiencies. Professor C. A. R. Hoare The 1980 Turing award lecture ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] PATH change
I created a .bash_profile file in my home directory and have had success putting an alias for ll in it. I would assume a PATH would work as well. --Susan On Jun 23, 2010, at 7:41 PM, Anahita Yazdi wrote: Hi guys, Can anyone help me with changing PATH on a mac os x (10.5.8) permanently? I tried export and set but it doesnt permanently change the path. I also did vi ./.bashrc but the document is like read-only it doesnt let me make changes! Is there a command there that i am missing? Lastly I will really be appreciated if anyone knows anything about Bus error by any chance? Thanks alot, Anahita ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
[vox-tech] NAS/Printer Server/Web Server?
So I need to replace my dying NAS/Print server and was contemplating a low power web server (5-10 watts) so I could stop leaving a workstation/server on all the time. Aside from the massive question of what to get, there's the tricky part of should this be 1 device or 2? It seems like a NAS with hardware RAID and 2-4 drives and 2-4 usb ports would do the trick nicely, but I'm having a hard time finding out how much power these things take and many of them seem to have custom linux setups with oddities that would prevent me from saying running apache/mod_wsgi/trac or plone (the 2 things I use for my websites). Is the trade-off of a less flexible linux install for a simpler printer/network share config worth it? (I've done a samba printer share before but it took me several days to figure out) Anyone have any suggestions about devices? I've been poking at: http://www.newegg.com/Product/Product.aspx?Item=N82E16822122022 http://www.amazon.com/fit-PC-Slim-Diskless/dp/B001L4I9HK and some other similar stuff... Thanks, Alex ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] NAS/Printer Server/Web Server?
On 06/24/2010 02:27 PM, Alex Mandel wrote: So I need to replace my dying NAS/Print server and was contemplating a low power web server (5-10 watts) so I could stop leaving a workstation/server on all the time. Aside from the massive question of what to get, there's the tricky part of should this be 1 device or 2? It seems like a NAS with hardware RAID and 2-4 drives and 2-4 usb ports would do the trick nicely, but I'm having a hard time finding out how much power these things take and many of them seem to have custom linux setups with oddities that would prevent me from saying running apache/mod_wsgi/trac or plone (the 2 things I use for my websites). Is the trade-off of a less flexible linux install for a simpler printer/network share config worth it? (I've done a samba printer share before but it took me several days to figure out) Anyone have any suggestions about devices? I've been poking at: http://www.newegg.com/Product/Product.aspx?Item=N82E16822122022 http://www.amazon.com/fit-PC-Slim-Diskless/dp/B001L4I9HK and some other similar stuff... Thanks, Alex I may have found answers to my own questions. Option 1: a fit-pc-slim or similar with a usb enclosure for hard drives. Cons- would have to configure printer share, file share etc all from scratch. Pro runs straight ubuntu or gentoo and is super low power. (Though the drive enclosure may make it equivalent) Option 2: A Netgear ReadyNAS Duo Cons- it's a netgear hacked version of debian (actually sounds better than the ipkg based other NAS systems so it's almost a Pro). Uses a lot more power 30-40 Watts. It's a 32 bit Sparc based processor, guess thats not that odd considering the other NAS I've seen are ARM or PPC. Nobody seems to use x86, atom etc in NAS, any idea why? Pro - simpler setup for most use cases, larger drive support and RAID features than simple 2 drive enclosures. Automatic usage of usb APC UPS units. Cost for both methods seem to come out about the same. Note to self: For some reason I'd never really thought about the fact that you should put such a device on a UPS. In hindsite this is probably what killed my previous NAS drive. So in all this the key is now I'm getting a UPS specifically for my NAS, router since they are in a common room where printers can be attached. For those curious I'm probably going Option 2, for the price it just seems easier to manage and since it takes most debs from standard lenny repos should be able to run all my python based web stuff. Hope these notes help others find their way. Thanks, Alex ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] NAS/Printer Server/Web Server?
If you don't care that much about hardware raid, then I'd suggest the NSLU2 or the Sheevaplug. I use the NSLU2 myself, and run debian on it. Its a mite slow, but it doesn't draw much power, nor does it generate a ton of heat. Mike On Thu, Jun 24, 2010 at 2:27 PM, Alex Mandel tech_...@wildintellect.comwrote: So I need to replace my dying NAS/Print server and was contemplating a low power web server (5-10 watts) so I could stop leaving a workstation/server on all the time. Aside from the massive question of what to get, there's the tricky part of should this be 1 device or 2? It seems like a NAS with hardware RAID and 2-4 drives and 2-4 usb ports would do the trick nicely, but I'm having a hard time finding out how much power these things take and many of them seem to have custom linux setups with oddities that would prevent me from saying running apache/mod_wsgi/trac or plone (the 2 things I use for my websites). Is the trade-off of a less flexible linux install for a simpler printer/network share config worth it? (I've done a samba printer share before but it took me several days to figure out) Anyone have any suggestions about devices? I've been poking at: http://www.newegg.com/Product/Product.aspx?Item=N82E16822122022 http://www.amazon.com/fit-PC-Slim-Diskless/dp/B001L4I9HK and some other similar stuff... Thanks, Alex ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech -- Michael Wenk mjw...@ucdavis.edu ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] NAS/Printer Server/Web Server?
Quoting Alex Mandel (tech_...@wildintellect.com): [Interesting details about hardware options you're considering:] Note to self: For some reason I'd never really thought about the fact that you should put such a device on a UPS. In hindsight, this is probably what killed my previous NAS drive. Are you thinking it was a power surge / spike or low-voltage line condition that fried the drive? Out here on the Left Coast, serious line-power problems are pretty rare, especially compared to what, say, LILCO customers have to put up with in the NYC area. But the matter is worth pondering. I have for a couple of decades run full-service *ix servers at my residences on (variously) T-1 and broadband, so I weigh some of the same concerns you do. In April 2009, the machine then running linuxmafia.com, a 1998-era VA Research model 500 2U server I literally rescued from a dumpster one day around year 2000 while working at VA Linux Systems, got fried during a late-spring lightning storm, and I hastily replaced it with a slightly less ancient VA Linux model 2230. That's the only time I've ever lost hardware from AC power fluctuations (in the Bay Area, anyway). Back in summer 2001, when California went through rolling blackouts, I pondered getting a UPS but decided it would be solving the wrong problem: My suffering small amounts of downtime when PGE lost power was OK as long as the machine came back up. So, the missing ingredient was reliable journaling filesystems, and I figured out how to migrate my system from ext2 to XFS. (See 'XFS Conversion' on http://linuxmafia.com/kb/Filesystems . To explain, ext3 was not then production-ready.) Still, it's bothered me to have my hardware, particularly HDs, exposed to PGE-caused damage _if_ that actually happens. So, I went shopping -- and _still_ found UPSes to be a solution to the wrong problem. Instead, I bought an APC-branded power filtering / conditioning unit, thereby addressing the power-quality issue without saddling me with a failure-prone lead-acid battery. Also, having recently bought an external (USB/Firewire) 2 TB drive and been astonished by the low cost, I'm considering buying a second one of those (to make a RAID1 pair) and, say, a ShivaPlug to replace the model 2230: That would cut the electricity hit to almost nothing -- and still let me use standard Debian on real mass storage. Anyway, think twice before putting printers on your UPSes (if that's part of what you're considering), as many printers draw gobs of power when in service, and are not typically an essential service you need running during power outages. ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] NAS/Printer Server/Web Server?
The NSLU2 looks interesting but doesn't seem to be available any longer. The Sheevaplug seems on par with the Fit-pc I was looking at but also appears to be a little obscure in terms of purchasing and sounds like more work to just get the OS I want onto it since it's ARM based and the Fit-pc is x86 compatible. Anyone have any thoughts on connecting something like the following as an external usb 2 drive hardware RAID? http://www.newegg.com/Product/Product.aspx?Item=N82E16817182144 http://www.newegg.com/Product/Product.aspx?Item=N82E16817121060 I guess the other question, for a use case like this, infrequent copies of data for backup does it matter if it's software or hardware RAID? I kind of liked the idea of just popping in a drive and having build the RAID without me doing anything. Thanks for the conversation, it always seems so simple at first until you get into the fact that there are lots of little details. Thanks, Alex On 06/24/2010 05:22 PM, Michael Wenk wrote: If you don't care that much about hardware raid, then I'd suggest the NSLU2 or the Sheevaplug. I use the NSLU2 myself, and run debian on it. Its a mite slow, but it doesn't draw much power, nor does it generate a ton of heat. Mike On Thu, Jun 24, 2010 at 2:27 PM, Alex Mandel tech_...@wildintellect.comwrote: So I need to replace my dying NAS/Print server and was contemplating a low power web server (5-10 watts) so I could stop leaving a workstation/server on all the time. Aside from the massive question of what to get, there's the tricky part of should this be 1 device or 2? It seems like a NAS with hardware RAID and 2-4 drives and 2-4 usb ports would do the trick nicely, but I'm having a hard time finding out how much power these things take and many of them seem to have custom linux setups with oddities that would prevent me from saying running apache/mod_wsgi/trac or plone (the 2 things I use for my websites). Is the trade-off of a less flexible linux install for a simpler printer/network share config worth it? (I've done a samba printer share before but it took me several days to figure out) Anyone have any suggestions about devices? I've been poking at: http://www.newegg.com/Product/Product.aspx?Item=N82E16822122022 http://www.amazon.com/fit-PC-Slim-Diskless/dp/B001L4I9HK and some other similar stuff... Thanks, Alex ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] NAS/Printer Server/Web Server?
On 06/24/2010 07:01 PM, Rick Moen wrote: Quoting Alex Mandel (tech_...@wildintellect.com): How do you RAID 2 external USB enclosures as a network drive, or are you talking software raid with both plugged in to a computer? The latter. With a Sheevaplug, NSLU2, or similar (not to mention more-conventional hardware), doing Linux md RAID1, assuming one can make sure the bootloader works properly from either drive, I consider that an optimal storage redundancy solution. Remirroring after a drive failure does indeed bog down the host a bit, but tolerably, whereas md RAID5 restriping after drive failure exacts a pretty awful performance hit. (And with 2 TB drives as cheap as they are, 50% RAID storage overhead seems absolutely fine to me.) In that usage scenario, the expense of serious hardware RAID seems absurd given that very little benefit. I was going to go with RAID 1 using 2 TB drives. Got a line on 2TB externals with longer than 1 year warranties (since buying drives themselves comes with 3). At a cost difference of $150(Sheeva is about $100, the ReadyNAS is $250) I don't see myself saving much buying cases and drives. That would also be 3 power plugs instead of one, and if I turn of the computer controller will it turn off the usb drives? (I guess it would if they are usb powered vs. their own power button). What do you think about the RAID case for $50 I posted in the other part of the thread? Seems to be the same as buying 2 reliable single drive cases? Thanks, Alex ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] NAS/Printer Server/Web Server?
Quoting Alex Mandel (tech_...@wildintellect.com): Anyone have any thoughts on connecting something like the following as an external usb 2 drive hardware RAID? http://www.newegg.com/Product/Product.aspx?Item=N82E16817182144 http://www.newegg.com/Product/Product.aspx?Item=N82E16817121060 That's just two drives in one box. (Personally, I rather like the idea of each drive having its own USB/Firewire box w/PSU: No SPoF.) You would need to furnish your own hardware RAID HBA. I'm unclear on how you'd do hardware RAID serving to _USB_: By contrast, if you used the eSATA connectors (instead of USB), you could, I guess, but I'm (speaking for myself) a little unenthusiastic about SATA hardware RAID, generally. Be careful what you pick; most RAID-capable SATA HBAs are still fakeraid (manufacturer-specific software RAID). I guess the other question, for a use case like this, infrequent copies of data for backup does it matter if it's software or hardware RAID? I kind of liked the idea of just popping in a drive and having build the RAID without me doing anything. I don't think configuring md RAID1 for remirroring is exactly a big deal, is it? Actually, I'll be able to speak to that question soon, because my server's recently failed one of its md RAID1 mirrored pair of antique 18GB SCSI drives, and I'll need to replace it RSN. ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] NAS/Printer Server/Web Server?
On Thu, Jun 24, 2010 at 06:25:55PM -0700, Alex Mandel wrote: Thanks for the conversation, it always seems so simple at first until you get into the fact that there are lots of little details. What about iSCSI? Can these devices support it or do you plan to just use NFS? -- Brian Lavender http://www.brie.com/brian/ There are two ways of constructing a software design. One way is to make it so simple that there are obviously no deficiencies. And the other way is to make it so complicated that there are no obvious deficiencies. Professor C. A. R. Hoare The 1980 Turing award lecture ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] NAS/Printer Server/Web Server?
Quoting Alex Mandel (tech_...@wildintellect.com): I was going to go with RAID 1 using 2 TB drives. Got a line on 2TB externals with longer than 1 year warranties (since buying drives themselves comes with 3). At a cost difference of $150(Sheeva is about $100, the ReadyNAS is $250) I don't see myself saving much buying cases and drives. As I just mentioned, my server's running a degraded RAID1 pair at the moment (failed drive), which is why I picked up a 2 TB external USB/Firewire thing as a bandaid. (It makes ensuring that I've made safety copies of key filesystems frequently really easy.) http://linuxmafia.com/pipermail/conspire/2010-June/005493.html http://linuxmafia.com/pipermail/conspire/2010-June/005495.html http://linuxmafia.com/pipermail/conspire/2010-June/005510.html The thing is a Hitachi HSD2000 'SimpleDrive'; $150, 1yr warranty. I was/am really very short on time for screwing around with hardware, so the first simple, realiable-tech solution I could find at Microcenter won. (I'm not posting it to claim it's great or to recommend it, just to say that it solved a problem of the moment. The data-saving solution you actually do that works wins over the better solution that you never get to.) That would also be 3 power plugs instead of one Single points of failure are bad. Power strips or PDUs with master switches on them are cheap. (FWIW, the Hitachi spins down and shuts off if the attached host powers off.) What do you think about the RAID case for $50 I posted in the other part of the thread? Seems to be the same as buying 2 reliable single drive cases? Nope. SPoF. And why are you calling that a 'RAID case'? Looks like a JBoD to me. ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] NAS/Printer Server/Web Server?
On 06/24/2010 07:21 PM, Brian Lavender wrote: On Thu, Jun 24, 2010 at 06:25:55PM -0700, Alex Mandel wrote: Thanks for the conversation, it always seems so simple at first until you get into the fact that there are lots of little details. What about iSCSI? Can these devices support it or do you plan to just use NFS? Neither, Samba/sftp for windows users and ssh/sftp for my linux boxes. I have no need for the files to always be mounted on my desktop/laptop. Alex ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] NAS/Printer Server/Web Server?
On Thu, Jun 24, 2010 at 07:21:55PM -0700, Brian Lavender wrote: On Thu, Jun 24, 2010 at 06:25:55PM -0700, Alex Mandel wrote: Thanks for the conversation, it always seems so simple at first until you get into the fact that there are lots of little details. What about iSCSI? Can these devices support it or do you plan to just use NFS? I found the following on the ReadyNAS http://readynasfreeware.org/projects/nas-iscsi-target/ http://whocares.de/readynas/iscsi-target-support-readynas/ http://www.markwilson.co.uk/blog/2009/09/creating-an-iscsi-target-on-a-netgear-readynas.htm http://whocares.de/readynas-goes-iscsi/ -- Brian Lavender http://www.brie.com/brian/ There are two ways of constructing a software design. One way is to make it so simple that there are obviously no deficiencies. And the other way is to make it so complicated that there are no obvious deficiencies. Professor C. A. R. Hoare The 1980 Turing award lecture ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] NAS/Printer Server/Web Server?
On 06/24/2010 07:13 PM, Rick Moen wrote: Quoting Alex Mandel (tech_...@wildintellect.com): Anyone have any thoughts on connecting something like the following as an external usb 2 drive hardware RAID? http://www.newegg.com/Product/Product.aspx?Item=N82E16817182144 http://www.newegg.com/Product/Product.aspx?Item=N82E16817121060 That's just two drives in one box. (Personally, I rather like the idea of each drive having its own USB/Firewire box w/PSU: No SPoF.) You would need to furnish your own hardware RAID HBA. Indeed I should have read the specs closer. I guess what I was looking for no longer exists. I'm unclear on how you'd do hardware RAID serving to _USB_: By contrast, if you used the eSATA connectors (instead of USB), you could, I guess, but I'm (speaking for myself) a little unenthusiastic about SATA hardware RAID, generally. Be careful what you pick; most RAID-capable SATA HBAs are still fakeraid (manufacturer-specific software RAID). I guess the other question, for a use case like this, infrequent copies of data for backup does it matter if it's software or hardware RAID? I kind of liked the idea of just popping in a drive and having build the RAID without me doing anything. I don't think configuring md RAID1 for remirroring is exactly a big deal, is it? Actually, I'll be able to speak to that question soon, because my server's recently failed one of its md RAID1 mirrored pair of antique 18GB SCSI drives, and I'll need to replace it RSN. I don't really know either, the only time I've had to mess with RAID was on a clunky old workstation with 3 drives and a terrible RAID BIOS. Single point of failure on the power supply doesn't worry me too much since I can live with downtime and it's seems to be a relatively ordinary part. But you do bring up some good points and I plan to shop for 2 independent drives to see how that compares. It will mean more work to configure since the NAS boxes seem to have print serve, file server, media serve all ready out of the box. Thanks, Alex ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
Re: [vox-tech] NAS/Printer Server/Web Server?
Quoting Alex Mandel (tech_...@wildintellect.com): I don't really know either, the only time I've had to mess with RAID was on a clunky old workstation with 3 drives and a terrible RAID BIOS. Doesn't seem a big deal. In my case, I'll need to muck about with /sbin/fdisk for a bit, because the mirrored pair has five filesystems plus swap: linuxmafia:/etc/bind# fdisk -l /dev/sdc Disk /dev/sdc: 18.3 GB, 18351959040 bytes 255 heads, 63 sectors/track, 2231 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000c1659 Device Boot Start End Blocks Id System /dev/sdc1 12231179204765 Extended /dev/sdc5 1 243 1951834+ fd Linux raid autodetect /dev/sdc6 244 425 1461883+ fd Linux raid autodetect /dev/sdc7 426 790 2931831 fd Linux raid autodetect /dev/sdc8 791 851 489951 82 Linux swap / Solaris /dev/sdc9 8521580 5855661 fd Linux raid autodetect /dev/sdc10 15812231 5229126 fd Linux raid autodetect I _could_ have made all of sdb and sdc be a single Linux raid autodetect volume md0 and then fdisked that, but I didn't want to mirror the swap space. Given that setup decision, I'll need to power down, crack the case, yank out and replace /dev/sdb with a fresh [sic] 18GB or so SCSI drive -- if I still have any -- and make a partition table on it of the above specs. Then, apparently I'll do: raidhotadd /dev/md0 /dev/sdb5 raidhotadd /dev/md1 /dev/sdb6 raidhotadd /dev/md2 /dev/sdb7 mkswap /dev/sdb8 swapon -a raidhotadd /dev/md3 /dev/sdb9 raidhotadd /dev/md5 /dev/sdb10 (Yeah, I know, 18GB SCSI drives in 2010 are a bit silly. All I can say is, time flies. I should at least fish into the pile and see if I have a pair of spare 73 GB ones -- though that will mean re-doing the partition maps.) Single point of failure on the power supply doesn't worry me too much since I can live with downtime and it's seems to be a relatively ordinary part. No, you should worry. Chief causes of HD catastrophic failure (other than simple age and wear) are misbehaving PSUs and heat stress. Putting both drives in a single external enclosure with a single PSU means they can be both taken down at once by the same misbehaving power supply or the same seized-up fan. At that point, you have just eradicated the entire point of having a RAID1 mirror pair. It will mean more work to configure since the NAS boxes seem to have print serve, file server, media serve all ready out of the box. Yeah, well, for present purposes I'd rather run a Linux server using simple, commodity, general-purpose components. Works for Me.[tm] ___ vox-tech mailing list vox-tech@lists.lugod.org http://lists.lugod.org/mailman/listinfo/vox-tech
