Re: [squid-users] HDD Configuration Recommendations
Hmm, is squid still unable to work if one of cache dirs has problems? sounds like calling for bug report ;) On 26.09.08 17:52, Amos Jeffries wrote: It's already reported long ago. Made it onto the worklist for Squid-3 recently. Should be done Someday Soon Now (tm) :-). If you mean bug 410, I wasn't sure if it's the same... quite possibly it is but for full cache_dir (which the bug is about) there may be other ways to handle it... -- Matus UHLAR - fantomas, [EMAIL PROTECTED] ; http://www.fantomas.sk/ Warning: I wish NOT to receive e-mail advertising to this address. Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu. Christian Science Programming: Let God Debug It!.
Re: [squid-users] HDD Configuration Recommendations
On Fri, 26 Sep 2008 17:52:13 +1200 Amos Jeffries [EMAIL PROTECTED] wrote: Matus UHLAR - fantomas wrote: John Doe ha scritto: two disks = RAID 0 or 1 RAID 1 is mirroring: - Pros: safe (goes on even with a dead HD), fast reads (from both disks) - Cons: you only use 50% of total HD space (500GB total in your case). RAID 0 is stripping: - Pros: fast reads/writes and you use 100% of total HD (1TB) - Cons: unsafe (you lose 1 HD, you lose everything). Or just don't use RAID and create a cache_dir on each HD... Best would be RAID1 for the system and no RAID for the cache_dirs I think. On 25.09.08 11:39, Marcello Romani wrote: I would add that a dead or malfunctioning drive could harm service uptime if the caache dirs are not on raid1. Therefore I would suggest keeping everything on raid1. The three setups which are usable with Squid and RAID are: RAID 1 + singe cache_dir - handles HDD failure silently. At cost of half the disk space. Q: is your cache big enough or bandwidth important enough to warrant saving the cache data? no-RAID + multi cache_dir - Twice the cache space. At cost of Squid goes down with either HDD. BUT, can be manually restarted without that cache_dir immediately on detection. RAID 0 + single cache_dir - already been covered. Generally considered worse than no RAID. Depending on the expected load on squid, running with few users on a fast SAS / SCSI (probably not SATA though) RAID 5 array is perfectly fine too. Caveat emptor : I do not run an ISP :) My own advice is, if you need squid to be fast, multiple cache_dir on separate drives is the way to go. If you need uptime, you have to use either RAID1 or RAID5 for those cache_dirs. If you need uptime and have a limited number of users, a single cache_dir on a RAID5 partition is OK. If you need speed and uptime, maybe multiple cache_dirs on multiple RAID1s would work, but I never went that route. Evaluate your load (number of users, speed of connections to users, speed of Internet connection), your needs (speed / uptime), build for uptime and see if it handles the load. François
Re: [squid-users] HDD Configuration Recommendations
Matus UHLAR - fantomas wrote: Hmm, is squid still unable to work if one of cache dirs has problems? sounds like calling for bug report ;) On 26.09.08 17:52, Amos Jeffries wrote: It's already reported long ago. Made it onto the worklist for Squid-3 recently. Should be done Someday Soon Now (tm) :-). If you mean bug 410, I wasn't sure if it's the same... quite possibly it is but for full cache_dir (which the bug is about) there may be other ways to handle it... I did. A great solution is still being looked for. Single object read failures are already recoverable (object is erased and replaced). The write failures are currently fatal as it happens in parallel to network on large objects. And particularly bad if its a disk-full fatal like the bug was about. Amos -- Please use Squid 2.7.STABLE4 or 3.0.STABLE9
Re: [squid-users] HDD Configuration Recommendations
On Fri, 2008-09-26 at 17:52 +1200, Amos Jeffries wrote: no-RAID + multi cache_dir - Twice the cache space. At cost of Squid goes down with either HDD. but see below Hmm, is squid still unable to work if one of cache dirs has problems? sounds like calling for bug report ;) It's already reported long ago. Made it onto the worklist for Squid-3 recently. Should be done Someday Soon Now (tm) :-). and there is already a patch for COSS and Squid2. For more details and to track progress, please see http://wiki.squid-cache.org/Features/CacheDirFailover HTH, Alex.
Re: [squid-users] HDD Configuration Recommendations
I'm preparing to move my squid to new hardware. I have two 500GB SATA HDD's in the new box which will be used to store squid's cache on. Any suggestions on the best raid config for these guys so as to maximize performance? two disks = RAID 0 or 1 RAID 1 is mirroring: - Pros: safe (goes on even with a dead HD), fast reads (from both disks) - Cons: you only use 50% of total HD space (500GB total in your case). RAID 0 is stripping: - Pros: fast reads/writes and you use 100% of total HD (1TB) - Cons: unsafe (you lose 1 HD, you lose everything). Or just don't use RAID and create a cache_dir on each HD... Best would be RAID1 for the system and no RAID for the cache_dirs I think. JD
Re: [squid-users] HDD Configuration Recommendations
John Doe ha scritto: I'm preparing to move my squid to new hardware. I have two 500GB SATA HDD's in the new box which will be used to store squid's cache on. Any suggestions on the best raid config for these guys so as to maximize performance? two disks = RAID 0 or 1 RAID 1 is mirroring: - Pros: safe (goes on even with a dead HD), fast reads (from both disks) - Cons: you only use 50% of total HD space (500GB total in your case). RAID 0 is stripping: - Pros: fast reads/writes and you use 100% of total HD (1TB) - Cons: unsafe (you lose 1 HD, you lose everything). Or just don't use RAID and create a cache_dir on each HD... Best would be RAID1 for the system and no RAID for the cache_dirs I think. JD I would add that a dead or malfunctioning drive could harm service uptime if the caache dirs are not on raid1. Therefore I would suggest keeping everything on raid1. -- Marcello Romani Responsabile IT Ottotecnica s.r.l. http://www.ottotecnica.com
Re: [squid-users] HDD Configuration Recommendations
On 24.09.08 13:17, Chris Nighswonger wrote: I'm preparing to move my squid to new hardware. I have two 500GB SATA HDD's in the new box which will be used to store squid's cache on. Any suggestions on the best raid config for these guys so as to maximize performance? to maximize performance don't use RAID but two cache directories, one on each disk. Or, since 500GB may be very enough, just use one disk for cache and other for everything else - system, configs, logs etc. other solution may be use part of one disk for system etc and the rest for cache, other disk only for cache or having everything but the cache mirrorred and two equal partitions on each disk for cache, However RAID-1 will cost some performance and the previous solution may degrade performance because of different load on different disks... -- Matus UHLAR - fantomas, [EMAIL PROTECTED] ; http://www.fantomas.sk/ Warning: I wish NOT to receive e-mail advertising to this address. Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu. Windows found: (R)emove, (E)rase, (D)elete
Re: [squid-users] HDD Configuration Recommendations
John Doe ha scritto: two disks = RAID 0 or 1 RAID 1 is mirroring: - Pros: safe (goes on even with a dead HD), fast reads (from both disks) - Cons: you only use 50% of total HD space (500GB total in your case). RAID 0 is stripping: - Pros: fast reads/writes and you use 100% of total HD (1TB) - Cons: unsafe (you lose 1 HD, you lose everything). Or just don't use RAID and create a cache_dir on each HD... Best would be RAID1 for the system and no RAID for the cache_dirs I think. On 25.09.08 11:39, Marcello Romani wrote: I would add that a dead or malfunctioning drive could harm service uptime if the caache dirs are not on raid1. Therefore I would suggest keeping everything on raid1. Hmm, is squid still unable to work if one of cache dirs has problems? sounds like calling for bug report ;) -- Matus UHLAR - fantomas, [EMAIL PROTECTED] ; http://www.fantomas.sk/ Warning: I wish NOT to receive e-mail advertising to this address. Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu. 2B|!2B, that's a question!
Re: [squid-users] HDD Configuration Recommendations
Matus UHLAR - fantomas wrote: John Doe ha scritto: two disks = RAID 0 or 1 RAID 1 is mirroring: - Pros: safe (goes on even with a dead HD), fast reads (from both disks) - Cons: you only use 50% of total HD space (500GB total in your case). RAID 0 is stripping: - Pros: fast reads/writes and you use 100% of total HD (1TB) - Cons: unsafe (you lose 1 HD, you lose everything). Or just don't use RAID and create a cache_dir on each HD... Best would be RAID1 for the system and no RAID for the cache_dirs I think. On 25.09.08 11:39, Marcello Romani wrote: I would add that a dead or malfunctioning drive could harm service uptime if the caache dirs are not on raid1. Therefore I would suggest keeping everything on raid1. The three setups which are usable with Squid and RAID are: RAID 1 + singe cache_dir - handles HDD failure silently. At cost of half the disk space. Q: is your cache big enough or bandwidth important enough to warrant saving the cache data? no-RAID + multi cache_dir - Twice the cache space. At cost of Squid goes down with either HDD. BUT, can be manually restarted without that cache_dir immediately on detection. RAID 0 + single cache_dir - already been covered. Generally considered worse than no RAID. Hmm, is squid still unable to work if one of cache dirs has problems? sounds like calling for bug report ;) It's already reported long ago. Made it onto the worklist for Squid-3 recently. Should be done Someday Soon Now (tm) :-). Amos -- Please use Squid 2.7.STABLE4 or 3.0.STABLE9
RE: [squid-users] HDD Configuration Recommendations
I advice a RAID5, wheter it's soft or hardware raid. -Original Message- From: Chris Nighswonger [mailto:[EMAIL PROTECTED] Sent: quarta-feira, 24 de Setembro de 2008 18:18 To: Squid Users Subject: [squid-users] HDD Configuration Recommendations Hi all, I'm preparing to move my squid to new hardware. I have two 500GB SATA HDD's in the new box which will be used to store squid's cache on. Any suggestions on the best raid config for these guys so as to maximize performance? Regards, Chris -- Christopher Nighswonger Faculty Member Network Systems Director Foundations Bible College Seminary www.foundations.edu www.fbcradio.org
RE: [squid-users] HDD Configuration Recommendations
Forgot to say, you'll need one more disk -Original Message- From: Chris Nighswonger [mailto:[EMAIL PROTECTED] Sent: quarta-feira, 24 de Setembro de 2008 18:18 To: Squid Users Subject: [squid-users] HDD Configuration Recommendations Hi all, I'm preparing to move my squid to new hardware. I have two 500GB SATA HDD's in the new box which will be used to store squid's cache on. Any suggestions on the best raid config for these guys so as to maximize performance? Regards, Chris -- Christopher Nighswonger Faculty Member Network Systems Director Foundations Bible College Seminary www.foundations.edu www.fbcradio.org
