Re: [OpenIndiana-discuss] Low low end server
smartctl -x reports the wear on decent ones (read: you shouldn't consider any that doesn't have this feature). When it gets close to 0, or you see a lot of errors, it's time to replace it. On Mon, Feb 10, 2014 at 5:00 PM, Brogyányi József wrote: > 2014.02.09. 22:19 keltezéssel, Jim Klimov írta: > > 2*120Gb Samsung Pro SSDs (with powerloss >> protection, formatted to use 100Gb for mirrored rpool/mirrored >> zil/striped l2arc since their 100Gb sub-model has much higher >> reliability and speed - but is not on sale here). >> > Jim > > Only one question about the SSD usage. How do I know the SSD status? > You know the SSD capacity is decreasing. When have to replace it? > Regards > Brogyi > > > > > ___ > OpenIndiana-discuss mailing list > OpenIndiana-discuss@openindiana.org > http://openindiana.org/mailman/listinfo/openindiana-discuss > ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
2014.02.09. 22:19 keltezéssel, Jim Klimov írta: 2*120Gb Samsung Pro SSDs (with powerloss protection, formatted to use 100Gb for mirrored rpool/mirrored zil/striped l2arc since their 100Gb sub-model has much higher reliability and speed - but is not on sale here). Jim Only one question about the SSD usage. How do I know the SSD status? You know the SSD capacity is decreasing. When have to replace it? Regards Brogyi ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
Seagate or Samsung SSDs? On 2014-02-09 22:19, Jim Klimov wrote: Sorry about the unclarities, I was away from both access to that machine and our shopping spec :) Ultimately, what my brother shopped for was: ... * OS/cache SSDs - 2*Seagate Enterprise SSD 120Gb ST120FN0021 But earlier you had said 5. 2*120Gb Samsung Pro SSDs (with powerloss protection, formatted to use 100Gb for mirrored rpool/mirrored zil/striped l2arc since their 100Gb sub-model has much higher reliability and speed - but is not on sale here). I'd say that the L2ARC on this box could use more volume, it (~2*60Gb) fills up pretty quickly and does not place a big toll on RAM yet. Disk IO performance is pretty decent for a home gigabit LAN, processing not so much (i.e. for compilation), although still quite usable The above is a wee bit unclear! Please clarify. HTH, //Jim Klimov ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
On 2014-02-09 22:35, Alex Smith (K4RNT) wrote: I don't know if it affects your setup, but I thought the 9211 was 6Gbps SAS only, and 3Gbps SATA. Are your disks SAS? I'm not familiar with any drives that WD makes being SAS, but maybe it was just the environment I was in didn't use them. Well, WD nowadays makes a lot of drives. HGST (formerly Hitachi Global Storage Technologies) is a wholly owned subsidiary of Western Digital for the past year or two, as I learned while shopping for this box ;) As for the controller speeds... I did not see such information about the speed limits, so I can take your words "as is". Anyhow, this is the setup which works with no hiccups and I am content with it. Much better than that older attempt, which was a decent PC and I've spent years with it (working, coding, playing, etc.) - but happened to be a disgrace of a server, which managed to keep losing data even with ZFS underneath. Although, trying to unravel those mysteries is what got me onto the illumos/OI/zfs lists, and did provide lots of learning experience about how things are made "under the hood". Not all is bad :) Thanks, //Jim ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
I don't know if it affects your setup, but I thought the 9211 was 6Gbps SAS
only, and 3Gbps SATA. Are your disks SAS? I'm not familiar with any drives
that WD makes being SAS, but maybe it was just the environment I was in
didn't use them.
" ' With the first link, the chain is forged. The first speech censured,
the first thought forbidden, the first freedom denied, chains us all
irrevocably.' Those words were uttered by Judge Aaron Satie as wisdom and
warning... The first time any man's freedom is trodden on we’re all
damaged." - Jean-Luc Picard, quoting Judge Aaron Satie, Star Trek: TNG
episode "The Drumhead"
- Alex Smith
- Dulles Technology Corridor (Chantilly/Ashburn/Dulles), Virginia USA
On Sun, Feb 9, 2014 at 4:19 PM, Jim Klimov wrote:
> Sorry about the unclarities, I was away from both access to that machine
> and our shopping spec :)
>
> Ultimately, what my brother shopped for was:
> * Chassis - minimal N54L with 2Gb RAM and 250Gb HDD which went elsewhere
> * RAM - 2 * Kingston / KVR1333D3E9S/8G
> 2*8Gb ECC (9*1024Mbyte = 72*1Gbit) DDR3 PC3-10600E-9 NOT_REGISTERED
> (UNBUFFERED)
> * data pool HDDs - 4*4Tb
> initially a set of Hitachi Deskstar 7K4000: H3IK40003272SE but they
> happened to be a bad batch (2 did not even start, one was very slow,
> just one seemed okay); replaced with
> a set of WD Red 4Tb ("" in format)
> * OS/cache SSDs - 2*Seagate Enterprise SSD 120Gb ST120FN0021
> * a 4*2.5" disk rack to fit into the 5.25" ODD slot
> (Thermaltake ST0046Z Max5 Quad)
> * the controller is apparently an original LSI 9211-8i
> when picking your parts, make sure that the card is small
> (half-length/half-height), we first tried a cheaper equivalent
> which did not fit into the cramped little box
> * an additional 1*SFF8087-4*SATA cable (overall two cables, one provided
> with the server, none provided with this controller purchase (not a
> "kit" bundle)); make sure cables are not too long nor too short
> * an USB flash drive for the OS image for installation :)
>
> apparently, that was it
>
>
> On 2014-02-09 11:48, Hans J. Albertsson wrote:
>
>> 2. does not use stock SATA ports at all,
>>>
>> Why? Are these SATA ports bad or substandard or what? Are you not even
>> using them for booting?
>>
>
> On one hand, the Mobo SATA controller is 3Gbps and the LSI card has
> 8*6Gbps ports; on another - this was the configuration that my brother
> tried first, it worked, and we avoided changes "from good to best".
> Ain't broke - don't fix, and all that :)
>
> One of the SFF8087 connectors goes to the main 4-disk bay, another
> goes to the add-on 4*2.5" bay in the ODD slot. There is not really
> much space to use more cabling than necessary.
>
> Besides, the controller is deemed to be a more "intellectual" piece
> of hardware and I can poke it with lsiutil, etc., unlike the Mobo ports.
>
>
> 4. 4*4TB disks for the data pool (raidz1, though I'd rather have more
>>> disks and a
>>> higher redundancy) and
>>>
>> What disk type?
>> With 8 ports on the LSI controller, I suppose you could add an external
>> ICY Box for 4 more disks? If you boot from the on-bord SATA ports.
>>
>
> This particular controller is 8i - 8 internal ports (over two 4-port
> connectors, not 8 SATA/SAS connectors). I guess it would make more
> sense for redundancy to use the Mobo eSATA port for external disks
> (spread the load over two controllers, especially if using mirroring).
>
>
>
>>
>> 5. 2*120Gb Samsung Pro SSDs (with powerloss
>>> protection, formatted to use 100Gb for mirrored rpool/mirrored
>>> zil/striped l2arc since their 100Gb sub-model has much higher
>>> reliability and speed - but is not on sale here). I'd say that the
>>> L2ARC on this box could use more volume, it (~2*60Gb) fills up
>>> pretty quickly and does not place a big toll on RAM yet. Disk IO
>>> performance is pretty decent for a home gigabit LAN, processing
>>> not so much (i.e. for compilation), although still quite usable :)
>>>
>>> The above is a wee bit unclear! Please clarify.
>>
>
>
> The disks are partitioned as follows:
>
> root@n54l:~# parted /dev/dsk/c3t5000C5002FF029D5d0p0 pri
> Model: Generic Ide (ide)
> Disk /dev/dsk/c3t5000C5002FF029D5d0p0: 120GB
> Sector size (logical/physical): 512B/512B
> Partition Table: msdos
>
> Number Start End SizeType File system Flags
> 1 8354kB 33.7GB 33.7GB primary solaris boot
> 2 33.7GB 39.2GB 5417MB primary
> 3 39.2GB 100GB 61.1GB primary
>
>
> This uses up 100Gb of the 120Gb available, in the hopes that the
> drive would perform similar to the stock 100Gb model with much
> better characteristics.
>
> These partitions are used for rpool, and for data pool's zil and
> l2arc, respectively:
>
> root@n54l:~# zpool status -v
> pool: pool
> state: ONLINE
> scan: scrub repaired 0 in 13h11m with 0 errors on Mon Jan 27 13:16:43
> 2014
> config:
>
> NAME STATE READ WRITE CKSUM
> pool
Re: [OpenIndiana-discuss] Low low end server
Sorry about the unclarities, I was away from both access to that machine
and our shopping spec :)
Ultimately, what my brother shopped for was:
* Chassis - minimal N54L with 2Gb RAM and 250Gb HDD which went elsewhere
* RAM - 2 * Kingston / KVR1333D3E9S/8G
2*8Gb ECC (9*1024Mbyte = 72*1Gbit) DDR3 PC3-10600E-9 NOT_REGISTERED
(UNBUFFERED)
* data pool HDDs - 4*4Tb
initially a set of Hitachi Deskstar 7K4000: H3IK40003272SE but they
happened to be a bad batch (2 did not even start, one was very slow,
just one seemed okay); replaced with
a set of WD Red 4Tb ("" in format)
* OS/cache SSDs - 2*Seagate Enterprise SSD 120Gb ST120FN0021
* a 4*2.5" disk rack to fit into the 5.25" ODD slot
(Thermaltake ST0046Z Max5 Quad)
* the controller is apparently an original LSI 9211-8i
when picking your parts, make sure that the card is small
(half-length/half-height), we first tried a cheaper equivalent
which did not fit into the cramped little box
* an additional 1*SFF8087-4*SATA cable (overall two cables, one provided
with the server, none provided with this controller purchase (not a
"kit" bundle)); make sure cables are not too long nor too short
* an USB flash drive for the OS image for installation :)
apparently, that was it
On 2014-02-09 11:48, Hans J. Albertsson wrote:
2. does not use stock SATA ports at all,
Why? Are these SATA ports bad or substandard or what? Are you not even
using them for booting?
On one hand, the Mobo SATA controller is 3Gbps and the LSI card has
8*6Gbps ports; on another - this was the configuration that my brother
tried first, it worked, and we avoided changes "from good to best".
Ain't broke - don't fix, and all that :)
One of the SFF8087 connectors goes to the main 4-disk bay, another
goes to the add-on 4*2.5" bay in the ODD slot. There is not really
much space to use more cabling than necessary.
Besides, the controller is deemed to be a more "intellectual" piece
of hardware and I can poke it with lsiutil, etc., unlike the Mobo ports.
4. 4*4TB disks for the data pool (raidz1, though I'd rather have more
disks and a
higher redundancy) and
What disk type?
With 8 ports on the LSI controller, I suppose you could add an external
ICY Box for 4 more disks? If you boot from the on-bord SATA ports.
This particular controller is 8i - 8 internal ports (over two 4-port
connectors, not 8 SATA/SAS connectors). I guess it would make more
sense for redundancy to use the Mobo eSATA port for external disks
(spread the load over two controllers, especially if using mirroring).
5. 2*120Gb Samsung Pro SSDs (with powerloss
protection, formatted to use 100Gb for mirrored rpool/mirrored
zil/striped l2arc since their 100Gb sub-model has much higher
reliability and speed - but is not on sale here). I'd say that the
L2ARC on this box could use more volume, it (~2*60Gb) fills up
pretty quickly and does not place a big toll on RAM yet. Disk IO
performance is pretty decent for a home gigabit LAN, processing
not so much (i.e. for compilation), although still quite usable :)
The above is a wee bit unclear! Please clarify.
The disks are partitioned as follows:
root@n54l:~# parted /dev/dsk/c3t5000C5002FF029D5d0p0 pri
Model: Generic Ide (ide)
Disk /dev/dsk/c3t5000C5002FF029D5d0p0: 120GB
Sector size (logical/physical): 512B/512B
Partition Table: msdos
Number Start End SizeType File system Flags
1 8354kB 33.7GB 33.7GB primary solaris boot
2 33.7GB 39.2GB 5417MB primary
3 39.2GB 100GB 61.1GB primary
This uses up 100Gb of the 120Gb available, in the hopes that the
drive would perform similar to the stock 100Gb model with much
better characteristics.
These partitions are used for rpool, and for data pool's zil and
l2arc, respectively:
root@n54l:~# zpool status -v
pool: pool
state: ONLINE
scan: scrub repaired 0 in 13h11m with 0 errors on Mon Jan 27 13:16:43
2014
config:
NAME STATE READ WRITE CKSUM
pool ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
c3t50014EE2B3C27E80d0ONLINE 0 0 0
c3t50014EE2B3C2749Bd0ONLINE 0 0 0
c3t50014EE25E6CE061d0ONLINE 0 0 0
c3t50014EE20917A8B4d0ONLINE 0 0 0
logs
mirror-1 ONLINE 0 0 0
c3t5000C5002FF029D5d0p2 ONLINE 0 0 0
c3t5000C5002FF02451d0p2 ONLINE 0 0 0
cache
c3t5000C5002FF029D5d0p3ONLINE 0 0 0
c3t5000C5002FF02451d0p3ONLINE 0 0 0
errors: No known data errors
pool: rpool
state: ONLINE
scan: scrub repaired 0 in 0h1m with 0 errors on Mon Jan 27 13:19:07 2014
config:
NAME STATE READ WRITE CKSUM
rpoolONLINE 0 0 0
m
Re: [OpenIndiana-discuss] Low low end server
Hi József! > I'd like to give you some suggestions. Thank you! > First the "zpool list -v" is > useless code if you want to know the free space. I know. I wanted to show the structure of the pools and the layout of the vdevs. > Another useless > thing is when you sliced your SSD and put on rpool,cache,log. I disagree. See below. > If > you want to increase your performance use standalone SSD for log and > another for cache. But there is no extra SATA connector, so I can only use one SSD. > My experience is about rpool not sensitive for > the drive speed. This is not always true. Obviously, it depends on the I/O operations you have on the disks. Note that the cache is not only for rpool... > I use a very slow disk for rpool and I've not > notice any server performance decrease. But I have to say the > booting time is slow and when I want to login that is not very > comfortable. Yes, that is why I use an SSD. Boot time is nice and short, and the system feels quick when I log in and run things on the command line. > These was a beginner experiences. We were all beginners at some time. :-) Best regards -- Volker -- Volker A. Brandt Consulting and Support for Oracle Solaris Brandt & Brandt Computer GmbH WWW: http://www.bb-c.de/ Am Wiesenpfad 6, 53340 Meckenheim, GERMANYEmail: v...@bb-c.de Handelsregister: Amtsgericht Bonn, HRB 10513 Schuhgröße: 46 Geschäftsführer: Rainer J.H. Brandt und Volker A. Brandt "When logic and proportion have fallen sloppy dead" ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
On 9/02/2014 2:37 PM, Brogyányi József wrote: Volker I'd like to give you some suggestions. First the "zpool list -v" is useless code if you want to know the free space. You try this:zfs list. You can see the real space on your server. I assume your experience is with raidz configurations, where a raidz1 made of 4 x 3Tbyte disks would show around 10.9Tb. I don't know the reason for this, but it is well known that the |zpool| command counts the disks that are being used for redundancy as space, while the |zfs| command does not. However, mirrored configurations report the usable size correctly, so 5.44Tb is the correct size here. Another useless thing is when you sliced your SSD and put on rpool,cache,log. If you want to increase your performance use standalone SSD for log and another for cache. What is your reasoning for this? If the rpool is not being accessed very often, why not share the disk's resource? - SSDs are excellent for random I/O. I have the same setup as this on several machines, and the performance is fine. I also need to do it because I don't have spare slots. My experience is about rpool not sensitive for the drive speed. I use a very slow disk for rpool and I've not notice any server performance decrease. But I have to say the booting time is slow and when I want to login that is not very comfortable. This slow things not effect any running service and copy speed from RAID. These was a beginner experiences. Have nice day. Regards Brogyi 2014.02.07. 18:20 keltezéssel, Volker A. Brandt írta: I looked at a HP N54L today: Costs nothing, but actually handles ECC memory. Albeit very slow memory, and not very much. So, would it be reasonable to set this guy up with 4 2TB SATA disks, 8GB 800MHz ECC memory and run some Illumos based version with ZFS. Yes. Note that you could also put in 2x 8GB = 16 GB. I am not really sure what you mean by "very slow". I use Kingston PC3-10600 CL9 ECC 8 GB DIMMs. I was thinking of putting two 2.5" small boot disks (300GB???) using some adapter in the optical drive slot, and 4 2TB disks in a raidz to provide 6TB of storage with medium availability performance. Do you really need the mirrored boot? Would this work?? Yes, altough you would have to find a sixth SATA connector for the second small boot disk, or you would have to loop the eSATA port back inside the case. Would the performance be good enough to be a home cloud server for media and/or documents? Yes. Is Nexenta or OmniOS or SMARTOS better or easier to deply than OpenIndiana for this setup? I am using OmniOS, with a 128 GB Samsung SSD as boot and cache, and four 3TB disks in the four slots: cat /etc/release OmniOS v11 r151006 Copyright 2012-2013 OmniTI Computer Consulting, Inc. All rights reserved. Use is subject to license terms. zpool list -v NAME SIZE ALLOC FREE EXPANDSZCAP DEDUP HEALTH ALTROOT dpool 5.44T 2.67T 2.77T -49% 1.00x ONLINE - mirror2.72T 1.33T 1.39T - c1t0d0 - - - - c1t2d0 - - - - mirror2.72T 1.33T 1.39T - c1t1d0 - - - - c1t3d0 - - - - cache - - - - - - c1t5d0s6 87.1G 3.36M 87.1G - rpool 32G 8.87G 23.1G -27% 1.00x ONLINE - c1t5d0s032G 8.87G 23.1G - Easy to deploy (except the "slice the SSD up into rpool and cache" bit). Works very well. Regards -- Volker ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
Volker I'd like to give you some suggestions. First the "zpool list -v" is useless code if you want to know the free space. You try this:zfs list. You can see the real space on your server. Another useless thing is when you sliced your SSD and put on rpool,cache,log. If you want to increase your performance use standalone SSD for log and another for cache. My experience is about rpool not sensitive for the drive speed. I use a very slow disk for rpool and I've not notice any server performance decrease. But I have to say the booting time is slow and when I want to login that is not very comfortable. This slow things not effect any running service and copy speed from RAID. These was a beginner experiences. Have nice day. Regards Brogyi 2014.02.07. 18:20 keltezéssel, Volker A. Brandt írta: I looked at a HP N54L today: Costs nothing, but actually handles ECC memory. Albeit very slow memory, and not very much. So, would it be reasonable to set this guy up with 4 2TB SATA disks, 8GB 800MHz ECC memory and run some Illumos based version with ZFS. Yes. Note that you could also put in 2x 8GB = 16 GB. I am not really sure what you mean by "very slow". I use Kingston PC3-10600 CL9 ECC 8 GB DIMMs. I was thinking of putting two 2.5" small boot disks (300GB???) using some adapter in the optical drive slot, and 4 2TB disks in a raidz to provide 6TB of storage with medium availability performance. Do you really need the mirrored boot? Would this work?? Yes, altough you would have to find a sixth SATA connector for the second small boot disk, or you would have to loop the eSATA port back inside the case. Would the performance be good enough to be a home cloud server for media and/or documents? Yes. Is Nexenta or OmniOS or SMARTOS better or easier to deply than OpenIndiana for this setup? I am using OmniOS, with a 128 GB Samsung SSD as boot and cache, and four 3TB disks in the four slots: cat /etc/release OmniOS v11 r151006 Copyright 2012-2013 OmniTI Computer Consulting, Inc. All rights reserved. Use is subject to license terms. zpool list -v NAME SIZE ALLOC FREE EXPANDSZCAP DEDUP HEALTH ALTROOT dpool 5.44T 2.67T 2.77T -49% 1.00x ONLINE - mirror2.72T 1.33T 1.39T - c1t0d0 - - - - c1t2d0 - - - - mirror2.72T 1.33T 1.39T - c1t1d0 - - - - c1t3d0 - - - - cache - - - - - - c1t5d0s6 87.1G 3.36M 87.1G - rpool 32G 8.87G 23.1G -27% 1.00x ONLINE - c1t5d0s032G 8.87G 23.1G - Easy to deploy (except the "slice the SSD up into rpool and cache" bit). Works very well. Regards -- Volker ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
Jim, On 2014-02-08 20:02, Jim Klimov wrote: 1.The latter (N54L) has an 8-port LSI controller, uses stock BIOS and What model controller is that? 2. does not use stock SATA ports at all, Why? Are these SATA ports bad or substandard or what? Are you not even using them for booting? 3. has 2*8GB Kingston RAM and KVR1333D3E9SK2/16G ??? 4. 4*4TB disks for the data pool (raidz1, though I'd rather have more disks and a higher redundancy) and What disk type? With 8 ports on the LSI controller, I suppose you could add an external ICY Box for 4 more disks? If you boot from the on-bord SATA ports. 5. 2*120Gb Samsung Pro SSDs (with powerloss protection, formatted to use 100Gb for mirrored rpool/mirrored zil/striped l2arc since their 100Gb sub-model has much higher reliability and speed - but is not on sale here). I'd say that the L2ARC on this box could use more volume, it (~2*60Gb) fills up pretty quickly and does not place a big toll on RAM yet. Disk IO performance is pretty decent for a home gigabit LAN, processing not so much (i.e. for compilation), although still quite usable :) The above is a wee bit unclear! Please clarify. //Jim ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
On 2014-02-07 20:54, Robbie Crash wrote: For a home job, is there really any reason to use ECC RAM? Like, real world I mean. Not "Realistically all servers should use ECC RAM to protect the sanctity of the harmonious existence of all data from interloping cosmic radiation" or whatever, but real world justification? On my older home NAS made from a PC, there were strange data losses with ZFS which might be linked to non-ECC RAM, or perhaps heat problems (though never measured to be extreme overheats), or electric noise on cables or contacts... since this is an el-cheapo rig, its components are not expected to be very reliable on one hand (in hardware and in protocols), and can't be really poked to say they failed - on another. After all, most of the pee-cee user woes about Windows instability for example are not so much about poor programming in Microsoft, but about using hardware where all pricey corners were cut, and then some more ;) One way or another, ZFS kept finding broken blocks (unrecoverable with RAIDZ2 over 6 disks), and still does. The box is now in the process of evacuating data to an N54L and will be repurposed somehow. The latter has an 8-port LSI controller, uses stock BIOS and does not use stock SATA ports at all, has 2*8GB Kingston RAM and 4*4TB disks for the data pool (raidz1, though I'd rather have more disks and a higher redundancy) and 2*120Gb Samsung Pro SSDs (with powerloss protection, formatted to use 100Gb for mirrored rpool/mirrored zil/striped l2arc since their 100Gb sub-model has much higher reliability and speed - but is not on sale here). I'd say that the L2ARC on this box could use more volume, it (~2*60Gb) fills up pretty quickly and does not place a big toll on RAM yet. Disk IO performance is pretty decent for a home gigabit LAN, processing not so much (i.e. for compilation), although still quite usable :) //Jim ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
On Fri, Feb 7, 2014 at 3:00 PM, Saso Kiselkov wrote: > > On 2/7/14, 7:54 PM, Robbie Crash wrote: > > For a home job, is there really any reason to use ECC RAM? > > It only costs a little extra and provides peace of mind. Apparently so! The last time I was looking at buying a significant amount of ECC vs non-ECC RAM the price difference was far more significant. Now it looks like $200 vs $230 for an 8GB stick. > > > > I'm running an i3 21020T, 32GB of normal non-ECC RAM, 4WD Green 2TBs and 4 > > WD Black 1TBs each in RAIDZ, with a pool that I've filled and emptied twice > > in the last few years, and aside from when a hdd froze last winter I've had > > zero reported errors in my data and the only performance bottleneck is my > > network speed. > > You're misunderstanding the purpose of ECC here. If you *do* have a > random bit flip in DRAM, ZFS won't detect it, because the corrupted file > block will have been written to stable storage and checksummed as > "correct". ZFS *can't* protect you here. Indeed I was. > > > -- > Saso > > ___ > OpenIndiana-discuss mailing list > OpenIndiana-discuss@openindiana.org > http://openindiana.org/mailman/listinfo/openindiana-discuss -- Seconds to the drop, but it seems like hours. http://www.openmedia.ca https://robbiecrash.me ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
For me my data at home are as valuable like my data at work and undetected RAM problems are the most probable way to loose or change data without a warning from ZFS. But ZFS without ECC can detect much more problems without ECC than filesystems without integrated checksums but with ECC. Main argument for ECC is the minimal premium. Why do you want to avoid ECC? Am 07.02.2014 um 20:54 schrieb Robbie Crash: > For a home job, is there really any reason to use ECC RAM? > > Like, real world I mean. Not "Realistically all servers should use ECC RAM > to protect the sanctity of the harmonious existence of all data from > interloping cosmic radiation" or whatever, but real world justification? > > With ZFS checksumming, isn't the likelihood of data corruption due to > flipped RAM bits small enough to offset the cost difference for /home/ use? > ZFS was built to handle RAM errors, wasn't it? > > I'm running an i3 21020T, 32GB of normal non-ECC RAM, 4WD Green 2TBs and 4 > WD Black 1TBs each in RAIDZ, with a pool that I've filled and emptied twice > in the last few years, and aside from when a hdd froze last winter I've had > zero reported errors in my data and the only performance bottleneck is my > network speed. > > > On Fri, Feb 7, 2014 at 1:19 PM, Johan Hertz wrote: > >> Hi, >> >> I just setup a Dell PowerEdge T20 using Smart OS and it works just fine. >> It start at 2199kr (not including VAT) so it is a cheap server too. I went >> for the Xeon E3 processor which is a bit more expensive but you might be ok >> with the cheaper options. >> >> Here's the link >> http://www.dell.com/se/foretag/p/poweredge-t20/pd?~ck=anav >> >> Regards >> Johan >> >> >> On 2014-02-07 18:55, Reginald Beardsley wrote: >> >>> I have an N40L configured w/ 4 x 2 TB disks and 8 GB of ECC DRAM. The >>> disks have two partitions each. A small one for a 4 way mirrored root >>> pool and a large one for data using double parity RAIDZ. It's a bit of >>> extra work to configure, but works very nicely giving 100+ MB/s disk I/O. >>> (179 MB/s 4 disk RAIDZ1, 109 MB/s RAIDZ2). An N54L should do better. >>> >>> The trick is to install OI to a small partition on a single disk. Then >>> partition the other disks, mirror the root pool, detach the first disk, >>> repartition it and add it to the mirror. Then form the RAIDZ on the rest >>> of the disk. Technically it's not bootable RAIDZ, but it's close enough >>> for me. >>> >>> Have Fun! >>> Reg >>> >>> >>> On Fri, 2/7/14, Hans J. Albertsson >>> wrote: >>> >>> Subject: [OpenIndiana-discuss] Low low end server >>> To: "Discussion list for OpenIndiana" >> openindiana.org> >>> Date: Friday, February 7, 2014, 10:50 AM >>>I looked at a HP N54L today: Costs >>> nothing, but actually handles ECC memory. Albeit very slow >>> memory, and not very much. >>>So, would it be reasonable to set this guy up with 4 2TB >>> SATA disks, 8GB 800MHz ECC memory and run some Illumos based >>> version with ZFS. >>>I was thinking of putting two 2.5" small boot disks >>> (300GB???) using some adapter in the optical drive slot, and >>> 4 2TB disks in a raidz to provide 6TB of storage with medium >>> availability performance. >>>Would this work?? Would the performance be good enough to be >>> a home cloud server for media and/or documents? >>>Is Nexenta or OmniOS or SMARTOS better or easier to deply >>> than OpenIndiana for this setup? >>> ___ >>> OpenIndiana-discuss mailing list >>> OpenIndiana-discuss@openindiana.org >>> http://openindiana.org/mailman/listinfo/openindiana-discuss >>> >>> ___ >>> OpenIndiana-discuss mailing list >>> OpenIndiana-discuss@openindiana.org >>> http://openindiana.org/mailman/listinfo/openindiana-discuss >>> >> >> >> ___ >> OpenIndiana-discuss mailing list >> OpenIndiana-discuss@openindiana.org >> http://openindiana.org/mailman/listinfo/openindiana-discuss >> > > > > -- > Seconds to the drop, but it seems like hours. > > http://www.openmedia.ca > https://robbiecrash.me > ___ > OpenIndiana-discuss mailing list > OpenIndiana-discuss@openindiana.org > http://openindiana.org/mailman/listinfo/openindiana-discuss -- ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
On Fri, 7 Feb 2014, Robbie Crash wrote: With ZFS checksumming, isn't the likelihood of data corruption due to flipped RAM bits small enough to offset the cost difference for /home/ use? ZFS was built to handle RAM errors, wasn't it? No, it is not built to handle RAM errors. Once the data has been decoded, checked, and put in the zfs ARC (huge memory cache) then the data can be corrupted in RAM and nothing is likely to notice. Likewise, data which is written may be corrupted if it is corrupted before the zfs checksums are computed. Bob -- Bob Friesenhahn bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
On 2/7/14, 7:54 PM, Robbie Crash wrote: > For a home job, is there really any reason to use ECC RAM? It only costs a little extra and provides peace of mind. > I'm running an i3 21020T, 32GB of normal non-ECC RAM, 4WD Green 2TBs and 4 > WD Black 1TBs each in RAIDZ, with a pool that I've filled and emptied twice > in the last few years, and aside from when a hdd froze last winter I've had > zero reported errors in my data and the only performance bottleneck is my > network speed. You're misunderstanding the purpose of ECC here. If you *do* have a random bit flip in DRAM, ZFS won't detect it, because the corrupted file block will have been written to stable storage and checksummed as "correct". ZFS *can't* protect you here. -- Saso ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
For a home job, is there really any reason to use ECC RAM? Like, real world I mean. Not "Realistically all servers should use ECC RAM to protect the sanctity of the harmonious existence of all data from interloping cosmic radiation" or whatever, but real world justification? With ZFS checksumming, isn't the likelihood of data corruption due to flipped RAM bits small enough to offset the cost difference for /home/ use? ZFS was built to handle RAM errors, wasn't it? I'm running an i3 21020T, 32GB of normal non-ECC RAM, 4WD Green 2TBs and 4 WD Black 1TBs each in RAIDZ, with a pool that I've filled and emptied twice in the last few years, and aside from when a hdd froze last winter I've had zero reported errors in my data and the only performance bottleneck is my network speed. On Fri, Feb 7, 2014 at 1:19 PM, Johan Hertz wrote: > Hi, > > I just setup a Dell PowerEdge T20 using Smart OS and it works just fine. > It start at 2199kr (not including VAT) so it is a cheap server too. I went > for the Xeon E3 processor which is a bit more expensive but you might be ok > with the cheaper options. > > Here's the link > http://www.dell.com/se/foretag/p/poweredge-t20/pd?~ck=anav > > Regards > Johan > > > On 2014-02-07 18:55, Reginald Beardsley wrote: > >> I have an N40L configured w/ 4 x 2 TB disks and 8 GB of ECC DRAM. The >> disks have two partitions each. A small one for a 4 way mirrored root >> pool and a large one for data using double parity RAIDZ. It's a bit of >> extra work to configure, but works very nicely giving 100+ MB/s disk I/O. >> (179 MB/s 4 disk RAIDZ1, 109 MB/s RAIDZ2). An N54L should do better. >> >> The trick is to install OI to a small partition on a single disk. Then >> partition the other disks, mirror the root pool, detach the first disk, >> repartition it and add it to the mirror. Then form the RAIDZ on the rest >> of the disk. Technically it's not bootable RAIDZ, but it's close enough >> for me. >> >> Have Fun! >> Reg >> >> >> On Fri, 2/7/14, Hans J. Albertsson >> wrote: >> >> Subject: [OpenIndiana-discuss] Low low end server >> To: "Discussion list for OpenIndiana" > openindiana.org> >> Date: Friday, February 7, 2014, 10:50 AM >> I looked at a HP N54L today: Costs >> nothing, but actually handles ECC memory. Albeit very slow >> memory, and not very much. >> So, would it be reasonable to set this guy up with 4 2TB >> SATA disks, 8GB 800MHz ECC memory and run some Illumos based >> version with ZFS. >> I was thinking of putting two 2.5" small boot disks >> (300GB???) using some adapter in the optical drive slot, and >> 4 2TB disks in a raidz to provide 6TB of storage with medium >> availability performance. >> Would this work?? Would the performance be good enough to be >> a home cloud server for media and/or documents? >> Is Nexenta or OmniOS or SMARTOS better or easier to deply >> than OpenIndiana for this setup? >> ___ >> OpenIndiana-discuss mailing list >> OpenIndiana-discuss@openindiana.org >> http://openindiana.org/mailman/listinfo/openindiana-discuss >> >> ___ >> OpenIndiana-discuss mailing list >> OpenIndiana-discuss@openindiana.org >> http://openindiana.org/mailman/listinfo/openindiana-discuss >> > > > ___ > OpenIndiana-discuss mailing list > OpenIndiana-discuss@openindiana.org > http://openindiana.org/mailman/listinfo/openindiana-discuss > -- Seconds to the drop, but it seems like hours. http://www.openmedia.ca https://robbiecrash.me ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
Hi, I just setup a Dell PowerEdge T20 using Smart OS and it works just fine. It start at 2199kr (not including VAT) so it is a cheap server too. I went for the Xeon E3 processor which is a bit more expensive but you might be ok with the cheaper options. Here's the link http://www.dell.com/se/foretag/p/poweredge-t20/pd?~ck=anav Regards Johan On 2014-02-07 18:55, Reginald Beardsley wrote: I have an N40L configured w/ 4 x 2 TB disks and 8 GB of ECC DRAM. The disks have two partitions each. A small one for a 4 way mirrored root pool and a large one for data using double parity RAIDZ. It's a bit of extra work to configure, but works very nicely giving 100+ MB/s disk I/O. (179 MB/s 4 disk RAIDZ1, 109 MB/s RAIDZ2). An N54L should do better. The trick is to install OI to a small partition on a single disk. Then partition the other disks, mirror the root pool, detach the first disk, repartition it and add it to the mirror. Then form the RAIDZ on the rest of the disk. Technically it's not bootable RAIDZ, but it's close enough for me. Have Fun! Reg On Fri, 2/7/14, Hans J. Albertsson wrote: Subject: [OpenIndiana-discuss] Low low end server To: "Discussion list for OpenIndiana" Date: Friday, February 7, 2014, 10:50 AM I looked at a HP N54L today: Costs nothing, but actually handles ECC memory. Albeit very slow memory, and not very much. So, would it be reasonable to set this guy up with 4 2TB SATA disks, 8GB 800MHz ECC memory and run some Illumos based version with ZFS. I was thinking of putting two 2.5" small boot disks (300GB???) using some adapter in the optical drive slot, and 4 2TB disks in a raidz to provide 6TB of storage with medium availability performance. Would this work?? Would the performance be good enough to be a home cloud server for media and/or documents? Is Nexenta or OmniOS or SMARTOS better or easier to deply than OpenIndiana for this setup? ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
I have an N40L configured w/ 4 x 2 TB disks and 8 GB of ECC DRAM. The disks have two partitions each. A small one for a 4 way mirrored root pool and a large one for data using double parity RAIDZ. It's a bit of extra work to configure, but works very nicely giving 100+ MB/s disk I/O. (179 MB/s 4 disk RAIDZ1, 109 MB/s RAIDZ2). An N54L should do better. The trick is to install OI to a small partition on a single disk. Then partition the other disks, mirror the root pool, detach the first disk, repartition it and add it to the mirror. Then form the RAIDZ on the rest of the disk. Technically it's not bootable RAIDZ, but it's close enough for me. Have Fun! Reg On Fri, 2/7/14, Hans J. Albertsson wrote: Subject: [OpenIndiana-discuss] Low low end server To: "Discussion list for OpenIndiana" Date: Friday, February 7, 2014, 10:50 AM I looked at a HP N54L today: Costs nothing, but actually handles ECC memory. Albeit very slow memory, and not very much. So, would it be reasonable to set this guy up with 4 2TB SATA disks, 8GB 800MHz ECC memory and run some Illumos based version with ZFS. I was thinking of putting two 2.5" small boot disks (300GB???) using some adapter in the optical drive slot, and 4 2TB disks in a raidz to provide 6TB of storage with medium availability performance. Would this work?? Would the performance be good enough to be a home cloud server for media and/or documents? Is Nexenta or OmniOS or SMARTOS better or easier to deply than OpenIndiana for this setup? ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
I have an N40l that I built up to 16 gb ecc memory, 4 3tb red wd drives, and a 4 2.5 bay in the CD slot with an Adaptec card for the other four drives. I am using two ssd drives for is and have two bays open (2.5). It works very well with Linux. It runs OI very well too other than I have not got around to working around the outdated Adaptec driver preventing the 2.5 drives from working under ok (and booting). Total price was about 1500 for everything. Sent from my HTC One on the Verizon Wireless 4G LTE network - Reply message - From: "Hans J. Albertsson" To: "Discussion list for OpenIndiana" Subject: [OpenIndiana-discuss] Low low end server Date: Fri, Feb 7, 2014 9:50 AM I looked at a HP N54L today: Costs nothing, but actually handles ECC memory. Albeit very slow memory, and not very much. So, would it be reasonable to set this guy up with 4 2TB SATA disks, 8GB 800MHz ECC memory and run some Illumos based version with ZFS. I was thinking of putting two 2.5" small boot disks (300GB???) using some adapter in the optical drive slot, and 4 2TB disks in a raidz to provide 6TB of storage with medium availability performance. Would this work?? Would the performance be good enough to be a home cloud server for media and/or documents? Is Nexenta or OmniOS or SMARTOS better or easier to deply than OpenIndiana for this setup? ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Low low end server
> I looked at a HP N54L today: Costs nothing, but actually handles ECC > memory. Albeit very slow memory, and not very much. > > So, would it be reasonable to set this guy up with 4 2TB SATA disks, > 8GB 800MHz ECC memory and run some Illumos based version with ZFS. Yes. Note that you could also put in 2x 8GB = 16 GB. I am not really sure what you mean by "very slow". I use Kingston PC3-10600 CL9 ECC 8 GB DIMMs. > I was thinking of putting two 2.5" small boot disks (300GB???) using > some adapter in the optical drive slot, and 4 2TB disks in a raidz > to provide 6TB of storage with medium availability performance. Do you really need the mirrored boot? > Would this work?? Yes, altough you would have to find a sixth SATA connector for the second small boot disk, or you would have to loop the eSATA port back inside the case. > Would the performance be good enough to be a home > cloud server for media and/or documents? Yes. > Is Nexenta or OmniOS or SMARTOS better or easier to deply than > OpenIndiana for this setup? I am using OmniOS, with a 128 GB Samsung SSD as boot and cache, and four 3TB disks in the four slots: cat /etc/release OmniOS v11 r151006 Copyright 2012-2013 OmniTI Computer Consulting, Inc. All rights reserved. Use is subject to license terms. zpool list -v NAME SIZE ALLOC FREE EXPANDSZCAP DEDUP HEALTH ALTROOT dpool 5.44T 2.67T 2.77T -49% 1.00x ONLINE - mirror2.72T 1.33T 1.39T - c1t0d0 - - - - c1t2d0 - - - - mirror2.72T 1.33T 1.39T - c1t1d0 - - - - c1t3d0 - - - - cache - - - - - - c1t5d0s6 87.1G 3.36M 87.1G - rpool 32G 8.87G 23.1G -27% 1.00x ONLINE - c1t5d0s032G 8.87G 23.1G - Easy to deploy (except the "slice the SSD up into rpool and cache" bit). Works very well. Regards -- Volker -- Volker A. Brandt Consulting and Support for Oracle Solaris Brandt & Brandt Computer GmbH WWW: http://www.bb-c.de/ Am Wiesenpfad 6, 53340 Meckenheim, GERMANYEmail: v...@bb-c.de Handelsregister: Amtsgericht Bonn, HRB 10513 Schuhgröße: 46 Geschäftsführer: Rainer J.H. Brandt und Volker A. Brandt "When logic and proportion have fallen sloppy dead" ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] Low low end server
I looked at a HP N54L today: Costs nothing, but actually handles ECC memory. Albeit very slow memory, and not very much. So, would it be reasonable to set this guy up with 4 2TB SATA disks, 8GB 800MHz ECC memory and run some Illumos based version with ZFS. I was thinking of putting two 2.5" small boot disks (300GB???) using some adapter in the optical drive slot, and 4 2TB disks in a raidz to provide 6TB of storage with medium availability performance. Would this work?? Would the performance be good enough to be a home cloud server for media and/or documents? Is Nexenta or OmniOS or SMARTOS better or easier to deply than OpenIndiana for this setup? ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
