Re: OSD nodes with =8 spinners, SSD-backed journals, and their performance impact

2013-01-19 Thread Simon Leinen
Gandalf Corvotempesta writes: 2013/1/18 Simon Leinen simon.lei...@switch.ch: FWIW, we have a few Quanta S210-X22RQ[1], which are very similar - 2U, 12 3.5 bays in front, 2*2.5 in back. We'll try a similar configuration to what you propose, though with only 8 spinning disks (3TB WD RED) and

Re: OSD nodes with =8 spinners, SSD-backed journals, and their performance impact

2013-01-15 Thread Mark Nelson
On 01/15/2013 03:31 AM, Gandalf Corvotempesta wrote: 2013/1/14 Mark Nelson mark.nel...@inktank.com: The advice that I usually give people is that if performance is a big concern, try to match filestore disk and journal performance is nearly matched. In my test setup, I use 1 intel 520 SSD to

Re: OSD nodes with =8 spinners, SSD-backed journals, and their performance impact

2013-01-15 Thread Mark Nelson
On 01/15/2013 03:24 PM, Gandalf Corvotempesta wrote: 2013/1/15 Mark Nelson mark.nel...@inktank.com: I think the 12 bay supermicro 2U A chassis with 12 spinning disks, 10GbE, and two controllers is potentially a really nice balanced combination. Which chassis are your referring to ? I don't

OSD nodes with =8 spinners, SSD-backed journals, and their performance impact

2013-01-14 Thread Florian Haas
Hi everyone, we ran into an interesting performance issue on Friday that we were able to troubleshoot with some help from Greg and Sam (thanks guys), and in the process realized that there's little guidance around for how to optimize performance in OSD nodes with lots of spinning disks (and

Re: OSD nodes with =8 spinners, SSD-backed journals, and their performance impact

2013-01-14 Thread Florian Haas
Hi Tom, On Mon, Jan 14, 2013 at 2:28 PM, Tom Lanyon t...@netspot.com.au wrote: On 14/01/2013, at 10:47 PM, Florian Haas flor...@hastexo.com wrote: snip http://www.hastexo.com/resources/hints-and-kinks/solid-state-drives-and-ceph-osd-journals It's probably easiest to comment directly on that

Re: OSD nodes with =8 spinners, SSD-backed journals, and their performance impact

2013-01-14 Thread Mark Nelson
On 01/14/2013 06:17 AM, Florian Haas wrote: Hi everyone, we ran into an interesting performance issue on Friday that we were able to troubleshoot with some help from Greg and Sam (thanks guys), and in the process realized that there's little guidance around for how to optimize performance in

Re: OSD nodes with =8 spinners, SSD-backed journals, and their performance impact

2013-01-14 Thread Tom Lanyon
On 14/01/2013, at 10:47 PM, Florian Haas flor...@hastexo.com wrote: snip http://www.hastexo.com/resources/hints-and-kinks/solid-state-drives-and-ceph-osd-journals It's probably easiest to comment directly on that page, but if you prefer instead to just respond in this thread, that's perfectly

Re: OSD nodes with =8 spinners, SSD-backed journals, and their performance impact

2013-01-14 Thread Florian Haas
Hi Mark, thanks for the comments. On Mon, Jan 14, 2013 at 2:46 PM, Mark Nelson mark.nel...@inktank.com wrote: Hi Florian, Couple of comments: OSDs use a write-ahead mode for local operations: a write hits the journal first, and from there is then being copied into the backing filestore.

Re: OSD nodes with =8 spinners, SSD-backed journals, and their performance impact

2013-01-14 Thread Gregory Farnum
On Mon, Jan 14, 2013 at 6:09 AM, Florian Haas flor...@hastexo.com wrote: Hi Mark, thanks for the comments. On Mon, Jan 14, 2013 at 2:46 PM, Mark Nelson mark.nel...@inktank.com wrote: Hi Florian, Couple of comments: OSDs use a write-ahead mode for local operations: a write hits the

Re: OSD nodes with =8 spinners, SSD-backed journals, and their performance impact

2013-01-14 Thread Florian Haas
On 01/14/2013 06:34 PM, Gregory Farnum wrote: On Mon, Jan 14, 2013 at 6:09 AM, Florian Haas flor...@hastexo.com wrote: Hi Mark, thanks for the comments. On Mon, Jan 14, 2013 at 2:46 PM, Mark Nelson mark.nel...@inktank.com wrote: Hi Florian, Couple of comments: OSDs use a write-ahead