But sorry, this was about "rados bench" which is run inside the Ceph
cluster. So there's no network between the "client" and my cluster.
On Fri, Nov 10, 2017 at 10:35 AM, Robert Stanford <rstanford8...@gmail.com>
wrote:
>
> Thank you for that excellent observation. Are there any rumors / has
> anyone had experience with faster clusters, on faster networks? I wonder
> how Ceph can get ("it depends"), of course, but I wonder about numbers
> people have seen.
>
> On Fri, Nov 10, 2017 at 10:31 AM, Denes Dolhay <de...@denkesys.com> wrote:
>
>> So you are using a 40 / 100 gbit connection all the way to your client?
>>
>> John's question is valid because 10 gbit = 1.25GB/s ... subtract some
>> ethernet, ip, tcp and protocol overhead take into account some additional
>> network factors and you are about there...
>>
>>
>> Denes
>>
>> On 11/10/2017 05:10 PM, Robert Stanford wrote:
>>
>>
>> The bandwidth of the network is much higher than that. The bandwidth I
>> mentioned came from "rados bench" output, under the "Bandwidth (MB/sec)"
>> row. I see from comparing mine to others online that mine is pretty good
>> (relatively). But I'd like to get much more than that.
>>
>> Does "rados bench" show a near maximum of what a cluster can do? Or is
>> it possible that I can tune it to get more bandwidth?
>>
>>
>> On Fri, Nov 10, 2017 at 3:43 AM, John Spray <jsp...@redhat.com> wrote:
>>
>>> On Fri, Nov 10, 2017 at 4:29 AM, Robert Stanford
>>> <rstanford8...@gmail.com> wrote:
>>> >
>>> > In my cluster, rados bench shows about 1GB/s bandwidth. I've done
>>> some
>>> > tuning:
>>> >
>>> > [osd]
>>> > osd op threads = 8
>>> > osd disk threads = 4
>>> > osd recovery max active = 7
>>> >
>>> >
>>> > I was hoping to get much better bandwidth. My network can handle it,
>>> and my
>>> > disks are pretty fast as well. Are there any major tunables I can
>>> play with
>>> > to increase what will be reported by "rados bench"? Am I pretty much
>>> stuck
>>> > around the bandwidth it reported?
>>>
>>> Are you sure your 1GB/s isn't just the NIC bandwidth limit of the
>>> client you're running rados bench from?
>>>
>>> John
>>>
>>> >
>>> > Thank you
>>> >
>>> > _______________________________________________
>>> > ceph-users mailing list
>>> > ceph-users@lists.ceph.com
>>> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>> >
>>>
>>
>>
>>
>> _______________________________________________
>> ceph-users mailing
>> listceph-us...@lists.ceph.comhttp://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>>
>>
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>>
>
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
