Jian, Thanks for the clarification. I'll mark traffic destined for the monitors as well. We are getting ready to put our first cluster into production. If you are interested we will be testing the heartbeat priority to see if we can saturate the network (not an easy task for 40 Gb) and keep the cluster from falling apart. Our network team is marking COS based on the DSCP and enforcing priority. We have three VLANs on bonded 40 GbE, management, storage (monitors, clients, OSDs), and cluster (replication). We have three priority classes management (heartbeats on all VLANs, SSH, DNS, etc), storage traffic (no marking), and replication (scavenger class). We are interested to see how things pan out.
Thanks, Robert On Mon, Mar 9, 2015 at 8:58 PM, Jian Wen <wenjia...@gmail.com> wrote: > Only OSD calls set_socket_priority(). > See https://github.com/ceph/ceph/pull/3353 > > On Tue, Mar 10, 2015 at 3:36 AM, Robert LeBlanc <rob...@leblancnet.us> wrote: >> I've found commit 9b9a682fe035c985e416ee1c112fa58f9045a27c and I see >> that when 'osd heartbeat use min delay socket = true' it will mark the >> packet with DSCP CS6. Based on the setting of the socket in >> msg/simple/Pipe.cc is it possible that this can apply to both OSD and >> monitor? I don't understand the code enough to know how the >> set_socket_options() is called from the OSD and monitor. >> >> If this applies to both monitor and OSD, would it be better to rename >> the option to a more generic name? >> >> Thanks, >> >> On Sat, Mar 7, 2015 at 4:23 PM, Daniel Swarbrick >> <daniel.swarbr...@gmail.com> wrote: >>> Judging by the commit, this ought to do the trick: >>> >>> osd heartbeat use min delay socket = true >>> >>> On 07/03/15 01:20, Robert LeBlanc wrote: >>>> >>>> I see that Jian Wen has done work on this for 0.94. I tried looking >>>> through the code to see if I can figure out how to configure this new >>>> option, but it all went over my head pretty quick. >>>> >>>> Can I get a brief summary on how to set the priority of heartbeat >>>> packets or where to look in the code to figure it out? >>>> >>>> Thanks, >>>> >>>> On Thu, Aug 28, 2014 at 2:01 AM, Daniel Swarbrick >>>> <daniel.swarbr...@profitbricks.com >>>> <mailto:daniel.swarbr...@profitbricks.com>> wrote: >>>> >>>> On 28/08/14 02:56, Sage Weil wrote: >>>> > I seem to remember someone telling me there were hooks/hints you >>>> could >>>> > call that would tag either a socket or possibly data on that socket >>>> with a >>>> > label for use by iptables and such.. but I forget what it was. >>>> > >>>> >>>> Something like setsockopt() SO_MARK? >>>> >>>> *SO_MARK *(since Linux 2.6.25) >>>> Set the mark for each packet sent through this socket >>>> (similar >>>> to the netfilter MARK target but socket-based). >>>> Changing the >>>> mark can be used for mark-based routing without >>>> netfilter or >>>> for packet filtering. Setting this option requires the >>>> *CAP_NET_ADMIN *capability. >>>> >>>> Alternatively, directly set IP_TOS options on the socket, or >>>> SO_PRIORITY >>>> which sets the IP TOS bits as well. >>>> >>>> >>>> _______________________________________________ >>>> ceph-users mailing list >>>> ceph-users@lists.ceph.com >>>> <mailto:ceph-users@lists.ceph.com> >>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>> >>>> >>>> >>>> >>>> _______________________________________________ >>>> ceph-users mailing list >>>> ceph-users@lists.ceph.com >>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>> >>> >>> >>> -- >>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in >>> the body of a message to majord...@vger.kernel.org >>> More majordomo info at http://vger.kernel.org/majordomo-info.html >> _______________________________________________ >> ceph-users mailing list >> ceph-users@lists.ceph.com >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > -- > Best, > > Jian _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
