On Tue, Jan 14, 2020 at 12:30 AM Stefan Kooman <ste...@bit.nl> wrote:
> Quoting Robert LeBlanc (rob...@leblancnet.us): > > The link that you referenced above is no longer available, do you have a > > new link?. We upgraded from 12.2.8 to 12.2.12 and the MDS metrics all > > changed, so I'm trying to may the old values to the new values. Might > just > > have to look in the code. :( > > I cannot recall that the metrics have ever changed between 12.2.8 and > 12.2.12. Anyways, it depends on what module you use to collect the > metrics if the right metrics are even there. See this issue: > https://tracker.ceph.com/issues/41881 Yes, I agree that the metrics should not change within a major version, but here is the difference. We are using diamond and the CephCollector, but I verified with the admin socket and dumping the perf counters manually Metrics collected with 12.2.8: servers.mds01.CephCollector.ceph.mds.mds01.mds_server.dispatch_client_request 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.dispatch_server_request 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.handle_client_request 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.handle_client_session 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.handle_slave_request 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_create 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getattr 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getfilelock 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_link 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookup 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookuphash 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupino 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupname 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupparent 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupsnap 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lssnap 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mkdir 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mknod 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mksnap 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_open 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_readdir 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rename 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_renamesnap 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmdir 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmsnap 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmxattr 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setattr 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setdirlayout 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setfilelock 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setlayout 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setxattr 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_symlink 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_unlink 0 1578955818 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.cap_revoke_eviction 0 1578955878 Metrics collected with 12.2.12: (much more clear and descriptive which is good) servers.mds01.CephCollector.ceph.mds.mds01.mds_server.dispatch_client_request 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.dispatch_server_request 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.handle_client_request 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.handle_client_session 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.handle_slave_request 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_create_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_create_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_create_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getattr_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getattr_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getattr_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getfilelock_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getfilelock_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getfilelock_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_link_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_link_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_link_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookup_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookup_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookup_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookuphash_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookuphash_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookuphash_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupino_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupino_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupino_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupname_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupname_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupname_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupparent_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupparent_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupparent_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupsnap_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupsnap_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupsnap_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lssnap_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lssnap_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lssnap_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mkdir_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mkdir_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mkdir_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mknod_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mknod_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mknod_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mksnap_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mksnap_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mksnap_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_open_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_open_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_open_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_readdir_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_readdir_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_readdir_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rename_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rename_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rename_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_renamesnap_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_renamesnap_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_renamesnap_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmdir_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmdir_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmdir_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmsnap_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmsnap_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmsnap_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmxattr_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmxattr_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmxattr_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setattr_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setattr_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setattr_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setdirlayout_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setdirlayout_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setdirlayout_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setfilelock_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setfilelock_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setfilelock_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setlayout_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setlayout_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setlayout_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setxattr_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setxattr_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setxattr_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_symlink_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_symlink_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_symlink_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_unlink_latency.avgcount 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_unlink_latency.avgtime 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_unlink_latency.sum 0 1578955878 servers.mds01.CephCollector.ceph.mds.mds01.mds_server.cap_revoke_eviction 0 1578955938 We were plotting: req_create req_getattr req_readdir req_lookupino req_open req_unlink We were graphing these as ops, but using the new avgcount, we are getting very different values, so I'm wondering if we are choosing the wrong new value, or we misunderstood what the old value really was and have been plotting it wrong all this time. Thanks, ---------------- Robert LeBlanc PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
