Hi All I’d like to open a discussion for merging Timeline Service v.2 (YARN-5355) to trunk in a few weeks.
We have previously completed one merge onto trunk [1] and Timeline Service v2 has been part of Hadoop release 3.0.0-alpha1. Since then, we have been working on extending the capabilities of Timeline Service v2 in a feature branch [2]. There are a few related issues pending that are being actively worked upon & tested. As soon as they are resolved, we plan on starting a merge vote within the next 2 weeks. The goal is to get this in for Hadoop3 beta. We have paid close attention to ensure that once disabled Timeline Service v.2 does not impact existing functionality when disabled (by default). At a high level, following are the key features that have been implemented since 3.0.0-alpha1: - Security (via Kerberos Authentication & delegation tokens) at the writer [YARN-3053] - Timeline server usability improvements [timeline-server <https://issues.apache.org/jira/browse/YARN-5715?jql=project%20%3D%20YARN%20AND%20fixVersion%20%3D%20YARN-5355%20AND%20component%20%3D%20timelineserver%20AND%20labels%20%21%3D%20atsv2-hbase%20ORDER%20BY%20updated%20ASC%2C%20priority%20DESC%2C%20created%20ASC> ] - HBase specific improvements [atsv2-hbase <https://issues.apache.org/jira/browse/YARN-6604?jql=project%20%3D%20YARN%20AND%20fixVersion%20%3D%20YARN-5355%20AND%20labels%20%3D%20atsv2-hbase%20ORDER%20BY%20updated%20DESC%2C%20affectedVersion%20DESC%2C%20priority%20DESC%2C%20created%20ASC> ] - REST API additions & improvements [timeline-reader <https://issues.apache.org/jira/browse/YARN-5739?jql=project%20%3D%20YARN%20AND%20fixVersion%20%3D%20YARN-5355%20AND%20component%20in%20%28timelineclient%2C%20timelinereader%29%20ORDER%20BY%20updated%20ASC%2C%20priority%20DESC%2C%20created%20ASC> ] - Reader side simple authorization via whitelist [YARN-6820] We would love to get your thoughts on these and more before we open a real voting thread. Special thanks to a team of folks who worked hard and contributed towards this effort with patches, reviews and guidance: Rohith Sharma K S, Varun Saxena, Haibo Chen, Sangjin Lee, Li Lu, Vinod Kumar Vavilapalli, Joep Rottinghuis, Jason Lowe, Jian He, Robert Kanter, Micheal Stack. Thanks! Vrushali [1] Merge to trunk: http://www.mail-archive.com/yarn-dev@hadoop. apache.org/msg23897.html [2] feature branch YARN-5355 commits: https://github.com/ apache/hadoop/commits/YARN-5355
