[ https://issues.apache.org/jira/browse/YARN-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15858743#comment-15858743 ]
Haibo Chen commented on YARN-4985: ---------------------------------- Uploading a patch for preliminary review. The hbase-backend module has been split into two separate modules based on the versions of hadoop-common/hdfs/auth that they need to run under. Coprocessor code and code in hbase-tests are now in the same module, that is, *timelineservice-hbase-server, which depends on *timelineservice-hbase-client that includes all table schema and hbase code executed in YARN trunk. YARN-6094 has enabled dynamic loading of coprocessor from HDFS, now if coprocessor code lives in a hbase-server jar that depends on hbase-client jar, I don't think the dynamic loading from HDFS will work unless HBase somehow knows how to pull in the dependent jars. Thoughts on workaround, [~sjlee0]? In the meantime, I will continue to verify maven dependencies to make sure they are clean. > Refactor the coprocessor code & other definition classes into independent > packages > ---------------------------------------------------------------------------------- > > Key: YARN-4985 > URL: https://issues.apache.org/jira/browse/YARN-4985 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver > Reporter: Vrushali C > Assignee: Haibo Chen > Labels: YARN-5355 > Attachments: YARN-4985-YARN-5355.prelim.patch > > > As part of the coprocessor deployment, we have realized that it will be much > cleaner to have the coprocessor code sit in a package which does not depend > on hadoop-yarn-server classes. It only needs hbase and other util classes. > These util classes and tag definition related classes can be refactored into > their own independent "definition" class package so that making changes to > coprocessor code, upgrading hbase, deploying hbase on a different hadoop > version cluster etc all becomes operationally much easier and less error > prone to having different library jars etc. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org