I write a log on org.apache.hadoop.hive.ql.Driver : LOG.info("Driver:1866 : "
+ hookContext.getIndex().getFinalSelectOps().size());
if I config LineageLogger to <hive.exec.post.hooks> the log will out put 1 or
it will out put 0 , why ??
2018-09-13
lk_hadoop
发件人:"lk_hadoop"<[email protected]>
发送时间:2018-09-13 13:28
主题:LineageLogger can't getEdges
收件人:"user"<[email protected]>
抄送:
hi,all:
I want to change LineageLogger code to output more log info .
I create a new mvn project and cp LineageLogger code to my own class named
MyLineageLogger. Then I add my code to output more log info ,last I build a new
jar. but when I config it to <hive.exec.post.hooks> ,the log file didn't
contain any edges info : "edges":[],"vertices":[]
I've tried to use hive's own LineageLogger with the same sql , and all is ok.
and if I config both hive's own LineageLogger and my MyLineageLogger to
the <hive.exec.post.hooks> , both LineageLogger and MyLineageLogger can out
put full lineage log.
I note that ,if I only config MyLineageLogger , LinkedHashMap<String,
ObjectPair<SelectOperator,org.apache.hadoop.hive.ql.metadata.Table>>
finalSelOps = index.getFinalSelectOps();
will return 0
can anybody give me some clue , why this happen ? thanks...
2018-09-13
lk_hadoop