[GitHub] [atlas] zhangxiong0301 opened a new pull request #75: ATLAS-3519: pool performance in hive lineage query
zhangxiong0301 opened a new pull request #75: ATLAS-3519: pool performance in hive lineage query URL: https://github.com/apache/atlas/pull/75 when query lineage info for hive, the throughput reachs only 3 query per second. we use jstack and jfr+flame graph tools and found that the GremlinGroovyScriptEngine object loading class logic takes much of the time. so we make the GremlinGroovyScriptEngine a global singleton object, which would be shared accross all query threads. finally the query performance improved much and got 200 qps. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [atlas] zhangxiong0301 opened a new pull request #75: ATLAS-3519: pool performance in hive lineage query
zhangxiong0301 opened a new pull request #75: ATLAS-3519: pool performance in hive lineage query URL: https://github.com/apache/atlas/pull/75 when query lineage info for hive, the throughput reachs only 3 query per second. we use jstack and jfr+flame graph tools and found that the GremlinGroovyScriptEngine object loading class logic takes much of the time. so we make the GremlinGroovyScriptEngine a global singleton object, which would be shared accross all query threads. finally the query performance improved much and got 200 qps. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
