rzuo commented on PR #1158: URL: https://github.com/apache/bigtop/pull/1158#issuecomment-1665293801
> > Local smoke test: > > create test database and test table (TPC-DS: web_sales) > > load test data (1GB TPC-DS test data) to tables; > > run select count(1) from web_sales; > > @rzuo Could you elaborate the purpose and coverage of this test? Does this cover the all added patches? How much memory consumption is changed after the patch is applied? Hi iwasakims, By run one single smoke test SQL, just to verify hive works normally. Basiclly, it's difficult to cover all added patches by running one single sql query. The patches cover different business scenarioes, also need much more data, time, different kinds of queries to verify them completely. In one of our production environment, with about thousands of GB data, about 2~3 days, the HiveServer2s were running OOM. I spent some days to analysis the JVM dumps, compare the information from dumps and logs with the hive PRs, and applied those patches finally. After the patches applied, no OOM found any more. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
