Re: Question Regarding The Benchmark of Calcite Compared To Conventional Database System(Related to CALCITE-2169)

2018-12-31 Thread Lim, Seung-Hwan
Hi Lekshmi, I am one of the members in Edmon Begoli’s team who did preliminary work on comparison Calcite with conventional RDBMS, especially postgresql. The major challenge that we’ve identified is that many benchmarks (e.g., TPC-H, TPC-DS) evaluates the performance of ‘Join’ operations. For

Re: [DISCUSS] Avatica - how efficient is our protocol?

2018-08-23 Thread Lim, Seung-Hwan
Sounds like a very interesting issue. While I’m evaluating Calcite for JDBC adaptor over postgreSQL with TPC-DS queries, where Calcite queries 2~10 times slower than native postgresql queries through psql. So, including JDBC latency issues, overall enhancement of Avatica would be beneficial to

Re: Approximate query processing in Calcite

2018-05-10 Thread Lim, Seung-Hwan
Hello Michael and Xiening, Due to NDA, I cannot reveal in detail, but I recall one of my previous projects where the sponsor wanted to do a sort of approximate query over RDBMs in geo-distributed environments. Roughly speaking, they tried to find if the entity of interest can be connected to

Re: Approximate query processing in Calcite

2018-05-04 Thread Lim, Seung-Hwan
Looking at query examples in VerdictDB, most of TPC-DS queries can earn a big benefit. They are mostly top-k queries over aggregated results. And the availability of various sampling techniques make the VerdictDB attractive to machine learning/graph analysis cases. — Seung-Hwan > On May 4, 201