Re: Re: how about integrate spark dataset/dataframe api

2016-09-04 Thread Wangfei (X)
IMO the main benefit is to inherit the optimization of spark SQL(such as whole stage codegen, memory management, maybe vectorized execution in future ...). not farmilar with calcite's codegen mechanism, any reference about it? I think firstly i will unsterstand how the spark adapter now

[jira] [Created] (CALCITE-1369) Display a list of Avatica clients on the website

2016-09-04 Thread Francis Chuang (JIRA)
Francis Chuang created CALCITE-1369: --- Summary: Display a list of Avatica clients on the website Key: CALCITE-1369 URL: https://issues.apache.org/jira/browse/CALCITE-1369 Project: Calcite

[ACCUMULO] New committer: Francis Chuang

2016-09-04 Thread Josh Elser
All, I'm happy to welcome Francis as an Apache Calcite committer. This is in recognition of Francis' continued contributions to the project, most notably in support of the development and stability of Avatica. Francis has been a great source of help for Avatica, reporting numerous issues

Re: how about integrate spark dataset/dataframe api

2016-09-04 Thread Julian Hyde
It’s an interesting idea. I know that the data frame API is easier to work with for application developers, but since Calcite would be generating the code, can you describe the benefits to the Calcite user of changing the integration point? It’s definitely true that Calcite’s Spark adapter

[ANNOUNCE] New committer: MinJi Kim

2016-09-04 Thread Julian Hyde
On behalf of the PMC I am delighted to announce MinJi Kim as a new Calcite committer. Over several months MinJi has contributed more than a few patches to the planner and adapters, always high quality and well tested, and it has been a pleasure interacting with her. Please give MinJi a warm

Re: dynamodb storage plugin

2016-09-04 Thread Julian Hyde
Forwarding to Calcite dev. I have heard that people are working on a Calcite adapter for DynamoDB and Calcite adapters can often be used in Drill. Julian > On Sep 4, 2016, at 12:03 PM, Navin Viswanath wrote: > > Hi, > > I'm currently working on a tool that provides a