Re: ApacheCon CFP closing soon (11 February)

2017-01-20 Thread jordan.halter...@gmail.com
Sure thing. > On Jan 19, 2017, at 12:38 PM, Julian Hyde wrote: > > Great to hear that. Can you (and anyone else with an upcoming talk > about Calcite) edit > https://github.com/apache/calcite/blob/master/site/community/index.md#upcoming-talks > and submit a PR, to get your talk listed at > http:

Re: ApacheCon CFP closing soon (11 February)

2017-01-20 Thread Riccardo Tommasini
Interesting, Jordan, can you show me some example on calcite+spark? Riccardo Tommasini Master Degree Computer Science PhD Student at Politecnico di Milano (Italy) streamreasoning.org Submitted from an iPhone, I apologise for typos. From: jordan.halter...@gmail.com

question regarding loggings in calcite

2017-01-20 Thread Albert
maybe some stupid question here: I've followed the configuration for logging -DXXX ``` .level=ALL handlers=java.util.logging.ConsoleHandler java.util.logging.ConsoleHandler.level=ALL ``` I can see the generated java code logged in the console when I running tests in under the optimiser package,

[jira] [Created] (CALCITE-1595) NPE in SqlTypeUtil

2017-01-20 Thread Jess Balint (JIRA)
Jess Balint created CALCITE-1595: Summary: NPE in SqlTypeUtil Key: CALCITE-1595 URL: https://issues.apache.org/jira/browse/CALCITE-1595 Project: Calcite Issue Type: Bug Components:

[jira] [Created] (CALCITE-1596) Log exceptions to custom logger

2017-01-20 Thread Julian Hyde (JIRA)
Julian Hyde created CALCITE-1596: Summary: Log exceptions to custom logger Key: CALCITE-1596 URL: https://issues.apache.org/jira/browse/CALCITE-1596 Project: Calcite Issue Type: Bug

Re: ApacheCon CFP closing soon (11 February)

2017-01-20 Thread jordan.halter...@gmail.com
I don't want to take over this thread with an off topic discussion. I'll respond to your other thread about Spark. > On Jan 20, 2017, at 4:35 AM, Riccardo Tommasini > wrote: > > Interesting, > > Jordan, can you show me some example on calcite+spark? > > Riccardo Tommasini > Master Degree Com

Re: Spark and Calcite

2017-01-20 Thread jordan.halter...@gmail.com
So, AFAIK the Spark adapter that's inside Calcite is in an unusable state right now. It's still using Spark 1.x and last time I tried it I couldn't get it to run. It probably needs to either be removed or completely rewritten. But I can certainly offer some guidance on working with Spark and Cal

[jira] [Created] (CALCITE-1597) Obsolete Util.newInternal and Throwables.propagate

2017-01-20 Thread Julian Hyde (JIRA)
Julian Hyde created CALCITE-1597: Summary: Obsolete Util.newInternal and Throwables.propagate Key: CALCITE-1597 URL: https://issues.apache.org/jira/browse/CALCITE-1597 Project: Calcite Issue

Re: Spark and Calcite

2017-01-20 Thread Jacques Nadeau
Jordan, super interesting work you've shared. It would be very cool to get this incorporated back into Spark mainline. That would continue to broaden Calcite's reach :) On Fri, Jan 20, 2017 at 1:36 PM, jordan.halter...@gmail.com < jordan.halter...@gmail.com> wrote: > So, AFAIK the Spark adapter t

Re: Spark and Calcite

2017-01-20 Thread Julian Hyde
I agree with Jacques. Jordan, If your company decides to open-source your work, I would be willing - nay, delighted - to replace Calcite's existing Spark adapter. As you say, the current adapter is unusable. There is considerable appetite for a real distributed compute engine for Calcite (not coun

Re: Spark and Calcite

2017-01-20 Thread Eli Levine
I second Julian's statement on the value of Calcite supporting adapters to distributed compute engines, such as Spark. FWIW, I've been tinkering with a Pig adapter for Calcite [1]. Early days still but the adapter already supports generating Pig-specific RelNode trees and converting them to Pig La