Hello Calcite Team,

 

I have a requirement to query multiple data sources in single SQL query, I
saw Calcite was providing this with JDBC adaptor, So while running I found
some challenges like,

 

1.      This execution was happening in the memory that will cause OOM when
big data execution.

2.      I saw their was option like spark, So if we enable this option
execution will happen in Spark?.

3.      If 2nd is yes when I am trying with spark option I am getting
following exception,

  Caused by: java.lang.NullPointerException

       at CalciteProgram84650.bind(Unknown Source)

       at
org.apache.calcite.jdbc.CalcitePrepare$CalciteSignature.enumerable(CalcitePr
epare.java:355)

       at
org.apache.calcite.jdbc.CalciteConnectionImpl.enumerable(CalciteConnectionIm
pl.java:309)

       at
org.apache.calcite.jdbc.CalciteMetaImpl._createIterable(CalciteMetaImpl.java
:506)

       at
org.apache.calcite.jdbc.CalciteMetaImpl.createIterable(CalciteMetaImpl.java:
497)

       at
org.apache.calcite.avatica.AvaticaResultSet.execute(AvaticaResultSet.java:18
2)

       at
org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:64)

       at
org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:43)

       at
org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.jav
a:667)

       at
org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.ja
va:566)

       at
org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(Avati
caConnection.java:675)

       at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement
.java:156)

       ... 2 more

4.      And please let me know how to overcome OOM when big data execution.

 

Thanks and Regards

Ajay Babu Maguluri.

Reply via email to