RE: JDBC Adapter for Apache-Arrow

2018-02-13 Thread Atul Dambalkar
. Are there any particular use-cases/requirements you have in mind? -Atul -Original Message- From: Jacques Nadeau [mailto:jacq...@apache.org] Sent: Tuesday, January 09, 2018 7:41 PM To: dev@arrow.apache.org Subject: Re: JDBC Adapter for Apache-Arrow We have some stuff I Dremio that

Re: JDBC Adapter for Apache-Arrow

2018-01-09 Thread Jacques Nadeau
his as well as the other piece about adding a > direct Arrow objects creation support from JDBC drivers? If yes, I can > certainly go ahead and create JIRA for JDBC Adapter work. > >> > >> Julian, would you like to create the JIRA for the other item that you > proposed.

Re: JDBC Adapter for Apache-Arrow

2018-01-07 Thread Uwe L. Korn
objects creation support from JDBC drivers? If yes, I can certainly go >> ahead and create JIRA for JDBC Adapter work. >> >> Julian, would you like to create the JIRA for the other item that you >> proposed. >> >> -Atul >> >> -----Original Message---

Re: JDBC Adapter for Apache-Arrow

2017-11-07 Thread Julian Hyde
like to create the JIRA for the other item that you > proposed. > > -Atul > > -Original Message- > From: Atul Dambalkar > Sent: Thursday, November 02, 2017 2:59 PM > To: dev@arrow.apache.org > Subject: RE: JDBC Adapter for Apache-Arrow > > I also like the

RE: JDBC Adapter for Apache-Arrow

2017-11-07 Thread Atul Dambalkar
n was suggesting earlier. -Original Message- From: Julian Hyde [mailto:jh...@apache.org] Sent: Tuesday, October 31, 2017 4:28 PM To: dev@arrow.apache.org Subject: Re: JDBC Adapter for Apache-Arrow Yeah, I agree, it should be an interface defined as part of Arrow. Not driver-specific. >

RE: JDBC Adapter for Apache-Arrow

2017-11-02 Thread Atul Dambalkar
suggesting earlier. -Original Message- From: Julian Hyde [mailto:jh...@apache.org] Sent: Tuesday, October 31, 2017 4:28 PM To: dev@arrow.apache.org Subject: Re: JDBC Adapter for Apache-Arrow Yeah, I agree, it should be an interface defined as part of Arrow. Not driver-specific. > On Oct

Re: JDBC Adapter for Apache-Arrow

2017-11-01 Thread Julian Hyde
activity. And you are right, we will have to look at >> specific >>>> JDBC driver to really optimize it individually. >>>> >>>> I would be curious if there are any further inputs/comments from other >> Dev >>>> folks, on the JDBC adapter aspect. >&

Re: JDBC Adapter for Apache-Arrow

2017-10-31 Thread 丁锦祥
row like data from a SQL > Database > >> to columnar Arrow data structures. The utility may be, can make use of > >> JDBC's MetaData features to figure out the underlying DB schema and > define > >> Arrow columnar schema. Also underlying database in this case

Re: JDBC Adapter for Apache-Arrow

2017-10-31 Thread Julian Hyde
other Dev >> folks, on the JDBC adapter aspect. >> >> -Atul >> >> -Original Message- >> From: Julian Hyde [mailto:jh...@apache.org] >> Sent: Tuesday, October 31, 2017 11:12 AM >> To: dev@arrow.apache.org >> Subject: Re: JDBC Adapter for Apa

Re: JDBC Adapter for Apache-Arrow

2017-10-31 Thread Laurent Goujon
f there are any further inputs/comments from other Dev > folks, on the JDBC adapter aspect. > > -Atul > > -Original Message- > From: Julian Hyde [mailto:jh...@apache.org] > Sent: Tuesday, October 31, 2017 11:12 AM > To: dev@arrow.apache.org > Subject: Re: JDBC Ada

RE: JDBC Adapter for Apache-Arrow

2017-10-31 Thread Atul Dambalkar
if there are any further inputs/comments from other Dev folks, on the JDBC adapter aspect. -Atul -Original Message- From: Julian Hyde [mailto:jh...@apache.org] Sent: Tuesday, October 31, 2017 11:12 AM To: dev@arrow.apache.org Subject: Re: JDBC Adapter for Apache-Arrow Sorry I didn’t read

Re: JDBC Adapter for Apache-Arrow

2017-10-31 Thread Julian Hyde
thing. > > -Atul > > -Original Message- > From: Julian Hyde [mailto:jhyde.apa...@gmail.com] > Sent: Monday, October 30, 2017 7:50 PM > To: dev@arrow.apache.org > Subject: Re: JDBC Adapter for Apache-Arrow > > How about writing an Arrow adapter for Calcit

RE: JDBC Adapter for Apache-Arrow

2017-10-31 Thread Atul Dambalkar
-Atul -Original Message- From: Julian Hyde [mailto:jhyde.apa...@gmail.com] Sent: Monday, October 30, 2017 7:50 PM To: dev@arrow.apache.org Subject: Re: JDBC Adapter for Apache-Arrow How about writing an Arrow adapter for Calcite? I think it amounts to the same thing - you would inherit Calcite’

Re: JDBC Adapter for Apache-Arrow

2017-10-30 Thread Julian Hyde
How about writing an Arrow adapter for Calcite? I think it amounts to the same thing - you would inherit Calcite’s SQL parser and Avatica JDBC stack. Would this database be ephemeral (i.e. would the data go away when you close the connection)? If not, how would you know where to load the data f