Re: Suitability of Avatica for Apache Arrow Flight JDBC Driver

2020-02-03 Thread Jacques Nadeau
BC driver for Apache Arrow Flight [1] and it > has been suggested that I use Avatica instead of building from scratch. > However, I'm not sure if Avatica is really designed for this use case since > I would not require the Avatica wire protocol or server process. The Flight > JDBC driver ne

Suitability of Avatica for Apache Arrow Flight JDBC Driver

2020-02-03 Thread Andy Grove
Hi, I have started building a JDBC driver for Apache Arrow Flight [1] and it has been suggested that I use Avatica instead of building from scratch. However, I'm not sure if Avatica is really designed for this use case since I would not require the Avatica wire protocol or server process

Re: Arrow Flight

2018-08-17 Thread Julian Hyde
> I don't really grok how Arrow would be used with Avatica now (I struggle > with how Arrow would be used in place of Protobuf, period), For the packets that carry rows I would envision a payload format where there rows are just a byte-array. The default payload format would remain protobuf. The

Re: Arrow Flight

2018-08-17 Thread Enrico Olivelli
I am interested in this topic too. I am not (yet?) using Avatica, but I am working a lot in order to save resources during data access and data transfer in JDBC driver in my project HerdDB (which is using Calcite SQLParser and planner). Currently the only way it is have a proprietary protocol

Re: Arrow Flight

2018-08-17 Thread Josh Elser
Thanks for the heads-up, Julian. Subscribing. I don't really grok how Arrow would be used with Avatica now (I struggle with how Arrow would be used in place of Protobuf, period), but I should make the time to figure that out. On 8/16/18 1:27 PM, Julian Hyde wrote: There's a discussion on

Arrow Flight

2018-08-16 Thread Julian Hyde
There's a discussion on the Apache Arrow list about a proposed RPC mechanism called Flight. One of its use cases is for executing SQL. I fear that for SQL they will likely end up with a protocol similar to Avatica. I think that we should extend Avatica should allow Arrow as its data format, with