Re: [FLIGHT] Question about Flight Protocol Usage

2023-02-03 Thread Paul Whalen
My team uses Flight this way as well. We just use DoGet, DoPut, or DoExchange, depending on whether we're reading a stream of record batches, writing a stream, or need some sort of bidirectional communication. We also have full control over clients and servers, and simply use JSON in the Flight m

Re: [FLIGHT] Question about Flight Protocol Usage

2023-02-03 Thread David Li
Yes, there's really no problem if you just want to use Flight as a pipe for Arrow data. (There's also a proposal to inline data directly into FlightInfo, if you want to keep the separate metadata.) On Fri, Feb 3, 2023, at 17:44, Aldrin wrote: > I am planning on doing something similar, but I do

Re: [FLIGHT] Question about Flight Protocol Usage

2023-02-03 Thread Aldrin
I am planning on doing something similar, but I don't have a concrete reference to point you to. In my case, I am treating the metadata as something that is re-usable (e.g. the FlightInfo is not something that expires after the first use). This makes the most sense when the information in FlightIn

[FLIGHT] Question about Flight Protocol Usage

2023-02-03 Thread Nate Jones
Hello, We've been using the Flight protocol similar to the way that the read path is described in documentation. That is, services have a separate metadata server (at least logically separated such that a network round trip occ

Re: [VOTE][Julia] Release Apache Arrow Julia 2.4.3 RC1

2023-02-03 Thread David Li
+1 Ran on Ubuntu 18.04/AMD64. On Thu, Feb 2, 2023, at 22:45, Jacob Quinn wrote: > +1 > > Ran on macos m1. > > -Jacob > > On Thu, Feb 2, 2023 at 7:53 PM Sutou Kouhei wrote: > >> +1 >> >> I ran the following command line on Debian GNU/Linux sid: >> >> VERIFY_FORCE_USE_JULIA_BINARY=1 dev/release

Re: [DISCUSS] Fixed shape tensor Canonical Extension Type

2023-02-03 Thread Joris Van den Bossche
On Thu, 2 Feb 2023 at 16:06, Clark Zinzow wrote: > > Hi Alenka, > > Great work on the RFC, I'm super excited to see this! I was planning to > open a similar RFC at some point over the next few weeks, so this just > saved me a bunch of work. :D > > At the Ray project [1], we've developed two tensor

Re: [DISCUSS] PR automation workflow

2023-02-03 Thread Rok Mihevc
+1 to Nic's comment. On Fri, Feb 3, 2023 at 12:46 PM Nic Crane wrote: > I have no specific comments on the what/how, other than to say I'm strongly > in favour of some kind of system being implemented and tried out, as I > currently rely on manual processes that are inefficient and make it easy

Re: [DISCUSS] PR automation workflow

2023-02-03 Thread Nic Crane
I have no specific comments on the what/how, other than to say I'm strongly in favour of some kind of system being implemented and tried out, as I currently rely on manual processes that are inefficient and make it easy to miss PRs which need looking at. On Thu, 2 Feb 2023 at 18:16, Andrew Lamb w

Re: DISCUSS: [FlightSQL] Catalog support

2023-02-03 Thread Andrew Lamb
As an update to this thread, we found we could support our version of catalogs using JDBC URL parameters, which are passed to the service as gRPC headers by the JDBC driver. I made a PR [1] proposing updates the docs to make this feature more discoverable Any URI parameters that are not handled b