Re: [DISCUSS] Fixed shape tensor Canonical Extension Type

Hi all, Thank you all for participating in the discussion. The feedback received was very helpful! I have updated the spec according to the discussion here and in the PR [1] plus the talk we had with Rok and Joris. The change in the spec can be found in the Description of the serialization sectio

Re: DISCUSS: [FlightSQL] Catalog support

Hi James, Thanks for sharing your plan! I will wait for an update. -- kou In "Re: DISCUSS: [FlightSQL] Catalog support" on Tue, 14 Feb 2023 04:53:07 +, James Duong wrote: > Hi Sutou, > > I saw your PostgreSQL project and thought it was quite interesting, > especially given the n

RE: [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements

Hi David, Thank you very much for your proposal. My comments about it are as follows: About PollFlightInfo: Many SQL queries (in fact, almost all OLAP queries?) cannot produce any output records until it completes - because of GROUP BY or ORDER BY clause. In that case, PollFlightInfo can degener

Re: [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements

Ah, right. I haven't written up the last set of ADBC proposals yet. I'll do that in the next day or two. On Tue, Feb 14, 2023, at 17:38, Will Jones wrote: > Hi David, > > The proposals in the Flight/Flight SQL document look excellent. As I've > been looking at ADBC I've been wondering about polli

Re: [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements

Hi David, The proposals in the Flight/Flight SQL document look excellent. As I've been looking at ADBC I've been wondering about polling / async execution, cancellation, and progress indicators. Glad to see those in the Flight document, but where are they in the ADBC issues? Do they still need to

[DISCUSS] Flight RPC/Flight SQL/ADBC enhancements

Hello, I would like to submit some Flight RPC and Flight SQL enhancements for discussion. They cover the following: - Executing 'queries' in a retryable, nonblocking way - Handling ordered result sets - Handling expiration of/re-reading result sets In addition, there are corresponding proposals

Re: [VOTE] Release Apache Arrow ADBC 0.2.0 - RC1

Thanks Dewey. I've added those to the 0.3.0 milestone/I'll take a look at setting up non-Conda CI when I get a chance. Are any PMC members available to take a look here? On Tue, Feb 14, 2023, at 09:19, Dewey Dunnington wrote: > I ran: > > ``` > export DOCKER_DEFAULT_ARCHITECTURE=linux/amd64 > ex

Re: [VOTE] Release Apache Arrow ADBC 0.2.0 - RC1

I ran: ``` export DOCKER_DEFAULT_ARCHITECTURE=linux/amd64 export PKG_CONFIG_PATH=/opt/homebrew/Cellar/libpq/15.2/lib/pkgconfig/:/opt/homebrew/Cellar/openssl@3 /3.0.8/lib/pkgconfig/ export CGO_CXXFLAGS="-std=c++11" TEST_GLIB=0 ./dev/release/verify-release-candidate.sh 0.2.0 1 ``` I had to manually

Re: Proposal: renaming the 'master' branch to 'main'

I would like to rename the default branch in arrow-datafusion next. I have a PR up with the required changes: https://github.com/apache/arrow-datafusion/pull/5280 I will submit a request to INFRA in the next few days to rename the default branch if there are no objections, and I will merge this P

Re: DISCUSS: [FlightSQL] Catalog support

Hi Sutou, I saw your PostgreSQL project and thought it was quite interesting, especially given the number of PostgreSQL-compatible databases. Paul Nienaber will be picking up implementation of the catalog feature going forward and can provide an update Get Outlook for Android

Re: [DISCUSS] Fixed shape tensor Canonical Extension Type

On Tue, 7 Feb 2023 at 19:32, Quentin Lhoest wrote: > > Hi, > > If I remember correctly one can already pass `types_mapper` > to `pa.Table.to_pandas`, to allow Ray or HF Datasets to define > their own pandas extension types associated to the arrow > extension types. I guess this could also be used

Re: [DISC] Self-Hosted Runners for Arrow

Hi, Following up on this thread, I am going to try and coordinate to set up an instance of the self-hosted runners for arm64 on the Arrow repository. There was a question about using Travis CI on Crossbow for those jobs. That could be a possibility but I think there are some benefits to the propo