gt;> place for "not quite in tree" projects; there have been discussions of
>> > >>> a 'contrib' repo in the past, but nothing has materialized.
>> > >>>
>> > >>> That said - have you shown this to Spark users? I'd guess there&#x
gt;>> source(s) you anticipate this would make available to them. (Though
> > >>> again, Flight SQL or ADBC over plain Flight RPC would might be a more
> > >>> attractive target for such a Spark plugin.)
> > >>>
> > >>> -David
> >
is would make available to them. (Though again, Flight SQL
> >>> or ADBC over plain Flight RPC would might be a more attractive target for
> >>> such a Spark plugin.)
> >>>
> >>> -David
> >>>
> >>> On Tue, Oct 18, 2022, at 16:50, Mat
he Arrow community
before submitting for inclusion to Spark. Is there a place the code can
live in the mean time?
Matt Phelps
From: Antoine Pitrou
Date: Monday, October 17, 2022 at 2:48 PM
To: dev@arrow.apache.org
Subject: Re: [DISCUSS] Integrate existing Spark connector for Flight
CAUTION: This
t; > Spark developers, we anticipate that it would take a long time to get
>> > into Spark. Our plan was to build up a user base in the Arrow community
>> > before submitting for inclusion to Spark. Is there a place the code can
>> > live in the mean time?
>>
>
> >
> > From: Antoine Pitrou
> > Date: Monday, October 17, 2022 at 2:48 PM
> > To: dev@arrow.apache.org
> > Subject: Re: [DISCUSS] Integrate existing Spark connector for Flight
> > CAUTION: This email originated from outside of the organization. Do not
> &g
Our plan was to build up a user base in the Arrow community
> before submitting for inclusion to Spark. Is there a place the code can
> live in the mean time?
>
> Matt Phelps
>
>
> From: Antoine Pitrou
> Date: Monday, October 17, 2022 at 2:48 PM
> To: dev@arrow.apach
the code can live in the mean time?
Matt Phelps
From: Antoine Pitrou
Date: Monday, October 17, 2022 at 2:48 PM
To: dev@arrow.apache.org
Subject: Re: [DISCUSS] Integrate existing Spark connector for Flight
CAUTION: This email originated from outside of the organization. Do not click
links or
Le 17/10/2022 à 21:27, David Li a écrit :
Hey Matt,
This is cool to see. To be clear, this is an implementation of Spark
DataSourceV2 using Arrow Flight?
I think the questions I have are:
- Does this belong under Arrow, or under Spark - I lean towards it being closer
to Spark than Arrow;
Hey Matt,
This is cool to see. To be clear, this is an implementation of Spark
DataSourceV2 using Arrow Flight?
I think the questions I have are:
- Does this belong under Arrow, or under Spark - I lean towards it being closer
to Spark than Arrow;
- How would we do the testing with Spark;
- Wha
Hi Arrow team,
I’d like to make a contribution to the Arrow project by submitting an existing
Spark connector for Flight. Ryan Murray and Kyle Brooks wrote a Flight
implementation (“flight-spark”) of Spark’s DataSource V2 interface found here:
https://github.com/rymurr/flight-spark-source. We w
11 matches
Mail list logo
