Re: Arrow Flight + Go, Arrow for Realtime

Having spent a few solid days looking at Finos Perspective a while back, I think it has a lot of potential, and also a few rough edges. Like JS Arrow, the documentation is sparse and experimentation is required. It does handle Arrow data well with possibly some caveats. One is, if I recall

Re: [DISCUSS] Plasma appears to have been forked, consider deprecating pyarrow.serialization

To answer Wes's question, the Plasma inside of Ray is not currently usable in a C++ library context, though it wouldn't be impossible to make that happen. I (or someone) could conduct a simple poll via Google Forms on the user mailing list to gauge demand if we are concerned about breaking a lot

Subject: [VOTE] Release Apache Arrow 1.0.1 - RC0

Hi, I would like to propose the following release candidate (RC0) of Apache Arrow version 1.0.1. This is a release consisting of 31 resolved JIRA issues[1]. This release candidate is based on commit: 886d87bdea78ce80e39a4b5b6fd6ca6042474c5f [2] The source release rc0 is hosted at [3]. The

Re: Polymorphism in DataFusion

Thanks Andrew, I am not sure I articulated this well enough, though, as I did not specify the type of polymorphism that I was thinking about. xD My question was/is about whether we should accept functions whose return type is known during planning, and constant during execution, or whether their

Re: Polymorphism in DataFusion

In my opinion, I suggest we do not continue down the path of (runtime) polymorphic functions unless a compelling use case for them can be articulated. You have done a great job articulating some of the implementation challenges, but I personally struggle to describe when, as a user of DataFusion,

Re: Building an executable with arrow flight (C++)

Thank you Wes - that worked - I have updated the sample repo, should the question come up again. > On Aug 17, 2020, at 2:06 PM, Wes McKinney wrote: > > OK. I understand the problem now. You need to add an imported static > library for libarrow_bundled_dependencies.a and include that when >

Re: Building an executable with arrow flight (C++)

OK. I understand the problem now. You need to add an imported static library for libarrow_bundled_dependencies.a and include that when linking. On Mon, Aug 17, 2020 at 12:47 PM Radu Teodorescu wrote: > > ok - here is a simple illustration of my challenges building with arrow > flight:

Re: Building an executable with arrow flight (C++)

ok - here is a simple illustration of my challenges building with arrow flight: https://github.com/raduteo/hello_flight The above actually works fine on mac but fails on linux with a number of dependency failures (at first in ares and absl but they

Polymorphism in DataFusion

Hi, Recently, I have been contributing to DataFusion, and I would like to bring to your attention a question that I faced while PRing to DataFusion that IMO needs some alignment :) DataFusion supports scalar UDFs: functions that expect a type, return a type, and performs some operation on the

1.0.1 patch release status

Hi, It took me a couple of attempts to cherry pick the selected jira issues' patches to the maint-1.0.x maintenance branch although I had to exclude a couple of patches, namely: - https://issues.apache.org/jira/browse/ARROW-9716 - https://issues.apache.org/jira/browse/ARROW-9714 -

[NIGHTLY] Arrow Build Report for Job nightly-2020-08-17-0

Arrow Build Report for Job nightly-2020-08-17-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-08-17-0 Failed Tasks: - test-conda-cpp-valgrind: URL:

Re: [DISCUSS] Plasma appears to have been forked, consider deprecating pyarrow.serialization

Le 15/08/2020 à 17:56, Wes McKinney a écrit : > > What isn't clear is whether the Plasma that's in Ray is usable in a > C++ library context (e.g. what we currently ship as libplasma-dev e.g. > on Ubuntu/Debian). That seems still useful, but if the project isn't > being actively maintained /