Re: [DISCUSS] Execute dataset scan tasks in distributed system

2020-07-31 Thread Micah Kornfield
Hi Hongze, > Does anyone ever try using Arrow Dataset API in a distributed system? My understanding is the Dataset project was initially was intended for running on a single node machine. It might be reasonable to extend it to be useable in a distributed system, but I'll let the primary

Re: [Gandiva] Additional types supported by abs, ceil, floor, etc.

2020-07-31 Thread Micah Kornfield
Hi Troy, I'm not an expert on gandiva but it does seem like having these functions for floating point/integer types makes sense (I'm surprised they aren't included already). Using the same output type as input types also makes sense (this seems consistent with both SQL and std library functions

Re: Likelyhood of 1.0.1 patch release

2020-07-31 Thread Micah Kornfield
As much as I would like to have it, I'm not sure we should include bigger bug fixes like the timezone one in a patch release (we should mostly be targeting regressions) On Friday, July 31, 2020, Neal Richardson wrote: > I just tagged a bunch of bugfixes with 1.0.1, as well as >

Re: Likelyhood of 1.0.1 patch release

2020-07-31 Thread Neal Richardson
I just tagged a bunch of bugfixes with 1.0.1, as well as https://issues.apache.org/jira/browse/ARROW-9528 (python timezones), which is not yet resolved. On Fri, Jul 31, 2020 at 9:41 AM Wes McKinney wrote: > No problem, feel free to add the patch release version as a Fix > Version so that it

Re: Likelyhood of 1.0.1 patch release

2020-07-31 Thread Wes McKinney
No problem, feel free to add the patch release version as a Fix Version so that it will get included later when the patches are assembled for cherry picking into a maint branch On Fri, Jul 31, 2020 at 8:44 AM Andy Grove wrote: > > There is a small packaging issue [1] with the Rust release that I

Re: Likelyhood of 1.0.1 patch release

2020-07-31 Thread Andy Grove
There is a small packaging issue [1] with the Rust release that I would like to patch if we're doing a 1.0.1 release. [1] https://issues.apache.org/jira/browse/ARROW-9600 On Thu, Jul 30, 2020 at 4:08 PM Neal Richardson wrote: > Makes sense to me. > > On Thu, Jul 30, 2020 at 1:50 PM Wes

[NIGHTLY] Arrow Build Report for Job nightly-2020-07-31-0

2020-07-31 Thread Crossbow
Arrow Build Report for Job nightly-2020-07-31-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-31-0 Failed Tasks: - conda-linux-gcc-py36-cuda: URL: