[jira] [Commented] (ARROW-11135) Using Maven Central artifacts as dependencies produce runtime errors

2021-04-13 Thread Kouhei Sutou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320752#comment-17320752 ] Kouhei Sutou commented on ARROW-11135: -- Gandiva developers such as [~praveenbingo]

[jira] [Resolved] (ARROW-12269) [JS] Move to eslint

2021-04-13 Thread Kouhei Sutou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kouhei Sutou resolved ARROW-12269. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 9992 [https://git

[jira] [Resolved] (ARROW-12309) [JS] Make es2015 bundles the default

2021-04-13 Thread Kouhei Sutou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kouhei Sutou resolved ARROW-12309. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 9961 [https://git

[jira] [Resolved] (ARROW-12304) [R] Update news and polish docs for 4.0

2021-04-13 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-12304. - Resolution: Fixed Issue resolved by pull request 10001 [https://github.com/apache/arrow/

[jira] [Updated] (ARROW-12373) [C++] max_partitions < 0 is accepted with no error

2021-04-13 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-12373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mauricio 'Pachá' Vargas Sepúlveda updated ARROW-12373: -- Description: from https://github.com/apache/arrow/blo

[jira] [Updated] (ARROW-12373) [C++] max_partitions < 0 is accepted with no error

2021-04-13 Thread Jonathan Keane (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Keane updated ARROW-12373: --- Description: from https://github.com/apache/arrow/blob/master/cpp/src/arrow/dataset/file_ba

[jira] [Updated] (ARROW-12373) [C++] max_partitions < 0 is accepted with no error

2021-04-13 Thread Jonathan Keane (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Keane updated ARROW-12373: --- Component/s: (was: R) > [C++] max_partitions < 0 is accepted with no error > ---

[jira] [Updated] (ARROW-12373) [C++] max_partitions < 0 is accepted with no error

2021-04-13 Thread Jonathan Keane (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Keane updated ARROW-12373: --- Summary: [C++] max_partitions < 0 is accepted with no error (was: max_partitions < 0 is acc

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-04-13 Thread Yordan Pavlov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320550#comment-17320550 ] Yordan Pavlov commented on ARROW-11897: --- I have finally been able to assemble enou

[jira] [Created] (ARROW-12373) max_partitions < 0 is accepted with no error

2021-04-13 Thread Jira
Mauricio 'Pachá' Vargas Sepúlveda created ARROW-12373: - Summary: max_partitions < 0 is accepted with no error Key: ARROW-12373 URL: https://issues.apache.org/jira/browse/ARROW-12373

[jira] [Created] (ARROW-12372) [R] Developer Docs followups

2021-04-13 Thread Jonathan Keane (Jira)
Jonathan Keane created ARROW-12372: -- Summary: [R] Developer Docs followups Key: ARROW-12372 URL: https://issues.apache.org/jira/browse/ARROW-12372 Project: Apache Arrow Issue Type: Improveme

[jira] [Updated] (ARROW-12371) [C++] Allow batch readahead to be processed in a "first-available" fashion instead of an "in order" fashion

2021-04-13 Thread Weston Pace (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weston Pace updated ARROW-12371: Description: The combination of EnumeratingGenerator and ResequencingGenerator can be used to pro

[jira] [Updated] (ARROW-12371) [C++] Allow batch readahead to be processed in a "first-available" fashion instead of an "in order" fashion

2021-04-13 Thread Weston Pace (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weston Pace updated ARROW-12371: Summary: [C++] Allow batch readahead to be processed in a "first-available" fashion instead of an

[jira] [Created] (ARROW-12371) [C++] Allow EnumeratingGenerator to be async-reentrant

2021-04-13 Thread Weston Pace (Jira)
Weston Pace created ARROW-12371: --- Summary: [C++] Allow EnumeratingGenerator to be async-reentrant Key: ARROW-12371 URL: https://issues.apache.org/jira/browse/ARROW-12371 Project: Apache Arrow I

[jira] [Resolved] (ARROW-12280) [Developer] Remove @-mentions from commit messages in merge tool

2021-04-13 Thread Diana Clarke (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Diana Clarke resolved ARROW-12280. -- Fix Version/s: (was: 5.0.0) 4.0.0 Resolution: Fixed > [Developer

[jira] [Commented] (ARROW-12280) [Developer] Remove @-mentions from commit messages in merge tool

2021-04-13 Thread Diana Clarke (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320534#comment-17320534 ] Diana Clarke commented on ARROW-12280: -- >From GitHub:  {quote} This should be fixe

[jira] [Comment Edited] (ARROW-11135) Using Maven Central artifacts as dependencies produce runtime errors

2021-04-13 Thread Julian Hyde (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320525#comment-17320525 ] Julian Hyde edited comment on ARROW-11135 at 4/13/21, 8:37 PM: ---

[jira] [Commented] (ARROW-11135) Using Maven Central artifacts as dependencies produce runtime errors

2021-04-13 Thread Julian Hyde (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320525#comment-17320525 ] Julian Hyde commented on ARROW-11135: - This issue is going to be a blocker for getti

[jira] [Commented] (ARROW-11729) [R] Add examples to the datasets documentation

2021-04-13 Thread Jonathan Keane (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320512#comment-17320512 ] Jonathan Keane commented on ARROW-11729: Are you still waiting for review on thi

[jira] [Closed] (ARROW-12363) Write tests for max_partitions argument

2021-04-13 Thread Jonathan Keane (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Keane closed ARROW-12363. -- Resolution: Duplicate > Write tests for max_partitions argument >

[jira] [Commented] (ARROW-12363) Write tests for max_partitions argument

2021-04-13 Thread Jonathan Keane (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320510#comment-17320510 ] Jonathan Keane commented on ARROW-12363: This work should be done as part of ARR

[jira] [Assigned] (ARROW-12316) [C++] Switch default memory allocator from jemalloc to mimalloc on macOS

2021-04-13 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson reassigned ARROW-12316: --- Assignee: Antoine Pitrou > [C++] Switch default memory allocator from jemalloc to m

[jira] [Updated] (ARROW-12316) [C++] Switch default memory allocator from jemalloc to mimalloc on macOS

2021-04-13 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-12316: Summary: [C++] Switch default memory allocator from jemalloc to mimalloc on macOS (was: [

[jira] [Resolved] (ARROW-12316) [C++] Switch default memory allocator from jemalloc to mimalloc

2021-04-13 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-12316. - Resolution: Fixed Issue resolved by pull request 10015 [https://github.com/apache/arrow/

[jira] [Assigned] (ARROW-12370) [R] Bindings for power kernel

2021-04-13 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mauricio 'Pachá' Vargas Sepúlveda reassigned ARROW-12370: - Assignee: Mauricio 'Pachá' Vargas Sepúlveda > [

[jira] [Created] (ARROW-12370) [R] Bindings for power kernel

2021-04-13 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-12370: --- Summary: [R] Bindings for power kernel Key: ARROW-12370 URL: https://issues.apache.org/jira/browse/ARROW-12370 Project: Apache Arrow Issue Type: New Fe

[jira] [Resolved] (ARROW-11070) [C++] Implement power / exponentiation compute kernel

2021-04-13 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson resolved ARROW-11070. - Fix Version/s: (was: 5.0.0) 4.0.0 Resolution: Fixed Issue

[jira] [Commented] (ARROW-11684) [Python] Publish macos m1 arm wheels for pypi

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320500#comment-17320500 ] Joris Van den Bossche commented on ARROW-11684: --- Pandas also doesn't yet h

[jira] [Updated] (ARROW-12336) [C++][Python] Empty Int64 array is of wrong size

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-12336: -- Fix Version/s: (was: 4.0.0) > [C++][Python] Empty Int64 array is of wrong

[jira] [Updated] (ARROW-12060) [Python] Enable calling compute functions on Expressions

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-12060: -- Fix Version/s: (was: 4.0.0) 5.0.0 > [Python] Enable cal

[jira] [Updated] (ARROW-12057) [Python] Remove direct usage of pandas' Block subclasses

2021-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-12057: --- Labels: pull-request-available (was: ) > [Python] Remove direct usage of pandas' Block subc

[jira] [Created] (ARROW-12369) [C++][Dataset] Scanner::TakeRows should push down the query if possible

2021-04-13 Thread David Li (Jira)
David Li created ARROW-12369: Summary: [C++][Dataset] Scanner::TakeRows should push down the query if possible Key: ARROW-12369 URL: https://issues.apache.org/jira/browse/ARROW-12369 Project: Apache Arrow

[jira] [Updated] (ARROW-11950) [C++][Compute] Add unary negative kernel

2021-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-11950: --- Labels: pull-request-available (was: ) > [C++][Compute] Add unary negative kernel > ---

[jira] [Commented] (ARROW-12280) [Developer] Remove @-mentions from commit messages in merge tool

2021-04-13 Thread Diana Clarke (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320335#comment-17320335 ] Diana Clarke commented on ARROW-12280: -- >From GitHub: {quote}For those of you still

[jira] [Resolved] (ARROW-12357) [Archery] Error running "crossbow submit ..."

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs resolved ARROW-12357. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 10011 [http

[jira] [Updated] (ARROW-12316) [C++] Switch default memory allocator from jemalloc to mimalloc

2021-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-12316: --- Labels: pull-request-available (was: ) > [C++] Switch default memory allocator from jemallo

[jira] [Commented] (ARROW-12316) [C++] Switch default memory allocator from jemalloc to mimalloc

2021-04-13 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320307#comment-17320307 ] Antoine Pitrou commented on ARROW-12316: It would be nice if the benchmark resul

[jira] [Commented] (ARROW-8999) [Python][C++] Non-deterministic segfault in "AMD64 MacOS 10.15 Python 3.7" build

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320308#comment-17320308 ] Krisztian Szucs commented on ARROW-8999: Yes, since pytest 5.0 and the most recen

[jira] [Comment Edited] (ARROW-12316) [C++] Switch default memory allocator from jemalloc to mimalloc

2021-04-13 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320299#comment-17320299 ] Neal Richardson edited comment on ARROW-12316 at 4/13/21, 4:32 PM: ---

[jira] [Commented] (ARROW-12316) [C++] Switch default memory allocator from jemalloc to mimalloc

2021-04-13 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320299#comment-17320299 ] Neal Richardson commented on ARROW-12316: - The idea we landed on was to make the

[jira] [Resolved] (ARROW-11839) [C++] Rewrite bit-unpacking optimizations using xsimd

2021-04-13 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-11839. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 9614 [https:/

[jira] [Updated] (ARROW-11061) [Rust] Validate array properties against schema

2021-04-13 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-11061: Fix Version/s: (was: 4.0.0) 5.0.0 > [Rust] Validate array propertie

[jira] [Resolved] (ARROW-12248) [C++] Allow static builds to change memory allocators

2021-04-13 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Li resolved ARROW-12248. -- Resolution: Fixed Issue resolved by pull request 9930 [https://github.com/apache/arrow/pull/9930] > [

[jira] [Commented] (ARROW-8999) [Python][C++] Non-deterministic segfault in "AMD64 MacOS 10.15 Python 3.7" build

2021-04-13 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320265#comment-17320265 ] Antoine Pitrou commented on ARROW-8999: --- I think it's enabled by default in recent

[jira] [Commented] (ARROW-8999) [Python][C++] Non-deterministic segfault in "AMD64 MacOS 10.15 Python 3.7" build

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320263#comment-17320263 ] Krisztian Szucs commented on ARROW-8999: Shouldn't we see a pytest faulthandler t

[jira] [Commented] (ARROW-12057) [Python] Remove direct usage of pandas' Block subclasses

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320260#comment-17320260 ] Krisztian Szucs commented on ARROW-12057: - [~jorisvandenbossche] is this somethi

[jira] [Updated] (ARROW-12280) [Developer] Remove @-mentions from commit messages in merge tool

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-12280: Fix Version/s: (was: 4.0.0) 5.0.0 > [Developer] Remove @-mentions f

[jira] [Commented] (ARROW-12280) [Developer] Remove @-mentions from commit messages in merge tool

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320258#comment-17320258 ] Krisztian Szucs commented on ARROW-12280: - Either way, we don't need to resolve

[jira] [Assigned] (ARROW-12330) [Developer] Restore values in counters column of Archery benchmark

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs reassigned ARROW-12330: --- Assignee: Kazuaki Ishizaki (was: Krisztian Szucs) > [Developer] Restore values in

[jira] [Assigned] (ARROW-12330) [Developer] Restore values in counters column of Archery benchmark

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs reassigned ARROW-12330: --- Assignee: Krisztian Szucs (was: Kazuaki Ishizaki) > [Developer] Restore values in

[jira] [Assigned] (ARROW-12262) [Doc][C++][Python] Docs built and pushed with S3 and Flight disabled

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs reassigned ARROW-12262: --- Assignee: Antoine Pitrou (was: Krisztian Szucs) > [Doc][C++][Python] Docs built an

[jira] [Assigned] (ARROW-12262) [Doc][C++][Python] Docs built and pushed with S3 and Flight disabled

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs reassigned ARROW-12262: --- Assignee: Krisztian Szucs (was: Antoine Pitrou) > [Doc][C++][Python] Docs built an

[jira] [Commented] (ARROW-12316) [C++] Switch default memory allocator from jemalloc to mimalloc

2021-04-13 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320247#comment-17320247 ] Antoine Pitrou commented on ARROW-12316: Also cc [~uwe] > [C++] Switch default

[jira] [Commented] (ARROW-12316) [C++] Switch default memory allocator from jemalloc to mimalloc

2021-04-13 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320246#comment-17320246 ] Antoine Pitrou commented on ARROW-12316: Feel free to post your final decision h

[jira] [Commented] (ARROW-12100) [C#] Cannot round-trip record batch with PyArrow

2021-04-13 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320245#comment-17320245 ] Antoine Pitrou commented on ARROW-12100: There is a JSON representation format t

[jira] [Updated] (ARROW-11477) [R][Doc] Reorganize and improve README and vignette content

2021-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-11477: --- Labels: pull-request-available (was: ) > [R][Doc] Reorganize and improve README and vignett

[jira] [Commented] (ARROW-12060) [Python] Enable calling compute functions on Expressions

2021-04-13 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320238#comment-17320238 ] David Li commented on ARROW-12060: -- >From discussion in ARROW-12058, we may want to wai

[jira] [Created] (ARROW-12368) [MATLAB] create a matlab2mex function

2021-04-13 Thread Sarah Gilmore (Jira)
Sarah Gilmore created ARROW-12368: - Summary: [MATLAB] create a matlab2mex function Key: ARROW-12368 URL: https://issues.apache.org/jira/browse/ARROW-12368 Project: Apache Arrow Issue Type: Ta

[jira] [Created] (ARROW-12367) [C++] Stop producing when PushGenerator was destroyed

2021-04-13 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-12367: -- Summary: [C++] Stop producing when PushGenerator was destroyed Key: ARROW-12367 URL: https://issues.apache.org/jira/browse/ARROW-12367 Project: Apache Arrow

[jira] [Created] (ARROW-12366) [C++] Investigate PushGenerator::Producer auto-close

2021-04-13 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-12366: -- Summary: [C++] Investigate PushGenerator::Producer auto-close Key: ARROW-12366 URL: https://issues.apache.org/jira/browse/ARROW-12366 Project: Apache Arrow

[jira] [Commented] (ARROW-12358) [C++][Python][R][Dataset] Control overwriting vs appending when writing to existing dataset

2021-04-13 Thread Lance Dacey (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320221#comment-17320221 ] Lance Dacey commented on ARROW-12358: - I think that having an "overwrite" option wou

[jira] [Commented] (ARROW-10440) [C++][Dataset][Python] Add a callback to visit file writers just before Finish()

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320199#comment-17320199 ] Joris Van den Bossche commented on ARROW-10440: --- ([~ldacey] since I asked

[jira] [Commented] (ARROW-9434) [C++] Store type_code information in UnionScalar::value

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320198#comment-17320198 ] Krisztian Szucs commented on ARROW-9434: Postponed to 5.0 > [C++] Store type_cod

[jira] [Updated] (ARROW-9434) [C++] Store type_code information in UnionScalar::value

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-9434: --- Fix Version/s: (was: 4.0.0) 5.0.0 > [C++] Store type_code information

[jira] [Updated] (ARROW-9295) [Archery] Support rust clippy in the lint command

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-9295: --- Fix Version/s: (was: 4.0.0) 5.0.0 > [Archery] Support rust clippy in t

[jira] [Updated] (ARROW-9435) [CI] Push docker images from nightly builds

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-9435: --- Fix Version/s: (was: 4.0.0) 5.0.0 > [CI] Push docker images from night

[jira] [Closed] (ARROW-4784) [C++][CI] Re-enable flaky mingw tests.

2021-04-13 Thread Krisztian Szucs (Jira)
[ https://issues.apache.org/jira/browse/ARROW-4784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs closed ARROW-4784. -- Assignee: Kouhei Sutou Resolution: Fixed AFAIK we've moved the mingw tests to GHA where w

[jira] [Comment Edited] (ARROW-7706) [Python] saving a dataframe to the same partitioned location silently doubles the data

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320194#comment-17320194 ] Joris Van den Bossche edited comment on ARROW-7706 at 4/13/21, 2:03 PM: ---

[jira] [Commented] (ARROW-7706) [Python] saving a dataframe to the same partitioned location silently doubles the data

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320194#comment-17320194 ] Joris Van den Bossche commented on ARROW-7706: -- For reference here, I opened

[jira] [Commented] (ARROW-10695) [C++][Dataset] Allow to use a UUID in the basename_template when writing a dataset

2021-04-13 Thread Lance Dacey (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320192#comment-17320192 ] Lance Dacey commented on ARROW-10695: - [~jorisvandenbossche] partition_filename_cb:

[jira] [Created] (ARROW-12365) [Python] [Dataset] Add partition_filename_cb to ds.write_dataset()

2021-04-13 Thread Lance Dacey (Jira)
updated_at timestamp and drop duplicates on the unique constraint, then partition and save it with partition_filename_cb. In the example below, if I partition by the "date_id" column, then my dataset structure will be "/date_id=202104123/20210413.parquet" {code:java}  

[jira] [Comment Edited] (ARROW-12358) [C++][Python][R][Dataset] Control overwriting vs appending when writing to existing dataset

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320191#comment-17320191 ] Joris Van den Bossche edited comment on ARROW-12358 at 4/13/21, 1:57 PM: -

[jira] [Commented] (ARROW-12358) [C++][Python][R][Dataset] Control overwriting vs appending when writing to existing dataset

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320191#comment-17320191 ] Joris Van den Bossche commented on ARROW-12358: --- As mentioned by [~ldacey]

[jira] [Commented] (ARROW-10695) [C++][Dataset] Allow to use a UUID in the basename_template when writing a dataset

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320183#comment-17320183 ] Joris Van den Bossche commented on ARROW-10695: --- > I think the remaining i

[jira] [Created] (ARROW-12364) [Python] [Dataset] Add metadata_collector option to ds.write_dataset()

2021-04-13 Thread Lance Dacey (Jira)
Lance Dacey created ARROW-12364: --- Summary: [Python] [Dataset] Add metadata_collector option to ds.write_dataset() Key: ARROW-12364 URL: https://issues.apache.org/jira/browse/ARROW-12364 Project: Apache

[jira] [Comment Edited] (ARROW-10695) [C++][Dataset] Allow to use a UUID in the basename_template when writing a dataset

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320167#comment-17320167 ] Joris Van den Bossche edited comment on ARROW-10695 at 4/13/21, 1:33 PM: -

[jira] [Assigned] (ARROW-12363) Write tests for max_partitions argument

2021-04-13 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mauricio 'Pachá' Vargas Sepúlveda reassigned ARROW-12363: - Assignee: Mauricio 'Pachá' Vargas Sepúlveda > W

[jira] [Created] (ARROW-12363) Write tests for max_partitions argument

2021-04-13 Thread Jira
Mauricio 'Pachá' Vargas Sepúlveda created ARROW-12363: - Summary: Write tests for max_partitions argument Key: ARROW-12363 URL: https://issues.apache.org/jira/browse/ARROW-12363 Proj

[jira] [Assigned] (ARROW-12332) [Rust] [Ballista] Api server for scheduler

2021-04-13 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove reassigned ARROW-12332: -- Assignee: (was: Sathis Kumar) > [Rust] [Ballista] Api server for scheduler >

[jira] [Assigned] (ARROW-12332) [Rust] [Ballista] Api server for scheduler

2021-04-13 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove reassigned ARROW-12332: -- Assignee: Sathis Kumar > [Rust] [Ballista] Api server for scheduler > ---

[jira] [Updated] (ARROW-12361) [Rust] [DataFusion] Allow users to override physical optimization rules

2021-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-12361: --- Labels: pull-request-available (was: ) > [Rust] [DataFusion] Allow users to override physic

[jira] [Created] (ARROW-12362) [Rust] [DataFusion] topk_query test failure

2021-04-13 Thread Andy Grove (Jira)
Andy Grove created ARROW-12362: -- Summary: [Rust] [DataFusion] topk_query test failure Key: ARROW-12362 URL: https://issues.apache.org/jira/browse/ARROW-12362 Project: Apache Arrow Issue Type: Im

[jira] [Created] (ARROW-12361) [Rust] [DataFusion] Allow users to override physical optimization rules

2021-04-13 Thread Andy Grove (Jira)
Andy Grove created ARROW-12361: -- Summary: [Rust] [DataFusion] Allow users to override physical optimization rules Key: ARROW-12361 URL: https://issues.apache.org/jira/browse/ARROW-12361 Project: Apache A

[jira] [Commented] (ARROW-10695) [C++][Dataset] Allow to use a UUID in the basename_template when writing a dataset

2021-04-13 Thread Lance Dacey (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320167#comment-17320167 ] Lance Dacey commented on ARROW-10695: - I have been creating my own basename_template

[jira] [Resolved] (ARROW-12332) [Rust] [Ballista] Api server for scheduler

2021-04-13 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove resolved ARROW-12332. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 9987 [https://github.

[jira] [Commented] (ARROW-12359) [C++] Deprecate or remove FileSystem::OpenAppendStream

2021-04-13 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320155#comment-17320155 ] Antoine Pitrou commented on ARROW-12359: Not unreasonable, no. The fact that it

[jira] [Resolved] (ARROW-12288) [C++] Create Scanner interface

2021-04-13 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Li resolved ARROW-12288. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 9947 [https://github.com/

[jira] [Updated] (ARROW-12360) [Dev] Unify source code formatting of Archery

2021-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-12360: --- Labels: pull-request-available (was: ) > [Dev] Unify source code formatting of Archery > -

[jira] [Assigned] (ARROW-12288) [C++] Create Scanner interface

2021-04-13 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Li reassigned ARROW-12288: Assignee: Weston Pace > [C++] Create Scanner interface > -- > >

[jira] [Created] (ARROW-12360) [Dev] Unify source code formatting of Archery

2021-04-13 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-12360: --- Summary: [Dev] Unify source code formatting of Archery Key: ARROW-12360 URL: https://issues.apache.org/jira/browse/ARROW-12360 Project: Apache Arrow I

[jira] [Commented] (ARROW-12359) [C++] Deprecate or remove FileSystem::OpenAppendStream

2021-04-13 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320151#comment-17320151 ] David Li commented on ARROW-12359: -- For our purposes, yes, it seems unlikely we'll have

[jira] [Commented] (ARROW-12359) [C++] Deprecate or remove FileSystem::OpenAppendStream

2021-04-13 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320141#comment-17320141 ] Antoine Pitrou commented on ARROW-12359: [~lidavidm] [~jorisvandenbossche] Thoug

[jira] [Created] (ARROW-12359) [C++] Deprecate or remove FileSystem::OpenAppendStream

2021-04-13 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-12359: -- Summary: [C++] Deprecate or remove FileSystem::OpenAppendStream Key: ARROW-12359 URL: https://issues.apache.org/jira/browse/ARROW-12359 Project: Apache Arrow

[jira] [Commented] (ARROW-10695) [C++][Dataset] Allow to use a UUID in the basename_template when writing a dataset

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320136#comment-17320136 ] Joris Van den Bossche commented on ARROW-10695: --- > Side note: perhaps we c

[jira] [Comment Edited] (ARROW-10695) [C++][Dataset] Allow to use a UUID in the basename_template when writing a dataset

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320136#comment-17320136 ] Joris Van den Bossche edited comment on ARROW-10695 at 4/13/21, 12:29 PM:

[jira] [Created] (ARROW-12358) [C++][Python][R][Dataset] Control overwriting vs appending when writing to existing dataset

2021-04-13 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-12358: - Summary: [C++][Python][R][Dataset] Control overwriting vs appending when writing to existing dataset Key: ARROW-12358 URL: https://issues.apache.org/jira/browse/

[jira] [Commented] (ARROW-10695) [C++][Dataset] Allow to use a UUID in the basename_template when writing a dataset

2021-04-13 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320130#comment-17320130 ] Antoine Pitrou commented on ARROW-10695: Side note: perhaps we could still imple

[jira] [Comment Edited] (ARROW-10695) [C++][Dataset] Allow to use a UUID in the basename_template when writing a dataset

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320103#comment-17320103 ] Joris Van den Bossche edited comment on ARROW-10695 at 4/13/21, 12:11 PM:

[jira] [Commented] (ARROW-10695) [C++][Dataset] Allow to use a UUID in the basename_template when writing a dataset

2021-04-13 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320115#comment-17320115 ] Antoine Pitrou commented on ARROW-10695: I think this should definitely be the r

[jira] [Commented] (ARROW-10695) [C++][Dataset] Allow to use a UUID in the basename_template when writing a dataset

2021-04-13 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17320112#comment-17320112 ] Joris Van den Bossche commented on ARROW-10695: --- bq. Is there a separate i

  1   2   >