[jira] [Updated] (ARROW-6281) [Python] Produce chunked arrays for nested types in pyarrow.array
[ https://issues.apache.org/jira/browse/ARROW-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-6281: Fix Version/s: (was: 1.0.0) > [Python] Produce chunked arrays for nested types in pyarrow.array > - > > Key: ARROW-6281 > URL: https://issues.apache.org/jira/browse/ARROW-6281 > Project: Apache Arrow > Issue Type: Improvement > Components: Python >Reporter: Wes McKinney >Priority: Major > > As follow up to ARROW-5028 and other issues, in a case like > {code} > vals = [['x' * 1024]] * ((2 << 20) + 1) > arr = pa.array(vals) > {code} > The child array of the ListArray cannot hold all of the string data. After > the patch for ARROW-5028, an exception is raised rather than returning a > malformed array. We could (with some effort) instead produce a chunked array > of list type -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ARROW-6281) [Python] Produce chunked arrays for nested types in pyarrow.array
[ https://issues.apache.org/jira/browse/ARROW-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-6281: Fix Version/s: 2.0.0 > [Python] Produce chunked arrays for nested types in pyarrow.array > - > > Key: ARROW-6281 > URL: https://issues.apache.org/jira/browse/ARROW-6281 > Project: Apache Arrow > Issue Type: Improvement > Components: Python >Reporter: Wes McKinney >Priority: Major > Fix For: 2.0.0 > > > As follow up to ARROW-5028 and other issues, in a case like > {code} > vals = [['x' * 1024]] * ((2 << 20) + 1) > arr = pa.array(vals) > {code} > The child array of the ListArray cannot hold all of the string data. After > the patch for ARROW-5028, an exception is raised rather than returning a > malformed array. We could (with some effort) instead produce a chunked array > of list type -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ARROW-6281) [Python] Produce chunked arrays for nested types in pyarrow.array
[ https://issues.apache.org/jira/browse/ARROW-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-6281: Fix Version/s: (was: 0.16.0) 1.0.0 > [Python] Produce chunked arrays for nested types in pyarrow.array > - > > Key: ARROW-6281 > URL: https://issues.apache.org/jira/browse/ARROW-6281 > Project: Apache Arrow > Issue Type: Improvement > Components: Python >Reporter: Wes McKinney >Priority: Major > Fix For: 1.0.0 > > > As follow up to ARROW-5028 and other issues, in a case like > {code} > vals = [['x' * 1024]] * ((2 << 20) + 1) > arr = pa.array(vals) > {code} > The child array of the ListArray cannot hold all of the string data. After > the patch for ARROW-5028, an exception is raised rather than returning a > malformed array. We could (with some effort) instead produce a chunked array > of list type -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ARROW-6281) [Python] Produce chunked arrays for nested types in pyarrow.array
[ https://issues.apache.org/jira/browse/ARROW-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-6281: -- Fix Version/s: 1.0.0 > [Python] Produce chunked arrays for nested types in pyarrow.array > - > > Key: ARROW-6281 > URL: https://issues.apache.org/jira/browse/ARROW-6281 > Project: Apache Arrow > Issue Type: Improvement > Components: Python >Reporter: Wes McKinney >Priority: Major > Fix For: 1.0.0 > > > As follow up to ARROW-5028 and other issues, in a case like > {code} > vals = [['x' * 1024]] * ((2 << 20) + 1) > arr = pa.array(vals) > {code} > The child array of the ListArray cannot hold all of the string data. After > the patch for ARROW-5028, an exception is raised rather than returning a > malformed array. We could (with some effort) instead produce a chunked array > of list type -- This message was sent by Atlassian Jira (v8.3.4#803005)