[jira] [Updated] (ARROW-5139) [Python/C++] Empty column selection no longer restores index
[ https://issues.apache.org/jira/browse/ARROW-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rok Mihevc updated ARROW-5139: -- External issue URL: https://github.com/apache/arrow/issues/21621 > [Python/C++] Empty column selection no longer restores index > > > Key: ARROW-5139 > URL: https://issues.apache.org/jira/browse/ARROW-5139 > Project: Apache Arrow > Issue Type: Bug > Components: C++, Python >Affects Versions: 0.12.1 >Reporter: Florian Jetter >Priority: Minor > Labels: parquet > > The index of a dataframe is no longer reconstructed when using empty column > selection. This is a regression to 0.12.1 and probably only happens for > pd.RangeIndex > {code:python} > import pandas as pd > import pyarrow as pa > import pyarrow.parquet as pq > from kartothek.serialization import ParquetSerializer > from storefact import get_store_from_url > print(pa.__version__) > df = pd.DataFrame( > {"a": [1, 2]} > ) > print(df.index) > table = pa.Table.from_pandas(df) > buf = pa.BufferOutputStream() > pq.write_table(table, buf) > reader = pa.BufferReader(buf.getvalue().to_pybytes()) > table_restored = pq.read_pandas(reader, columns=[]) > df_restored = table_restored.to_pandas() > print(len(df_restored)) > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (ARROW-5139) [Python/C++] Empty column selection no longer restores index
[ https://issues.apache.org/jira/browse/ARROW-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-5139: Fix Version/s: (was: 5.0.0) > [Python/C++] Empty column selection no longer restores index > > > Key: ARROW-5139 > URL: https://issues.apache.org/jira/browse/ARROW-5139 > Project: Apache Arrow > Issue Type: Bug > Components: C++, Python >Affects Versions: 0.12.1 >Reporter: Florian Jetter >Priority: Minor > Labels: parquet > > The index of a dataframe is no longer reconstructed when using empty column > selection. This is a regression to 0.12.1 and probably only happens for > pd.RangeIndex > {code:python} > import pandas as pd > import pyarrow as pa > import pyarrow.parquet as pq > from kartothek.serialization import ParquetSerializer > from storefact import get_store_from_url > print(pa.__version__) > df = pd.DataFrame( > {"a": [1, 2]} > ) > print(df.index) > table = pa.Table.from_pandas(df) > buf = pa.BufferOutputStream() > pq.write_table(table, buf) > reader = pa.BufferReader(buf.getvalue().to_pybytes()) > table_restored = pq.read_pandas(reader, columns=[]) > df_restored = table_restored.to_pandas() > print(len(df_restored)) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ARROW-5139) [Python/C++] Empty column selection no longer restores index
[ https://issues.apache.org/jira/browse/ARROW-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5139: - Fix Version/s: (was: 4.0.0) 5.0.0 > [Python/C++] Empty column selection no longer restores index > > > Key: ARROW-5139 > URL: https://issues.apache.org/jira/browse/ARROW-5139 > Project: Apache Arrow > Issue Type: Bug > Components: C++, Python >Affects Versions: 0.12.1 >Reporter: Florian Jetter >Priority: Minor > Labels: parquet > Fix For: 5.0.0 > > > The index of a dataframe is no longer reconstructed when using empty column > selection. This is a regression to 0.12.1 and probably only happens for > pd.RangeIndex > {code:python} > import pandas as pd > import pyarrow as pa > import pyarrow.parquet as pq > from kartothek.serialization import ParquetSerializer > from storefact import get_store_from_url > print(pa.__version__) > df = pd.DataFrame( > {"a": [1, 2]} > ) > print(df.index) > table = pa.Table.from_pandas(df) > buf = pa.BufferOutputStream() > pq.write_table(table, buf) > reader = pa.BufferReader(buf.getvalue().to_pybytes()) > table_restored = pq.read_pandas(reader, columns=[]) > df_restored = table_restored.to_pandas() > print(len(df_restored)) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ARROW-5139) [Python/C++] Empty column selection no longer restores index
[ https://issues.apache.org/jira/browse/ARROW-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-5139: Fix Version/s: 4.0.0 > [Python/C++] Empty column selection no longer restores index > > > Key: ARROW-5139 > URL: https://issues.apache.org/jira/browse/ARROW-5139 > Project: Apache Arrow > Issue Type: Bug > Components: C++, Python >Affects Versions: 0.12.1 >Reporter: Florian Jetter >Priority: Minor > Labels: parquet > Fix For: 4.0.0 > > > The index of a dataframe is no longer reconstructed when using empty column > selection. This is a regression to 0.12.1 and probably only happens for > pd.RangeIndex > {code:python} > import pandas as pd > import pyarrow as pa > import pyarrow.parquet as pq > from kartothek.serialization import ParquetSerializer > from storefact import get_store_from_url > print(pa.__version__) > df = pd.DataFrame( > {"a": [1, 2]} > ) > print(df.index) > table = pa.Table.from_pandas(df) > buf = pa.BufferOutputStream() > pq.write_table(table, buf) > reader = pa.BufferReader(buf.getvalue().to_pybytes()) > table_restored = pq.read_pandas(reader, columns=[]) > df_restored = table_restored.to_pandas() > print(len(df_restored)) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ARROW-5139) [Python/C++] Empty column selection no longer restores index
[ https://issues.apache.org/jira/browse/ARROW-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson updated ARROW-5139: --- Fix Version/s: (was: 1.0.0) > [Python/C++] Empty column selection no longer restores index > > > Key: ARROW-5139 > URL: https://issues.apache.org/jira/browse/ARROW-5139 > Project: Apache Arrow > Issue Type: Bug > Components: C++, Python >Affects Versions: 0.12.1 >Reporter: Florian Jetter >Priority: Minor > Labels: parquet > > The index of a dataframe is no longer reconstructed when using empty column > selection. This is a regression to 0.12.1 and probably only happens for > pd.RangeIndex > {code:python} > import pandas as pd > import pyarrow as pa > import pyarrow.parquet as pq > from kartothek.serialization import ParquetSerializer > from storefact import get_store_from_url > print(pa.__version__) > df = pd.DataFrame( > {"a": [1, 2]} > ) > print(df.index) > table = pa.Table.from_pandas(df) > buf = pa.BufferOutputStream() > pq.write_table(table, buf) > reader = pa.BufferReader(buf.getvalue().to_pybytes()) > table_restored = pq.read_pandas(reader, columns=[]) > df_restored = table_restored.to_pandas() > print(len(df_restored)) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)