vhnguyenae opened a new issue, #1024:
URL: https://github.com/apache/iceberg-python/issues/1024
### Apache Iceberg version
0.7.0 (latest release)
### Please describe the bug 🐞
```python
from pyiceberg import catalog
from pyiceberg.expressions import EqualTo
from pandas import DataFrame
def read_data_from_table(project_hash: str, database: str, my_table: str) ->
DataFrame:
glue_catalog = catalog.load_glue(name='glue', conf={})
table = glue_catalog.load_table(f"{database}.{my_table}")
scan = table.scan(
row_filter=EqualTo('project_hash', project_hash),
selected_fields=("issue_id",)
)
print(scan)
return scan.to_pandas()
df_iceberg = read_data_from_table("my_project", "my_db", "my_table")
print(df_iceberg)
```
Same piece of code, it worked fine on version 0.6.1, meanwhile with version
0.7.0 I got this stack trace error:
```
Traceback (most recent call last):
File "/Users/vuhainguyen/Workspace/git/wux/tempo_script.py", line 34, in
read_data_from_table
return scan.to_pandas()
^^^^^^^^^^^^^^^^
File
"/Users/vuhainguyen/.pyenv/versions/3.11.5/lib/python3.11/site-packages/pyiceberg/table/__init__.py",
line 2043, in to_pandas
return self.to_arrow().to_pandas(**kwargs)
^^^^^^^^^^^^^^^
File
"/Users/vuhainguyen/.pyenv/versions/3.11.5/lib/python3.11/site-packages/pyiceberg/table/__init__.py",
line 2013, in to_arrow
return project_table(
^^^^^^^^^^^^^^
File
"/Users/vuhainguyen/.pyenv/versions/3.11.5/lib/python3.11/site-packages/pyiceberg/io/pyarrow.py",
line 1335, in project_table
if table_result := future.result():
^^^^^^^^^^^^^^^
File
"/Users/vuhainguyen/.pyenv/versions/3.11.5/lib/python3.11/concurrent/futures/_base.py",
line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File
"/Users/vuhainguyen/.pyenv/versions/3.11.5/lib/python3.11/concurrent/futures/_base.py",
line 401, in __get_result
raise self._exception
File
"/Users/vuhainguyen/.pyenv/versions/3.11.5/lib/python3.11/concurrent/futures/thread.py",
line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/Users/vuhainguyen/.pyenv/versions/3.11.5/lib/python3.11/site-packages/pyiceberg/io/pyarrow.py",
line 1237, in _task_to_table
batches = list(
^^^^^
File
"/Users/vuhainguyen/.pyenv/versions/3.11.5/lib/python3.11/site-packages/pyiceberg/io/pyarrow.py",
line 1222, in _task_to_record_batches
batch = arrow_table.to_batches()[0]
~~~~~~~~~~~~~~~~~~~~~~~~^^^
IndexError: list index out of range
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
