Re: [I] Iceberg table not able to read data from S3 after few hours using Athena . [iceberg]

2024-09-02 Thread via GitHub
yashgangrades commented on issue #9684: URL: https://github.com/apache/iceberg/issues/9684#issuecomment-2325634504 I am also facing the same issue. I am using Glue to create an Iceberg table from raw data in S3, but when I run a `SELECT *` query, it returns 0 results. -- This is an automa

Re: [I] Iceberg table not able to read data from S3 after few hours using Athena . [iceberg]

2024-07-26 Thread via GitHub
nastra commented on issue #9684: URL: https://github.com/apache/iceberg/issues/9684#issuecomment-2252590320 @jackye1995 could you take a look at this please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [I] Iceberg table not able to read data from S3 after few hours using Athena . [iceberg]

2024-07-26 Thread via GitHub
abhiips07 commented on issue #9684: URL: https://github.com/apache/iceberg/issues/9684#issuecomment-2252526309 Hi, Is this issue resolved? I m also using AWS Athena for creating the Iceberg Table. My table gets created but when i run Select on table I get no result. `CREATE TABLE ela

Re: [I] Iceberg table not able to read data from S3 after few hours using Athena . [iceberg]

2024-02-09 Thread via GitHub
ajsalunkhe commented on issue #9684: URL: https://github.com/apache/iceberg/issues/9684#issuecomment-1935894752 Just to share more details, using below pyspark code to write data to Iceberg table on EMR cluster. **dataframe.writeTo("..").overwritePartitions()** -- This is an a

Re: [I] Iceberg table not able to read data from S3 after few hours using Athena . [iceberg]

2024-02-09 Thread via GitHub
nastra commented on issue #9684: URL: https://github.com/apache/iceberg/issues/9684#issuecomment-1935563328 It seems suspicious that there are no snapshots anymore. Iceberg writes a new snapshot on any operations that would modify data. Can you please share your full catalog configuration?

Re: [I] Iceberg table not able to read data from S3 after few hours using Athena . [iceberg]

2024-02-09 Thread via GitHub
ajsalunkhe commented on issue #9684: URL: https://github.com/apache/iceberg/issues/9684#issuecomment-1935525146 The files don't get cleaned up, I can still see them at S3 location, while the table doesn't loads it on querying. -- This is an automated message from the Apache Git Service. T

Re: [I] Iceberg table not able to read data from S3 after few hours using Athena . [iceberg]

2024-02-09 Thread via GitHub
nastra commented on issue #9684: URL: https://github.com/apache/iceberg/issues/9684#issuecomment-1935495525 @ajsalunkhe at this point it's difficult to say what's going wrong here. Do you have any particular bucket policies enabled or anything else that would clean up files? -- This is a

Re: [I] Iceberg table not able to read data from S3 after few hours using Athena . [iceberg]

2024-02-08 Thread via GitHub
ajsalunkhe commented on issue #9684: URL: https://github.com/apache/iceberg/issues/9684#issuecomment-1935443901 We are creating iceberg table using below sql query using Athena in Glue Catalog: **CREATE TABLE db_name.table_name(col1 string, col2 string, col3 string) PARTITIONED BY

Re: [I] Iceberg table not able to read data from S3 after few hours using Athena . [iceberg]

2024-02-08 Thread via GitHub
nastra commented on issue #9684: URL: https://github.com/apache/iceberg/issues/9684#issuecomment-1933759635 @ajsalunkhe it's not clear from the description whether this is an Iceberg or an Athena-related issue. Can you elaborate and add a few more details which queries you ran exactly that