Re: [PR] Add support to use regional endpoints for STS client while using assume role [iceberg]

2024-08-24 Thread via GitHub
munendrasn closed pull request #10289: Add support to use regional endpoints for STS client while using assume role URL: https://github.com/apache/iceberg/pull/10289 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Add support to use regional endpoints for STS client while using assume role [iceberg]

2024-08-24 Thread via GitHub
munendrasn commented on PR #10289: URL: https://github.com/apache/iceberg/pull/10289#issuecomment-2308678240 As AWS sdk is [defaulting](https://docs.aws.amazon.com/sdkref/latest/guide/feature-sts-regionalized-endpoints.html) to `regional` endpoint in latest version, which I have validated w

[PR] Build: Bump org.xerial:sqlite-jdbc from 3.46.0.1 to 3.46.1.0 [iceberg]

2024-08-24 Thread via GitHub
dependabot[bot] opened a new pull request, #11007: URL: https://github.com/apache/iceberg/pull/11007 Bumps [org.xerial:sqlite-jdbc](https://github.com/xerial/sqlite-jdbc) from 3.46.0.1 to 3.46.1.0. Release notes Sourced from https://github.com/xerial/sqlite-jdbc/releases";>org.xeri

[PR] Build: Bump software.amazon.awssdk:bom from 2.27.7 to 2.27.12 [iceberg]

2024-08-24 Thread via GitHub
dependabot[bot] opened a new pull request, #11006: URL: https://github.com/apache/iceberg/pull/11006 Bumps software.amazon.awssdk:bom from 2.27.7 to 2.27.12. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=softw

[PR] Build: Bump org.apache.commons:commons-compress from 1.27.0 to 1.27.1 [iceberg]

2024-08-24 Thread via GitHub
dependabot[bot] opened a new pull request, #11005: URL: https://github.com/apache/iceberg/pull/11005 Bumps org.apache.commons:commons-compress from 1.27.0 to 1.27.1. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-na

[PR] Build: Bump com.palantir.baseline:gradle-baseline-java from 5.61.0 to 5.64.0 [iceberg]

2024-08-24 Thread via GitHub
dependabot[bot] opened a new pull request, #11004: URL: https://github.com/apache/iceberg/pull/11004 Bumps [com.palantir.baseline:gradle-baseline-java](https://github.com/palantir/gradle-baseline) from 5.61.0 to 5.64.0. Release notes Sourced from https://github.com/palantir/gradle

[PR] Build: Bump jetty from 11.0.22 to 11.0.23 [iceberg]

2024-08-24 Thread via GitHub
dependabot[bot] opened a new pull request, #11003: URL: https://github.com/apache/iceberg/pull/11003 Bumps `jetty` from 11.0.22 to 11.0.23. Updates `org.eclipse.jetty:jetty-server` from 11.0.22 to 11.0.23 Updates `org.eclipse.jetty:jetty-servlet` from 11.0.22 to 11.0.23 D

Re: [I] Support partitioned writes [iceberg-python]

2024-08-24 Thread via GitHub
RLashofRegas commented on issue #208: URL: https://github.com/apache/iceberg-python/issues/208#issuecomment-2308652459 @Fokko any expected timeline you can share on support for bucket transform? Is there a separate issue I can follow for that? Thanks for all the hard work so far!! -- Thi

[PR] Build: Bump mkdocs-material from 9.5.31 to 9.5.33 [iceberg]

2024-08-24 Thread via GitHub
dependabot[bot] opened a new pull request, #11002: URL: https://github.com/apache/iceberg/pull/11002 Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.5.31 to 9.5.33. Release notes Sourced from https://github.com/squidfunk/mkdocs-material/releases";>mkdoc

Re: [PR] AWS: Include http-auth-aws-crt module into iceberg-aws-bundle [iceberg]

2024-08-24 Thread via GitHub
amogh-jahagirdar merged PR #10972: URL: https://github.com/apache/iceberg/pull/10972 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [I] 'software.amazon.awssdk:http-auth-aws-crt' module is missing in iceberg-aws-bundle jar [iceberg]

2024-08-24 Thread via GitHub
amogh-jahagirdar closed issue #10967: 'software.amazon.awssdk:http-auth-aws-crt' module is missing in iceberg-aws-bundle jar URL: https://github.com/apache/iceberg/issues/10967 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Build: switch to slf4j-simple 2.x for test implementation dependency [iceberg]

2024-08-24 Thread via GitHub
stevenzwu commented on PR #11001: URL: https://github.com/apache/iceberg/pull/11001#issuecomment-2308591224 test logging seems to have been broken since `apache-iceberg-1.4.0` by mock nets server ``` org.slf4j:slf4j-api:2.0.6 +--- org.mock-server:mockserver-client-java:5.15.0

Re: [I] Support Rest Catalog Metrics Endpoint [iceberg-python]

2024-08-24 Thread via GitHub
github-actions[bot] commented on issue #474: URL: https://github.com/apache/iceberg-python/issues/474#issuecomment-2308585675 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity oc

Re: [PR] Flink: Replace Flink Tableschema To Resolvedschema [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #7008: URL: https://github.com/apache/iceberg/pull/7008#issuecomment-2308585146 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] Flink: Update the docs [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] closed issue #7025: Flink: Update the docs URL: https://github.com/apache/iceberg/issues/7025 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

Re: [PR] Integration tests for Snowflake catalog [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #7004: URL: https://github.com/apache/iceberg/pull/7004#issuecomment-2308585136 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] cache delete files for repeat reading [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6866: URL: https://github.com/apache/iceberg/pull/6866#issuecomment-2308585115 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Core: Fix for - Do not use overwrite avro appender for manifests with non Hadoop io [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6839: URL: https://github.com/apache/iceberg/pull/6839#issuecomment-2308585097 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] Iceberg to Redshift load [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on issue #6841: URL: https://github.com/apache/iceberg/issues/6841#issuecomment-2308585102 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Parquet: Optimize dictionary filter evaluation on notIn and notEq [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6836: URL: https://github.com/apache/iceberg/pull/6836#issuecomment-2308585090 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] iceberg can not write data when last unlock error use hive catalog [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on issue #6824: URL: https://github.com/apache/iceberg/issues/6824#issuecomment-2308585086 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [PR] Parquet: fix conversion of enums to strings [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6804: URL: https://github.com/apache/iceberg/pull/6804#issuecomment-2308585081 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] iceberg can not write data when last unlock error use hive catalog [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] closed issue #6824: iceberg can not write data when last unlock error use hive catalog URL: https://github.com/apache/iceberg/issues/6824 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] Extend data files abstraction in the table manifest with the modification time [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6773: URL: https://github.com/apache/iceberg/pull/6773#issuecomment-2308585063 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Spark-3.3: Support unregister table procedure [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6786: URL: https://github.com/apache/iceberg/pull/6786#issuecomment-2308585068 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] [Spark] add extraSnapshotMetadata using sql conf [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6755: URL: https://github.com/apache/iceberg/pull/6755#issuecomment-2308585048 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] Integrate CRT with Iceberg S3 client [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on issue #6739: URL: https://github.com/apache/iceberg/issues/6739#issuecomment-2308585040 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Mysql CDC -- Flink -- Iceberg(Minio) Data is not reaching to Minio bucket location [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on issue #6734: URL: https://github.com/apache/iceberg/issues/6734#issuecomment-2308585037 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Mysql CDC -- Flink -- Iceberg(Minio) Data is not reaching to Minio bucket location [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] closed issue #6734: Mysql CDC -- Flink -- Iceberg(Minio) Data is not reaching to Minio bucket location URL: https://github.com/apache/iceberg/issues/6734 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [I] [DOC] Reorder pages under Spark in the nav bar [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] closed issue #6724: [DOC] Reorder pages under Spark in the nav bar URL: https://github.com/apache/iceberg/issues/6724 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] StructCopy does not correctly Copy Fixed Data Type [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on issue #6685: URL: https://github.com/apache/iceberg/issues/6685#issuecomment-2308585032 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Flink: Update the docs [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on issue #7025: URL: https://github.com/apache/iceberg/issues/7025#issuecomment-2308585165 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [PR] support batch reading for int/long-backed decimal type [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #7020: URL: https://github.com/apache/iceberg/pull/7020#issuecomment-2308585158 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Docs: Document 'write.parquet.row-group-check-min-record-count' and '… [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6905: URL: https://github.com/apache/iceberg/pull/6905#issuecomment-2308585133 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Spark: allows catalog.warehouse for Spark Hive Catalogs #6863 [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6886: URL: https://github.com/apache/iceberg/pull/6886#issuecomment-2308585123 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Fix StructCopy [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6894: URL: https://github.com/apache/iceberg/pull/6894#issuecomment-2308585128 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] Iceberg partition date/day equality problem when created on timestamp [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on issue #6853: URL: https://github.com/apache/iceberg/issues/6853#issuecomment-2308585111 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Iceberg partition date/day equality problem when created on timestamp [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] closed issue #6853: Iceberg partition date/day equality problem when created on timestamp URL: https://github.com/apache/iceberg/issues/6853 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] Core: Use avro compression properties from table properties when writing manifests and manifest lists [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6799: URL: https://github.com/apache/iceberg/pull/6799#issuecomment-2308585074 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] Core: enforce writing POSIX compatible paths for data location [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6772: URL: https://github.com/apache/iceberg/pull/6772#issuecomment-2308585052 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [PR] AWS: support force register table in GlueCatalog [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on PR #6742: URL: https://github.com/apache/iceberg/pull/6742#issuecomment-2308585044 This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull

Re: [I] [DOC] Unable to scroll down the right navigation section [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on issue #6684: URL: https://github.com/apache/iceberg/issues/6684#issuecomment-2308585024 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] [DOC] Unable to scroll down the right navigation section [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] closed issue #6684: [DOC] Unable to scroll down the right navigation section URL: https://github.com/apache/iceberg/issues/6684 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [I] ClassCastException: SerializableTableWithSize cannot be cast to org.apache.iceberg.Table [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] closed issue #6681: ClassCastException: SerializableTableWithSize cannot be cast to org.apache.iceberg.Table URL: https://github.com/apache/iceberg/issues/6681 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [I] ClassCastException: SerializableTableWithSize cannot be cast to org.apache.iceberg.Table [iceberg]

2024-08-24 Thread via GitHub
github-actions[bot] commented on issue #6681: URL: https://github.com/apache/iceberg/issues/6681#issuecomment-2308585020 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [PR] Build: switch to slf4j-simple 2.x for test implementation dependency [iceberg]

2024-08-24 Thread via GitHub
stevenzwu commented on PR #11001: URL: https://github.com/apache/iceberg/pull/11001#issuecomment-2308580403 right now, logging for tests is broken. it appears to affect both `main` and `apache/1.6.x` branch. ``` SLF4J(W): No SLF4J providers were found. SLF4J(W): Defaulting to no

Re: [I] Sqlalchemy breaks projects that need to support Pandas < 2.0 [iceberg-python]

2024-08-24 Thread via GitHub
aschreiber1 commented on issue #1085: URL: https://github.com/apache/iceberg-python/issues/1085#issuecomment-2308556900 I realized this an issue specifically to the conda recipe for pyiceberg and not pyiceberg itself, you can see the dependency here: https://github.com/conda-forge/pyiceber

Re: [I] Sqlalchemy breaks projects that need to support Pandas < 2.0 [iceberg-python]

2024-08-24 Thread via GitHub
aschreiber1 closed issue #1085: Sqlalchemy breaks projects that need to support Pandas < 2.0 URL: https://github.com/apache/iceberg-python/issues/1085 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] Sqlalchemy breaks projects that need to support Pandas < 2.0 [iceberg-python]

2024-08-24 Thread via GitHub
aschreiber1 commented on issue #1085: URL: https://github.com/apache/iceberg-python/issues/1085#issuecomment-2308556763 I realized this an issue specifically to the conda recipe for pyiceberg and not pyiceberg itself, you can see the dependency here: https://github.com/conda-forge/pyiceber

Re: [PR] Add Scan Planning Endpoints to open api spec [iceberg]

2024-08-24 Thread via GitHub
rahil-c commented on PR #9695: URL: https://github.com/apache/iceberg/pull/9695#issuecomment-2308549128 let me know what you guys think on the recent changes @rdblue @danielcweeks @amogh-jahagirdar @jackye1995 -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] feat: SQL Catalog - namespaces [iceberg-rust]

2024-08-24 Thread via GitHub
callum-ryan commented on code in PR #534: URL: https://github.com/apache/iceberg-rust/pull/534#discussion_r1730004295 ## crates/catalog/sql/src/catalog.rs: ## @@ -276,4 +579,385 @@ mod tests { new_sql_catalog(warehouse_loc.clone()).await; new_sql_catalog(wareho

Re: [PR] feat: SQL Catalog - namespaces [iceberg-rust]

2024-08-24 Thread via GitHub
callum-ryan commented on code in PR #534: URL: https://github.com/apache/iceberg-rust/pull/534#discussion_r1730004206 ## crates/catalog/sql/src/catalog.rs: ## @@ -141,21 +142,30 @@ impl SqlCatalog { } /// SQLX Any does not implement PostgresSQL bindings, so we have t

Re: [PR] fix (issue-1079): allow update_column to set doc as '' [iceberg-python]

2024-08-24 Thread via GitHub
sungwy commented on code in PR #1083: URL: https://github.com/apache/iceberg-python/pull/1083#discussion_r1729931129 ## pyiceberg/table/__init__.py: ## @@ -2492,21 +2492,26 @@ def update_column( except ResolveError as e: raise ValidationErro

Re: [PR] fix (issue-1079): allow update_column to set doc as '' [iceberg-python]

2024-08-24 Thread via GitHub
sungwy commented on code in PR #1083: URL: https://github.com/apache/iceberg-python/pull/1083#discussion_r1729934598 ## pyiceberg/table/__init__.py: ## @@ -2492,21 +2492,26 @@ def update_column( except ResolveError as e: raise ValidationErro

[PR] test: Introduce integration test framework. [iceberg-rust]

2024-08-24 Thread via GitHub
liurenjie1024 opened a new pull request, #581: URL: https://github.com/apache/iceberg-rust/pull/581 This pr introduces an integration test framework which utilizes [sqllogictest-rs](https://github.com/risinglightdb/sqllogictest-rs) to build data driven test cases. -- This is an automated

Re: [PR] fix (issue-1079): allow update_column to set doc as '' [iceberg-python]

2024-08-24 Thread via GitHub
sungwy commented on code in PR #1083: URL: https://github.com/apache/iceberg-python/pull/1083#discussion_r1729922493 ## pyiceberg/table/__init__.py: ## @@ -2492,21 +2492,22 @@ def update_column( except ResolveError as e: raise ValidationErro

Re: [PR] fix (issue-1079): allow update_column to set doc as '' [iceberg-python]

2024-08-24 Thread via GitHub
sungwy commented on code in PR #1083: URL: https://github.com/apache/iceberg-python/pull/1083#discussion_r1729931129 ## pyiceberg/table/__init__.py: ## @@ -2492,21 +2492,26 @@ def update_column( except ResolveError as e: raise ValidationErro

Re: [PR] fix (issue-1079): allow update_column to set doc as '' [iceberg-python]

2024-08-24 Thread via GitHub
sungwy commented on code in PR #1083: URL: https://github.com/apache/iceberg-python/pull/1083#discussion_r1729922493 ## pyiceberg/table/__init__.py: ## @@ -2492,21 +2492,22 @@ def update_column( except ResolveError as e: raise ValidationErro

Re: [PR] fix (issue-1079): allow update_column to set doc as '' [iceberg-python]

2024-08-24 Thread via GitHub
TiansuYu commented on code in PR #1083: URL: https://github.com/apache/iceberg-python/pull/1083#discussion_r1729866980 ## pyiceberg/table/__init__.py: ## @@ -2492,21 +2492,26 @@ def update_column( except ResolveError as e: raise ValidationEr

Re: [I] Review new DangerousJavaDeserialization error-prone check [iceberg]

2024-08-24 Thread via GitHub
ebyhr commented on issue #10853: URL: https://github.com/apache/iceberg/issues/10853#issuecomment-2308234607 @spotted-cat You can find the code at https://github.com/palantir/gradle-baseline/blob/develop/baseline-error-prone/src/main/java/com/palantir/baseline/errorprone/DangerousJavaDeseria

Re: [I] Extends Iceberg table stats API to allow publish data and stats atomically [iceberg]

2024-08-24 Thread via GitHub
findepi commented on issue #6442: URL: https://github.com/apache/iceberg/issues/6442#issuecomment-2308222370 it's remains needed by Trino. cc @alexjo2144 @findinpath -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [I] Update Iceberg Hive documentation [iceberg]

2024-08-24 Thread via GitHub
InvisibleProgrammer closed issue #6249: Update Iceberg Hive documentation URL: https://github.com/apache/iceberg/issues/6249 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To