Re: [I] flink to iceberg commit fail (Datastream API, hiveCatalog) [iceberg]

2024-03-23 Thread via GitHub
pvary commented on issue #10019: URL: https://github.com/apache/iceberg/issues/10019#issuecomment-2016702532 @SML0127: Good to hear that your issue has been resolved! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] flink to iceberg commit fail (Datastream API, hiveCatalog) [iceberg]

2024-03-23 Thread via GitHub
pvary closed issue #10019: flink to iceberg commit fail (Datastream API, hiveCatalog) URL: https://github.com/apache/iceberg/issues/10019 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [I] flink to iceberg commit fail (Datastream API, hiveCatalog) [iceberg]

2024-03-23 Thread via GitHub
SML0127 commented on issue #10019: URL: https://github.com/apache/iceberg/issues/10019#issuecomment-2016405173 Thank you @pvary ! I found the cause! While setting up HMSClient, I found that the hive-metastore lib version in Flink project is the latest version (v3.x). It works fi

Re: [I] flink to iceberg commit fail (Datastream API, hiveCatalog) [iceberg]

2024-03-22 Thread via GitHub
SML0127 commented on issue #10019: URL: https://github.com/apache/iceberg/issues/10019#issuecomment-2016361743 @pvary There's something strange about hive catalog. When I check HiveCatalog.namespaceExists(namespace), it always return `false`. But when I create name space, it re

Re: [I] flink to iceberg commit fail (Datastream API, hiveCatalog) [iceberg]

2024-03-22 Thread via GitHub
SML0127 commented on issue #10019: URL: https://github.com/apache/iceberg/issues/10019#issuecomment-2016358035 HI @pvary ! - Hive, HMS version is `2.3.2` - Current checkpoint interval is 60s. should I decrease checkpoint interval further? - I checked table exist in HD