[GitHub] [hudi] alexeykudinkin commented on issue #6398: [SUPPORT] Metadata table thows hbase exceptions
alexeykudinkin commented on issue #6398: URL: https://github.com/apache/hudi/issues/6398#issuecomment-1251581367 @rbtrtr glad that you've sorted out! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on issue #6398: [SUPPORT] Metadata table thows hbase exceptions
alexeykudinkin commented on issue #6398: URL: https://github.com/apache/hudi/issues/6398#issuecomment-1245706642 Yeah, you can try to remove "hudi-default.xml" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on issue #6398: [SUPPORT] Metadata table thows hbase exceptions
alexeykudinkin commented on issue #6398: URL: https://github.com/apache/hudi/issues/6398#issuecomment-1245637513 This is a miss. Filed HUDI-4836 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on issue #6398: [SUPPORT] Metadata table thows hbase exceptions
alexeykudinkin commented on issue #6398: URL: https://github.com/apache/hudi/issues/6398#issuecomment-1244554944 > The metadata table in Hudi uses HFile as the base file format. This issue should be fixed by https://github.com/apache/hudi/pull/6114 (setting hbase.defaults.for.version.skip to true) which is included in 0.12.0. @rbtrtr could you double-check? And there is no need to start spark-shell with the HBase jars. To clarify what @yihua was saying: this should have already been addressed in 0.12. Can you try 0.12 and see if that works for you? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on issue #6398: [SUPPORT] Metadata table thows hbase exceptions
alexeykudinkin commented on issue #6398: URL: https://github.com/apache/hudi/issues/6398#issuecomment-1244078601 @rbtrtr can you try this remediation: https://stackoverflow.com/questions/16497480/hbase-error-hbase-default-xml-file-seems-to-be-for-and-old-version-of-hbase-nu -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on issue #6398: [SUPPORT] Metadata table thows hbase exceptions
alexeykudinkin commented on issue #6398: URL: https://github.com/apache/hudi/issues/6398#issuecomment-1242535317 @rbtrtr so the issue is in the first exception in your stack-trace: ``` Caused by: java.lang.ExceptionInInitializerError at org.apache.hudi.org.apache.hadoop.hbase.io.hfile.HFileContextBuilder.(HFileContextBuilder.java:54) at org.apache.hudi.common.table.log.block.HoodieHFileDataBlock.serializeRecords(HoodieHFileDataBlock.java:105) at org.apache.hudi.common.table.log.block.HoodieDataBlock.getContentBytes(HoodieDataBlock.java:131) at org.apache.hudi.common.table.log.HoodieLogFormatWriter.appendBlocks(HoodieLogFormatWriter.java:158) at org.apache.hudi.io.HoodieAppendHandle.appendDataAndDeleteBlocks(HoodieAppendHandle.java:404) at org.apache.hudi.io.HoodieAppendHandle.doAppend(HoodieAppendHandle.java:382) at org.apache.hudi.table.action.deltacommit.BaseSparkDeltaCommitActionExecutor.handleUpdate(BaseSparkDeltaCommitActionExecutor.java:84) at org.apache.hudi.table.action.commit.BaseSparkCommitActionExecutor.handleUpsertPartition(BaseSparkCommitActionExecutor.java:322) ... 28 more Caused by: java.lang.RuntimeException: hbase-default.xml file seems to be for an older version of HBase (2.2.3.7.1.7.0-551), this version is 2.4.9 at org.apache.hudi.org.apache.hadoop.hbase.HBaseConfiguration.checkDefaultsVersion(HBaseConfiguration.java:74) at org.apache.hudi.org.apache.hadoop.hbase.HBaseConfiguration.addHbaseResources(HBaseConfiguration.java:84) at org.apache.hudi.org.apache.hadoop.hbase.HBaseConfiguration.create(HBaseConfiguration.java:98) at org.apache.hudi.org.apache.hadoop.hbase.io.crypto.Context.(Context.java:44) at org.apache.hudi.org.apache.hadoop.hbase.io.crypto.Encryption$Context.(Encryption.java:110) at org.apache.hudi.org.apache.hadoop.hbase.io.crypto.Encryption$Context.(Encryption.java:107) ... 36 more ``` Your `hbase-default.xml` is for older version of HBase than the Hudi is using (2.4.9). Would it be possible for you to upgrade it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
