[GitHub] [hudi] ad1happy2go commented on issue #8903: [SUPPORT] aws spark3.2.1 & hudi 0.13.1 with java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.PartitionedFile
ad1happy2go commented on issue #8903: URL: https://github.com/apache/hudi/issues/8903#issuecomment-1598349584 Thanks @zyclove . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] ad1happy2go commented on issue #8903: [SUPPORT] aws spark3.2.1 & hudi 0.13.1 with java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.PartitionedFile
ad1happy2go commented on issue #8903: URL: https://github.com/apache/hudi/issues/8903#issuecomment-1591019975 @zyclove I am not able to reproduce this issue, I was able to get the EMR cluster started with the version you mentioned and able to create and use MOR tables using spark sql. https://github.com/apache/hudi/assets/63430370/43f9a515-b9cb-4e4a-925d-8ce45f2efb86";> https://gist.github.com/ad1happy2go/9ed270ada234a3c78c79603a8abe755c Are you still facing this issue? If not can you please let us know why you were facing the issue before. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] ad1happy2go commented on issue #8903: [SUPPORT] aws spark3.2.1 & hudi 0.13.1 with java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.PartitionedFile
ad1happy2go commented on issue #8903: URL: https://github.com/apache/hudi/issues/8903#issuecomment-1589525351 @zyclove Sorry, just realised you using --packages org.apache.hudi:hudi-spark3.2-bundle_2.12:0.13.1 , so that means its using the OSS version of hudi only. I will try to reproduce it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] ad1happy2go commented on issue #8903: [SUPPORT] aws spark3.2.1 & hudi 0.13.1 with java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.PartitionedFile
ad1happy2go commented on issue #8903: URL: https://github.com/apache/hudi/issues/8903#issuecomment-1589492618 @zyclove Did you got the chance to try with OSS hudi, you still getting this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] ad1happy2go commented on issue #8903: [SUPPORT] aws spark3.2.1 & hudi 0.13.1 with java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.PartitionedFile
ad1happy2go commented on issue #8903: URL: https://github.com/apache/hudi/issues/8903#issuecomment-1584119663 @zyclove This is related to conflicts on hive/hadoop/spark run time versions on EMR and what Hudi spark bundle is compiled with. Meanwhile instead of using the aws version i.e. --datalake_format hudi, you can use the OSS version of hudi. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
