Re: [I] [SUPPORT] Hive SYNC TOOL on EMR failed, Exception in thread main java.ang.NoClassDefFoundError: com/fasterxml/... [hudi]
codope closed issue #10741: [SUPPORT] Hive SYNC TOOL on EMR failed, Exception in thread main java.ang.NoClassDefFoundError: com/fasterxml/... URL: https://github.com/apache/hudi/issues/10741 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [SUPPORT] Hive SYNC TOOL on EMR failed, Exception in thread main java.ang.NoClassDefFoundError: com/fasterxml/... [hudi]
ad1happy2go commented on issue #10741: URL: https://github.com/apache/hudi/issues/10741#issuecomment-1966833615 Great! Thanks lot @huliwuli. Closing out this issue then. Please reopen in case you have any concerns. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [SUPPORT] Hive SYNC TOOL on EMR failed, Exception in thread main java.ang.NoClassDefFoundError: com/fasterxml/... [hudi]
huliwuli commented on issue #10741: URL: https://github.com/apache/hudi/issues/10741#issuecomment-1966749869 > Sorry, Looks like you are using the AWS managed hudi. Can you try using emr-6.15.0 which has hudi 0.14.0 EMR 6.15 worked, I tested it yesterday. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [SUPPORT] Hive SYNC TOOL on EMR failed, Exception in thread main java.ang.NoClassDefFoundError: com/fasterxml/... [hudi]
ad1happy2go commented on issue #10741: URL: https://github.com/apache/hudi/issues/10741#issuecomment-1966729193 Sorry, Looks like you are using the AWS managed hudi. Can you try using emr-6.15.0 which has hudi 0.14.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [SUPPORT] Hive SYNC TOOL on EMR failed, Exception in thread main java.ang.NoClassDefFoundError: com/fasterxml/... [hudi]
ad1happy2go commented on issue #10741: URL: https://github.com/apache/hudi/issues/10741#issuecomment-1966712421 @huliwuli Did you tried using 0.13.1 or 0.14.1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [SUPPORT] Hive SYNC TOOL on EMR failed, Exception in thread main java.ang.NoClassDefFoundError: com/fasterxml/... [hudi]
huliwuli commented on issue #10741: URL: https://github.com/apache/hudi/issues/10741#issuecomment-1962986573 > Finds out where the legacy jackson comes from and remove it from the classpath. Ok, thanks I will try ... since it's on EMR. Not sure whether I have permission to remove it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [SUPPORT] Hive SYNC TOOL on EMR failed, Exception in thread main java.ang.NoClassDefFoundError: com/fasterxml/... [hudi]
danny0405 commented on issue #10741: URL: https://github.com/apache/hudi/issues/10741#issuecomment-1962771611 Finds out where the legacy jackson comes from and remove it from the classpath. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [SUPPORT] Hive SYNC TOOL on EMR failed, Exception in thread main java.ang.NoClassDefFoundError: com/fasterxml/... [hudi]
huliwuli commented on issue #10741: URL: https://github.com/apache/hudi/issues/10741#issuecomment-1962629612 > Looks like a jackson jar conflict. Is there anything I can do for this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [SUPPORT] Hive SYNC TOOL on EMR failed, Exception in thread main java.ang.NoClassDefFoundError: com/fasterxml/... [hudi]
danny0405 commented on issue #10741: URL: https://github.com/apache/hudi/issues/10741#issuecomment-1962247269 Looks like a jackson jar conflict. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[I] [SUPPORT] Hive SYNC TOOL on EMR failed, Exception in thread main java.ang.NoClassDefFoundError: com/fasterxml/... [hudi]
huliwuli opened a new issue, #10741: URL: https://github.com/apache/hudi/issues/10741 Tips before filing an issue Describe the problem you faced Did Async Clustering on EMR 6.14 and Hive on Athena did not sync the latest commit after clustering? I want to use the hive sync tool to sync it. When using ``` cd /usr/lib/hudi/bin ./run_sync_tool.sh --base-path s3: --database --table --partitioned-by ``` I got the error caused by java.lang.ClassNotFoundException: com.fasterxml.jackson,datatype.jsr310.JavaTimeModule. Also, I noticed AWS documentation includes use-jdbc false  so I did ``` cd /usr/lib/hudi/bin ./run_sync_tool.sh --base-path s3: --database --table --partitioned-by --sync-mode hms --use-jdbc false --sync-tool-classes org.apache.hudi.hive.MultiPartKeysValueExtractor ``` Then I got: 'false' but no main parameter was defined in your arg class Environment Description Hudi version : 0.13.0 Spark version : 3.4.1 Hive version : 0.13.1 Hadoop version : Storage (HDFS/S3/GCS..) : S3 Running on Docker? (yes/no) : NO -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
