CTTY commented on issue #10376:
URL: https://github.com/apache/hudi/issues/10376#issuecomment-1974124259
I think we need to understand why Spark is trying to delete Hudi jars here,
can you share the previous log so we can see what Spark is doing before this
exception?
On the other ha
Lakshmi-Holla12 commented on issue #10376:
URL: https://github.com/apache/hudi/issues/10376#issuecomment-1876894215
Hi @ad1happy2go @CTTY,
I have been testing EMR on EKS with different EMR versions: **emr-6.15.0,
emr-6.14.0, emr-6.13.0, and emr-6.11.0.**
I found that emr-6.11.
ad1happy2go commented on issue #10376:
URL: https://github.com/apache/hudi/issues/10376#issuecomment-1875578004
@CTTY Any insights on this. thanks in advance.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL abo
Lakshmi-Holla12 commented on issue #10376:
URL: https://github.com/apache/hudi/issues/10376#issuecomment-1875098138
Hi @ad1happy2go, I'm still experiencing the issue with EMR 6.15. By default,
Spark jar is located at /usr/lib/hudi, which I am currently using. During the
spark-submit, I prov
ad1happy2go commented on issue #10376:
URL: https://github.com/apache/hudi/issues/10376#issuecomment-1874094831
@Lakshmi-Holla12 Were you able to resolve this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
ad1happy2go commented on issue #10376:
URL: https://github.com/apache/hudi/issues/10376#issuecomment-1867797289
@Lakshmi-Holla12 Interesting. Not sure why spark is trying to delete the jar
from that location. Can you try putting hudi spark jar in some different
location and point that to it
Lakshmi-Holla12 opened a new issue, #10376:
URL: https://github.com/apache/hudi/issues/10376
**Describe the problem you faced**
Getting Failed to delete the hudi jar from /usr/lib/hudi/./ location after
upgrading the EMR to 6.15.0 which has in built hudi 0.14.0 and Spark 3.4.1
versio
