[GitHub] [hudi] Virmaline commented on issue #6278: [SUPPORT] Deltastreamer fails with data and timestamp related exception after upgrading to EMR 6.5 and spark3

Virmaline commented on issue #6278: URL: https://github.com/apache/hudi/issues/6278#issuecomment-1357616082 Hi lucabem, I haven't run into that, I will have to test that out, maybe it'll get to that tomorrow and I can let you know my results, but I don't actually know how all of this works

[GitHub] [hudi] Virmaline commented on issue #6278: [SUPPORT] Deltastreamer fails with data and timestamp related exception after upgrading to EMR 6.5 and spark3

Virmaline commented on issue #6278: URL: https://github.com/apache/hudi/issues/6278#issuecomment-1356496864 Can you post your exact spark submit? Do you know why it's failing, what is the data type and value in the column? -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] Virmaline commented on issue #6278: [SUPPORT] Deltastreamer fails with data and timestamp related exception after upgrading to EMR 6.5 and spark3

Virmaline commented on issue #6278: URL: https://github.com/apache/hudi/issues/6278#issuecomment-1353894927 Never mind, I got it working. I specified the --conf wrong, having the options comma separated instead of separate --conf statements and it needs to have both spark.sql.avro

[GitHub] [hudi] Virmaline commented on issue #6278: [SUPPORT] Deltastreamer fails with data and timestamp related exception after upgrading to EMR 6.5 and spark3

Virmaline commented on issue #6278: URL: https://github.com/apache/hudi/issues/6278#issuecomment-1353791597 @alexeykudinkin Hey Alexey, I'm also still getting the same error after updating to 0.12.1. Hudi: 0.12.1-amzn-0-SNAPSHOT Spark: 3.3.0 EMR: 6.9.0