Re: [I] Unable to merge CDC data into snapshot data. java.lang.ClassCastException: org.apache.spark.unsafe.types.UTF8String cannot be cast to java.lang.Long [iceberg]

amogh-jahagirdar commented on issue #8333: URL: https://github.com/apache/iceberg/issues/8333#issuecomment-1864845786 I've been discussing with @sabyasachinandy @harshith-bolar-rapido offline, I can reproduce the issue from the minimal reproduction steps here

Re: [I] Unable to merge CDC data into snapshot data. java.lang.ClassCastException: org.apache.spark.unsafe.types.UTF8String cannot be cast to java.lang.Long [iceberg]

sabyasachinandy commented on issue #8333: URL: https://github.com/apache/iceberg/issues/8333#issuecomment-1856243795 Adding to this, I did a quick check of the stackstrace, seems like something is happening after the addMetadataRows function is getting called. It creates a generated

Re: [I] Unable to merge CDC data into snapshot data. java.lang.ClassCastException: org.apache.spark.unsafe.types.UTF8String cannot be cast to java.lang.Long [iceberg]

harshith-bolar-rapido commented on issue #8333: URL: https://github.com/apache/iceberg/issues/8333#issuecomment-1856030578 Quick heads up, the merge into query works fine in version `1.0.0`, starts breaking from `1.1.0`. -- This is an automated message from the Apache Git Service. To

Re: [I] Unable to merge CDC data into snapshot data. java.lang.ClassCastException: org.apache.spark.unsafe.types.UTF8String cannot be cast to java.lang.Long [iceberg]

sabyasachinandy commented on issue #8333: URL: https://github.com/apache/iceberg/issues/8333#issuecomment-1855701368 I will do @nastra. I apologize for the rude tone. Surely I will mention it in the mailing list or maybe use slack -- This is an automated message from the Apache Git

Re: [I] Unable to merge CDC data into snapshot data. java.lang.ClassCastException: org.apache.spark.unsafe.types.UTF8String cannot be cast to java.lang.Long [iceberg]

nastra commented on issue #8333: URL: https://github.com/apache/iceberg/issues/8333#issuecomment-1855684168 Sorry that it feels that nobody is actively looking into this. People might be busy with other things or might not be aware about this issue. To raise awareness and get some

Re: [I] Unable to merge CDC data into snapshot data. java.lang.ClassCastException: org.apache.spark.unsafe.types.UTF8String cannot be cast to java.lang.Long [iceberg]

sabyasachinandy commented on issue #8333: URL: https://github.com/apache/iceberg/issues/8333#issuecomment-183371 Any update on this? Given this is a bread and butter usecase and still no one cares for looking into this in priority. -- This is an automated message from the Apache Git

Re: [I] Unable to merge CDC data into snapshot data. java.lang.ClassCastException: org.apache.spark.unsafe.types.UTF8String cannot be cast to java.lang.Long [iceberg]

harshith-bolar-rapido commented on issue #8333: URL: https://github.com/apache/iceberg/issues/8333#issuecomment-1854204500 Noticed that this happens when the input folders are partitioned by date. Ex: `mmdd=20230304` Here's a minimal reproducible example. @RussellSpitzer @nastra

Re: [I] Unable to merge CDC data into snapshot data. java.lang.ClassCastException: org.apache.spark.unsafe.types.UTF8String cannot be cast to java.lang.Long [iceberg]

chandu-1101 commented on issue #8333: URL: https://github.com/apache/iceberg/issues/8333#issuecomment-1851283161 Abandon Iceberg, Abandon Hudi. Both are useless frameworks. Go with Parquet and spark sql. Your life will be simple and happy -- This is an automated message from the Apache

Re: [I] Unable to merge CDC data into snapshot data. java.lang.ClassCastException: org.apache.spark.unsafe.types.UTF8String cannot be cast to java.lang.Long [iceberg]

harshith-bolar-rapido commented on issue #8333: URL: https://github.com/apache/iceberg/issues/8333#issuecomment-1851252377 Any update on this? Facing the same issue with 1.2.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub