[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-08-05 Thread GitBox
liujinhui1994 commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-893193914 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-08-04 Thread GitBox
liujinhui1994 commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-893200281 @nsivabalan @codope @vinothchandar thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-08-04 Thread GitBox
liujinhui1994 commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-893193914 I re-synchronized the latest code this time, and now it works. I think a lot of content has been updated recently. It should have been repaired.I have informed my colleagues that

[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-07-28 Thread GitBox
liujinhui1994 commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-888135807 The latest discovery is that when I turn off hive sync I don't get the above error, when I turn it on I get the above error @nsivabalan -- This is an automated message from

[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-07-26 Thread GitBox
liujinhui1994 commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-887178822 1. No changes to any kafka-related configuration, or any other configuration 2. I am using structuredstreaming not hudi-deltastreamer -- This is an automated message from

[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-07-22 Thread GitBox
liujinhui1994 commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-885360852 Is there a partner who can help me? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-07-15 Thread GitBox
liujinhui1994 commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-880782097 No, please take a look at my description. The first batch of the same program can write data normally, but the second batch cannot be written. If it is a jar problem, the problem

[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-07-15 Thread GitBox
liujinhui1994 commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-880629245 @n3nash @nsivabalan Can you help me? This problem has troubled me for a week. I tried my best to find the problem, but it still didn't solve it. Thank you very much~ --

[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-07-15 Thread GitBox
liujinhui1994 commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-880627989 2.4.5 3.0.0 0.9.0-SNAPSHOT 2.3.1 2.11.12 2.11 1.72 1.10.0 5.1.47 -- This is an automated message from the Apache Git Servi

[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-07-15 Thread GitBox
liujinhui1994 commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-880627533 ![image](https://user-images.githubusercontent.com/25769285/125782669-b6ee2d03-fc27-4d05-94c4-b426e42df81e.png) ![image](https://user-images.githubusercontent.com/25769285/1257

[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-07-15 Thread GitBox
liujinhui1994 commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-880626007 ![image](https://user-images.githubusercontent.com/25769285/125782428-87d7d34b-f5b1-4527-a044-c35570c129a1.png) ![image](https://user-images.githubusercontent.com/25769285/1257

[GitHub] [hudi] liujinhui1994 commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-07-15 Thread GitBox
liujinhui1994 commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-880625093 ``` Diagnostics: | User class threw exception: org.apache.spark.sql.streaming.StreamingQueryException: Invalid value org.apache.kafka.common.serialization.ByteArrayDeserial