Re: [I] [SUPPORT] Hudi cdc upserts stopped working after migrating from hudi 13.1 to 14.0 [hudi]

2024-04-01 Thread via GitHub


ROOBALJINDAL closed issue #10884: [SUPPORT] Hudi cdc upserts stopped working 
after migrating from hudi 13.1 to 14.0
URL: https://github.com/apache/hudi/issues/10884


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [SUPPORT] Hudi cdc upserts stopped working after migrating from hudi 13.1 to 14.0 [hudi]

2024-04-01 Thread via GitHub


ROOBALJINDAL commented on issue #10884:
URL: https://github.com/apache/hudi/issues/10884#issuecomment-2029401141

   I have found the issue. We were using custom MssqlDebeziumSource class as 
debezium source and in constructor we were using `HoodieStreamerMetrics` 
instead of `HoodieIngestionMetrics` (which is introduced in hudi 14.0)
   
   Once corrected the class, it started working. We can close this issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [SUPPORT] Hudi cdc upserts stopped working after migrating from hudi 13.1 to 14.0 [hudi]

2024-03-19 Thread via GitHub


ad1happy2go commented on issue #10884:
URL: https://github.com/apache/hudi/issues/10884#issuecomment-2007239157

   Dont think it can be kafka version related issue as job is not failing. we 
need to know more logs  to debug this. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [SUPPORT] Hudi cdc upserts stopped working after migrating from hudi 13.1 to 14.0 [hudi]

2024-03-19 Thread via GitHub


ROOBALJINDAL commented on issue #10884:
URL: https://github.com/apache/hudi/issues/10884#issuecomment-2006856626

   @ad1happy2go need time to setup new cluster. Our aws msk kafka cluster uses 
kafka version=2.6.2, can you confirm is this fine or this can be an issue? Any 
specific supported version of kafka?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [SUPPORT] Hudi cdc upserts stopped working after migrating from hudi 13.1 to 14.0 [hudi]

2024-03-19 Thread via GitHub


ad1happy2go commented on issue #10884:
URL: https://github.com/apache/hudi/issues/10884#issuecomment-2006696281

   @ROOBALJINDAL Is it possible to try the same on EMR so that you will get all 
the logs to look into this more. There is no known updates which can cause this 
for 0.14.0 upgrade.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [SUPPORT] Hudi cdc upserts stopped working after migrating from hudi 13.1 to 14.0 [hudi]

2024-03-19 Thread via GitHub


ROOBALJINDAL commented on issue #10884:
URL: https://github.com/apache/hudi/issues/10884#issuecomment-2006449206

   @nsivabalan can you please check


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org