[GitHub] [hudi] WTa-hash commented on issue #2057: [SUPPORT] AWSDmsAvroPayload not processing Deletes correctly + IOException when reading log file

2020-09-17 Thread GitBox
WTa-hash commented on issue #2057: URL: https://github.com/apache/hudi/issues/2057#issuecomment-694437332 > @umehrot2 Could the IOException be due to #2089 ? I'm not entirely sure if it's related to this issue as the steps to reproduce is different, but the thing I see in common is t

[GitHub] [hudi] WTa-hash commented on issue #2057: [SUPPORT] AWSDmsAvroPayload not processing Deletes correctly + IOException when reading log file

2020-09-16 Thread GitBox
WTa-hash commented on issue #2057: URL: https://github.com/apache/hudi/issues/2057#issuecomment-693403063 @umehrot2 - the only other issue is what I have here: https://github.com/apache/hudi/issues/2057#issuecomment-683835686 with error "org.apache.hudi.exception.HoodieIOException: IOExcep

[GitHub] [hudi] WTa-hash commented on issue #2057: [SUPPORT] AWSDmsAvroPayload not processing Deletes correctly + IOException when reading log file

2020-09-01 Thread GitBox
WTa-hash commented on issue #2057: URL: https://github.com/apache/hudi/issues/2057#issuecomment-685015564 For the 0.6.0 issue with error: java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.PartitionedFile.(Lorg/apache/spark/sql/catalyst/InternalRow;Ljava/lang/String;JJ[

[GitHub] [hudi] WTa-hash commented on issue #2057: [SUPPORT] AWSDmsAvroPayload not processing Deletes correctly + IOException when reading log file

2020-09-01 Thread GitBox
WTa-hash commented on issue #2057: URL: https://github.com/apache/hudi/issues/2057#issuecomment-684936471 For java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.PartitionedFile.(Lorg/apache/spark/sql/catalyst/InternalRow;Ljava/lang/String;JJ[Ljava/lang/String;)V issue:

[GitHub] [hudi] WTa-hash commented on issue #2057: [SUPPORT] AWSDmsAvroPayload not processing Deletes correctly + IOException when reading log file

2020-09-01 Thread GitBox
WTa-hash commented on issue #2057: URL: https://github.com/apache/hudi/issues/2057#issuecomment-684836604 @bvaradar - This is all I have for 0.5.2 logs. [0.5.2-logs.txt](https://github.com/apache/hudi/files/5156322/0.5.2-logs.txt) The error is reproducible - you can try running th

[GitHub] [hudi] WTa-hash commented on issue #2057: [SUPPORT] AWSDmsAvroPayload not processing Deletes correctly + IOException when reading log file

2020-08-31 Thread GitBox
WTa-hash commented on issue #2057: URL: https://github.com/apache/hudi/issues/2057#issuecomment-683882871 Seems the first issue reported about AWSDmsAvroPayload not processing deletes correctly may be tracked here https://issues.apache.org/jira/browse/HUDI-979. I'm keeping this issu

[GitHub] [hudi] WTa-hash commented on issue #2057: [SUPPORT] AWSDmsAvroPayload not processing Deletes correctly + IOException when reading log file

2020-08-31 Thread GitBox
WTa-hash commented on issue #2057: URL: https://github.com/apache/hudi/issues/2057#issuecomment-683835686 After implementing the custom AWSDmsAvroPayload class referenced in https://issues.apache.org/jira/browse/HUDI-802. It seems processing insert + delete for a particular record within t