[GitHub] [incubator-hudi] wangxianghu commented on pull request #1652: [HUDI-918] Fix kafkaOffsetGen can not read kafka data bug

2020-05-21 Thread GitBox
wangxianghu commented on pull request #1652: URL: https://github.com/apache/incubator-hudi/pull/1652#issuecomment-632445691 Hi @UZi5136225, It may be better to give some reminders on the description of "--source-limit" This

[GitHub] [incubator-hudi] wangxianghu commented on pull request #1652: [HUDI-918] Fix kafkaOffsetGen can not read kafka data bug

2020-05-21 Thread GitBox
wangxianghu commented on pull request #1652: URL: https://github.com/apache/incubator-hudi/pull/1652#issuecomment-632429037 Hi @garyli1019, @UZi5136225 means when the configed "sourceLimit" is lesser than the partitions of kafka, kafkaOffetsGen will consumer no data. -