[GitHub] [hudi] zhilinli123 commented on issue #4881: Full incremental Enable index loading to discover duplicate data(index.bootstrap.enabled)

2022-05-24 Thread GitBox
zhilinli123 commented on issue #4881: URL: https://github.com/apache/hudi/issues/4881#issuecomment-1135486214 > @zhilinli123 We recently fired a fix in master branch: https://issues.apache.org/jira/browse/HUDI-4078, the MOR table may lost the index data if there are pending compactions on t

[GitHub] [hudi] zhilinli123 commented on issue #4881: Full incremental Enable index loading to discover duplicate data(index.bootstrap.enabled)

2022-05-23 Thread GitBox
zhilinli123 commented on issue #4881: URL: https://github.com/apache/hudi/issues/4881#issuecomment-1134825081 > > > @zhilinli123 @danny0405 : is there any follows pending on this issue. If not, can we please close it out. > > > > > > This problem should still exist, community lead

[GitHub] [hudi] zhilinli123 commented on issue #4881: Full incremental Enable index loading to discover duplicate data(index.bootstrap.enabled)

2022-05-18 Thread GitBox
zhilinli123 commented on issue #4881: URL: https://github.com/apache/hudi/issues/4881#issuecomment-1131081185 > @zhilinli123 @danny0405 : is there any follows pending on this issue. If not, can we please close it out. This problem should still exist, community leaders can help confirm

[GitHub] [hudi] zhilinli123 commented on issue #4881: Full incremental Enable index loading to discover duplicate data(index.bootstrap.enabled)

2022-04-19 Thread GitBox
zhilinli123 commented on issue #4881: URL: https://github.com/apache/hudi/issues/4881#issuecomment-1102329893 In the previous tests, data duplication occurred after the checkpoint was completed for the first time. No new data was written before the checkpoint was completed -- This is

[GitHub] [hudi] zhilinli123 commented on issue #4881: Full incremental Enable index loading to discover duplicate data(index.bootstrap.enabled)

2022-04-18 Thread GitBox
zhilinli123 commented on issue #4881: URL: https://github.com/apache/hudi/issues/4881#issuecomment-1101349187 > The expect behavior is that only after the bootstrap ends up we can handle the in-coming new records. Maybe when you set the bootstrap parallelism as `>1`, the in-coming records a

[GitHub] [hudi] zhilinli123 commented on issue #4881: Full incremental Enable index loading to discover duplicate data(index.bootstrap.enabled)

2022-04-12 Thread GitBox
zhilinli123 commented on issue #4881: URL: https://github.com/apache/hudi/issues/4881#issuecomment-1097523827 > That's weird, what version did you use ? hudi:0.10.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [hudi] zhilinli123 commented on issue #4881: Full incremental Enable index loading to discover duplicate data(index.bootstrap.enabled)

2022-04-12 Thread GitBox
zhilinli123 commented on issue #4881: URL: https://github.com/apache/hudi/issues/4881#issuecomment-1096660043 > > @nsivabalan Will the current issue be fixed when the next version is released > > Do you still use the batch bootstrap ? I am currently using a real-time a

[GitHub] [hudi] zhilinli123 commented on issue #4881: Full incremental Enable index loading to discover duplicate data(index.bootstrap.enabled)

2022-04-11 Thread GitBox
zhilinli123 commented on issue #4881: URL: https://github.com/apache/hudi/issues/4881#issuecomment-1096179551 @nsivabalan Will the current issue be fixed when the next version is released -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [hudi] zhilinli123 commented on issue #4881: Full incremental Enable index loading to discover duplicate data(index.bootstrap.enabled)

2022-03-02 Thread GitBox
zhilinli123 commented on issue #4881: URL: https://github.com/apache/hudi/issues/4881#issuecomment-1057743257 > I'm using the code for the master branch where this problem occurred after 0.10.1 -- This is an automated message from the Apache Git Service. To respond to th

[GitHub] [hudi] zhilinli123 commented on issue #4881: Full incremental Enable index loading to discover duplicate data(index.bootstrap.enabled)

2022-03-02 Thread GitBox
zhilinli123 commented on issue #4881: URL: https://github.com/apache/hudi/issues/4881#issuecomment-1057734767 > 似乎以前修复了一个已知的错误,您的是否有此修复:#3925? I'm using the code for the master branch where this problem occurred after 0.10.1 -- This is an automated message from the Apache Git