[GitHub] [hudi] n3nash commented on issue #2633: Empty File Slice causing application to fail in small files optimization code

2021-04-14 Thread GitBox
n3nash commented on issue #2633: URL: https://github.com/apache/hudi/issues/2633#issuecomment-820160205 I've filed a ticket here -> https://issues.apache.org/jira/browse/HUDI-1800. Let's move the discussion and solution there. -- This is an automated message from the Apache Git Service.

[GitHub] [hudi] n3nash commented on issue #2633: Empty File Slice causing application to fail in small files optimization code

2021-04-05 Thread GitBox
n3nash commented on issue #2633: URL: https://github.com/apache/hudi/issues/2633#issuecomment-813862735 @bvaradar @umehrot2 I think we should move this discussion to a JIRA so that all the details and possible solutions are captured there. Have one of you created it ? if not I can do it.

[GitHub] [hudi] n3nash commented on issue #2633: Empty File Slice causing application to fail in small files optimization code

2021-03-30 Thread GitBox
n3nash commented on issue #2633: URL: https://github.com/apache/hudi/issues/2633#issuecomment-810755480 Thanks for this explanation @bvaradar, this makes sense to me. I think `getLatestFileSlicesBeforeOrOn` is slightly misleading when read out of context :( I just read the java docs and it

[GitHub] [hudi] n3nash commented on issue #2633: Empty File Slice causing application to fail in small files optimization code

2021-03-30 Thread GitBox
n3nash commented on issue #2633: URL: https://github.com/apache/hudi/issues/2633#issuecomment-810001258 @umehrot2 Are you going to open a PR to fix this issue ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] n3nash commented on issue #2633: Empty File Slice causing application to fail in small files optimization code

2021-03-04 Thread GitBox
n3nash commented on issue #2633: URL: https://github.com/apache/hudi/issues/2633#issuecomment-790917128 @umehrot2 From what you are describing, it looks like a bug. When we configure HbaseIndex, we automatically assume ``` public boolean canIndexLogFiles() { return true;