[jira] [Closed] (HUDI-590) Cut a new Doc version 0.5.1 explicitly

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-590. -- > Cut a new Doc version 0.5.1 explicitly > -- > > Key:

[jira] [Reopened] (HUDI-624) Split some of the code from PR for HUDI-479

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-624: > Split some of the code from PR for HUDI-479 > > >

[jira] [Resolved] (HUDI-624) Split some of the code from PR for HUDI-479

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-624. Resolution: Fixed > Split some of the code from PR for HUDI-479 >

[jira] [Closed] (HUDI-684) Introduce abstraction for writing and reading and compacting from FileGroups

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-684. -- > Introduce abstraction for writing and reading and compacting from FileGroups >

[jira] [Reopened] (HUDI-728) Support for complex record keys with TimestampBasedKeyGenerator

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-728: > Support for complex record keys with TimestampBasedKeyGenerator >

[jira] [Resolved] (HUDI-728) Support for complex record keys with TimestampBasedKeyGenerator

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-728. Resolution: Fixed > Support for complex record keys with TimestampBasedKeyGenerator >

[jira] [Resolved] (HUDI-684) Introduce abstraction for writing and reading and compacting from FileGroups

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-684. Resolution: Fixed > Introduce abstraction for writing and reading and compacting from FileGroups >

[jira] [Closed] (HUDI-728) Support for complex record keys with TimestampBasedKeyGenerator

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-728. -- > Support for complex record keys with TimestampBasedKeyGenerator >

[jira] [Reopened] (HUDI-684) Introduce abstraction for writing and reading and compacting from FileGroups

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-684: > Introduce abstraction for writing and reading and compacting from FileGroups >

[jira] [Closed] (HUDI-738) Add error msg in DeltaStreamer if `filterDupes=true` is enabled for `operation=UPSERT`.

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-738. -- > Add error msg in DeltaStreamer if `filterDupes=true` is enabled for > `operation=UPSERT`. >

[jira] [Reopened] (HUDI-742) Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-742: > Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I >

[jira] [Closed] (HUDI-742) Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-742. -- > Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I >

[jira] [Resolved] (HUDI-742) Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-742. Resolution: Fixed > Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I >

[jira] [Reopened] (HUDI-738) Add error msg in DeltaStreamer if `filterDupes=true` is enabled for `operation=UPSERT`.

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-738: > Add error msg in DeltaStreamer if `filterDupes=true` is enabled for > `operation=UPSERT`. >

[jira] [Resolved] (HUDI-738) Add error msg in DeltaStreamer if `filterDupes=true` is enabled for `operation=UPSERT`.

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-738. Resolution: Fixed > Add error msg in DeltaStreamer if `filterDupes=true` is enabled for >

[jira] [Closed] (HUDI-760) Remove Rolling Stat management from Hudi Writer

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-760. -- > Remove Rolling Stat management from Hudi Writer > --- > >

[jira] [Reopened] (HUDI-760) Remove Rolling Stat management from Hudi Writer

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-760: > Remove Rolling Stat management from Hudi Writer > --- > >

[jira] [Resolved] (HUDI-760) Remove Rolling Stat management from Hudi Writer

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-760. Resolution: Fixed > Remove Rolling Stat management from Hudi Writer >

[jira] [Resolved] (HUDI-802) AWSDmsTransformer does not handle insert -> delete of a row in a single batch correctly

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-802. Resolution: Fixed > AWSDmsTransformer does not handle insert -> delete of a row in a single batch >

[jira] [Closed] (HUDI-802) AWSDmsTransformer does not handle insert -> delete of a row in a single batch correctly

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-802. -- > AWSDmsTransformer does not handle insert -> delete of a row in a single batch > correctly >

[jira] [Reopened] (HUDI-802) AWSDmsTransformer does not handle insert -> delete of a row in a single batch correctly

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-802: > AWSDmsTransformer does not handle insert -> delete of a row in a single batch > correctly >

[jira] [Closed] (HUDI-855) Run Auto Cleaner in parallel with ingestion

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-855. -- > Run Auto Cleaner in parallel with ingestion > --- > >

[jira] [Resolved] (HUDI-855) Run Auto Cleaner in parallel with ingestion

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-855. Resolution: Fixed > Run Auto Cleaner in parallel with ingestion >

[jira] [Reopened] (HUDI-855) Run Auto Cleaner in parallel with ingestion

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-855: > Run Auto Cleaner in parallel with ingestion > --- > >

[jira] [Resolved] (HUDI-883) Update docs for new config in PR-1605

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-883. Resolution: Fixed > Update docs for new config in PR-1605 > - >

[jira] [Closed] (HUDI-882) Update documentation with new configs for 0.6.0 release

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-882. -- > Update documentation with new configs for 0.6.0 release >

[jira] [Reopened] (HUDI-883) Update docs for new config in PR-1605

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-883: > Update docs for new config in PR-1605 > - > > Key:

[jira] [Updated] (HUDI-883) Update docs for new config in PR-1605

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-883: --- Status: Closed (was: Patch Available) > Update docs for new config in PR-1605 >

[jira] [Closed] (HUDI-883) Update docs for new config in PR-1605

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-883. -- > Update docs for new config in PR-1605 > - > > Key:

[jira] [Resolved] (HUDI-882) Update documentation with new configs for 0.6.0 release

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-882. Resolution: Fixed > Update documentation with new configs for 0.6.0 release >

[jira] [Resolved] (HUDI-942) Increase minmum number of delta commits for inline compaction

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-942. Resolution: Fixed > Increase minmum number of delta commits for inline compaction >

[jira] [Closed] (HUDI-971) Fix HFileBootstrapIndexReader.getIndexedPartitions() returns unclean partition name

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-971. -- > Fix HFileBootstrapIndexReader.getIndexedPartitions() returns unclean > partition name >

[jira] [Closed] (HUDI-900) Metadata Bootstrap Key Generator needs to handle complex keys correctly

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-900. -- > Metadata Bootstrap Key Generator needs to handle complex keys correctly >

[jira] [Reopened] (HUDI-942) Increase minmum number of delta commits for inline compaction

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-942: > Increase minmum number of delta commits for inline compaction >

[jira] [Resolved] (HUDI-900) Metadata Bootstrap Key Generator needs to handle complex keys correctly

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-900. Resolution: Fixed > Metadata Bootstrap Key Generator needs to handle complex keys correctly >

[jira] [Reopened] (HUDI-900) Metadata Bootstrap Key Generator needs to handle complex keys correctly

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-900: > Metadata Bootstrap Key Generator needs to handle complex keys correctly >

[jira] [Closed] (HUDI-942) Increase minmum number of delta commits for inline compaction

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-942. -- > Increase minmum number of delta commits for inline compaction >

[jira] [Reopened] (HUDI-971) Fix HFileBootstrapIndexReader.getIndexedPartitions() returns unclean partition name

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-971: > Fix HFileBootstrapIndexReader.getIndexedPartitions() returns unclean > partition name >

[jira] [Resolved] (HUDI-971) Fix HFileBootstrapIndexReader.getIndexedPartitions() returns unclean partition name

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-971. Resolution: Fixed > Fix HFileBootstrapIndexReader.getIndexedPartitions() returns unclean >

[jira] [Closed] (HUDI-1013) Bulk Insert w/o converting to RDD

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-1013. --- > Bulk Insert w/o converting to RDD > - > > Key:

[jira] [Reopened] (HUDI-1013) Bulk Insert w/o converting to RDD

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-1013: - > Bulk Insert w/o converting to RDD > - > > Key:

[jira] [Resolved] (HUDI-1013) Bulk Insert w/o converting to RDD

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-1013. - Resolution: Fixed > Bulk Insert w/o converting to RDD > - > >

[jira] [Closed] (HUDI-1100) Docs: Update index type in Configuration section and fix typo in deployment page

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-1100. --- > Docs: Update index type in Configuration section and fix typo in deployment > page >

[jira] [Reopened] (HUDI-1100) Docs: Update index type in Configuration section and fix typo in deployment page

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-1100: - > Docs: Update index type in Configuration section and fix typo in deployment > page >

[jira] [Updated] (HUDI-1100) Docs: Update index type in Configuration section and fix typo in deployment page

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-1100: Status: Closed (was: Patch Available) > Docs: Update index type in Configuration section and fix

[jira] [Closed] (HUDI-1190) Annotate all public APIs classes with stability indication

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-1190. --- > Annotate all public APIs classes with stability indication >

[jira] [Resolved] (HUDI-1100) Docs: Update index type in Configuration section and fix typo in deployment page

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-1100. - Resolution: Fixed > Docs: Update index type in Configuration section and fix typo in deployment

[jira] [Resolved] (HUDI-1098) Marker file finalizing may block on a data file that was never written

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-1098. - Resolution: Fixed > Marker file finalizing may block on a data file that was never written >

[jira] [Reopened] (HUDI-1190) Annotate all public APIs classes with stability indication

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-1190: - > Annotate all public APIs classes with stability indication >

[jira] [Reopened] (HUDI-1098) Marker file finalizing may block on a data file that was never written

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-1098: - > Marker file finalizing may block on a data file that was never written >

[jira] [Reopened] (HUDI-1068) HoodieGlobalBloomIndex does not correctly send deletes to older partition when partition path is updated

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-1068: - > HoodieGlobalBloomIndex does not correctly send deletes to older partition > when partition path is

[jira] [Resolved] (HUDI-1068) HoodieGlobalBloomIndex does not correctly send deletes to older partition when partition path is updated

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-1068. - Resolution: Fixed > HoodieGlobalBloomIndex does not correctly send deletes to older partition >

[jira] [Resolved] (HUDI-1190) Annotate all public APIs classes with stability indication

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-1190. - Resolution: Fixed > Annotate all public APIs classes with stability indication >

[jira] [Closed] (HUDI-1098) Marker file finalizing may block on a data file that was never written

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-1098. --- > Marker file finalizing may block on a data file that was never written >

[jira] [Closed] (HUDI-1068) HoodieGlobalBloomIndex does not correctly send deletes to older partition when partition path is updated

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-1068. --- > HoodieGlobalBloomIndex does not correctly send deletes to older partition > when partition path is

[jira] [Reopened] (HUDI-1054) Address performance issues with finalizing writes on S3

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-1054: - > Address performance issues with finalizing writes on S3 >

[jira] [Resolved] (HUDI-1014) Design and Implement upgrade-downgrade infrastrucutre

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-1014. - Resolution: Fixed > Design and Implement upgrade-downgrade infrastrucutre >

[jira] [Reopened] (HUDI-1014) Design and Implement upgrade-downgrade infrastrucutre

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-1014: - > Design and Implement upgrade-downgrade infrastrucutre >

[jira] [Resolved] (HUDI-1054) Address performance issues with finalizing writes on S3

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-1054. - Resolution: Fixed > Address performance issues with finalizing writes on S3 >

[jira] [Closed] (HUDI-1014) Design and Implement upgrade-downgrade infrastrucutre

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-1014. --- > Design and Implement upgrade-downgrade infrastrucutre >

[jira] [Closed] (HUDI-1054) Address performance issues with finalizing writes on S3

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-1054. --- > Address performance issues with finalizing writes on S3 >

[GitHub] [hudi] satishkotha opened a new pull request #2023: [HUDI-1137] Add option to configure different path selector

2020-08-24 Thread GitBox
satishkotha opened a new pull request #2023: URL: https://github.com/apache/hudi/pull/2023 ## What is the purpose of the pull request Add configuration option to pick different path selector ## Brief change log Add configuration option to pick different path selector.

[jira] [Updated] (HUDI-1137) [Test Suite] Add option to configure different path selector

2020-08-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1137: - Labels: pull-request-available (was: ) > [Test Suite] Add option to configure different path

[hudi] branch asf-site updated: [DOC] Doc changes for release 0.6.0 (#2011)

2020-08-24 Thread bhavanisudha
This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 0ac5f3f [DOC] Doc changes for release

[GitHub] [hudi] bhasudha merged pull request #2011: [DOC] Doc changes for release 0.6.0

2020-08-24 Thread GitBox
bhasudha merged pull request #2011: URL: https://github.com/apache/hudi/pull/2011 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] bvaradar closed issue #1947: datadog monitor hudi

2020-08-24 Thread GitBox
bvaradar closed issue #1947: URL: https://github.com/apache/hudi/issues/1947 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] bvaradar commented on issue #1947: datadog monitor hudi

2020-08-24 Thread GitBox
bvaradar commented on issue #1947: URL: https://github.com/apache/hudi/issues/1947#issuecomment-679276189 @cun123 : Please reopen if the suggestion @xushiyan did not work. This is an automated message from the Apache

[GitHub] [hudi] bvaradar commented on issue #2002: [SUPPORT] Inconsistent Commits between CLI and Incremental Query

2020-08-24 Thread GitBox
bvaradar commented on issue #2002: URL: https://github.com/apache/hudi/issues/2002#issuecomment-679275414 @jpugliesi : It looks like 2nd and 3rd upsert updated the same set of records (generateUpdates()). In this case, all those records will be updated with latest commit time and

[GitHub] [hudi] bvaradar closed issue #2002: [SUPPORT] Inconsistent Commits between CLI and Incremental Query

2020-08-24 Thread GitBox
bvaradar closed issue #2002: URL: https://github.com/apache/hudi/issues/2002 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Assigned] (HUDI-945) Cleanup spillable map files eagerly as part of close

2020-08-24 Thread Sreeram Ramji (Jira)
[ https://issues.apache.org/jira/browse/HUDI-945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreeram Ramji reassigned HUDI-945: -- Assignee: Sreeram Ramji > Cleanup spillable map files eagerly as part of close >

[jira] [Commented] (HUDI-945) Cleanup spillable map files eagerly as part of close

2020-08-24 Thread Sreeram Ramji (Jira)
[ https://issues.apache.org/jira/browse/HUDI-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183504#comment-17183504 ] Sreeram Ramji commented on HUDI-945: [~vbalaji] I am interested in working on this. Assigning it to

[jira] [Commented] (HUDI-945) Cleanup spillable map files eagerly as part of close

2020-08-24 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183499#comment-17183499 ] Balaji Varadarajan commented on HUDI-945: - [~baobaoyeye]: Let me know if you are interested in

[jira] [Resolved] (HUDI-1190) Annotate all public APIs classes with stability indication

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-1190. - Resolution: Fixed > Annotate all public APIs classes with stability indication >

[jira] [Reopened] (HUDI-1190) Annotate all public APIs classes with stability indication

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reopened HUDI-1190: - > Annotate all public APIs classes with stability indication >

[jira] [Closed] (HUDI-1190) Annotate all public APIs classes with stability indication

2020-08-24 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-1190. --- > Annotate all public APIs classes with stability indication >

[GitHub] [hudi] bvaradar commented on issue #2001: NPE While writing data to same partition on S3

2020-08-24 Thread GitBox
bvaradar commented on issue #2001: URL: https://github.com/apache/hudi/issues/2001#issuecomment-679264433 Can you turn on INFO level logs and attach the logs to debug this ? Thanks, Balaji.V This is an automated

[GitHub] [hudi] ashishmgofficial commented on issue #2007: [SUPPORT] Is Timeline metadata queryable ?

2020-08-24 Thread GitBox
ashishmgofficial commented on issue #2007: URL: https://github.com/apache/hudi/issues/2007#issuecomment-679264539 Our exact process is that, - We have a Kafka Topic producing data - Target is Ceph object store So, we need timeline data like - Source Topic -

[GitHub] [hudi] bvaradar commented on issue #2019: Leak in DiskBasedMap

2020-08-24 Thread GitBox
bvaradar commented on issue #2019: URL: https://github.com/apache/hudi/issues/2019#issuecomment-679261953 This is currently tracked in https://issues.apache.org/jira/browse/HUDI-945 Should be a simple fix as mentioned in the jira. Are you interested in submitting a PR ? We will have

[jira] [Comment Edited] (HUDI-945) Cleanup spillable map files eagerly as part of close

2020-08-24 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183488#comment-17183488 ] Balaji Varadarajan edited comment on HUDI-945 at 8/24/20, 5:25 PM: ---

[jira] [Commented] (HUDI-945) Cleanup spillable map files eagerly as part of close

2020-08-24 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183488#comment-17183488 ] Balaji Varadarajan commented on HUDI-945: - https://issues.apache.org/jira/browse/HUDI-945 >

[jira] [Commented] (HUDI-945) Cleanup spillable map files eagerly as part of close

2020-08-24 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183483#comment-17183483 ] Balaji Varadarajan commented on HUDI-945: - [~baobaoyeye]: Sorry for the delay. I missed this

[jira] [Updated] (HUDI-945) Cleanup spillable map files eagerly as part of close

2020-08-24 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan updated HUDI-945: Status: Open (was: New) > Cleanup spillable map files eagerly as part of close >

[jira] [Created] (HUDI-1221) Ensure docker demo page reflects the latest support on all query engines

2020-08-24 Thread Bhavani Sudha (Jira)
Bhavani Sudha created HUDI-1221: --- Summary: Ensure docker demo page reflects the latest support on all query engines Key: HUDI-1221 URL: https://issues.apache.org/jira/browse/HUDI-1221 Project: Apache

[GitHub] [hudi] bvaradar commented on issue #2020: [SUPPORT] Compaction fails with "java.io.FileNotFoundException"

2020-08-24 Thread GitBox
bvaradar commented on issue #2020: URL: https://github.com/apache/hudi/issues/2020#issuecomment-679253153 Can you please add the details of "commit showfiles --commit 20200821153748" Are you running with consistency check enabled ? Can you also check if the file is

[jira] [Created] (HUDI-1220) Leverage java docs for publishing to config pages in site

2020-08-24 Thread Bhavani Sudha (Jira)
Bhavani Sudha created HUDI-1220: --- Summary: Leverage java docs for publishing to config pages in site Key: HUDI-1220 URL: https://issues.apache.org/jira/browse/HUDI-1220 Project: Apache Hudi

[GitHub] [hudi] bvaradar commented on issue #2017: multi-level partition

2020-08-24 Thread GitBox
bvaradar commented on issue #2017: URL: https://github.com/apache/hudi/issues/2017#issuecomment-679249338 Please reopen if this doesnt solve the problem This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] bvaradar commented on issue #2017: multi-level partition

2020-08-24 Thread GitBox
bvaradar commented on issue #2017: URL: https://github.com/apache/hudi/issues/2017#issuecomment-679249107 'hoodie.datasource.write.partitionpath.field' should be 'year,month'. Please make sure you use ComplexKeyGenerator

[GitHub] [hudi] bvaradar commented on issue #2007: [SUPPORT] Is Timeline metadata queryable ?

2020-08-24 Thread GitBox
bvaradar commented on issue #2007: URL: https://github.com/apache/hudi/issues/2007#issuecomment-679248311 Timeline metadata is available through Hudi CLI currently. Although, I believe there is already someone looking at supporting this feature cc @n3nash @satishkotha @prashantwason

[GitHub] [hudi] bvaradar commented on issue #1960: How do you change the 'hoodie.datasource.write.payload.class' configuration property?

2020-08-24 Thread GitBox
bvaradar commented on issue #1960: URL: https://github.com/apache/hudi/issues/1960#issuecomment-679236183 Closing this issue as we have a jira to track. This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] bvaradar closed issue #1960: How do you change the 'hoodie.datasource.write.payload.class' configuration property?

2020-08-24 Thread GitBox
bvaradar closed issue #1960: URL: https://github.com/apache/hudi/issues/1960 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] bvaradar commented on issue #1955: [SUPPORT] DMS partition treated as part of pk

2020-08-24 Thread GitBox
bvaradar commented on issue #1955: URL: https://github.com/apache/hudi/issues/1955#issuecomment-679235853 @nsivabalan : Please take a look when you get a chance. This is an automated message from the Apache Git Service. To

[GitHub] [hudi] bvaradar closed issue #1948: [SUPPORT] DMS example complains about dfs-source.properties

2020-08-24 Thread GitBox
bvaradar closed issue #1948: URL: https://github.com/apache/hudi/issues/1948 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[hudi] branch master updated: [MINOR] Update README.md (#2010)

2020-08-24 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 111a975 [MINOR] Update README.md (#2010)

[GitHub] [hudi] xushiyan merged pull request #2010: [MINOR] Update README.md

2020-08-24 Thread GitBox
xushiyan merged pull request #2010: URL: https://github.com/apache/hudi/pull/2010 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] vinothchandar commented on pull request #2010: [MINOR] Update README.md

2020-08-24 Thread GitBox
vinothchandar commented on pull request #2010: URL: https://github.com/apache/hudi/pull/2010#issuecomment-679231806 @xushiyan can you try merging yourself using squash and merge? This is an automated message from the Apache

svn commit: r41095 - in /release/hudi: 0.6.0/ hudi-0.6.0/

2020-08-24 Thread bhavanisudha
Author: bhavanisudha Date: Mon Aug 24 16:08:47 2020 New Revision: 41095 Log: Apache Hudi 0.6.0 source release. Rename hudi-0.6.0 to 0.6.0 Added: release/hudi/0.6.0/ - copied from r41094, release/hudi/hudi-0.6.0/ Removed: release/hudi/hudi-0.6.0/

[GitHub] [hudi] Trevor-zhang commented on pull request #2022: Code optimization on hudi-common moudle

2020-08-24 Thread GitBox
Trevor-zhang commented on pull request #2022: URL: https://github.com/apache/hudi/pull/2022#issuecomment-679203797 hi, @yanghua ,can u take a look when fre? This is an automated message from the Apache Git Service.

[GitHub] [hudi] Trevor-zhang opened a new pull request #2022: Code optimization on hudi-common moudle

2020-08-24 Thread GitBox
Trevor-zhang opened a new pull request #2022: URL: https://github.com/apache/hudi/pull/2022 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[jira] [Updated] (HUDI-1219) Code optimization on hudi-common moudle

2020-08-24 Thread Trevorzhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trevorzhang updated HUDI-1219: -- Summary: Code optimization on hudi-common moudle (was: Code optimization) > Code optimization on

[jira] [Created] (HUDI-1219) Code optimization

2020-08-24 Thread Trevorzhang (Jira)
Trevorzhang created HUDI-1219: - Summary: Code optimization Key: HUDI-1219 URL: https://issues.apache.org/jira/browse/HUDI-1219 Project: Apache Hudi Issue Type: Improvement Components:

<    1   2   3   >