[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775983714 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/storage/HoodieBucketLayout.java ## @@ -0,0 +1,60 @@ +/* + * Licensed to

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775929156 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/storage/HoodieStorageLayout.java ## @@ -0,0 +1,51 @@ +/* + * Licensed to

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775919793 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkBucketIndexPartitioner.java ## @@ -0,0 +1,126 @@ +/* +

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775919793 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkBucketIndexPartitioner.java ## @@ -0,0 +1,126 @@ +/* +

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775917882 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestMORDataSourceWithBucket.scala ## @@ -0,0 +1,153 @@ +/* + *

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775910756 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -526,6 +526,12 @@ object

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775799674 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -526,6 +526,12 @@ object

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775530270 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/BaseSparkCommitActionExecutor.java ## @@ -303,7 +305,7 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775535979 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestMORDataSourceWithBucket.scala ## @@ -0,0 +1,153 @@ +/* + *

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775532332 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/index/bucket/HoodieBucketIndexSuite.java ## @@ -0,0 +1,147 @@ +/* + * Licensed

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775530270 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/BaseSparkCommitActionExecutor.java ## @@ -303,7 +305,7 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775526260 ## File path: hudi-client/hudi-client-common/src/test/resources/hive_bucket_id_check.csv ## @@ -0,0 +1,27 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r775520220 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkBucketIndexPartitioner.java ## @@ -0,0 +1,126 @@ +/* +

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r771492004 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bucket/BucketIdentifier.java ## @@ -0,0 +1,84 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r771454072 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bucket/BucketIdentifier.java ## @@ -0,0 +1,84 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r771465980 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +209,48 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r771454072 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bucket/BucketIdentifier.java ## @@ -0,0 +1,84 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770757474 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bucket/BucketIdentifier.java ## @@ -0,0 +1,84 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770755856 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bucket/BucketIdentifier.java ## @@ -0,0 +1,84 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770646050 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bucket/SparkBucketIndex.java ## @@ -0,0 +1,174 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770641903 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/SparkHoodieIndexFactory.java ## @@ -63,6 +64,8 @@ public static

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770609328 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -526,6 +526,12 @@ object

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770608136 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bucket/BucketIdentifier.java ## @@ -0,0 +1,84 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770564377 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/AbstractWriteHelper.java ## @@ -46,7 +46,7 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770494052 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/execution/CopyOnWriteInsertHandler.java ## @@ -85,7 +85,9 @@ public void

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770503636 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/execution/CopyOnWriteInsertHandler.java ## @@ -85,7 +85,9 @@ public void

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770494052 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/execution/CopyOnWriteInsertHandler.java ## @@ -85,7 +85,9 @@ public void

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770494052 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/execution/CopyOnWriteInsertHandler.java ## @@ -85,7 +85,9 @@ public void

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770491594 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +209,48 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r770483944 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +209,48 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r769787451 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieMergeOnReadRDD.scala ## @@ -39,7 +39,13 @@ import

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r769785613 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/MergeOnReadSnapshotRelation.scala ## @@ -219,17 +226,31 @@ class

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r769782126 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -540,5 +602,28 @@ private String

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r769779554 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/deltacommit/AbstractSparkDeltaCommitActionExecutor.java ## @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r769780335 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +209,48 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r769769561 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/BaseSparkCommitActionExecutor.java ## @@ -214,7 +214,11 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r769767400 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/HoodieIndex.java ## @@ -122,13 +125,40 @@ public O updateLocation(O

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r760226513 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +209,48 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r760045330 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -54,7 +63,7 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r745675229 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkBucketIndexPartitioner.java ## @@ -0,0 +1,128 @@ +/* +

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r745656950 ## File path: hudi-common/src/main/java/org/apache/hudi/keygen/BaseKeyGenerator.java ## @@ -71,11 +75,24 @@ public final HoodieKey getKey(GenericRecord

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r745639798 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieMergeOnReadRDD.scala ## @@ -58,32 +64,50 @@ class

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r745639798 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieMergeOnReadRDD.scala ## @@ -58,32 +64,50 @@ class

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r745638078 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/MergeOnReadSnapshotRelation.scala ## @@ -146,7 +154,7 @@ class

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r745620724 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/serializer/HoodieKeyV1Serializer.java ## @@ -0,0 +1,45 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r745617761 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/deltacommit/AbstractSparkDeltaCommitActionExecutor.java ## @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r745614959 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkHoodiePartitioner.java ## @@ -0,0 +1,48 @@ +/* + *

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r745614757 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkBucketIndexPartitioner.java ## @@ -0,0 +1,128 @@ +/* +

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r745602279 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bucket/SparkBucketIndex.java ## @@ -0,0 +1,152 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r745598142 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/BaseCommitActionExecutor.java ## @@ -76,6 +77,11 @@ public

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r745597686 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/ComplexAvroKeyGenerator.java ## @@ -36,6 +38,9 @@ public

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r744630064 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodieKey.java ## @@ -31,13 +35,16 @@ private String recordKey; private

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r744630064 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodieKey.java ## @@ -31,13 +35,16 @@ private String recordKey; private

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r744503290 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +202,25 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r744503290 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +202,25 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r744507996 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +202,25 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r744507996 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +202,25 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r744503290 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +202,25 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r736630174 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/utils/HiveHasher.java ## @@ -0,0 +1,196 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r736361071 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/utils/BucketUtils.java ## @@ -0,0 +1,89 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r736355271 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bucket/SparkBucketIndex.java ## @@ -0,0 +1,183 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r735459825 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/BaseCommitActionExecutor.java ## @@ -76,6 +77,11 @@ public

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r716500207 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bucket/SparkBucketIndex.java ## @@ -0,0 +1,183 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r716488152 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/HoodieIndex.java ## @@ -97,13 +100,32 @@ public abstract O

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r703007870 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/BaseCommitActionExecutor.java ## @@ -76,6 +77,11 @@ public

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r703004865 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/ComplexAvroKeyGenerator.java ## @@ -36,6 +38,9 @@ public

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r703004865 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/ComplexAvroKeyGenerator.java ## @@ -36,6 +38,9 @@ public

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r702996262 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +203,19 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r702996262 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +203,19 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r702996262 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +203,19 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r702792987 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/ComplexAvroKeyGenerator.java ## @@ -36,6 +38,9 @@ public

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r702773287 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java ## @@ -1372,6 +1372,10 @@ public boolean

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r702773053 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +203,19 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r702771294 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +203,19 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r702770466 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +203,19 @@

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r699048626 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/execution/CopyOnWriteInsertHandler.java ## @@ -85,7 +85,9 @@ public void

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r699048626 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/execution/CopyOnWriteInsertHandler.java ## @@ -85,7 +85,9 @@ public void

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r695418277 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkBucketIndexPartitioner.java ## @@ -0,0 +1,126 @@ +/* +

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r695410064 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/ComplexAvroKeyGenerator.java ## @@ -47,4 +52,9 @@ public String

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r694674064 ## File path: hudi-common/src/main/java/org/apache/hudi/keygen/BaseKeyGenerator.java ## @@ -71,11 +75,28 @@ public final HoodieKey getKey(GenericRecord

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r694672580 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java ## @@ -933,6 +933,10 @@ public boolean

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r685185980 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/utils/HiveHasher.java ## @@ -0,0 +1,362 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r685129939 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java ## @@ -140,6 +140,12 @@ public static final String

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r685129787 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bucket/SparkHiveBucketIndex.java ## @@ -0,0 +1,179 @@ +/* + * Licensed to

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r685122711 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/BaseKeyGenerator.java ## @@ -71,11 +84,25 @@ public final HoodieKey

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r671039836 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/serializer/HoodieKeyV1Serializer.java ## @@ -0,0 +1,45 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r670237675 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/block/HoodieLogBlock.java ## @@ -45,8 +45,9 @@ * The current version of the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r670231829 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkHiveBucketPartitioner.java ## @@ -0,0 +1,134 @@ +/* +

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r670231707 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bucket/SparkHiveBucketIndex.java ## @@ -0,0 +1,179 @@ +/* + * Licensed to

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r670220735 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bucket/SparkHiveBucketIndex.java ## @@ -0,0 +1,179 @@ +/* + * Licensed to

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r670215889 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bucket/SparkHiveBucketIndex.java ## @@ -0,0 +1,179 @@ +/* + * Licensed to

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r669628423 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/utils/HiveHasher.java ## @@ -0,0 +1,362 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r669650790 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/utils/HiveHasher.java ## @@ -0,0 +1,362 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r669645301 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bucket/SparkHiveBucketIndex.java ## @@ -0,0 +1,179 @@ +/* + * Licensed to

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r669636892 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/serializer/HoodieKeyV1Serializer.java ## @@ -0,0 +1,45 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r669634406 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bucket/SparkHiveBucketIndex.java ## @@ -0,0 +1,179 @@ +/* + * Licensed to

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r669629400 ## File path: hudi-client/hudi-client-common/src/test/java/org/apache/hudi/utils/TestHiveBucketUtils.java ## @@ -0,0 +1,62 @@ +/* + * Licensed to the

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r669628423 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/utils/HiveHasher.java ## @@ -0,0 +1,362 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r669628423 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/utils/HiveHasher.java ## @@ -0,0 +1,362 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r669624501 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/BaseCommitActionExecutor.java ## @@ -75,6 +77,11 @@ public

  1   2   >