[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7528: [HUDI-5443] Fixing exception trying to read MOR table after `NestedSchemaPruning` rule has been applied

2023-01-23 Thread via GitHub
alexeykudinkin commented on code in PR #7528: URL: https://github.com/apache/hudi/pull/7528#discussion_r1084673705 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieMergeOnReadRDD.scala: ## @@ -138,10 +137,16 @@ class HoodieMergeOnReadRDD(@transient

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7528: [HUDI-5443] Fixing exception trying to read MOR table after `NestedSchemaPruning` rule has been applied

2023-01-23 Thread via GitHub
alexeykudinkin commented on code in PR #7528: URL: https://github.com/apache/hudi/pull/7528#discussion_r1084393671 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala: ## @@ -106,18 +112,16 @@ class BaseFileOnlyRelation(sqlContext

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7528: [HUDI-5443] Fixing exception trying to read MOR table after `NestedSchemaPruning` rule has been applied

2023-01-23 Thread via GitHub
alexeykudinkin commented on code in PR #7528: URL: https://github.com/apache/hudi/pull/7528#discussion_r1067595140 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala: ## @@ -106,18 +112,16 @@ class BaseFileOnlyRelation(sqlContext

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7528: [HUDI-5443] Fixing exception trying to read MOR table after `NestedSchemaPruning` rule has been applied

2023-01-23 Thread via GitHub
alexeykudinkin commented on code in PR #7528: URL: https://github.com/apache/hudi/pull/7528#discussion_r1083321386 ## hudi-client/hudi-spark-client/src/main/scala/org/apache/spark/sql/HoodieCatalystExpressionUtils.scala: ## @@ -78,14 +80,52 @@ object HoodieCatalystExpressionUtil

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7528: [HUDI-5443] Fixing exception trying to read MOR table after `NestedSchemaPruning` rule has been applied

2023-01-21 Thread via GitHub
alexeykudinkin commented on code in PR #7528: URL: https://github.com/apache/hudi/pull/7528#discussion_r1083321450 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieMergeOnReadRDD.scala: ## @@ -138,10 +137,16 @@ class HoodieMergeOnReadRDD(@transient

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7528: [HUDI-5443] Fixing exception trying to read MOR table after `NestedSchemaPruning` rule has been applied

2023-01-21 Thread via GitHub
alexeykudinkin commented on code in PR #7528: URL: https://github.com/apache/hudi/pull/7528#discussion_r1083321386 ## hudi-client/hudi-spark-client/src/main/scala/org/apache/spark/sql/HoodieCatalystExpressionUtils.scala: ## @@ -78,14 +80,52 @@ object HoodieCatalystExpressionUtil

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7528: [HUDI-5443] Fixing exception trying to read MOR table after `NestedSchemaPruning` rule has been applied

2023-01-21 Thread via GitHub
alexeykudinkin commented on code in PR #7528: URL: https://github.com/apache/hudi/pull/7528#discussion_r1083314313 ## hudi-client/hudi-spark-client/src/main/scala/org/apache/spark/sql/HoodieCatalystExpressionUtils.scala: ## @@ -78,14 +80,52 @@ object HoodieCatalystExpressionUtil

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7528: [HUDI-5443] Fixing exception trying to read MOR table after `NestedSchemaPruning` rule has been applied

2023-01-21 Thread via GitHub
alexeykudinkin commented on code in PR #7528: URL: https://github.com/apache/hudi/pull/7528#discussion_r1083261673 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestNestedSchemaPruningOptimization.scala: ## @@ -113,6 +113,9 @@ class TestNestedSchem

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7528: [HUDI-5443] Fixing exception trying to read MOR table after `NestedSchemaPruning` rule has been applied

2023-01-11 Thread GitBox
alexeykudinkin commented on code in PR #7528: URL: https://github.com/apache/hudi/pull/7528#discussion_r1067596208 ## hudi-client/hudi-spark-client/src/main/scala/org/apache/spark/sql/HoodieCatalystExpressionUtils.scala: ## @@ -78,14 +80,52 @@ object HoodieCatalystExpressionUtil

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7528: [HUDI-5443] Fixing exception trying to read MOR table after `NestedSchemaPruning` rule has been applied

2023-01-11 Thread GitBox
alexeykudinkin commented on code in PR #7528: URL: https://github.com/apache/hudi/pull/7528#discussion_r1067594500 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieMergeOnReadRDD.scala: ## @@ -138,10 +137,16 @@ class HoodieMergeOnReadRDD(@transient

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7528: [HUDI-5443] Fixing exception trying to read MOR table after `NestedSchemaPruning` rule has been applied

2023-01-11 Thread GitBox
alexeykudinkin commented on code in PR #7528: URL: https://github.com/apache/hudi/pull/7528#discussion_r1067594366 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala: ## @@ -67,6 +70,9 @@ class BaseFileOnlyRelation(sqlContext: SQ

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7528: [HUDI-5443] Fixing exception trying to read MOR table after NestedSchemaPruning rule has been applied

2022-12-20 Thread GitBox
alexeykudinkin commented on code in PR #7528: URL: https://github.com/apache/hudi/pull/7528#discussion_r1054026446 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/common/HoodieSparkEngineContext.java: ## @@ -57,15 +57,15 @@ public class HoodieSparkEngineCon