[GitHub] [hudi] jonvex commented on a diff in pull request #8303: [HUDI-5998] Speed up reads from bootstrapped tables in spark

2023-05-23 Thread via GitHub
jonvex commented on code in PR #8303: URL: https://github.com/apache/hudi/pull/8303#discussion_r1202649672 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBootstrapRelation.scala: ## @@ -188,11 +188,23 @@ case class HoodieBootstrapRelation(overrid

[GitHub] [hudi] jonvex commented on a diff in pull request #8303: [HUDI-5998] Speed up reads from bootstrapped tables in spark

2023-04-28 Thread via GitHub
jonvex commented on code in PR #8303: URL: https://github.com/apache/hudi/pull/8303#discussion_r1180579947 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala: ## @@ -271,6 +273,25 @@ object DefaultSource { } } + private def r

[GitHub] [hudi] jonvex commented on a diff in pull request #8303: [HUDI-5998] Speed up reads from bootstrapped tables in spark

2023-04-28 Thread via GitHub
jonvex commented on code in PR #8303: URL: https://github.com/apache/hudi/pull/8303#discussion_r1180550309 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala: ## @@ -271,6 +273,25 @@ object DefaultSource { } } + private def r

[GitHub] [hudi] jonvex commented on a diff in pull request #8303: [HUDI-5998] Speed up reads from bootstrapped tables in spark

2023-04-13 Thread via GitHub
jonvex commented on code in PR #8303: URL: https://github.com/apache/hudi/pull/8303#discussion_r116978 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala: ## @@ -270,6 +271,21 @@ object DefaultSource { } } + private def r

[GitHub] [hudi] jonvex commented on a diff in pull request #8303: [HUDI-5998] Speed up reads from bootstrapped tables in spark

2023-04-12 Thread via GitHub
jonvex commented on code in PR #8303: URL: https://github.com/apache/hudi/pull/8303#discussion_r1164683803 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala: ## @@ -270,6 +271,21 @@ object DefaultSource { } } + private def r

[GitHub] [hudi] jonvex commented on a diff in pull request #8303: [HUDI-5998] Speed up reads from bootstrapped tables in spark

2023-04-12 Thread via GitHub
jonvex commented on code in PR #8303: URL: https://github.com/apache/hudi/pull/8303#discussion_r1164217702 ## docker/demo/sparksql-batch2.commands: ## @@ -26,7 +26,8 @@ spark.sql("select `_hoodie_commit_time`, symbol, ts, volume, open, close from s spark.sql("select symbol, m

[GitHub] [hudi] jonvex commented on a diff in pull request #8303: [HUDI-5998] Speed up reads from bootstrapped tables in spark

2023-04-11 Thread via GitHub
jonvex commented on code in PR #8303: URL: https://github.com/apache/hudi/pull/8303#discussion_r1163162168 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala: ## @@ -270,6 +271,21 @@ object DefaultSource { } } + private def r

[GitHub] [hudi] jonvex commented on a diff in pull request #8303: [HUDI-5998] Speed up reads from bootstrapped tables in spark

2023-04-11 Thread via GitHub
jonvex commented on code in PR #8303: URL: https://github.com/apache/hudi/pull/8303#discussion_r1162986794 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala: ## @@ -100,7 +101,7 @@ class DefaultSource extends RelationProvider )

[GitHub] [hudi] jonvex commented on a diff in pull request #8303: [HUDI-5998] Speed up reads from bootstrapped tables in spark

2023-04-10 Thread via GitHub
jonvex commented on code in PR #8303: URL: https://github.com/apache/hudi/pull/8303#discussion_r1161793098 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala: ## @@ -270,6 +271,21 @@ object DefaultSource { } } + private def r

[GitHub] [hudi] jonvex commented on a diff in pull request #8303: [HUDI-5998] Speed up reads from bootstrapped tables in spark

2023-04-04 Thread via GitHub
jonvex commented on code in PR #8303: URL: https://github.com/apache/hudi/pull/8303#discussion_r1157379761 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/TestHoodieSparkSqlWriter.scala: ## @@ -807,7 +807,9 @@ class TestHoodieSparkSqlWriter { .option(

[GitHub] [hudi] jonvex commented on a diff in pull request #8303: [HUDI-5998] Speed up reads from bootstrapped tables in spark

2023-04-04 Thread via GitHub
jonvex commented on code in PR #8303: URL: https://github.com/apache/hudi/pull/8303#discussion_r1157363856 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieFileIndex.scala: ## @@ -180,6 +180,22 @@ case class HoodieFileIndex(spark: SparkSession,

[GitHub] [hudi] jonvex commented on a diff in pull request #8303: [HUDI-5998] Speed up reads from bootstrapped tables in spark

2023-04-04 Thread via GitHub
jonvex commented on code in PR #8303: URL: https://github.com/apache/hudi/pull/8303#discussion_r1157360595 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala: ## @@ -270,6 +271,21 @@ object DefaultSource { } } + private def r