[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r563213871 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/parquet/ParquetPartitionReaderFactory.scala ## @@ -225,6 +230,7

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r563213809 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileMetaCacheManager.scala ## @@ -0,0 +1,75 @@ +/* + * Licensed to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r563213655 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileMetaCacheManager.scala ## @@ -0,0 +1,75 @@ +/* + * Licensed to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r563213572 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFileMeta.scala ## @@ -0,0 +1,48 @@ +/* + * Licensed to the

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r563213415 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileMetaCacheManager.scala ## @@ -0,0 +1,75 @@ +/* + * Licensed to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r563213189 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileMetaCacheManager.scala ## @@ -0,0 +1,75 @@ +/* + * Licensed to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r563212908 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -838,6 +845,20 @@ object SQLConf { .booleanConf

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r563212780 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -838,6 +845,20 @@ object SQLConf { .booleanConf

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r563212548 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -838,6 +845,20 @@ object SQLConf { .booleanConf

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r563212466 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -785,6 +785,13 @@ object SQLConf { .booleanConf

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r563212195 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -785,6 +785,13 @@ object SQLConf { .booleanConf

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r546147807 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -818,6 +825,20 @@ object SQLConf { .booleanConf

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r546147756 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -765,6 +765,13 @@ object SQLConf { .booleanConf

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r529778176 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -765,6 +765,11 @@ object SQLConf { .booleanConf