[GitHub] spark pull request #21618: [SPARK-20408][SQL] Get the glob path in parallel ...

[xuanyuanking]

Github user xuanyuanking commented on a diff in the pull request:

    https://github.com/apache/spark/pull/21618#discussion_r216147887
  
    --- Diff: 
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
    @@ -1557,6 +1576,15 @@ class SQLConf extends Serializable with Logging {
       def parallelPartitionDiscoveryParallelism: Int =
         getConf(SQLConf.PARALLEL_PARTITION_DISCOVERY_PARALLELISM)
     
    +  def parallelGetGlobbedPathThreshold: Int =
    +    getConf(SQLConf.PARALLEL_GET_GLOBBED_PATH_THRESHOLD)
    +
    +  def parallelGetGlobbedPathNumThreads: Int =
    +    getConf(SQLConf.PARALLEL_GET_GLOBBED_PATH_NUM_THREADS)
    +
    +  def parallelGetGlobbedPathEnabled: Boolean =
    --- End diff --
    
    Thanks, done in 1319cd3.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org