(spark) branch master updated: [SPARK-48205][PYTHON] Remove the private[sql] modifier for Python data sources

[gurwls223]

This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 4fb6624bd2ce [SPARK-48205][PYTHON] Remove the private[sql] modifier 
for Python data sources
4fb6624bd2ce is described below

commit 4fb6624bd2cec0fec893ea0ac65b1a02c60384ec
Author: allisonwang-db <allison.w...@databricks.com>
AuthorDate: Thu May 9 08:22:48 2024 +0900

    [SPARK-48205][PYTHON] Remove the private[sql] modifier for Python data 
sources
    
    ### What changes were proposed in this pull request?
    
    This PR removes the `private[sql]` modifier for Python data sources to make 
it consistent with UDFs and UDTFs.
    
    ### Why are the changes needed?
    
    ### Does this PR introduce _any_ user-facing change?
    
    No
    
    ### How was this patch tested?
    
    Existing tests
    
    ### Was this patch authored or co-authored using generative AI tooling?
    
    No
    
    Closes #46487 from allisonwang-db/spark-48205-pyds-modifier.
    
    Authored-by: allisonwang-db <allison.w...@databricks.com>
    Signed-off-by: Hyukjin Kwon <gurwls...@apache.org>
---
 .../src/main/scala/org/apache/spark/sql/DataSourceRegistration.scala    | 2 +-
 sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala         | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

diff --git 
a/sql/core/src/main/scala/org/apache/spark/sql/DataSourceRegistration.scala 
b/sql/core/src/main/scala/org/apache/spark/sql/DataSourceRegistration.scala
index 63cee8861c5a..8ffdbb952b08 100644
--- a/sql/core/src/main/scala/org/apache/spark/sql/DataSourceRegistration.scala
+++ b/sql/core/src/main/scala/org/apache/spark/sql/DataSourceRegistration.scala
@@ -30,7 +30,7 @@ import org.apache.spark.sql.internal.SQLConf
  * Use `SparkSession.dataSource` to access this.
  */
 @Evolving
-private[sql] class DataSourceRegistration private[sql] (dataSourceManager: 
DataSourceManager)
+class DataSourceRegistration private[sql] (dataSourceManager: 
DataSourceManager)
   extends Logging {
 
   protected[sql] def registerPython(
diff --git a/sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala 
b/sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala
index 5d85f070fbbe..d5de74455dce 100644
--- a/sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala
+++ b/sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala
@@ -234,7 +234,7 @@ class SparkSession private(
   /**
    * A collection of methods for registering user-defined data sources.
    */
-  private[sql] def dataSource: DataSourceRegistration = 
sessionState.dataSourceRegistration
+  def dataSource: DataSourceRegistration = sessionState.dataSourceRegistration
 
   /**
    * Returns a `StreamingQueryManager` that allows managing all the


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org