This is an automated email from the ASF dual-hosted git repository.
ueshin pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new a011d16a24d [SPARK-44614][PYTHON][CONNECT] Add missing packages in
setup.py
a011d16a24d is described below
commit a011d16a24db383496cc64c396f08bc64f34e379
Author: Takuya UESHIN <ues...@databricks.com>
AuthorDate: Tue Aug 1 01:08:23 2023 -0700
[SPARK-44614][PYTHON][CONNECT] Add missing packages in setup.py
### What changes were proposed in this pull request?
Adds missing packages in `setup.py`.
### Why are the changes needed?
The following packages are not listed in `setup.py`.
- `pyspark.sql.connect.avro`
- `pyspark.sql.connect.client`
- `pyspark.sql.connect.streaming`
- `pyspark.ml.connect`
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
The existing tests.
Closes #42248 from ueshin/issues/SPARK-44614/packages.
Authored-by: Takuya UESHIN <ues...@databricks.com>
Signed-off-by: Takuya UESHIN <ues...@databricks.com>
---
python/setup.py | 6 +++++-
1 file changed, 5 insertions(+), 1 deletion(-)
diff --git a/python/setup.py b/python/setup.py
index 2282b2535e7..6642ec5042f 100755
--- a/python/setup.py
+++ b/python/setup.py
@@ -238,6 +238,7 @@ try:
"pyspark.mllib.linalg",
"pyspark.mllib.stat",
"pyspark.ml",
+ "pyspark.ml.connect",
"pyspark.ml.linalg",
"pyspark.ml.param",
"pyspark.ml.torch",
@@ -245,13 +246,16 @@ try:
"pyspark.sql",
"pyspark.sql.avro",
"pyspark.sql.connect",
+ "pyspark.sql.connect.avro",
+ "pyspark.sql.connect.client",
"pyspark.sql.connect.proto",
+ "pyspark.sql.connect.streaming",
+ "pyspark.sql.connect.streaming.worker",
"pyspark.sql.pandas",
"pyspark.sql.protobuf",
"pyspark.sql.streaming",
"pyspark.sql.worker",
"pyspark.streaming",
- "pyspark.sql.connect.streaming.worker",
"pyspark.bin",
"pyspark.sbin",
"pyspark.jars",
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
