[GitHub] [spark] WeichenXu123 commented on a diff in pull request #40954: [PYSPARK] [CONNECT] [ML] PySpark UDF supports python package dependencies

WeichenXu123 commented on code in PR #40954: URL: https://github.com/apache/spark/pull/40954#discussion_r1177556859 ## core/src/main/scala/org/apache/spark/api/python/PythonEnvSetup.scala: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [spark] WeichenXu123 commented on a diff in pull request #40954: [PYSPARK] [CONNECT] [ML] PySpark UDF supports python package dependencies

WeichenXu123 commented on code in PR #40954: URL: https://github.com/apache/spark/pull/40954#discussion_r1177559376 ## core/src/main/scala/org/apache/spark/api/python/PythonEnvSetup.scala: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [spark] WeichenXu123 commented on a diff in pull request #40954: [PYSPARK] [CONNECT] [ML] PySpark UDF supports python package dependencies

WeichenXu123 commented on code in PR #40954: URL: https://github.com/apache/spark/pull/40954#discussion_r1177557772 ## python/pyspark/pythonenv/pip_req_parser.py: ## @@ -0,0 +1,191 @@ +# -*- coding: utf-8 -*- +# +# Licensed to the Apache Software Foundation (ASF) under one or mo

[GitHub] [spark] WeichenXu123 commented on a diff in pull request #40954: [PYSPARK] [CONNECT] [ML] PySpark UDF supports python package dependencies

WeichenXu123 commented on code in PR #40954: URL: https://github.com/apache/spark/pull/40954#discussion_r1177556859 ## core/src/main/scala/org/apache/spark/api/python/PythonEnvSetup.scala: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [spark] WeichenXu123 commented on a diff in pull request #40954: [PYSPARK] [CONNECT] [ML] PySpark UDF supports python package dependencies

WeichenXu123 commented on code in PR #40954: URL: https://github.com/apache/spark/pull/40954#discussion_r1177395283 ## core/src/main/scala/org/apache/spark/api/python/PythonEnvSetup.scala: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or