[jira] [Updated] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

2021-10-28 Thread Hyukjin Kwon (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-37134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyukjin Kwon updated SPARK-37134:
-
Affects Version/s: (was: 1.6.2)
   3.2.0

> documentation - unclear "Using PySpark Native Features"
> ---
>
> Key: SPARK-37134
> URL: https://issues.apache.org/jira/browse/SPARK-37134
> Project: Spark
>  Issue Type: Improvement
>  Components: Documentation
>Affects Versions: 3.2.0
>Reporter: carl rees
>Priority: Major
>
> sorry, no idea on the version it affects or what Shepard is? no explanation 
> on this form so guessed whatever!
>  
> This page of your documentation is UNCLEAR
> paragraph "Using PySpark Native Features" QUOTE
> "PySpark allows to upload Python files ({{.py}}), zipped Python packages 
> ({{.zip}}), and Egg files ({{.egg}}) to the executors by:
>  * Setting the configuration setting {{spark.submit.pyFiles}}
>  * Setting {{--py-files}} option in Spark scripts
>  * Directly calling 
> [{{pyspark.SparkContext.addPyFile()}}|https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.SparkContext.addPyFile.html#pyspark.SparkContext.addPyFile]
>  in applications
>  
> QUESTION: is this all of the above or each of the above steps?
> suggest adding "OR" between each bullet point?
>  
> [https://spark.apache.org/docs/latest/api/python/user_guide/python_packaging.html]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

2021-10-27 Thread Hyukjin Kwon (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-37134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyukjin Kwon updated SPARK-37134:
-
Target Version/s:   (was: 1.6.2)

> documentation - unclear "Using PySpark Native Features"
> ---
>
> Key: SPARK-37134
> URL: https://issues.apache.org/jira/browse/SPARK-37134
> Project: Spark
>  Issue Type: Improvement
>  Components: Documentation
>Affects Versions: 1.6.2
>Reporter: carl rees
>Priority: Critical
>
> sorry, no idea on the version it affects or what Shepard is? no explanation 
> on this form so guessed whatever!
>  
> This page of your documentation is UNCLEAR
> paragraph "Using PySpark Native Features" QUOTE
> "PySpark allows to upload Python files ({{.py}}), zipped Python packages 
> ({{.zip}}), and Egg files ({{.egg}}) to the executors by:
>  * Setting the configuration setting {{spark.submit.pyFiles}}
>  * Setting {{--py-files}} option in Spark scripts
>  * Directly calling 
> [{{pyspark.SparkContext.addPyFile()}}|https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.SparkContext.addPyFile.html#pyspark.SparkContext.addPyFile]
>  in applications
>  
> QUESTION: is this all of the above or each of the above steps?
> suggest adding "OR" between each bullet point?
>  
> [https://spark.apache.org/docs/latest/api/python/user_guide/python_packaging.html]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

2021-10-27 Thread Hyukjin Kwon (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-37134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyukjin Kwon updated SPARK-37134:
-
Shepherd:   (was: Tenovip33)

> documentation - unclear "Using PySpark Native Features"
> ---
>
> Key: SPARK-37134
> URL: https://issues.apache.org/jira/browse/SPARK-37134
> Project: Spark
>  Issue Type: Improvement
>  Components: Documentation
>Affects Versions: 1.6.2
>Reporter: carl rees
>Priority: Major
>
> sorry, no idea on the version it affects or what Shepard is? no explanation 
> on this form so guessed whatever!
>  
> This page of your documentation is UNCLEAR
> paragraph "Using PySpark Native Features" QUOTE
> "PySpark allows to upload Python files ({{.py}}), zipped Python packages 
> ({{.zip}}), and Egg files ({{.egg}}) to the executors by:
>  * Setting the configuration setting {{spark.submit.pyFiles}}
>  * Setting {{--py-files}} option in Spark scripts
>  * Directly calling 
> [{{pyspark.SparkContext.addPyFile()}}|https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.SparkContext.addPyFile.html#pyspark.SparkContext.addPyFile]
>  in applications
>  
> QUESTION: is this all of the above or each of the above steps?
> suggest adding "OR" between each bullet point?
>  
> [https://spark.apache.org/docs/latest/api/python/user_guide/python_packaging.html]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

2021-10-27 Thread Hyukjin Kwon (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-37134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyukjin Kwon updated SPARK-37134:
-
Priority: Major  (was: Critical)

> documentation - unclear "Using PySpark Native Features"
> ---
>
> Key: SPARK-37134
> URL: https://issues.apache.org/jira/browse/SPARK-37134
> Project: Spark
>  Issue Type: Improvement
>  Components: Documentation
>Affects Versions: 1.6.2
>Reporter: carl rees
>Priority: Major
>
> sorry, no idea on the version it affects or what Shepard is? no explanation 
> on this form so guessed whatever!
>  
> This page of your documentation is UNCLEAR
> paragraph "Using PySpark Native Features" QUOTE
> "PySpark allows to upload Python files ({{.py}}), zipped Python packages 
> ({{.zip}}), and Egg files ({{.egg}}) to the executors by:
>  * Setting the configuration setting {{spark.submit.pyFiles}}
>  * Setting {{--py-files}} option in Spark scripts
>  * Directly calling 
> [{{pyspark.SparkContext.addPyFile()}}|https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.SparkContext.addPyFile.html#pyspark.SparkContext.addPyFile]
>  in applications
>  
> QUESTION: is this all of the above or each of the above steps?
> suggest adding "OR" between each bullet point?
>  
> [https://spark.apache.org/docs/latest/api/python/user_guide/python_packaging.html]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

2021-10-27 Thread Hyukjin Kwon (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-37134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyukjin Kwon updated SPARK-37134:
-
Environment: (was: ?)

> documentation - unclear "Using PySpark Native Features"
> ---
>
> Key: SPARK-37134
> URL: https://issues.apache.org/jira/browse/SPARK-37134
> Project: Spark
>  Issue Type: Improvement
>  Components: Documentation
>Affects Versions: 1.6.2
>Reporter: carl rees
>Priority: Critical
> Fix For: 1.6.2
>
>
> sorry, no idea on the version it affects or what Shepard is? no explanation 
> on this form so guessed whatever!
>  
> This page of your documentation is UNCLEAR
> paragraph "Using PySpark Native Features" QUOTE
> "PySpark allows to upload Python files ({{.py}}), zipped Python packages 
> ({{.zip}}), and Egg files ({{.egg}}) to the executors by:
>  * Setting the configuration setting {{spark.submit.pyFiles}}
>  * Setting {{--py-files}} option in Spark scripts
>  * Directly calling 
> [{{pyspark.SparkContext.addPyFile()}}|https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.SparkContext.addPyFile.html#pyspark.SparkContext.addPyFile]
>  in applications
>  
> QUESTION: is this all of the above or each of the above steps?
> suggest adding "OR" between each bullet point?
>  
> [https://spark.apache.org/docs/latest/api/python/user_guide/python_packaging.html]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

2021-10-27 Thread Hyukjin Kwon (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-37134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyukjin Kwon updated SPARK-37134:
-
Fix Version/s: (was: 1.6.2)

> documentation - unclear "Using PySpark Native Features"
> ---
>
> Key: SPARK-37134
> URL: https://issues.apache.org/jira/browse/SPARK-37134
> Project: Spark
>  Issue Type: Improvement
>  Components: Documentation
>Affects Versions: 1.6.2
>Reporter: carl rees
>Priority: Critical
>
> sorry, no idea on the version it affects or what Shepard is? no explanation 
> on this form so guessed whatever!
>  
> This page of your documentation is UNCLEAR
> paragraph "Using PySpark Native Features" QUOTE
> "PySpark allows to upload Python files ({{.py}}), zipped Python packages 
> ({{.zip}}), and Egg files ({{.egg}}) to the executors by:
>  * Setting the configuration setting {{spark.submit.pyFiles}}
>  * Setting {{--py-files}} option in Spark scripts
>  * Directly calling 
> [{{pyspark.SparkContext.addPyFile()}}|https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.SparkContext.addPyFile.html#pyspark.SparkContext.addPyFile]
>  in applications
>  
> QUESTION: is this all of the above or each of the above steps?
> suggest adding "OR" between each bullet point?
>  
> [https://spark.apache.org/docs/latest/api/python/user_guide/python_packaging.html]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-37134) documentation - unclear "Using PySpark Native Features"

2021-10-27 Thread carl rees (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-37134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

carl rees updated SPARK-37134:
--
Description: 
sorry, no idea on the version it affects or what Shepard is? no explanation on 
this form so guessed whatever!

 

This page of your documentation is UNCLEAR

paragraph "Using PySpark Native Features" QUOTE

"PySpark allows to upload Python files ({{.py}}), zipped Python packages 
({{.zip}}), and Egg files ({{.egg}}) to the executors by:
 * Setting the configuration setting {{spark.submit.pyFiles}}

 * Setting {{--py-files}} option in Spark scripts

 * Directly calling 
[{{pyspark.SparkContext.addPyFile()}}|https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.SparkContext.addPyFile.html#pyspark.SparkContext.addPyFile]
 in applications

 

QUESTION: is this all of the above or each of the above steps?

suggest adding "OR" between each bullet point?

 

[https://spark.apache.org/docs/latest/api/python/user_guide/python_packaging.html]

 

  was:
sorry, no idea on the version it affects or what Shepard is? no explanation on 
this form so guessed whatever!

 

This page of your documentation is UNCLEAR

paragraph "Using PySpark Native Features" QUOTE

"PySpark allows to upload Python files ({{.py}}), zipped Python packages 
({{.zip}}), and Egg files ({{.egg}}) to the executors by:
 * Setting the configuration setting {{spark.submit.pyFiles}}

 * Setting {{--py-files}} option in Spark scripts

 * Directly calling 
[{{pyspark.SparkContext.addPyFile()}}|https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.SparkContext.addPyFile.html#pyspark.SparkContext.addPyFile]
 in applications

 

QUESTION: is this all of the above or each of the above steps?

 

[https://spark.apache.org/docs/latest/api/python/user_guide/python_packaging.html]

 


> documentation - unclear "Using PySpark Native Features"
> ---
>
> Key: SPARK-37134
> URL: https://issues.apache.org/jira/browse/SPARK-37134
> Project: Spark
>  Issue Type: Improvement
>  Components: Documentation
>Affects Versions: 1.6.2
> Environment: ?
>Reporter: carl rees
>Priority: Critical
> Fix For: 1.6.2
>
>
> sorry, no idea on the version it affects or what Shepard is? no explanation 
> on this form so guessed whatever!
>  
> This page of your documentation is UNCLEAR
> paragraph "Using PySpark Native Features" QUOTE
> "PySpark allows to upload Python files ({{.py}}), zipped Python packages 
> ({{.zip}}), and Egg files ({{.egg}}) to the executors by:
>  * Setting the configuration setting {{spark.submit.pyFiles}}
>  * Setting {{--py-files}} option in Spark scripts
>  * Directly calling 
> [{{pyspark.SparkContext.addPyFile()}}|https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.SparkContext.addPyFile.html#pyspark.SparkContext.addPyFile]
>  in applications
>  
> QUESTION: is this all of the above or each of the above steps?
> suggest adding "OR" between each bullet point?
>  
> [https://spark.apache.org/docs/latest/api/python/user_guide/python_packaging.html]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org