[jira] [Resolved] (SPARK-28652) spark.kubernetes.pyspark.pythonVersion is never passed to executors

2019-08-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28652. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25411

[jira] [Assigned] (SPARK-28652) spark.kubernetes.pyspark.pythonVersion is never passed to executors

2019-08-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28652: Assignee: Liang-Chi Hsieh > spark.kubernetes.pyspark.pythonVersion is never passed to

[jira] [Commented] (SPARK-28689) Unable to successfully issue spark sql code

2019-08-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904844#comment-16904844 ] Hyukjin Kwon commented on SPARK-28689: -- For questions, let's ask to mailing list. You will have a

[jira] [Resolved] (SPARK-28689) Unable to successfully issue spark sql code

2019-08-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28689. -- Resolution: Invalid > Unable to successfully issue spark sql code >

[jira] [Updated] (SPARK-28689) Unable to successfully issue spark sql code

2019-08-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28689: - Target Version/s: (was: 2.4.3) > Unable to successfully issue spark sql code >

[jira] [Updated] (SPARK-28683) Upgrade Scala to 2.12.10

2019-08-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28683: -- Description: *Note that we tested 2.12.9 via https://github.com/apache/spark/pull/25404 and

[jira] [Updated] (SPARK-28683) Upgrade Scala to 2.12.10

2019-08-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28683: -- Description: **Note that we tested 2.12.9 and found that 2.12.9 has a serious bug,

[jira] [Commented] (SPARK-28683) Upgrade Scala to 2.12.9

2019-08-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904835#comment-16904835 ] Dongjoon Hyun commented on SPARK-28683: --- [~yumwang]. Let's reuse this issue for Scala 2.12.10. >

[jira] [Reopened] (SPARK-28683) Upgrade Scala to 2.12.9

2019-08-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-28683: --- > Upgrade Scala to 2.12.9 > --- > > Key: SPARK-28683 >

[jira] [Updated] (SPARK-28683) Upgrade Scala to 2.12.10

2019-08-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28683: -- Summary: Upgrade Scala to 2.12.10 (was: Upgrade Scala to 2.12.9) > Upgrade Scala to 2.12.10

[jira] [Commented] (SPARK-28652) spark.kubernetes.pyspark.pythonVersion is never passed to executors

2019-08-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904797#comment-16904797 ] Hyukjin Kwon commented on SPARK-28652: -- +1 for [~viirya]'s judgement here. >

[jira] [Updated] (SPARK-28691) Examples of streaming support kafka with kerberos

2019-08-11 Thread hong dongdong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hong dongdong updated SPARK-28691: -- Description: Now, DirectKafkaWordCount example is not support to visit kafka using kerberos

[jira] [Created] (SPARK-28691) Examples of streaming support kafka with kerberos

2019-08-11 Thread hong dongdong (JIRA)
hong dongdong created SPARK-28691: - Summary: Examples of streaming support kafka with kerberos Key: SPARK-28691 URL: https://issues.apache.org/jira/browse/SPARK-28691 Project: Spark Issue

[jira] [Resolved] (SPARK-28683) Upgrade Scala to 2.12.9

2019-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-28683. - Resolution: Won't Fix > Upgrade Scala to 2.12.9 > --- > >

[jira] [Commented] (SPARK-28683) Upgrade Scala to 2.12.9

2019-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904768#comment-16904768 ] Yuming Wang commented on SPARK-28683: -  Let's wait for 2.12.10 since

[jira] [Updated] (SPARK-28688) Incompatible java.util.ArrayList

2019-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28688: Summary: Incompatible java.util.ArrayList (was: incompatible java.util.ArrayList) >

[jira] [Updated] (SPARK-28652) spark.kubernetes.pyspark.pythonVersion is never passed to executors

2019-08-11 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-28652: Priority: Minor (was: Major) > spark.kubernetes.pyspark.pythonVersion is never passed to

[jira] [Updated] (SPARK-28652) spark.kubernetes.pyspark.pythonVersion is never passed to executors

2019-08-11 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-28652: Issue Type: Test (was: Bug) > spark.kubernetes.pyspark.pythonVersion is never passed to

[jira] [Commented] (SPARK-28652) spark.kubernetes.pyspark.pythonVersion is never passed to executors

2019-08-11 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904743#comment-16904743 ] Liang-Chi Hsieh commented on SPARK-28652: - As existing tests don't explicitly check the Python

[jira] [Commented] (SPARK-28652) spark.kubernetes.pyspark.pythonVersion is never passed to executors

2019-08-11 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904729#comment-16904729 ] Liang-Chi Hsieh commented on SPARK-28652: - This looks interesting to me. I tried to look into

[jira] [Updated] (SPARK-28420) Date/Time Functions: date_part for intervals

2019-08-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28420: --- Description: ||Function||Return Type||Description||Example||Result|| |{{date_part(}}{{text}}{{, 

[jira] [Updated] (SPARK-28420) Date/Time Functions: date_part for intervals

2019-08-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28420: --- Summary: Date/Time Functions: date_part for intervals (was: Date/Time Functions: date_part) >

[jira] [Updated] (SPARK-28690) Date/Time Functions: date_part for intervals

2019-08-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28690: --- Description: ||Function||Return Type||Description||Example||Result|| |{{date_part(}}{{text}}{{, 

[jira] [Updated] (SPARK-28690) Date/Time Functions: date_part for timestamps

2019-08-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28690: --- Summary: Date/Time Functions: date_part for timestamps (was: Date/Time Functions: date_part for

[jira] [Created] (SPARK-28690) Date/Time Functions: date_part for intervals

2019-08-11 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28690: -- Summary: Date/Time Functions: date_part for intervals Key: SPARK-28690 URL: https://issues.apache.org/jira/browse/SPARK-28690 Project: Spark Issue Type:

[jira] [Created] (SPARK-28689) Unable to successfully issue spark sql code

2019-08-11 Thread CARLTON PATTERSON (JIRA)
CARLTON PATTERSON created SPARK-28689: - Summary: Unable to successfully issue spark sql code Key: SPARK-28689 URL: https://issues.apache.org/jira/browse/SPARK-28689 Project: Spark Issue

[jira] [Updated] (SPARK-28688) incompatible java.util.ArrayList

2019-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28688: Description: {{2 TESTS FAILED}} from {{org.apache.spark.sql.hive.client.VersionsSuite}}

[jira] [Updated] (SPARK-28688) incompatible java.util.ArrayList

2019-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28688: Attachment: screenshot-2.png > incompatible java.util.ArrayList >

[jira] [Updated] (SPARK-28688) incompatible java.util.ArrayList

2019-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28688: Attachment: screenshot-1.png > incompatible java.util.ArrayList >

[jira] [Created] (SPARK-28688) incompatible java.util.ArrayList

2019-08-11 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28688: --- Summary: incompatible java.util.ArrayList Key: SPARK-28688 URL: https://issues.apache.org/jira/browse/SPARK-28688 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-28687) Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`

2019-08-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28687: --- Description: Currently, we support these field for EXTRACT: CENTURY, MILLENNIUM, DECADE, YEAR,

[jira] [Created] (SPARK-28687) Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`

2019-08-11 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28687: -- Summary: Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()` Key: SPARK-28687 URL: https://issues.apache.org/jira/browse/SPARK-28687 Project:

[jira] [Updated] (SPARK-28686) Higher precision in Math.toRadians from JDK 11

2019-08-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28686: Description: {{- udf_radians *** FAILED *** (1 second, 791 milliseconds)}} from

[jira] [Created] (SPARK-28686) Higher precision in Math.toRadians from JDK 11

2019-08-11 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28686: --- Summary: Higher precision in Math.toRadians from JDK 11 Key: SPARK-28686 URL: https://issues.apache.org/jira/browse/SPARK-28686 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-28639) Configuration doc for Barrier Execution Mode

2019-08-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28639. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25370

[jira] [Updated] (SPARK-28639) Configuration doc for Barrier Execution Mode

2019-08-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28639: -- Priority: Minor (was: Major) > Configuration doc for Barrier Execution Mode >

[jira] [Commented] (SPARK-28680) redundant code, or possible bug in Partitioner that could mess up check against spark.default.parallelism

2019-08-11 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904599#comment-16904599 ] Shivu Sondur commented on SPARK-28680: -- [~ch...@buildlackey.com] This is not duplicate code, it is