[jira] [Assigned] (SPARK-26223) Scan: track metastore operation time

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26223: Assignee: Apache Spark > Scan: track metastore operation time >

[jira] [Assigned] (SPARK-26223) Scan: track metastore operation time

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26223: Assignee: (was: Apache Spark) > Scan: track metastore operation time >

[jira] [Commented] (SPARK-26223) Scan: track metastore operation time

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727201#comment-16727201 ] ASF GitHub Bot commented on SPARK-26223: xuanyuanking opened a new pull request #23371:

[jira] [Commented] (SPARK-26430) Upgrade Surefire plugin to 3.0.0-M2

2018-12-21 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727198#comment-16727198 ] Dongjoon Hyun commented on SPARK-26430: --- cc [~dbtsai] > Upgrade Surefire plugin to 3.0.0-M2 >

[jira] [Assigned] (SPARK-26430) Upgrade Surefire plugin to 3.0.0-M2

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26430: Assignee: Apache Spark > Upgrade Surefire plugin to 3.0.0-M2 >

[jira] [Assigned] (SPARK-26430) Upgrade Surefire plugin to 3.0.0-M2

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26430: Assignee: (was: Apache Spark) > Upgrade Surefire plugin to 3.0.0-M2 >

[jira] [Commented] (SPARK-26430) Upgrade Surefire plugin to 3.0.0-M2

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727193#comment-16727193 ] ASF GitHub Bot commented on SPARK-26430: dongjoon-hyun opened a new pull request #23370:

[jira] [Created] (SPARK-26430) Upgrade Surefire plugin to 3.0.0-M2

2018-12-21 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-26430: - Summary: Upgrade Surefire plugin to 3.0.0-M2 Key: SPARK-26430 URL: https://issues.apache.org/jira/browse/SPARK-26430 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-26429) Add jdbc sink support for Structured Streaming

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26429: Assignee: Apache Spark > Add jdbc sink support for Structured Streaming >

[jira] [Assigned] (SPARK-26429) Add jdbc sink support for Structured Streaming

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26429: Assignee: (was: Apache Spark) > Add jdbc sink support for Structured Streaming >

[jira] [Commented] (SPARK-26429) Add jdbc sink support for Structured Streaming

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727186#comment-16727186 ] ASF GitHub Bot commented on SPARK-26429: yanlin-Lynn opened a new pull request #23369:

[jira] [Created] (SPARK-26429) Add jdbc sink support for Structured Streaming

2018-12-21 Thread Wang Yanlin (JIRA)
Wang Yanlin created SPARK-26429: --- Summary: Add jdbc sink support for Structured Streaming Key: SPARK-26429 URL: https://issues.apache.org/jira/browse/SPARK-26429 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26269) YarnAllocator should have same blacklist behaviour with YARN to maxmize use of cluster resource

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727179#comment-16727179 ] ASF GitHub Bot commented on SPARK-26269: Ngone51 opened a new pull request #23368:

[jira] [Commented] (SPARK-26216) Do not use case class as public API (ScalaUDF)

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727177#comment-16727177 ] ASF GitHub Bot commented on SPARK-26216: asfgit closed pull request #23351:

[jira] [Commented] (SPARK-26428) Minimize deprecated `ProcessingTime` usage

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727173#comment-16727173 ] ASF GitHub Bot commented on SPARK-26428: dongjoon-hyun opened a new pull request #23367:

[jira] [Assigned] (SPARK-26428) Minimize deprecated `ProcessingTime` usage

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26428: Assignee: Apache Spark > Minimize deprecated `ProcessingTime` usage >

[jira] [Assigned] (SPARK-26428) Minimize deprecated `ProcessingTime` usage

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26428: Assignee: (was: Apache Spark) > Minimize deprecated `ProcessingTime` usage >

[jira] [Updated] (SPARK-26428) Minimize deprecated `ProcessingTime` usage

2018-12-21 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26428: -- Description: Use of `ProcessingTime` class was deprecated in favor of

[jira] [Updated] (SPARK-26428) Minimize deprecated `ProcessingTime` usage

2018-12-21 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26428: -- Description: Use of `ProcessingTime` class was deprecated in favor of

[jira] [Created] (SPARK-26428) Minimize deprecated `ProcessingTime` usage

2018-12-21 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-26428: - Summary: Minimize deprecated `ProcessingTime` usage Key: SPARK-26428 URL: https://issues.apache.org/jira/browse/SPARK-26428 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26269) YarnAllocator should have same blacklist behaviour with YARN to maxmize use of cluster resource

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727167#comment-16727167 ] ASF GitHub Bot commented on SPARK-26269: Ngone51 opened a new pull request #23366:

[jira] [Updated] (SPARK-26267) Kafka source may reprocess data

2018-12-21 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-26267: - Fix Version/s: 3.0.0 > Kafka source may reprocess data > --- > >

[jira] [Commented] (SPARK-26366) Except with transform regression

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727121#comment-16727121 ] ASF GitHub Bot commented on SPARK-26366: gatorsmile closed pull request #23350:

[jira] [Commented] (SPARK-23458) Flaky test: OrcQuerySuite

2018-12-21 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727087#comment-16727087 ] Dongjoon Hyun commented on SPARK-23458: --- SPARK-26427 will land ORC 1.5.4 to `master` branch with

[jira] [Commented] (SPARK-24491) Support for requesting GPU resources on K8S

2018-12-21 Thread Alex Milowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727052#comment-16727052 ] Alex Milowski commented on SPARK-24491: --- Agreed. Pod Templates is the right solution. > Support

[jira] [Updated] (SPARK-26402) Accessing nested fields with different cases in case insensitive mode

2018-12-21 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-26402: Description: {{GetStructField}} with different optional names should be semantically equal. We will use

[jira] [Updated] (SPARK-26402) Accessing nested fields with different cases in case insensitive mode

2018-12-21 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-26402: Description: GetStructField with different optional names should be semantically equal. We will use this

[jira] [Resolved] (SPARK-25220) [K8S] Split out node selector config between driver and executors.

2018-12-21 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25220. Resolution: Duplicate Seems like this is covered by SPARK-24434 (pod templates). > [K8S]

[jira] [Commented] (SPARK-25220) [K8S] Split out node selector config between driver and executors.

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727009#comment-16727009 ] ASF GitHub Bot commented on SPARK-25220: vanzin closed pull request #22212: [SPARK-25220]

[jira] [Resolved] (SPARK-24491) Support for requesting GPU resources on K8S

2018-12-21 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24491. Resolution: Duplicate Consensus seems to be that pod templates (SPARK-24434) already

[jira] [Commented] (SPARK-24491) Support for requesting GPU resources on K8S

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727003#comment-16727003 ] ASF GitHub Bot commented on SPARK-24491: vanzin closed pull request #21511:

[jira] [Commented] (SPARK-25642) Add new Metrics in External Shuffle Service to help determine Network performance and Connection Handling capabilities of the Shuffle Service

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726999#comment-16726999 ] ASF GitHub Bot commented on SPARK-25642: asfgit closed pull request #22498: [SPARK-25642] :

[jira] [Resolved] (SPARK-25642) Add new Metrics in External Shuffle Service to help determine Network performance and Connection Handling capabilities of the Shuffle Service

2018-12-21 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25642. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22498

[jira] [Assigned] (SPARK-25642) Add new Metrics in External Shuffle Service to help determine Network performance and Connection Handling capabilities of the Shuffle Service

2018-12-21 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25642: -- Assignee: Parth Gandhi > Add new Metrics in External Shuffle Service to help

[jira] [Assigned] (SPARK-26269) YarnAllocator should have same blacklist behaviour with YARN to maxmize use of cluster resource

2018-12-21 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-26269: - Assignee: wuyi > YarnAllocator should have same blacklist behaviour with YARN to

[jira] [Resolved] (SPARK-26269) YarnAllocator should have same blacklist behaviour with YARN to maxmize use of cluster resource

2018-12-21 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-26269. --- Resolution: Fixed Fix Version/s: (was: 2.4.0) 3.0.0 >

[jira] [Commented] (SPARK-26269) YarnAllocator should have same blacklist behaviour with YARN to maxmize use of cluster resource

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726995#comment-16726995 ] ASF GitHub Bot commented on SPARK-26269: asfgit closed pull request #23223:

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24432: Assignee: Apache Spark > Add support for dynamic resource allocation >

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726977#comment-16726977 ] ASF GitHub Bot commented on SPARK-24432: vanzin closed pull request #22722: [SPARK-24432][k8s]

[jira] [Commented] (SPARK-26267) Kafka source may reprocess data

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726973#comment-16726973 ] ASF GitHub Bot commented on SPARK-26267: zsxwing opened a new pull request #23365:

[jira] [Commented] (SPARK-23078) Allow Submitting Spark Thrift Server in Cluster Mode

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726982#comment-16726982 ] ASF GitHub Bot commented on SPARK-23078: vanzin closed pull request #20272: [SPARK-23078] [CORE]

[jira] [Resolved] (SPARK-26416) Refactor `ColumnPruning` from `Optimizer.scala` to `ColumnPruning.scala`

2018-12-21 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-26416. - Resolution: Won't Do > Refactor `ColumnPruning` from `Optimizer.scala` to `ColumnPruning.scala` >

[jira] [Resolved] (SPARK-25442) Support STS to run in K8S deployment with spark deployment mode as cluster

2018-12-21 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25442. Resolution: Duplicate > Support STS to run in K8S deployment with spark deployment mode

[jira] [Commented] (SPARK-26416) Refactor `ColumnPruning` from `Optimizer.scala` to `ColumnPruning.scala`

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726980#comment-16726980 ] ASF GitHub Bot commented on SPARK-26416: dbtsai closed pull request #23359: [SPARK-26416] [SQL]

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24432: Assignee: (was: Apache Spark) > Add support for dynamic resource allocation >

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

2018-12-21 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24432: -- Assignee: (was: Marcelo Vanzin) > Add support for dynamic resource allocation >

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

2018-12-21 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24432: -- Assignee: Marcelo Vanzin > Add support for dynamic resource allocation >

[jira] [Commented] (SPARK-26267) Kafka source may reprocess data

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726970#comment-16726970 ] ASF GitHub Bot commented on SPARK-26267: zsxwing closed pull request #23324:

[jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11

2018-12-21 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726952#comment-16726952 ] Dongjoon Hyun commented on SPARK-24417: --- Hi, [~mlebihan]. Yes. Officially, it does. We need to

[jira] [Assigned] (SPARK-26427) Upgrade Apache ORC to 1.5.4

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26427: Assignee: (was: Apache Spark) > Upgrade Apache ORC to 1.5.4 >

[jira] [Assigned] (SPARK-26427) Upgrade Apache ORC to 1.5.4

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26427: Assignee: Apache Spark > Upgrade Apache ORC to 1.5.4 > --- > >

[jira] [Commented] (SPARK-26427) Upgrade Apache ORC to 1.5.4

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726945#comment-16726945 ] ASF GitHub Bot commented on SPARK-26427: dongjoon-hyun opened a new pull request #23364:

[jira] [Created] (SPARK-26427) Upgrade Apache ORC to 1.5.4

2018-12-21 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-26427: - Summary: Upgrade Apache ORC to 1.5.4 Key: SPARK-26427 URL: https://issues.apache.org/jira/browse/SPARK-26427 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-26427) Upgrade Apache ORC to 1.5.4

2018-12-21 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26427: -- Component/s: (was: SQL) Build > Upgrade Apache ORC to 1.5.4 >

[jira] [Commented] (SPARK-26426) ExpressionInfo related unit tests fail in Windows

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726885#comment-16726885 ] ASF GitHub Bot commented on SPARK-26426: yanlin-Lynn opened a new pull request #23363:

[jira] [Assigned] (SPARK-26426) ExpressionInfo related unit tests fail in Windows

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26426: Assignee: Apache Spark > ExpressionInfo related unit tests fail in Windows >

[jira] [Assigned] (SPARK-26426) ExpressionInfo related unit tests fail in Windows

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26426: Assignee: (was: Apache Spark) > ExpressionInfo related unit tests fail in Windows >

[jira] [Commented] (SPARK-26426) ExpressionInfo related unit tests fail in Windows

2018-12-21 Thread Wang Yanlin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726878#comment-16726878 ] Wang Yanlin commented on SPARK-26426: - see attached file "unit-test.log" for more details. >

[jira] [Updated] (SPARK-26426) ExpressionInfo related unit tests fail in Windows

2018-12-21 Thread Wang Yanlin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Yanlin updated SPARK-26426: Attachment: unit-test.log > ExpressionInfo related unit tests fail in Windows >

[jira] [Created] (SPARK-26426) ExpressionInfo related unit tests fail in Windows

2018-12-21 Thread Wang Yanlin (JIRA)
Wang Yanlin created SPARK-26426: --- Summary: ExpressionInfo related unit tests fail in Windows Key: SPARK-26426 URL: https://issues.apache.org/jira/browse/SPARK-26426 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26410) Support per Pandas UDF configuration

2018-12-21 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726824#comment-16726824 ] Li Jin commented on SPARK-26410: One thing we want think about is whether or not to mix different size

[jira] [Commented] (SPARK-26410) Support per Pandas UDF configuration

2018-12-21 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726820#comment-16726820 ] Li Jin commented on SPARK-26410: Thanks for the explanation. I think it makes sense to have batch size

[jira] [Assigned] (SPARK-23155) YARN-aggregated executor/driver logs appear unavailable when NM is down

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23155: Assignee: Apache Spark > YARN-aggregated executor/driver logs appear unavailable when NM

[jira] [Assigned] (SPARK-23155) YARN-aggregated executor/driver logs appear unavailable when NM is down

2018-12-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23155: Assignee: (was: Apache Spark) > YARN-aggregated executor/driver logs appear

[jira] [Created] (SPARK-26425) Add more constraint checks in file streaming source to avoid checkpoint corruption

2018-12-21 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-26425: - Summary: Add more constraint checks in file streaming source to avoid checkpoint corruption Key: SPARK-26425 URL: https://issues.apache.org/jira/browse/SPARK-26425

[jira] [Commented] (SPARK-14043) Remove restriction on maxDepth for decision trees

2018-12-21 Thread Gaetan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726544#comment-16726544 ] Gaetan commented on SPARK-14043: In my opinion this is a mistake to not invest in machine learning

[jira] [Commented] (SPARK-26422) Unable to disable Hive support in SparkR when Hadoop version is unsupported

2018-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726526#comment-16726526 ] ASF GitHub Bot commented on SPARK-26422: asfgit closed pull request #23356: [SPARK-26422][R]

[jira] [Resolved] (SPARK-26422) Unable to disable Hive support in SparkR when Hadoop version is unsupported

2018-12-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26422. -- Resolution: Fixed Fix Version/s: 2.4.1 3.0.0

[jira] [Assigned] (SPARK-26422) Unable to disable Hive support in SparkR when Hadoop version is unsupported

2018-12-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26422: Assignee: Hyukjin Kwon > Unable to disable Hive support in SparkR when Hadoop version is