[jira] [Closed] (SPARK-22610) AM restart in a other node send Jobs into a state of feign death

2017-12-20 Thread Bang Xiao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bang Xiao closed SPARK-22610. - > AM restart in a other node send Jobs into a state of feign death >

[jira] [Resolved] (SPARK-22848) Avoid the generation of useless mutable states by Stack function

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22848. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20035

[jira] [Assigned] (SPARK-22848) Avoid the generation of useless mutable states by Stack function

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22848: --- Assignee: Kazuaki Ishizaki > Avoid the generation of useless mutable states by Stack

[jira] [Commented] (SPARK-22853) K8s or Kubernetes?

2017-12-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299632#comment-16299632 ] Reynold Xin commented on SPARK-22853: - I personally prefer "k8s", since it is way simpler, but I

[jira] [Assigned] (SPARK-22856) Add wrapper for codegen output and nullability

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22856: Assignee: (was: Apache Spark) > Add wrapper for codegen output and nullability >

[jira] [Commented] (SPARK-22856) Add wrapper for codegen output and nullability

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299536#comment-16299536 ] Apache Spark commented on SPARK-22856: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22856) Add wrapper for codegen output and nullability

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22856: Assignee: Apache Spark > Add wrapper for codegen output and nullability >

[jira] [Created] (SPARK-22856) Add wrapper for codegen output and nullability

2017-12-20 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-22856: --- Summary: Add wrapper for codegen output and nullability Key: SPARK-22856 URL: https://issues.apache.org/jira/browse/SPARK-22856 Project: Spark Issue

[jira] [Commented] (SPARK-22855) Sbt publishLocal under scala 2.12 fails due to invalid javadoc comments in tags package

2017-12-20 Thread Erik LaBianca (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299489#comment-16299489 ] Erik LaBianca commented on SPARK-22855: --- With the fix: {noformat} > ++2.12.4 [info] Setting

[jira] [Assigned] (SPARK-22855) Sbt publishLocal under scala 2.12 fails due to invalid javadoc comments in tags package

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22855: Assignee: Apache Spark > Sbt publishLocal under scala 2.12 fails due to invalid javadoc

[jira] [Commented] (SPARK-22855) Sbt publishLocal under scala 2.12 fails due to invalid javadoc comments in tags package

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299485#comment-16299485 ] Apache Spark commented on SPARK-22855: -- User 'easel' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22855) Sbt publishLocal under scala 2.12 fails due to invalid javadoc comments in tags package

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22855: Assignee: (was: Apache Spark) > Sbt publishLocal under scala 2.12 fails due to

[jira] [Commented] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299474#comment-16299474 ] wuyi commented on SPARK-22847: -- [~srowen] So, how can I handle these little mistake properly next time I

[jira] [Commented] (SPARK-22855) Sbt publishLocal under scala 2.12 fails due to invalid javadoc comments in tags package

2017-12-20 Thread Erik LaBianca (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299473#comment-16299473 ] Erik LaBianca commented on SPARK-22855: --- For example: {noformat} [spark] SBT_OPTS=-Dscala-2.12 sbt

[jira] [Created] (SPARK-22855) Sbt publishLocal under scala 2.12 fails due to invalid javadoc comments in tags package

2017-12-20 Thread Erik LaBianca (JIRA)
Erik LaBianca created SPARK-22855: - Summary: Sbt publishLocal under scala 2.12 fails due to invalid javadoc comments in tags package Key: SPARK-22855 URL: https://issues.apache.org/jira/browse/SPARK-22855

[jira] [Created] (SPARK-22854) AppStatusListener should get Spark version by SparkListenerLogStart

2017-12-20 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-22854: --- Summary: AppStatusListener should get Spark version by SparkListenerLogStart Key: SPARK-22854 URL: https://issues.apache.org/jira/browse/SPARK-22854 Project: Spark

[jira] [Resolved] (SPARK-22387) propagate session configs to data source read/write options

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22387. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19861

[jira] [Assigned] (SPARK-22387) propagate session configs to data source read/write options

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22387: --- Assignee: Jiang Xingbo > propagate session configs to data source read/write options >

[jira] [Resolved] (SPARK-22810) PySpark supports LinearRegression with huber loss

2017-12-20 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-22810. - Resolution: Fixed Fix Version/s: 2.3.0 > PySpark supports LinearRegression with huber

[jira] [Created] (SPARK-22853) K8s or Kubernetes?

2017-12-20 Thread Anirudh Ramanathan (JIRA)
Anirudh Ramanathan created SPARK-22853: -- Summary: K8s or Kubernetes? Key: SPARK-22853 URL: https://issues.apache.org/jira/browse/SPARK-22853 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299335#comment-16299335 ] Apache Spark commented on SPARK-22042: -- User 'tejasapatil' has created a pull request for this

[jira] [Resolved] (SPARK-22845) Modify spark.kubernetes.allocation.batch.delay to take time instead of int

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22845. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20032

[jira] [Assigned] (SPARK-22845) Modify spark.kubernetes.allocation.batch.delay to take time instead of int

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-22845: -- Assignee: Anirudh Ramanathan > Modify spark.kubernetes.allocation.batch.delay to take

[jira] [Commented] (SPARK-22739) Additional Expression Support for Objects

2017-12-20 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299232#comment-16299232 ] Michael Armbrust commented on SPARK-22739: -- Sounds good to me. I'm happy to provide pointers on

[jira] [Commented] (SPARK-22852) sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc

2017-12-20 Thread Erik LaBianca (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299193#comment-16299193 ] Erik LaBianca commented on SPARK-22852: --- With the fix: {noformat} > launcher/publishLocal [warn]

[jira] [Commented] (SPARK-22852) sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc

2017-12-20 Thread Erik LaBianca (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299192#comment-16299192 ] Erik LaBianca commented on SPARK-22852: --- There's a one-liner PR to resolve this at

[jira] [Assigned] (SPARK-22852) sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22852: Assignee: Apache Spark > sbt publishLocal fails due to -Xlint:unchecked flag passed to

[jira] [Assigned] (SPARK-22852) sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22852: Assignee: (was: Apache Spark) > sbt publishLocal fails due to -Xlint:unchecked flag

[jira] [Commented] (SPARK-22852) sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299191#comment-16299191 ] Apache Spark commented on SPARK-22852: -- User 'easel' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-22847: -- Assignee: wuyi > Remove the duplicate code in AppStatusListener while assigning

[jira] [Resolved] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22847. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20033

[jira] [Created] (SPARK-22852) sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc

2017-12-20 Thread Erik LaBianca (JIRA)
Erik LaBianca created SPARK-22852: - Summary: sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc Key: SPARK-22852 URL: https://issues.apache.org/jira/browse/SPARK-22852 Project:

[jira] [Updated] (SPARK-22839) Refactor Kubernetes code for configuring driver/executor pods to use consistent and cleaner abstraction

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-22839: --- Description: As discussed in https://github.com/apache/spark/pull/19954, the current code

[jira] [Commented] (SPARK-22739) Additional Expression Support for Objects

2017-12-20 Thread Aleksander Eskilson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299177#comment-16299177 ] Aleksander Eskilson commented on SPARK-22739: - Yes. I've got a branch with the new

[jira] [Updated] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-22836: --- Description: -I think this was mainly caused by SPARK-15951; that changed modified the

[jira] [Commented] (SPARK-22739) Additional Expression Support for Objects

2017-12-20 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299167#comment-16299167 ] Michael Armbrust commented on SPARK-22739: -- Any progress on this? Branch cut is January 1st,

[jira] [Updated] (SPARK-22739) Additional Expression Support for Objects

2017-12-20 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-22739: - Target Version/s: 2.3.0 > Additional Expression Support for Objects >

[jira] [Commented] (SPARK-5594) SparkException: Failed to get broadcast (TorrentBroadcast)

2017-12-20 Thread Swathi Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299149#comment-16299149 ] Swathi Subramanian commented on SPARK-5594: --- Any update on this issue? I have a similar

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

2017-12-20 Thread John Brock (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299109#comment-16299109 ] John Brock commented on SPARK-22851: Some colleagues claimed to have specifically downloaded from

[jira] [Assigned] (SPARK-22830) Scala Coding style has been improved in Spark Examples

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22830: - Assignee: Chetan Khatri > Scala Coding style has been improved in Spark Examples >

[jira] [Resolved] (SPARK-22830) Scala Coding style has been improved in Spark Examples

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22830. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20016

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299059#comment-16299059 ] Sean Owen commented on SPARK-22851: --- I see the same thing. The source release seems fine but the binary

[jira] [Commented] (SPARK-22850) Executor page in SHS does not show driver

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299039#comment-16299039 ] Apache Spark commented on SPARK-22850: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22850) Executor page in SHS does not show driver

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22850: Assignee: Apache Spark > Executor page in SHS does not show driver >

[jira] [Assigned] (SPARK-22850) Executor page in SHS does not show driver

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22850: Assignee: (was: Apache Spark) > Executor page in SHS does not show driver >

[jira] [Created] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

2017-12-20 Thread John Brock (JIRA)
John Brock created SPARK-22851: -- Summary: Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum Key: SPARK-22851 URL: https://issues.apache.org/jira/browse/SPARK-22851

[jira] [Updated] (SPARK-22850) Executor page in SHS does not show driver

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-22850: --- Affects Version/s: (was: 2.2.0) 2.3.0 > Executor page in SHS does

[jira] [Commented] (SPARK-22850) Executor page in SHS does not show driver

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298991#comment-16298991 ] Marcelo Vanzin commented on SPARK-22850: Sorry for the noise, this is actually a bug in the

[jira] [Resolved] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22849. - Resolution: Fixed Fix Version/s: 2.3.0 > ivy.retrieve pattern should also consider `classifier` >

[jira] [Created] (SPARK-22850) Executor page in SHS does not show driver

2017-12-20 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-22850: -- Summary: Executor page in SHS does not show driver Key: SPARK-22850 URL: https://issues.apache.org/jira/browse/SPARK-22850 Project: Spark Issue Type:

[jira] [Updated] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-22836: --- Affects Version/s: (was: 2.1.0) 2.3.0 > Executors page is not

[jira] [Commented] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298952#comment-16298952 ] Marcelo Vanzin commented on SPARK-22836: The 2.2 issue is different (and also affects 2.3 aside

[jira] [Commented] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298935#comment-16298935 ] Marcelo Vanzin commented on SPARK-22836: I posted a patch for 2.3. For 2.2, it seems to work

[jira] [Resolved] (SPARK-22832) BisectingKMeans unpersist unused datasets

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22832. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 20017

[jira] [Assigned] (SPARK-22832) BisectingKMeans unpersist unused datasets

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22832: - Assignee: zhengruifeng Fix Version/s: (was: 3.0.0) 2.3.0 >

[jira] [Resolved] (SPARK-22804) Using a window function inside of an aggregation causes StackOverflowError

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22804. --- Resolution: Duplicate Provisionally resolving this > Using a window function inside of an

[jira] [Resolved] (SPARK-22824) Spark Structured Streaming Source trait breaking change

2017-12-20 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-22824. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20012

[jira] [Assigned] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22836: Assignee: (was: Apache Spark) > Executors page is not showing driver logs links >

[jira] [Commented] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298885#comment-16298885 ] Apache Spark commented on SPARK-22836: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22836: Assignee: Apache Spark > Executors page is not showing driver logs links >

[jira] [Commented] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2017-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298874#comment-16298874 ] Thomas Graves commented on SPARK-22577: --- correct (unfortunately don't time), anyone can take it

[jira] [Commented] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2017-12-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298869#comment-16298869 ] Imran Rashid commented on SPARK-22577: -- OK that sounds reasonable. I'd be happy to look at some

[jira] [Commented] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2017-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298854#comment-16298854 ] Thomas Graves commented on SPARK-22577: --- Yes I was thinking the stage UI (and perhaps executor UI).

[jira] [Commented] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2017-12-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298838#comment-16298838 ] Imran Rashid commented on SPARK-22577: -- [~tgraves] what exactly were you thinking? I remember when

[jira] [Resolved] (SPARK-22788) HdfsUtils.getOutputStream uses non-existent Hadoop conf "hdfs.append.support"

2017-12-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-22788. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19983

[jira] [Assigned] (SPARK-22788) HdfsUtils.getOutputStream uses non-existent Hadoop conf "hdfs.append.support"

2017-12-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-22788: Assignee: Marcelo Vanzin > HdfsUtils.getOutputStream uses non-existent Hadoop conf

[jira] [Commented] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298749#comment-16298749 ] Xiao Li commented on SPARK-22849: - Not sure whether they are related, but my fix is very trivial. >

[jira] [Assigned] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22849: Assignee: Apache Spark (was: Xiao Li) > ivy.retrieve pattern should also consider

[jira] [Assigned] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22849: Assignee: Xiao Li (was: Apache Spark) > ivy.retrieve pattern should also consider

[jira] [Commented] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298745#comment-16298745 ] Apache Spark commented on SPARK-22849: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-21172) EOFException reached end of stream in UnsafeRowSerializer

2017-12-20 Thread Fernando Pereira (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298735#comment-16298735 ] Fernando Pereira commented on SPARK-21172: -- I'm getting the same problem, even though my data is

[jira] [Commented] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298731#comment-16298731 ] Sean Owen commented on SPARK-22849: --- I think this is the same, or closely related to, an issue I

[jira] [Created] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Xiao Li (JIRA)
Xiao Li created SPARK-22849: --- Summary: ivy.retrieve pattern should also consider `classifier` Key: SPARK-22849 URL: https://issues.apache.org/jira/browse/SPARK-22849 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298696#comment-16298696 ] Apache Spark commented on SPARK-18016: -- User 'kiszk' has created a pull request for this issue:

[jira] [Updated] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22847: -- Priority: Trivial (was: Minor) Fix Version/s: (was: 2.2.1) Issue Type: Improvement

[jira] [Commented] (SPARK-22841) Select regexp_extract from table with where clause having is null throws indexoutofbounds exception

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298667#comment-16298667 ] Sean Owen commented on SPARK-22841: --- Well, an error is displayed. As I say, exceptions are appropriate

[jira] [Reopened] (SPARK-22841) Select regexp_extract from table with where clause having is null throws indexoutofbounds exception

2017-12-20 Thread Chetan Bhat (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chetan Bhat reopened SPARK-22841: - Exception should not be thrown in any scenario. Instead proper error message can be displayed. >

[jira] [Resolved] (SPARK-22841) Select regexp_extract from table with where clause having is null throws indexoutofbounds exception

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22841. --- Resolution: Invalid As the error says, there's no matching group in your regex, so this fails.

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

2017-12-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298634#comment-16298634 ] Xuefu Zhang commented on SPARK-22765: - bq: at least based on this one experiment up front allocation

[jira] [Updated] (SPARK-22848) Avoid the generation of useless mutable states by Stack function

2017-12-20 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22848: - Description: Current Spark generates two mutable states in generated code for

[jira] [Updated] (SPARK-22848) Avoid the generation of useless mutable states by Stack function

2017-12-20 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22848: - Description: Current Spark generates two mutable states in generated code for {Stack}.

[jira] [Updated] (SPARK-22848) Avoid the generation of useless mutable states by Stack function

2017-12-20 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22848: - Description: Current Spark generates two mutable states in generated code for {{Stack}}.

[jira] [Updated] (SPARK-22848) Avoid the generation of useless mutable states by Stack function

2017-12-20 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22848: - Summary: Avoid the generation of useless mutable states by Stack function (was: Do not

[jira] [Updated] (SPARK-22848) Do not execute generated code of functions in Generator

2017-12-20 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22848: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-22692 > Do not execute

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

2017-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298589#comment-16298589 ] Thomas Graves commented on SPARK-22765: --- ok so at least based on this one experiment up front

[jira] [Assigned] (SPARK-22848) Do not execute generated code of functions in Generator

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22848: Assignee: (was: Apache Spark) > Do not execute generated code of functions in

[jira] [Commented] (SPARK-22848) Do not execute generated code of functions in Generator

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298553#comment-16298553 ] Apache Spark commented on SPARK-22848: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22848) Do not execute generated code of functions in Generator

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22848: Assignee: Apache Spark > Do not execute generated code of functions in Generator >

[jira] [Created] (SPARK-22848) Do not execute generated code of functions in Generator

2017-12-20 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-22848: Summary: Do not execute generated code of functions in Generator Key: SPARK-22848 URL: https://issues.apache.org/jira/browse/SPARK-22848 Project: Spark

[jira] [Assigned] (SPARK-22846) table's owner property in hive metastore is null

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22846: Assignee: Apache Spark > table's owner property in hive metastore is null >

[jira] [Commented] (SPARK-22846) table's owner property in hive metastore is null

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298474#comment-16298474 ] Apache Spark commented on SPARK-22846: -- User 'BruceXu1991' has created a pull request for this

[jira] [Assigned] (SPARK-22846) table's owner property in hive metastore is null

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22846: Assignee: (was: Apache Spark) > table's owner property in hive metastore is null >

[jira] [Commented] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298461#comment-16298461 ] Apache Spark commented on SPARK-22847: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22847: Assignee: (was: Apache Spark) > Remove the duplicate code in AppStatusListener while

[jira] [Assigned] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22847: Assignee: Apache Spark > Remove the duplicate code in AppStatusListener while assigning

[jira] [Comment Edited] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298456#comment-16298456 ] Wenchen Fan edited comment on SPARK-17647 at 12/20/17 1:06 PM: --- {code}

[jira] [Comment Edited] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298456#comment-16298456 ] Wenchen Fan edited comment on SPARK-17647 at 12/20/17 1:05 PM: --- {{{

[jira] [Comment Edited] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298456#comment-16298456 ] Wenchen Fan edited comment on SPARK-17647 at 12/20/17 1:05 PM: --- {

[jira] [Comment Edited] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298456#comment-16298456 ] Wenchen Fan edited comment on SPARK-17647 at 12/20/17 1:05 PM: --- {code}

[jira] [Commented] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298456#comment-16298456 ] Wenchen Fan commented on SPARK-17647: - {{spark.sql("select '' like '%\\%'").show}} actually is

  1   2   >