[jira] [Commented] (SPARK-18406) Race between end-of-task and completion iterator read lock release

2017-04-15 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15970235#comment-15970235 ] Josh Rosen commented on SPARK-18406: I can see how allowing user-level code to call setTaskContext()

[jira] [Resolved] (SPARK-20335) Children expressions of Hive UDF impacts the determinism of Hive UDF

2017-04-15 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20335. - Resolution: Fixed Fix Version/s: 2.2.0 > Children expressions of Hive UDF impacts the

[jira] [Assigned] (SPARK-20348) Support squared hinge loss (L2 loss) for LinearSVC

2017-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20348: Assignee: Apache Spark > Support squared hinge loss (L2 loss) for LinearSVC >

[jira] [Assigned] (SPARK-20348) Support squared hinge loss (L2 loss) for LinearSVC

2017-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20348: Assignee: (was: Apache Spark) > Support squared hinge loss (L2 loss) for LinearSVC >

[jira] [Commented] (SPARK-20348) Support squared hinge loss (L2 loss) for LinearSVC

2017-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15970217#comment-15970217 ] Apache Spark commented on SPARK-20348: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Created] (SPARK-20348) Support squared hinge loss (L2 loss) for LinearSVC

2017-04-15 Thread yuhao yang (JIRA)
yuhao yang created SPARK-20348: -- Summary: Support squared hinge loss (L2 loss) for LinearSVC Key: SPARK-20348 URL: https://issues.apache.org/jira/browse/SPARK-20348 Project: Spark Issue Type:

[jira] [Updated] (SPARK-20347) Provide AsyncRDDActions in Python

2017-04-15 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-20347: Shepherd: holdenk > Provide AsyncRDDActions in Python > - > >

[jira] [Created] (SPARK-20347) Provide AsyncRDDActions in Python

2017-04-15 Thread holdenk (JIRA)
holdenk created SPARK-20347: --- Summary: Provide AsyncRDDActions in Python Key: SPARK-20347 URL: https://issues.apache.org/jira/browse/SPARK-20347 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-17729) Enable creating hive bucketed tables

2017-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15970201#comment-15970201 ] Apache Spark commented on SPARK-17729: -- User 'tejasapatil' has created a pull request for this

[jira] [Updated] (SPARK-20346) sum aggregate over empty Dataset gives null

2017-04-15 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-20346: Description: {code} scala> spark.range(0).agg(sum("id")).show +---+ |sum(id)|

[jira] [Created] (SPARK-20346) sum aggregate over empty Dataset gives null

2017-04-15 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-20346: --- Summary: sum aggregate over empty Dataset gives null Key: SPARK-20346 URL: https://issues.apache.org/jira/browse/SPARK-20346 Project: Spark Issue

[jira] [Updated] (SPARK-20345) Fix STS error handling logic on HiveSQLException

2017-04-15 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20345: -- Description:

[jira] [Commented] (SPARK-20345) Fix STS error handling logic on HiveSQLException

2017-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15970084#comment-15970084 ] Apache Spark commented on SPARK-20345: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-20345) Fix STS error handling logic on HiveSQLException

2017-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20345: Assignee: Apache Spark > Fix STS error handling logic on HiveSQLException >

[jira] [Assigned] (SPARK-20345) Fix STS error handling logic on HiveSQLException

2017-04-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20345: Assignee: (was: Apache Spark) > Fix STS error handling logic on HiveSQLException >

[jira] [Created] (SPARK-20345) Fix STS error handling logic on HiveSQLException

2017-04-15 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-20345: - Summary: Fix STS error handling logic on HiveSQLException Key: SPARK-20345 URL: https://issues.apache.org/jira/browse/SPARK-20345 Project: Spark Issue

[jira] [Commented] (SPARK-20299) NullPointerException when null and string are in a tuple while encoding Dataset

2017-04-15 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969996#comment-15969996 ] Jacek Laskowski commented on SPARK-20299: - It does work for 2.1. It does not for 2.2.0-SNAPSHOT.

[jira] [Updated] (SPARK-20299) NullPointerException when null and string are in a tuple while encoding Dataset

2017-04-15 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-20299: Description: When creating a Dataset from a tuple with {{null}} and a string, NPE is

[jira] [Commented] (SPARK-20344) Duplicate call in FairSchedulableBuilder.addTaskSetManager

2017-04-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969946#comment-15969946 ] Sean Owen commented on SPARK-20344: --- We use pull requests -- http://spark.apache.org/contributing.html

[jira] [Commented] (SPARK-20286) dynamicAllocation.executorIdleTimeout is ignored after unpersist

2017-04-15 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-20286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969944#comment-15969944 ] Miguel Pérez commented on SPARK-20286: -- My supposition is that {{onExecutorIdle}} is only called

[jira] [Resolved] (SPARK-20339) Issue in regex_replace in Apache Spark Java

2017-04-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20339. --- Resolution: Invalid (No need to paste that much redundant code.) If it's a question it should to go

[jira] [Updated] (SPARK-20339) Issue in regex_replace in Apache Spark Java

2017-04-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20339: -- Description: We are currently facing couple of issues 1.

[jira] [Commented] (SPARK-20299) NullPointerException when null and string are in a tuple while encoding Dataset

2017-04-15 Thread Umesh Chaudhary (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969933#comment-15969933 ] Umesh Chaudhary commented on SPARK-20299: - [~jlaskowski] your last two lines in repro steps are

[jira] [Commented] (SPARK-20286) dynamicAllocation.executorIdleTimeout is ignored after unpersist

2017-04-15 Thread Umesh Chaudhary (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969924#comment-15969924 ] Umesh Chaudhary commented on SPARK-20286: - While looking at

[jira] [Commented] (SPARK-20344) Duplicate call in FairSchedulableBuilder.addTaskSetManager

2017-04-15 Thread Robert Stupp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969901#comment-15969901 ] Robert Stupp commented on SPARK-20344: -- Just saw it's a duplicate. Not a serious thing - just

[jira] [Updated] (SPARK-20344) Duplicate call in FairSchedulableBuilder.addTaskSetManager

2017-04-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20344: -- Priority: Trivial (was: Minor) Does it cause any problem? yes you could probably rearrange this

[jira] [Assigned] (SPARK-20316) In SparkSQLCLIDriver, val and var should strictly follow the Scala syntax

2017-04-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20316: - Assignee: Xiaochen Ouyang > In SparkSQLCLIDriver, val and var should strictly follow the Scala

[jira] [Resolved] (SPARK-20316) In SparkSQLCLIDriver, val and var should strictly follow the Scala syntax

2017-04-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20316. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17628

[jira] [Resolved] (SPARK-7674) R-like stats for ML models

2017-04-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7674. -- Resolution: Done > R-like stats for ML models > -- > > Key:

[jira] [Created] (SPARK-20344) Duplicate call in FairSchedulableBuilder.addTaskSetManager

2017-04-15 Thread Robert Stupp (JIRA)
Robert Stupp created SPARK-20344: Summary: Duplicate call in FairSchedulableBuilder.addTaskSetManager Key: SPARK-20344 URL: https://issues.apache.org/jira/browse/SPARK-20344 Project: Spark