[jira] [Commented] (SPARK-8489) Add regression tests for SPARK-8470

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271974#comment-15271974 ] Apache Spark commented on SPARK-8489: - User 'dilipbiswal' has created a pull request f

[jira] [Commented] (SPARK-14893) Re-enable HiveSparkSubmitSuite SPARK-8489 test after HiveContext is removed

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271973#comment-15271973 ] Apache Spark commented on SPARK-14893: -- User 'dilipbiswal' has created a pull reques

[jira] [Assigned] (SPARK-14893) Re-enable HiveSparkSubmitSuite SPARK-8489 test after HiveContext is removed

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14893: Assignee: Apache Spark > Re-enable HiveSparkSubmitSuite SPARK-8489 test after HiveContext

[jira] [Assigned] (SPARK-14893) Re-enable HiveSparkSubmitSuite SPARK-8489 test after HiveContext is removed

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14893: Assignee: (was: Apache Spark) > Re-enable HiveSparkSubmitSuite SPARK-8489 test after H

[jira] [Commented] (SPARK-15114) Column name generated by typed aggregate is super verbose

2016-05-04 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271972#comment-15271972 ] Dilip Biswal commented on SPARK-15114: -- [~yhuai] Sure Yin. I will give it a try. >

[jira] [Assigned] (SPARK-15148) Upgrade Univocity library from 2.0.2 to 2.1.0

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15148: Assignee: Apache Spark > Upgrade Univocity library from 2.0.2 to 2.1.0 >

[jira] [Assigned] (SPARK-15148) Upgrade Univocity library from 2.0.2 to 2.1.0

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15148: Assignee: (was: Apache Spark) > Upgrade Univocity library from 2.0.2 to 2.1.0 > -

[jira] [Commented] (SPARK-15148) Upgrade Univocity library from 2.0.2 to 2.1.0

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271964#comment-15271964 ] Apache Spark commented on SPARK-15148: -- User 'HyukjinKwon' has created a pull reques

[jira] [Commented] (SPARK-15146) Allow specifying kafka parameters through configurations

2016-05-04 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271962#comment-15271962 ] Saisai Shao commented on SPARK-15146: - [~c...@koeninger.org], what is your opinion on

[jira] [Comment Edited] (SPARK-14495) Distinct aggregation cannot be used in the having clause

2016-05-04 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271956#comment-15271956 ] Xin Wu edited comment on SPARK-14495 at 5/5/16 6:25 AM: [~smilega

[jira] [Created] (SPARK-15148) Upgrade Univocity library from 2.0.2 to 2.1.0

2016-05-04 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-15148: Summary: Upgrade Univocity library from 2.0.2 to 2.1.0 Key: SPARK-15148 URL: https://issues.apache.org/jira/browse/SPARK-15148 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-14495) Distinct aggregation cannot be used in the having clause

2016-05-04 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271956#comment-15271956 ] Xin Wu commented on SPARK-14495: [~smilegator] I got the fix and running regtest now. Wil

[jira] [Created] (SPARK-15147) Catalog should have a property to indicate case-sensitivity

2016-05-04 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-15147: -- Summary: Catalog should have a property to indicate case-sensitivity Key: SPARK-15147 URL: https://issues.apache.org/jira/browse/SPARK-15147 Project: Spark Issu

[jira] [Comment Edited] (SPARK-15114) Column name generated by typed aggregate is super verbose

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271943#comment-15271943 ] Yin Huai edited comment on SPARK-15114 at 5/5/16 6:22 AM: -- I thi

[jira] [Created] (SPARK-15146) Allow specifying kafka parameters through configurations

2016-05-04 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-15146: --- Summary: Allow specifying kafka parameters through configurations Key: SPARK-15146 URL: https://issues.apache.org/jira/browse/SPARK-15146 Project: Spark Issue

[jira] [Commented] (SPARK-15114) Column name generated by typed aggregate is super verbose

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271943#comment-15271943 ] Yin Huai commented on SPARK-15114: -- I think at here, we should use a UnresolvedAlias. Wi

[jira] [Commented] (SPARK-15144) option nullValue for CSV data source not working for several types.

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271927#comment-15271927 ] Apache Spark commented on SPARK-15144: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-15144) option nullValue for CSV data source not working for several types.

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15144: Assignee: (was: Apache Spark) > option nullValue for CSV data source not working for s

[jira] [Assigned] (SPARK-15144) option nullValue for CSV data source not working for several types.

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15144: Assignee: Apache Spark > option nullValue for CSV data source not working for several type

[jira] [Assigned] (SPARK-15143) CSV data source is not being tested as HadoopFsRelation

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15143: Assignee: Apache Spark > CSV data source is not being tested as HadoopFsRelation > ---

[jira] [Assigned] (SPARK-15145) spark.ml binary classification should include accuracy

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15145: Assignee: Apache Spark > spark.ml binary classification should include accuracy >

[jira] [Assigned] (SPARK-15143) CSV data source is not being tested as HadoopFsRelation

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15143: Assignee: (was: Apache Spark) > CSV data source is not being tested as HadoopFsRelatio

[jira] [Commented] (SPARK-15143) CSV data source is not being tested as HadoopFsRelation

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271926#comment-15271926 ] Apache Spark commented on SPARK-15143: -- User 'HyukjinKwon' has created a pull reques

[jira] [Commented] (SPARK-15145) spark.ml binary classification should include accuracy

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271925#comment-15271925 ] Apache Spark commented on SPARK-15145: -- User 'wangmiao1981' has created a pull reque

[jira] [Assigned] (SPARK-15145) spark.ml binary classification should include accuracy

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15145: Assignee: (was: Apache Spark) > spark.ml binary classification should include accuracy

[jira] [Created] (SPARK-15145) spark.ml binary classification should include accuracy

2016-05-04 Thread Miao Wang (JIRA)
Miao Wang created SPARK-15145: - Summary: spark.ml binary classification should include accuracy Key: SPARK-15145 URL: https://issues.apache.org/jira/browse/SPARK-15145 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15144) option nullValue for CSV data source not working for several types.

2016-05-04 Thread Abhinav Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271922#comment-15271922 ] Abhinav Gupta commented on SPARK-15144: --- Can you explain with example? So that I ca

[jira] [Created] (SPARK-15144) option nullValue for CSV data source not working for several types.

2016-05-04 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-15144: Summary: option nullValue for CSV data source not working for several types. Key: SPARK-15144 URL: https://issues.apache.org/jira/browse/SPARK-15144 Project: Spark

[jira] [Created] (SPARK-15143) CSV data source is not being tested as HadoopFsRelation

2016-05-04 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-15143: Summary: CSV data source is not being tested as HadoopFsRelation Key: SPARK-15143 URL: https://issues.apache.org/jira/browse/SPARK-15143 Project: Spark Issue

[jira] [Updated] (SPARK-15045) Remove dead code in TaskMemoryManager.cleanUpAllAllocatedMemory for pageTable

2016-05-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-15045: --- Assignee: Jacek Lewandowski > Remove dead code in TaskMemoryManager.cleanUpAllAllocatedMemory for pag

[jira] [Resolved] (SPARK-15045) Remove dead code in TaskMemoryManager.cleanUpAllAllocatedMemory for pageTable

2016-05-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-15045. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12829 [https://github.

[jira] [Created] (SPARK-15142) Spark Mesos dispatcher becomes unusable when the Mesos master restarts

2016-05-04 Thread Devaraj K (JIRA)
Devaraj K created SPARK-15142: - Summary: Spark Mesos dispatcher becomes unusable when the Mesos master restarts Key: SPARK-15142 URL: https://issues.apache.org/jira/browse/SPARK-15142 Project: Spark

[jira] [Resolved] (SPARK-15132) Debug log for generated code should be printed with proper indentation

2016-05-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15132. - Resolution: Fixed Assignee: Kousuke Saruta Fix Version/s: 2.0.0 > Debug log for g

[jira] [Assigned] (SPARK-15141) Add python example for OneVsRest

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15141: Assignee: (was: Apache Spark) > Add python example for OneVsRest > ---

[jira] [Assigned] (SPARK-15141) Add python example for OneVsRest

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15141: Assignee: Apache Spark > Add python example for OneVsRest > --

[jira] [Commented] (SPARK-15141) Add python example for OneVsRest

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271891#comment-15271891 ] Apache Spark commented on SPARK-15141: -- User 'zhengruifeng' has created a pull reque

[jira] [Created] (SPARK-15141) Add python example for OneVsRest

2016-05-04 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-15141: Summary: Add python example for OneVsRest Key: SPARK-15141 URL: https://issues.apache.org/jira/browse/SPARK-15141 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-15140) ensure input object of encoder is not null

2016-05-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271885#comment-15271885 ] Wenchen Fan commented on SPARK-15140: - cc [~marmbrus] [~lian cheng] > ensure input

[jira] [Created] (SPARK-15140) ensure input object of encoder is not null

2016-05-04 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-15140: --- Summary: ensure input object of encoder is not null Key: SPARK-15140 URL: https://issues.apache.org/jira/browse/SPARK-15140 Project: Spark Issue Type: Improvem

[jira] [Resolved] (SPARK-15131) StateStore management thread does not stop after SparkContext is shutdown

2016-05-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-15131. -- Resolution: Fixed Fix Version/s: 2.0.0 > StateStore management thread does not stop afte

[jira] [Commented] (SPARK-10713) SPARK_DIST_CLASSPATH ignored on Mesos executors

2016-05-04 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271875#comment-15271875 ] Devaraj K commented on SPARK-10713: --- bq. However, on Mesos, SPARK_DIST_CLASSPATH is mis

[jira] [Commented] (SPARK-15122) TPC-DS Qury 41 fails with The correlated scalar subquery can only contain equality predicates

2016-05-04 Thread Frederick Reiss (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271874#comment-15271874 ] Frederick Reiss commented on SPARK-15122: - In the official version of the query,

[jira] [Assigned] (SPARK-15092) toDebugString missing from ML DecisionTreeClassifier

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15092: Assignee: Apache Spark > toDebugString missing from ML DecisionTreeClassifier > --

[jira] [Commented] (SPARK-15092) toDebugString missing from ML DecisionTreeClassifier

2016-05-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271873#comment-15271873 ] holdenk commented on SPARK-15092: - Ah yes, it is present in Java so it is a simple fix. I

[jira] [Assigned] (SPARK-15139) PySpark TreeEnsemble missing methods

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15139: Assignee: (was: Apache Spark) > PySpark TreeEnsemble missing methods > ---

[jira] [Commented] (SPARK-15139) PySpark TreeEnsemble missing methods

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271871#comment-15271871 ] Apache Spark commented on SPARK-15139: -- User 'holdenk' has created a pull request fo

[jira] [Commented] (SPARK-15092) toDebugString missing from ML DecisionTreeClassifier

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271872#comment-15271872 ] Apache Spark commented on SPARK-15092: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-15139) PySpark TreeEnsemble missing methods

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15139: Assignee: Apache Spark > PySpark TreeEnsemble missing methods > --

[jira] [Assigned] (SPARK-15092) toDebugString missing from ML DecisionTreeClassifier

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15092: Assignee: (was: Apache Spark) > toDebugString missing from ML DecisionTreeClassifier >

[jira] [Commented] (SPARK-15139) PySpark TreeEnsemble missing methods

2016-05-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271851#comment-15271851 ] holdenk commented on SPARK-15139: - This is related to SPARK-15092 > PySpark TreeEnsemble

[jira] [Updated] (SPARK-15139) PySpark TreeEnsemble missing methods

2016-05-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-15139: Description: TreeEnsemble class is missing some accessor methods compared to Scala API > PySpark TreeEnsem

[jira] [Created] (SPARK-15139) PySpark TreeEnsemble missing methods

2016-05-04 Thread holdenk (JIRA)
holdenk created SPARK-15139: --- Summary: PySpark TreeEnsemble missing methods Key: SPARK-15139 URL: https://issues.apache.org/jira/browse/SPARK-15139 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-15137) Linkify ML PyDoc classification

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15137: Assignee: Apache Spark > Linkify ML PyDoc classification > ---

[jira] [Commented] (SPARK-15137) Linkify ML PyDoc classification

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271839#comment-15271839 ] Apache Spark commented on SPARK-15137: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-15137) Linkify ML PyDoc classification

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15137: Assignee: (was: Apache Spark) > Linkify ML PyDoc classification >

[jira] [Updated] (SPARK-15137) Linkify ML PyDoc classification

2016-05-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-15137: Description: PyDoc links in ml are in non-standard format. Switch to standard sphinx link format for better

[jira] [Commented] (SPARK-15101) Audit: ml.clustering and ml.recommendation

2016-05-04 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271824#comment-15271824 ] zhengruifeng commented on SPARK-15101: -- [~josephkb] User Doc and scala example for m

[jira] [Created] (SPARK-15138) Linkify ML PyDoc regression

2016-05-04 Thread holdenk (JIRA)
holdenk created SPARK-15138: --- Summary: Linkify ML PyDoc regression Key: SPARK-15138 URL: https://issues.apache.org/jira/browse/SPARK-15138 Project: Spark Issue Type: Sub-task Reporter:

[jira] [Created] (SPARK-15137) Linkify ML PyDoc classification

2016-05-04 Thread holdenk (JIRA)
holdenk created SPARK-15137: --- Summary: Linkify ML PyDoc classification Key: SPARK-15137 URL: https://issues.apache.org/jira/browse/SPARK-15137 Project: Spark Issue Type: Sub-task Report

[jira] [Created] (SPARK-15136) Linkify ML PyDoc

2016-05-04 Thread holdenk (JIRA)
holdenk created SPARK-15136: --- Summary: Linkify ML PyDoc Key: SPARK-15136 URL: https://issues.apache.org/jira/browse/SPARK-15136 Project: Spark Issue Type: Improvement Reporter: holdenk

[jira] [Updated] (SPARK-14837) Add support in file stream source for reading new files added to subdirs

2016-05-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-14837: -- Target Version/s: 2.0.0 > Add support in file stream source for reading new files added to subd

[jira] [Updated] (SPARK-15131) StateStore management thread does not stop after SparkContext is shutdown

2016-05-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15131: -- Fix Version/s: (was: 2.0.0) > StateStore management thread does not stop after SparkContext

[jira] [Updated] (SPARK-15131) StateStore management thread does not stop after SparkContext is shutdown

2016-05-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15131: -- Target Version/s: 2.0.0 > StateStore management thread does not stop after SparkContext is shut

[jira] [Updated] (SPARK-14340) Add Scala Example and User DOC for ml.BisectingKMeans

2016-05-04 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-14340: - Summary: Add Scala Example and User DOC for ml.BisectingKMeans (was: Add Scala Example and Descr

[jira] [Updated] (SPARK-14993) Inconsistent behavior of partitioning discovery

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14993: - Assignee: Xiao Li > Inconsistent behavior of partitioning discovery > ---

[jira] [Resolved] (SPARK-14993) Inconsistent behavior of partitioning discovery

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14993. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12828 [https://github.com/

[jira] [Updated] (SPARK-6339) Support creating temporary views with DDL

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6339: Assignee: Sean Zhong > Support creating temporary views with DDL > -

[jira] [Resolved] (SPARK-6339) Support creating temporary tables with DDL

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-6339. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12872 [https://github.com/apa

[jira] [Updated] (SPARK-6339) Support creating temporary views with DDL

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6339: Summary: Support creating temporary views with DDL (was: Support creating temporary tables with DDL) > Sup

[jira] [Updated] (SPARK-6339) Support creating temporary views with DDL

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6339: Description: It would useful to support following: {code} create temporary view counted as select count(tra

[jira] [Resolved] (SPARK-14896) Deprecate HiveContext in Python

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14896. --- Resolution: Fixed Fix Version/s: 2.0.0 > Deprecate HiveContext in Python > ---

[jira] [Comment Edited] (SPARK-15112) Dataset filter returns garbage

2016-05-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271025#comment-15271025 ] Cheng Lian edited comment on SPARK-15112 at 5/5/16 12:28 AM: -

[jira] [Commented] (SPARK-14896) Deprecate HiveContext in Python

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271685#comment-15271685 ] Apache Spark commented on SPARK-14896: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-14896) Deprecate HiveContext in Python

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14896: Assignee: Andrew Or (was: Apache Spark) > Deprecate HiveContext in Python > -

[jira] [Assigned] (SPARK-14896) Deprecate HiveContext in Python

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14896: Assignee: Apache Spark (was: Andrew Or) > Deprecate HiveContext in Python > -

[jira] [Commented] (SPARK-14897) Upgrade Jetty to latest version of 8/9

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271669#comment-15271669 ] Apache Spark commented on SPARK-14897: -- User 'bomeng' has created a pull request for

[jira] [Updated] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15037: -- Assignee: Sandeep Singh > Use SparkSession instead of SQLContext in testsuites > --

[jira] [Updated] (SPARK-15045) Remove dead code in TaskMemoryManager.cleanUpAllAllocatedMemory for pageTable

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15045: -- Priority: Major (was: Trivial) > Remove dead code in TaskMemoryManager.cleanUpAllAllocatedMemory for p

[jira] [Commented] (SPARK-15135) Make sure SparkSession thread safe

2016-05-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271621#comment-15271621 ] Shixiong Zhu commented on SPARK-15135: -- https://github.com/apache/spark/pull/12915

[jira] [Commented] (SPARK-15135) Make sure SparkSession thread safe

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271622#comment-15271622 ] Apache Spark commented on SPARK-15135: -- User 'zsxwing' has created a pull request fo

[jira] [Created] (SPARK-15135) Make sure SparkSession thread safe

2016-05-04 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-15135: Summary: Make sure SparkSession thread safe Key: SPARK-15135 URL: https://issues.apache.org/jira/browse/SPARK-15135 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10713) SPARK_DIST_CLASSPATH ignored on Mesos executors

2016-05-04 Thread Dara Adib (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271613#comment-15271613 ] Dara Adib commented on SPARK-10713: --- [~devaraj.k] Thanks for trying to reproduce. I'm

[jira] [Comment Edited] (SPARK-10713) SPARK_DIST_CLASSPATH ignored on Mesos executors

2016-05-04 Thread Dara Adib (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271613#comment-15271613 ] Dara Adib edited comment on SPARK-10713 at 5/4/16 11:18 PM: [

[jira] [Updated] (SPARK-15130) PySpark shared params should include default values to match Scala

2016-05-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-15130: Summary: PySpark shared params should include default values to match Scala (was: PySpark decision tree pa

[jira] [Assigned] (SPARK-15130) PySpark decision tree params should include default values to match Scala

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15130: Assignee: (was: Apache Spark) > PySpark decision tree params should include default va

[jira] [Assigned] (SPARK-15130) PySpark decision tree params should include default values to match Scala

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15130: Assignee: Apache Spark > PySpark decision tree params should include default values to mat

[jira] [Commented] (SPARK-15130) PySpark decision tree params should include default values to match Scala

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271611#comment-15271611 ] Apache Spark commented on SPARK-15130: -- User 'holdenk' has created a pull request fo

[jira] [Commented] (SPARK-15130) PySpark decision tree params should include default values to match Scala

2016-05-04 Thread Holden Karau (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271585#comment-15271585 ] Holden Karau commented on SPARK-15130: -- I mean that the pydocs should include what t

[jira] [Commented] (SPARK-15112) Dataset filter returns garbage

2016-05-04 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271576#comment-15271576 ] Suresh Thalamati commented on SPARK-15112: -- I ran into similar issue SPARK-14218

[jira] [Comment Edited] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2016-05-04 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265805#comment-15265805 ] Sandeep Singh edited comment on SPARK-928 at 5/4/16 10:43 PM: --

[jira] [Assigned] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-928: -- Assignee: Apache Spark > Add support for Unsafe-based serializer in Kryo 2.22 >

[jira] [Commented] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271570#comment-15271570 ] Apache Spark commented on SPARK-928: User 'techaddict' has created a pull request for t

[jira] [Assigned] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-928: -- Assignee: (was: Apache Spark) > Add support for Unsafe-based serializer in Kryo 2.22 > -

[jira] [Assigned] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15134: Assignee: Apache Spark > Indent SparkSession builder patterns and update > binary_classif

[jira] [Commented] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271541#comment-15271541 ] Apache Spark commented on SPARK-15134: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15134: Assignee: (was: Apache Spark) > Indent SparkSession builder patterns and update > bin

[jira] [Updated] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

2016-05-04 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15134: -- Description: This issue addresses the comments in SPARK-15031 and also fix java-linter errors.

[jira] [Created] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

2016-05-04 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-15134: - Summary: Indent SparkSession builder patterns and update binary_classification_metrics_example.py Key: SPARK-15134 URL: https://issues.apache.org/jira/browse/SPARK-15134

[jira] [Commented] (SPARK-15130) PySpark decision tree params should include default values to match Scala

2016-05-04 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271531#comment-15271531 ] Xin Ren commented on SPARK-15130: - Hi I just found in class DecisionTreeClassifier of pys

[jira] [Assigned] (SPARK-13670) spark-class doesn't bubble up error from launcher command

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13670: Assignee: Apache Spark > spark-class doesn't bubble up error from launcher command > -

  1   2   3   >