[jira] [Commented] (SPARK-15144) option nullValue for CSV data source not working for several types.

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271927#comment-15271927 ] Apache Spark commented on SPARK-15144: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-15144) option nullValue for CSV data source not working for several types.

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15144: Assignee: (was: Apache Spark) > option nullValue for CSV data source not working for

[jira] [Assigned] (SPARK-15144) option nullValue for CSV data source not working for several types.

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15144: Assignee: Apache Spark > option nullValue for CSV data source not working for several

[jira] [Assigned] (SPARK-15143) CSV data source is not being tested as HadoopFsRelation

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15143: Assignee: Apache Spark > CSV data source is not being tested as HadoopFsRelation >

[jira] [Assigned] (SPARK-15145) spark.ml binary classification should include accuracy

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15145: Assignee: Apache Spark > spark.ml binary classification should include accuracy >

[jira] [Assigned] (SPARK-15143) CSV data source is not being tested as HadoopFsRelation

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15143: Assignee: (was: Apache Spark) > CSV data source is not being tested as

[jira] [Commented] (SPARK-15143) CSV data source is not being tested as HadoopFsRelation

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271926#comment-15271926 ] Apache Spark commented on SPARK-15143: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-15145) spark.ml binary classification should include accuracy

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271925#comment-15271925 ] Apache Spark commented on SPARK-15145: -- User 'wangmiao1981' has created a pull request for this

[jira] [Assigned] (SPARK-15145) spark.ml binary classification should include accuracy

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15145: Assignee: (was: Apache Spark) > spark.ml binary classification should include

[jira] [Created] (SPARK-15145) spark.ml binary classification should include accuracy

2016-05-04 Thread Miao Wang (JIRA)
Miao Wang created SPARK-15145: - Summary: spark.ml binary classification should include accuracy Key: SPARK-15145 URL: https://issues.apache.org/jira/browse/SPARK-15145 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15144) option nullValue for CSV data source not working for several types.

2016-05-04 Thread Abhinav Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271922#comment-15271922 ] Abhinav Gupta commented on SPARK-15144: --- Can you explain with example? So that I can reproduce it.

[jira] [Created] (SPARK-15144) option nullValue for CSV data source not working for several types.

2016-05-04 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-15144: Summary: option nullValue for CSV data source not working for several types. Key: SPARK-15144 URL: https://issues.apache.org/jira/browse/SPARK-15144 Project: Spark

[jira] [Created] (SPARK-15143) CSV data source is not being tested as HadoopFsRelation

2016-05-04 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-15143: Summary: CSV data source is not being tested as HadoopFsRelation Key: SPARK-15143 URL: https://issues.apache.org/jira/browse/SPARK-15143 Project: Spark

[jira] [Updated] (SPARK-15045) Remove dead code in TaskMemoryManager.cleanUpAllAllocatedMemory for pageTable

2016-05-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-15045: --- Assignee: Jacek Lewandowski > Remove dead code in TaskMemoryManager.cleanUpAllAllocatedMemory for

[jira] [Resolved] (SPARK-15045) Remove dead code in TaskMemoryManager.cleanUpAllAllocatedMemory for pageTable

2016-05-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-15045. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12829

[jira] [Created] (SPARK-15142) Spark Mesos dispatcher becomes unusable when the Mesos master restarts

2016-05-04 Thread Devaraj K (JIRA)
Devaraj K created SPARK-15142: - Summary: Spark Mesos dispatcher becomes unusable when the Mesos master restarts Key: SPARK-15142 URL: https://issues.apache.org/jira/browse/SPARK-15142 Project: Spark

[jira] [Resolved] (SPARK-15132) Debug log for generated code should be printed with proper indentation

2016-05-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15132. - Resolution: Fixed Assignee: Kousuke Saruta Fix Version/s: 2.0.0 > Debug log for

[jira] [Assigned] (SPARK-15141) Add python example for OneVsRest

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15141: Assignee: (was: Apache Spark) > Add python example for OneVsRest >

[jira] [Assigned] (SPARK-15141) Add python example for OneVsRest

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15141: Assignee: Apache Spark > Add python example for OneVsRest >

[jira] [Commented] (SPARK-15141) Add python example for OneVsRest

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271891#comment-15271891 ] Apache Spark commented on SPARK-15141: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-15141) Add python example for OneVsRest

2016-05-04 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-15141: Summary: Add python example for OneVsRest Key: SPARK-15141 URL: https://issues.apache.org/jira/browse/SPARK-15141 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-15140) ensure input object of encoder is not null

2016-05-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271885#comment-15271885 ] Wenchen Fan commented on SPARK-15140: - cc [~marmbrus] [~lian cheng] > ensure input object of

[jira] [Created] (SPARK-15140) ensure input object of encoder is not null

2016-05-04 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-15140: --- Summary: ensure input object of encoder is not null Key: SPARK-15140 URL: https://issues.apache.org/jira/browse/SPARK-15140 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-15131) StateStore management thread does not stop after SparkContext is shutdown

2016-05-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-15131. -- Resolution: Fixed Fix Version/s: 2.0.0 > StateStore management thread does not stop

[jira] [Commented] (SPARK-10713) SPARK_DIST_CLASSPATH ignored on Mesos executors

2016-05-04 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271875#comment-15271875 ] Devaraj K commented on SPARK-10713: --- bq. However, on Mesos, SPARK_DIST_CLASSPATH is missing from

[jira] [Commented] (SPARK-15122) TPC-DS Qury 41 fails with The correlated scalar subquery can only contain equality predicates

2016-05-04 Thread Frederick Reiss (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271874#comment-15271874 ] Frederick Reiss commented on SPARK-15122: - In the official version of the query, the expression

[jira] [Assigned] (SPARK-15092) toDebugString missing from ML DecisionTreeClassifier

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15092: Assignee: Apache Spark > toDebugString missing from ML DecisionTreeClassifier >

[jira] [Commented] (SPARK-15092) toDebugString missing from ML DecisionTreeClassifier

2016-05-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271873#comment-15271873 ] holdenk commented on SPARK-15092: - Ah yes, it is present in Java so it is a simple fix. I've created a PR

[jira] [Assigned] (SPARK-15139) PySpark TreeEnsemble missing methods

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15139: Assignee: (was: Apache Spark) > PySpark TreeEnsemble missing methods >

[jira] [Commented] (SPARK-15139) PySpark TreeEnsemble missing methods

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271871#comment-15271871 ] Apache Spark commented on SPARK-15139: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-15092) toDebugString missing from ML DecisionTreeClassifier

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271872#comment-15271872 ] Apache Spark commented on SPARK-15092: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15139) PySpark TreeEnsemble missing methods

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15139: Assignee: Apache Spark > PySpark TreeEnsemble missing methods >

[jira] [Assigned] (SPARK-15092) toDebugString missing from ML DecisionTreeClassifier

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15092: Assignee: (was: Apache Spark) > toDebugString missing from ML DecisionTreeClassifier

[jira] [Commented] (SPARK-15139) PySpark TreeEnsemble missing methods

2016-05-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271851#comment-15271851 ] holdenk commented on SPARK-15139: - This is related to SPARK-15092 > PySpark TreeEnsemble missing methods

[jira] [Updated] (SPARK-15139) PySpark TreeEnsemble missing methods

2016-05-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-15139: Description: TreeEnsemble class is missing some accessor methods compared to Scala API > PySpark

[jira] [Created] (SPARK-15139) PySpark TreeEnsemble missing methods

2016-05-04 Thread holdenk (JIRA)
holdenk created SPARK-15139: --- Summary: PySpark TreeEnsemble missing methods Key: SPARK-15139 URL: https://issues.apache.org/jira/browse/SPARK-15139 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-15137) Linkify ML PyDoc classification

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15137: Assignee: Apache Spark > Linkify ML PyDoc classification >

[jira] [Commented] (SPARK-15137) Linkify ML PyDoc classification

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271839#comment-15271839 ] Apache Spark commented on SPARK-15137: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15137) Linkify ML PyDoc classification

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15137: Assignee: (was: Apache Spark) > Linkify ML PyDoc classification >

[jira] [Updated] (SPARK-15137) Linkify ML PyDoc classification

2016-05-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-15137: Description: PyDoc links in ml are in non-standard format. Switch to standard sphinx link format for

[jira] [Commented] (SPARK-15101) Audit: ml.clustering and ml.recommendation

2016-05-04 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271824#comment-15271824 ] zhengruifeng commented on SPARK-15101: -- [~josephkb] User Doc and scala example for

[jira] [Created] (SPARK-15138) Linkify ML PyDoc regression

2016-05-04 Thread holdenk (JIRA)
holdenk created SPARK-15138: --- Summary: Linkify ML PyDoc regression Key: SPARK-15138 URL: https://issues.apache.org/jira/browse/SPARK-15138 Project: Spark Issue Type: Sub-task Reporter:

[jira] [Created] (SPARK-15137) Linkify ML PyDoc classification

2016-05-04 Thread holdenk (JIRA)
holdenk created SPARK-15137: --- Summary: Linkify ML PyDoc classification Key: SPARK-15137 URL: https://issues.apache.org/jira/browse/SPARK-15137 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-15136) Linkify ML PyDoc

2016-05-04 Thread holdenk (JIRA)
holdenk created SPARK-15136: --- Summary: Linkify ML PyDoc Key: SPARK-15136 URL: https://issues.apache.org/jira/browse/SPARK-15136 Project: Spark Issue Type: Improvement Reporter: holdenk

[jira] [Updated] (SPARK-14837) Add support in file stream source for reading new files added to subdirs

2016-05-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-14837: -- Target Version/s: 2.0.0 > Add support in file stream source for reading new files added to

[jira] [Updated] (SPARK-15131) StateStore management thread does not stop after SparkContext is shutdown

2016-05-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15131: -- Fix Version/s: (was: 2.0.0) > StateStore management thread does not stop after

[jira] [Updated] (SPARK-15131) StateStore management thread does not stop after SparkContext is shutdown

2016-05-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15131: -- Target Version/s: 2.0.0 > StateStore management thread does not stop after SparkContext is

[jira] [Updated] (SPARK-14340) Add Scala Example and User DOC for ml.BisectingKMeans

2016-05-04 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-14340: - Summary: Add Scala Example and User DOC for ml.BisectingKMeans (was: Add Scala Example and

[jira] [Updated] (SPARK-14993) Inconsistent behavior of partitioning discovery

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14993: - Assignee: Xiao Li > Inconsistent behavior of partitioning discovery >

[jira] [Resolved] (SPARK-14993) Inconsistent behavior of partitioning discovery

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14993. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12828

[jira] [Updated] (SPARK-6339) Support creating temporary views with DDL

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6339: Assignee: Sean Zhong > Support creating temporary views with DDL >

[jira] [Updated] (SPARK-6339) Support creating temporary views with DDL

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6339: Summary: Support creating temporary views with DDL (was: Support creating temporary tables with DDL) >

[jira] [Resolved] (SPARK-6339) Support creating temporary tables with DDL

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-6339. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12872

[jira] [Updated] (SPARK-6339) Support creating temporary views with DDL

2016-05-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6339: Description: It would useful to support following: {code} create temporary view counted as select

[jira] [Resolved] (SPARK-14896) Deprecate HiveContext in Python

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14896. --- Resolution: Fixed Fix Version/s: 2.0.0 > Deprecate HiveContext in Python >

[jira] [Comment Edited] (SPARK-15112) Dataset filter returns garbage

2016-05-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271025#comment-15271025 ] Cheng Lian edited comment on SPARK-15112 at 5/5/16 12:28 AM: - The following

[jira] [Commented] (SPARK-14896) Deprecate HiveContext in Python

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271685#comment-15271685 ] Apache Spark commented on SPARK-14896: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14896) Deprecate HiveContext in Python

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14896: Assignee: Andrew Or (was: Apache Spark) > Deprecate HiveContext in Python >

[jira] [Assigned] (SPARK-14896) Deprecate HiveContext in Python

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14896: Assignee: Apache Spark (was: Andrew Or) > Deprecate HiveContext in Python >

[jira] [Commented] (SPARK-14897) Upgrade Jetty to latest version of 8/9

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271669#comment-15271669 ] Apache Spark commented on SPARK-14897: -- User 'bomeng' has created a pull request for this issue:

[jira] [Updated] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15037: -- Assignee: Sandeep Singh > Use SparkSession instead of SQLContext in testsuites >

[jira] [Updated] (SPARK-15045) Remove dead code in TaskMemoryManager.cleanUpAllAllocatedMemory for pageTable

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15045: -- Priority: Major (was: Trivial) > Remove dead code in TaskMemoryManager.cleanUpAllAllocatedMemory for

[jira] [Commented] (SPARK-15135) Make sure SparkSession thread safe

2016-05-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271621#comment-15271621 ] Shixiong Zhu commented on SPARK-15135: -- https://github.com/apache/spark/pull/12915 > Make sure

[jira] [Commented] (SPARK-15135) Make sure SparkSession thread safe

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271622#comment-15271622 ] Apache Spark commented on SPARK-15135: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Created] (SPARK-15135) Make sure SparkSession thread safe

2016-05-04 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-15135: Summary: Make sure SparkSession thread safe Key: SPARK-15135 URL: https://issues.apache.org/jira/browse/SPARK-15135 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10713) SPARK_DIST_CLASSPATH ignored on Mesos executors

2016-05-04 Thread Dara Adib (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271613#comment-15271613 ] Dara Adib commented on SPARK-10713: --- [~devaraj.k] Thanks for trying to reproduce. I'm not using the

[jira] [Comment Edited] (SPARK-10713) SPARK_DIST_CLASSPATH ignored on Mesos executors

2016-05-04 Thread Dara Adib (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271613#comment-15271613 ] Dara Adib edited comment on SPARK-10713 at 5/4/16 11:18 PM: [~devaraj.k]

[jira] [Updated] (SPARK-15130) PySpark shared params should include default values to match Scala

2016-05-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-15130: Summary: PySpark shared params should include default values to match Scala (was: PySpark decision tree

[jira] [Assigned] (SPARK-15130) PySpark decision tree params should include default values to match Scala

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15130: Assignee: (was: Apache Spark) > PySpark decision tree params should include default

[jira] [Assigned] (SPARK-15130) PySpark decision tree params should include default values to match Scala

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15130: Assignee: Apache Spark > PySpark decision tree params should include default values to

[jira] [Commented] (SPARK-15130) PySpark decision tree params should include default values to match Scala

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271611#comment-15271611 ] Apache Spark commented on SPARK-15130: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-15130) PySpark decision tree params should include default values to match Scala

2016-05-04 Thread Holden Karau (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271585#comment-15271585 ] Holden Karau commented on SPARK-15130: -- I mean that the pydocs should include what the default value

[jira] [Commented] (SPARK-15112) Dataset filter returns garbage

2016-05-04 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271576#comment-15271576 ] Suresh Thalamati commented on SPARK-15112: -- I ran into similar issue SPARK-14218 > Dataset

[jira] [Comment Edited] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2016-05-04 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15265805#comment-15265805 ] Sandeep Singh edited comment on SPARK-928 at 5/4/16 10:43 PM: -- [~joshrosen] I

[jira] [Assigned] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-928: -- Assignee: Apache Spark > Add support for Unsafe-based serializer in Kryo 2.22 >

[jira] [Commented] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271570#comment-15271570 ] Apache Spark commented on SPARK-928: User 'techaddict' has created a pull request for this issue:

[jira] [Assigned] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-928: -- Assignee: (was: Apache Spark) > Add support for Unsafe-based serializer in Kryo 2.22 >

[jira] [Assigned] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15134: Assignee: Apache Spark > Indent SparkSession builder patterns and update >

[jira] [Commented] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271541#comment-15271541 ] Apache Spark commented on SPARK-15134: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15134: Assignee: (was: Apache Spark) > Indent SparkSession builder patterns and update >

[jira] [Updated] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

2016-05-04 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15134: -- Description: This issue addresses the comments in SPARK-15031 and also fix java-linter

[jira] [Created] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

2016-05-04 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-15134: - Summary: Indent SparkSession builder patterns and update binary_classification_metrics_example.py Key: SPARK-15134 URL: https://issues.apache.org/jira/browse/SPARK-15134

[jira] [Commented] (SPARK-15130) PySpark decision tree params should include default values to match Scala

2016-05-04 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271531#comment-15271531 ] Xin Ren commented on SPARK-15130: - Hi I just found in class DecisionTreeClassifier of pyspark, there is a

[jira] [Assigned] (SPARK-13670) spark-class doesn't bubble up error from launcher command

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13670: Assignee: Apache Spark > spark-class doesn't bubble up error from launcher command >

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271487#comment-15271487 ] Apache Spark commented on SPARK-13670: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13670) spark-class doesn't bubble up error from launcher command

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13670: Assignee: (was: Apache Spark) > spark-class doesn't bubble up error from launcher

[jira] [Resolved] (SPARK-15116) In REPL we should create SparkSession first and get SparkContext from it

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15116. --- Resolution: Fixed Fix Version/s: 2.0.0 > In REPL we should create SparkSession first and get

[jira] [Commented] (SPARK-2629) Improved state management for Spark Streaming

2016-05-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271479#comment-15271479 ] Shixiong Zhu commented on SPARK-2629: - The compaction issue was fixed in SPARK-6847. However, as it

[jira] [Resolved] (SPARK-15031) Use SparkSession in Scala/Python/Java example.

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15031. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Use SparkSession

[jira] [Updated] (SPARK-13001) Coarse-grained Mesos scheduler should reject offers for longer period of time when reached max cores

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13001: -- Assignee: Sebastien Rainville > Coarse-grained Mesos scheduler should reject offers for longer period

[jira] [Resolved] (SPARK-13001) Coarse-grained Mesos scheduler should reject offers for longer period of time when reached max cores

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13001. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Coarse-grained

[jira] [Resolved] (SPARK-15121) Improve logging of external shuffle handler

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15121. --- Resolution: Fixed Assignee: Thomas Graves Fix Version/s: 2.0.0 Target

[jira] [Updated] (SPARK-15121) Improve logging of external shuffle handler

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15121: -- Priority: Minor (was: Major) > Improve logging of external shuffle handler >

[jira] [Assigned] (SPARK-11249) [Launcher] Launcher library fails is app resource is not added

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11249: Assignee: (was: Apache Spark) > [Launcher] Launcher library fails is app resource is

[jira] [Resolved] (SPARK-12299) Remove history serving functionality from standalone Master

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12299. --- Resolution: Fixed Assignee: Bryan Cutler Fix Version/s: 2.0.0 > Remove history

[jira] [Resolved] (SPARK-15126) RuntimeConfig.set should return Unit rather than RuntimeConfig itself

2016-05-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15126. --- Resolution: Fixed > RuntimeConfig.set should return Unit rather than RuntimeConfig itself >

[jira] [Assigned] (SPARK-11249) [Launcher] Launcher library fails is app resource is not added

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11249: Assignee: Apache Spark > [Launcher] Launcher library fails is app resource is not added >

[jira] [Commented] (SPARK-11249) [Launcher] Launcher library fails is app resource is not added

2016-05-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271475#comment-15271475 ] Apache Spark commented on SPARK-11249: -- User 'vanzin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-2629) Improved state management for Spark Streaming

2016-05-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-2629. - Resolution: Fixed Fix Version/s: 1.6.0 This was done in 1.6.0 > Improved state management

[jira] [Updated] (SPARK-15133) Add streamFrom to SparkSession

2016-05-04 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Singh updated SPARK-15133: -- Component/s: SQL > Add streamFrom to SparkSession > -- > >

  1   2   3   >