[jira] [Commented] (SPARK-15266) Use SparkSession instead of SQLContext in Python tests

2016-05-10 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279594#comment-15279594 ] Sandeep Singh commented on SPARK-15266: --- np. > Use SparkSession instead of SQLContext in Python

[jira] [Closed] (SPARK-15266) Use SparkSession instead of SQLContext in Python tests

2016-05-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon closed SPARK-15266. Resolution: Duplicate > Use SparkSession instead of SQLContext in Python tests >

[jira] [Commented] (SPARK-15266) Use SparkSession instead of SQLContext in Python tests

2016-05-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279591#comment-15279591 ] Hyukjin Kwon commented on SPARK-15266: -- Oh, sorry. I could not find. Thank you for correcting me. >

[jira] [Comment Edited] (SPARK-15266) Use SparkSession instead of SQLContext in Python tests

2016-05-10 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279581#comment-15279581 ] Sandeep Singh edited comment on SPARK-15266 at 5/11/16 5:46 AM: This is a

[jira] [Commented] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279586#comment-15279586 ] Apache Spark commented on SPARK-15037: -- User 'techaddict' has created a pull request for this issue:

[jira] [Commented] (SPARK-15266) Use SparkSession instead of SQLContext in Python tests

2016-05-10 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279581#comment-15279581 ] Sandeep Singh commented on SPARK-15266: --- This is a duplicate of

[jira] [Resolved] (SPARK-15235) Corresponding row cannot be highlighted even though cursor is on the job on Web UI's timeline

2016-05-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15235. - Resolution: Fixed Assignee: Kousuke Saruta Fix Version/s: 2.0.0 > Corresponding

[jira] [Updated] (SPARK-15266) Use SparkSession instead of SQLContext in Python tests

2016-05-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-15266: - Affects Version/s: 2.0.0 > Use SparkSession instead of SQLContext in Python tests >

[jira] [Commented] (SPARK-15266) Use SparkSession instead of SQLContext in Python tests

2016-05-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279575#comment-15279575 ] Hyukjin Kwon commented on SPARK-15266: -- I will work on this. > Use SparkSession instead of

[jira] [Created] (SPARK-15266) Use SparkSession instead of SQLContext in Python tests

2016-05-10 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-15266: Summary: Use SparkSession instead of SQLContext in Python tests Key: SPARK-15266 URL: https://issues.apache.org/jira/browse/SPARK-15266 Project: Spark Issue

[jira] [Resolved] (SPARK-15246) Fix code style and improve volatile for SPARK-4452

2016-05-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15246. - Resolution: Fixed Assignee: Lianhui Wang Fix Version/s: 2.0.0 > Fix code style

[jira] [Resolved] (SPARK-15255) RDD name from DataFrame op should not include full local relation data

2016-05-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15255. - Resolution: Fixed Assignee: Davies Liu Fix Version/s: 2.0.0 > RDD name from

[jira] [Resolved] (SPARK-15265) Fix Union query error message indentation

2016-05-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15265. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 > Fix Union query

[jira] [Updated] (SPARK-15263) Make shuffle service dir cleanup faster by using `rm -rf`

2016-05-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15263: Target Version/s: 2.0.0 > Make shuffle service dir cleanup faster by using `rm -rf` >

[jira] [Updated] (SPARK-15250) Remove deprecated json API in DataFrameReader

2016-05-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15250: Description: I see json() API in DataFrameReader should be removed as below: {code} // TODO:

[jira] [Updated] (SPARK-15250) Remove deprecated json API in DataFrameReader

2016-05-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15250: Description: I see json() API in DataFrameReader should be removed as below: {code} // TODO:

[jira] [Resolved] (SPARK-15250) Remove deprecated json API in DataFrameReader

2016-05-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15250. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.0.0 > Remove

[jira] [Resolved] (SPARK-15261) Remove experimental tag from DataFrameReader and DataFrameWriter

2016-05-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15261. - Resolution: Fixed > Remove experimental tag from DataFrameReader and DataFrameWriter >

[jira] [Resolved] (SPARK-14476) Show table name or path in string of DataSourceScan

2016-05-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14476. - Resolution: Fixed Assignee: Sean Zhong (was: Cheng Lian) Fix Version/s: 2.0.0 >

[jira] [Assigned] (SPARK-15265) Fix Union query error message indentation

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15265: Assignee: (was: Apache Spark) > Fix Union query error message indentation >

[jira] [Commented] (SPARK-15265) Fix Union query error message indentation

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279436#comment-15279436 ] Apache Spark commented on SPARK-15265: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-15265) Fix Union query error message indentation

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15265: Assignee: Apache Spark > Fix Union query error message indentation >

[jira] [Updated] (SPARK-15265) Fix Union query error message indentation

2016-05-10 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15265: -- Description: This issue fixes the error message indentation consistently with other set

[jira] [Created] (SPARK-15265) Fix Union query error message indentation

2016-05-10 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-15265: - Summary: Fix Union query error message indentation Key: SPARK-15265 URL: https://issues.apache.org/jira/browse/SPARK-15265 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15263) Make shuffle service dir cleanup faster by using `rm -rf`

2016-05-10 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-15263: Description: The current logic for directory cleanup (JavaUtils. deleteRecursively) is slow

[jira] [Commented] (SPARK-15263) Make shuffle service dir cleanup faster by using `rm -rf`

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279391#comment-15279391 ] Apache Spark commented on SPARK-15263: -- User 'tejasapatil' has created a pull request for this

[jira] [Assigned] (SPARK-15263) Make shuffle service dir cleanup faster by using `rm -rf`

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15263: Assignee: Apache Spark > Make shuffle service dir cleanup faster by using `rm -rf` >

[jira] [Assigned] (SPARK-15263) Make shuffle service dir cleanup faster by using `rm -rf`

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15263: Assignee: (was: Apache Spark) > Make shuffle service dir cleanup faster by using `rm

[jira] [Commented] (SPARK-15224) Can not delete jar and list jar in spark Thrift server

2016-05-10 Thread poseidon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279386#comment-15279386 ] poseidon commented on SPARK-15224: -- well,It's very obvious, the exception say that it's not a valid

[jira] [Commented] (SPARK-14813) ML 2.0 QA: API: Python API coverage

2016-05-10 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279380#comment-15279380 ] holdenk commented on SPARK-14813: - redid the links > ML 2.0 QA: API: Python API coverage >

[jira] [Assigned] (SPARK-15264) Spark 2.0 CSV Reader: Error on Blank Column Names

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15264: Assignee: Apache Spark > Spark 2.0 CSV Reader: Error on Blank Column Names >

[jira] [Commented] (SPARK-15264) Spark 2.0 CSV Reader: Error on Blank Column Names

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279367#comment-15279367 ] Apache Spark commented on SPARK-15264: -- User 'anabranch' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15264) Spark 2.0 CSV Reader: Error on Blank Column Names

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15264: Assignee: (was: Apache Spark) > Spark 2.0 CSV Reader: Error on Blank Column Names >

[jira] [Created] (SPARK-15264) Spark 2.0 CSV Reader: Error on Blank Column Names

2016-05-10 Thread Bill Chambers (JIRA)
Bill Chambers created SPARK-15264: - Summary: Spark 2.0 CSV Reader: Error on Blank Column Names Key: SPARK-15264 URL: https://issues.apache.org/jira/browse/SPARK-15264 Project: Spark Issue

[jira] [Created] (SPARK-15263) Make shuffle service dir cleanup faster by using `rm -rf`

2016-05-10 Thread Tejas Patil (JIRA)
Tejas Patil created SPARK-15263: --- Summary: Make shuffle service dir cleanup faster by using `rm -rf` Key: SPARK-15263 URL: https://issues.apache.org/jira/browse/SPARK-15263 Project: Spark

[jira] [Commented] (SPARK-10643) Support HDFS application download in client mode spark submit

2016-05-10 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279318#comment-15279318 ] Michael Gummelt commented on SPARK-10643: - +1 to fix this. > Support HDFS application download

[jira] [Assigned] (SPARK-15250) Remove deprecated json API in DataFrameReader

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15250: Assignee: (was: Apache Spark) > Remove deprecated json API in DataFrameReader >

[jira] [Commented] (SPARK-15250) Remove deprecated json API in DataFrameReader

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279311#comment-15279311 ] Apache Spark commented on SPARK-15250: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-15250) Remove deprecated json API in DataFrameReader

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15250: Assignee: Apache Spark > Remove deprecated json API in DataFrameReader >

[jira] [Created] (SPARK-15262) race condition in killing an executor and reregistering an executor

2016-05-10 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-15262: Summary: race condition in killing an executor and reregistering an executor Key: SPARK-15262 URL: https://issues.apache.org/jira/browse/SPARK-15262 Project: Spark

[jira] [Updated] (SPARK-15262) race condition in killing an executor and reregistering an executor

2016-05-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-15262: - Affects Version/s: 1.6.1 > race condition in killing an executor and reregistering an executor >

[jira] [Commented] (SPARK-15243) Binarizer.explainParam(u"...") raises ValueError

2016-05-10 Thread Kazuki Yokoishi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279299#comment-15279299 ] Kazuki Yokoishi commented on SPARK-15243: - Thank you for handling this issue. But same problems

[jira] [Updated] (SPARK-15248) Partition added with ALTER TABLE to a hive partitioned table is not read while querying

2016-05-10 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15248: -- Description: Table partitions can be added with locations different from default warehouse

[jira] [Updated] (SPARK-15248) Partition added with ALTER TABLE to a hive partitioned table is not read while querying

2016-05-10 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15248: -- Description: Table partitions can be added with locations different from default warehouse

[jira] [Updated] (SPARK-15248) Partition added with ALTER TABLE to a hive partitioned table is not read while querying

2016-05-10 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15248: -- Description: Table partitions can be added with locations different from default warehouse

[jira] [Assigned] (SPARK-15260) UnifiedMemoryManager could be in bad state if any exception happen while evicting blocks

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15260: Assignee: Apache Spark (was: Andrew Or) > UnifiedMemoryManager could be in bad state if

[jira] [Comment Edited] (SPARK-14148) Kmeans Sum of squares - Within cluster, between clusters and total

2016-05-10 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211393#comment-15211393 ] Narine Kokhlikyan edited comment on SPARK-14148 at 5/10/16 11:57 PM: -

[jira] [Commented] (SPARK-15260) UnifiedMemoryManager could be in bad state if any exception happen while evicting blocks

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279263#comment-15279263 ] Apache Spark commented on SPARK-15260: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15260) UnifiedMemoryManager could be in bad state if any exception happen while evicting blocks

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15260: Assignee: Andrew Or (was: Apache Spark) > UnifiedMemoryManager could be in bad state if

[jira] [Assigned] (SPARK-15261) Remove experimental tag from DataFrameReader and DataFrameWriter

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15261: Assignee: Apache Spark (was: Reynold Xin) > Remove experimental tag from DataFrameReader

[jira] [Assigned] (SPARK-15261) Remove experimental tag from DataFrameReader and DataFrameWriter

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15261: Assignee: Reynold Xin (was: Apache Spark) > Remove experimental tag from DataFrameReader

[jira] [Commented] (SPARK-15261) Remove experimental tag from DataFrameReader and DataFrameWriter

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279259#comment-15279259 ] Apache Spark commented on SPARK-15261: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-15261) Remove experimental tag from DataFrameReader and DataFrameWriter

2016-05-10 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-15261: --- Summary: Remove experimental tag from DataFrameReader and DataFrameWriter Key: SPARK-15261 URL: https://issues.apache.org/jira/browse/SPARK-15261 Project: Spark

[jira] [Created] (SPARK-15260) UnifiedMemoryManager could be in bad state if any exception happen while evicting blocks

2016-05-10 Thread Davies Liu (JIRA)
Davies Liu created SPARK-15260: -- Summary: UnifiedMemoryManager could be in bad state if any exception happen while evicting blocks Key: SPARK-15260 URL: https://issues.apache.org/jira/browse/SPARK-15260

[jira] [Resolved] (SPARK-14837) Add support in file stream source for reading new files added to subdirs

2016-05-10 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14837. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12616

[jira] [Commented] (SPARK-15114) Column name generated by typed aggregate is super verbose

2016-05-10 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279229#comment-15279229 ] Dilip Biswal commented on SPARK-15114: -- Going to submit a PR for this tonight. > Column name

[jira] [Commented] (SPARK-1301) Add UI elements to collapse "Aggregated Metrics by Executor" pane on stage page

2016-05-10 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279188#comment-15279188 ] Alex Bozarth commented on SPARK-1301: - Submitted a small fix similar to Ryan's above but in line with

[jira] [Commented] (SPARK-1301) Add UI elements to collapse "Aggregated Metrics by Executor" pane on stage page

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279177#comment-15279177 ] Apache Spark commented on SPARK-1301: - User 'ajbozarth' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15243) Binarizer.explainParam(u"...") raises ValueError

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15243: Assignee: Apache Spark > Binarizer.explainParam(u"...") raises ValueError >

[jira] [Commented] (SPARK-15243) Binarizer.explainParam(u"...") raises ValueError

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279161#comment-15279161 ] Apache Spark commented on SPARK-15243: -- User 'sethah' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15243) Binarizer.explainParam(u"...") raises ValueError

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15243: Assignee: (was: Apache Spark) > Binarizer.explainParam(u"...") raises ValueError >

[jira] [Assigned] (SPARK-15259) Sort time metric should not include spill and record insertion time

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15259: Assignee: Apache Spark > Sort time metric should not include spill and record insertion

[jira] [Commented] (SPARK-15259) Sort time metric should not include spill and record insertion time

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279131#comment-15279131 ] Apache Spark commented on SPARK-15259: -- User 'ericl' has created a pull request for this issue:

[jira] [Created] (SPARK-15259) Sort time metric

2016-05-10 Thread Eric Liang (JIRA)
Eric Liang created SPARK-15259: -- Summary: Sort time metric Key: SPARK-15259 URL: https://issues.apache.org/jira/browse/SPARK-15259 Project: Spark Issue Type: Bug Components: SQL

[jira] [Assigned] (SPARK-15259) Sort time metric should not include spill and record insertion time

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15259: Assignee: (was: Apache Spark) > Sort time metric should not include spill and record

[jira] [Updated] (SPARK-15259) Sort time metric should not include spill and record insertion time

2016-05-10 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang updated SPARK-15259: --- Summary: Sort time metric should not include spill and record insertion time (was: Sort time

[jira] [Resolved] (SPARK-14936) FlumePollingStreamSuite is slow

2016-05-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-14936. -- Resolution: Fixed Assignee: Xin Ren Fix Version/s: 2.0.0 >

[jira] [Commented] (SPARK-15243) Binarizer.explainParam(u"...") raises ValueError

2016-05-10 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279091#comment-15279091 ] Seth Hendrickson commented on SPARK-15243: -- I'll submit a PR shortly. >

[jira] [Updated] (SPARK-15145) port binary classification evaluator to spark.ml

2016-05-10 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miao Wang updated SPARK-15145: -- Description: As we discussed in #12922, binary classification evaluator should be ported from mllib to

[jira] [Updated] (SPARK-15145) port binary classification evaluator to spark.ml

2016-05-10 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miao Wang updated SPARK-15145: -- Summary: port binary classification evaluator to spark.ml (was: spark.ml binary classification should

[jira] [Updated] (SPARK-15145) port binary classification evaluator to spark.ml

2016-05-10 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miao Wang updated SPARK-15145: -- Priority: Major (was: Minor) > port binary classification evaluator to spark.ml >

[jira] [Assigned] (SPARK-15256) Clarify the docstring for DataFrameReader.jdbc()

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15256: Assignee: Apache Spark > Clarify the docstring for DataFrameReader.jdbc() >

[jira] [Commented] (SPARK-15256) Clarify the docstring for DataFrameReader.jdbc()

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279025#comment-15279025 ] Apache Spark commented on SPARK-15256: -- User 'nchammas' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15256) Clarify the docstring for DataFrameReader.jdbc()

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15256: Assignee: (was: Apache Spark) > Clarify the docstring for DataFrameReader.jdbc() >

[jira] [Assigned] (SPARK-15255) RDD name from DataFrame op should not include full local relation data

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15255: Assignee: (was: Apache Spark) > RDD name from DataFrame op should not include full

[jira] [Assigned] (SPARK-15255) RDD name from DataFrame op should not include full local relation data

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15255: Assignee: Apache Spark > RDD name from DataFrame op should not include full local

[jira] [Commented] (SPARK-15255) RDD name from DataFrame op should not include full local relation data

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279007#comment-15279007 ] Apache Spark commented on SPARK-15255: -- User 'davies' has created a pull request for this issue:

[jira] [Resolved] (SPARK-15249) Use FunctionResource instead of (String, String) in CreateFunction and CatalogFunction for resource

2016-05-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15249. --- Resolution: Fixed Assignee: Sandeep Singh Fix Version/s: 2.0.0 Target

[jira] [Commented] (SPARK-15257) Require CREATE EXTERNAL TABLE to specify LOCATION

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278877#comment-15278877 ] Apache Spark commented on SPARK-15257: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15257) Require CREATE EXTERNAL TABLE to specify LOCATION

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15257: Assignee: Apache Spark (was: Andrew Or) > Require CREATE EXTERNAL TABLE to specify

[jira] [Assigned] (SPARK-15257) Require CREATE EXTERNAL TABLE to specify LOCATION

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15257: Assignee: Andrew Or (was: Apache Spark) > Require CREATE EXTERNAL TABLE to specify

[jira] [Commented] (SPARK-15258) Nested/Chained case statements generate codegen over 64k exception

2016-05-10 Thread Jonathan Gray (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278859#comment-15278859 ] Jonathan Gray commented on SPARK-15258: --- I ran this against the master branch as of 8th May 2016

[jira] [Updated] (SPARK-15256) Clarify the docstring for DataFrameReader.jdbc()

2016-05-10 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-15256: - Description: The doc for the {{properties}} parameter [currently

[jira] [Updated] (SPARK-15258) Nested/Chained case statements generate codegen over 64k exception

2016-05-10 Thread Jonathan Gray (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Gray updated SPARK-15258: -- Attachment: NestedCases.scala Example code that exhibits the exceptional behaviour >

[jira] [Updated] (SPARK-15256) Clarify the docstring for DataFrameReader.jdbc()

2016-05-10 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-15256: - Summary: Clarify the docstring for DataFrameReader.jdbc() (was: Correct the docstring

[jira] [Created] (SPARK-15258) Nested/Chained case statements generate codegen over 64k exception

2016-05-10 Thread Jonathan Gray (JIRA)
Jonathan Gray created SPARK-15258: - Summary: Nested/Chained case statements generate codegen over 64k exception Key: SPARK-15258 URL: https://issues.apache.org/jira/browse/SPARK-15258 Project: Spark

[jira] [Created] (SPARK-15257) Require CREATE EXTERNAL TABLE to specify LOCATION

2016-05-10 Thread Andrew Or (JIRA)
Andrew Or created SPARK-15257: - Summary: Require CREATE EXTERNAL TABLE to specify LOCATION Key: SPARK-15257 URL: https://issues.apache.org/jira/browse/SPARK-15257 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-6005) Flaky test: o.a.s.streaming.kafka.DirectKafkaStreamSuite.offset recovery

2016-05-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-6005. - Resolution: Fixed Fix Version/s: 2.0.0 > Flaky test:

[jira] [Created] (SPARK-15256) Correct the docstring for DataFrameReader.jdbc()

2016-05-10 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-15256: Summary: Correct the docstring for DataFrameReader.jdbc() Key: SPARK-15256 URL: https://issues.apache.org/jira/browse/SPARK-15256 Project: Spark

[jira] [Updated] (SPARK-15207) Use Travis CI for Java Linter and JDK7/8 compilation test

2016-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15207: -- Assignee: Dongjoon Hyun Priority: Minor (was: Major) Issue Type: New Feature (was: Task)

[jira] [Resolved] (SPARK-15207) Use Travis CI for Java Linter and JDK7/8 compilation test

2016-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15207. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 12980

[jira] [Updated] (SPARK-15255) RDD name from DataFrame op should not include full local relation data

2016-05-10 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15255: Component/s: Web UI > RDD name from DataFrame op should not include full local relation data >

[jira] [Updated] (SPARK-14986) Spark SQL returns incorrect results for LATERAL VIEW OUTER queries if all inner columns are projected out

2016-05-10 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14986: - Assignee: Herman van Hovell > Spark SQL returns incorrect results for LATERAL VIEW OUTER queries if all

[jira] [Resolved] (SPARK-14986) Spark SQL returns incorrect results for LATERAL VIEW OUTER queries if all inner columns are projected out

2016-05-10 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14986. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12906

[jira] [Commented] (SPARK-15181) Python API for Generalized Linear Regression Summary

2016-05-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278740#comment-15278740 ] Joseph K. Bradley commented on SPARK-15181: --- Is this a duplicate of [SPARK-14982]? > Python

[jira] [Updated] (SPARK-15169) Consider improving HasSolver to allow generalization

2016-05-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15169: -- Summary: Consider improving HasSolver to allow generalization (was: Consider

[jira] [Commented] (SPARK-15161) Consider moving featureImportances into TreeEnsemble models base class

2016-05-10 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278735#comment-15278735 ] Joseph K. Bradley commented on SPARK-15161: --- Sounds fine, but we'll need to make sure it's

[jira] [Updated] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions

2016-05-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-14642: - Assignee: Subhobrata Dey > import org.apache.spark.sql.expressions._ breaks udf under functions

[jira] [Resolved] (SPARK-14642) import org.apache.spark.sql.expressions._ breaks udf under functions

2016-05-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-14642. -- Resolution: Fixed Fix Version/s: 2.0.0 > import org.apache.spark.sql.expressions._

[jira] [Updated] (SPARK-15171) Deprecate registerTempTable and add dataset.createTempView

2016-05-10 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15171: - Issue Type: New Feature (was: Bug) > Deprecate registerTempTable and add dataset.createTempView >

  1   2   3   >