[jira] [Resolved] (SPARK-15417) Failed to enable HiveSupport in PySpark

2016-05-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15417. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Failed to enable Hi

[jira] [Resolved] (SPARK-15421) Table and Database property values need to be validated

2016-05-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15421. --- Resolution: Fixed Fix Version/s: 2.0.0 > Table and Database property values need to be validat

[jira] [Commented] (SPARK-15415) Marking partitions for broadcast broken

2016-05-19 Thread Jurriaan Pruis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292828#comment-15292828 ] Jurriaan Pruis commented on SPARK-15415: [~rxin] I could try to work on that. The

[jira] [Updated] (SPARK-15153) SparkR spark.naiveBayes throws error when label is numeric type

2016-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15153: -- Shepherd: Xiangrui Meng > SparkR spark.naiveBayes throws error when label is numeric type > ---

[jira] [Updated] (SPARK-15153) SparkR spark.naiveBayes throws error when label is numeric type

2016-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15153: -- Assignee: Yanbo Liang > SparkR spark.naiveBayes throws error when label is numeric type > -

[jira] [Resolved] (SPARK-15367) Add refreshTable back

2016-05-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15367. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13156 [https://githu

[jira] [Updated] (SPARK-15339) ML 2.0 QA: Scala APIs and code audit for regression

2016-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15339: -- Assignee: Yanbo Liang > ML 2.0 QA: Scala APIs and code audit for regression > -

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

2016-05-19 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292815#comment-15292815 ] Kai Jiang commented on SPARK-15439: --- Cool! Let me know if you find a way to solve this.

[jira] [Resolved] (SPARK-15339) ML 2.0 QA: Scala APIs and code audit for regression

2016-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-15339. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13129 [https://g

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

2016-05-19 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292814#comment-15292814 ] Miao Wang commented on SPARK-15439: --- Let me investigate this bug. Thanks! > Failed to

[jira] [Created] (SPARK-15439) Failed to run unit test in SparkR

2016-05-19 Thread Kai Jiang (JIRA)
Kai Jiang created SPARK-15439: - Summary: Failed to run unit test in SparkR Key: SPARK-15439 URL: https://issues.apache.org/jira/browse/SPARK-15439 Project: Spark Issue Type: Bug Compone

[jira] [Updated] (SPARK-15394) ML user guide typos and grammar audit

2016-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15394: -- Fix Version/s: 2.0.0 > ML user guide typos and grammar audit >

[jira] [Updated] (SPARK-15394) ML user guide typos and grammar audit

2016-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15394: -- Assignee: Seth Hendrickson > ML user guide typos and grammar audit > --

[jira] [Assigned] (SPARK-15437) Failed to create HiveContext in SparkR

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15437: Assignee: Apache Spark > Failed to create HiveContext in SparkR >

[jira] [Commented] (SPARK-15438) Improve the explain of whole-stage codegen

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292805#comment-15292805 ] Apache Spark commented on SPARK-15438: -- User 'davies' has created a pull request for

[jira] [Commented] (SPARK-15437) Failed to create HiveContext in SparkR

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292803#comment-15292803 ] Reynold Xin commented on SPARK-15437: - Maybe we should remove HIveContext from R, and

[jira] [Assigned] (SPARK-15437) Failed to create HiveContext in SparkR

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15437: Assignee: (was: Apache Spark) > Failed to create HiveContext in SparkR > -

[jira] [Assigned] (SPARK-15438) Improve the explain of whole-stage codegen

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15438: Assignee: Apache Spark (was: Davies Liu) > Improve the explain of whole-stage codegen > -

[jira] [Assigned] (SPARK-15434) improve EmbedSerializerInFilter rule

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15434: Assignee: Apache Spark (was: Wenchen Fan) > improve EmbedSerializerInFilter rule > --

[jira] [Assigned] (SPARK-15438) Improve the explain of whole-stage codegen

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15438: Assignee: Davies Liu (was: Apache Spark) > Improve the explain of whole-stage codegen > -

[jira] [Commented] (SPARK-15437) Failed to create HiveContext in SparkR

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292806#comment-15292806 ] Apache Spark commented on SPARK-15437: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-15434) improve EmbedSerializerInFilter rule

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15434: Assignee: Wenchen Fan (was: Apache Spark) > improve EmbedSerializerInFilter rule > --

[jira] [Resolved] (SPARK-15398) Update the warning message to recommend ML usage

2016-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-15398. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13190 [https://g

[jira] [Commented] (SPARK-15434) improve EmbedSerializerInFilter rule

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292802#comment-15292802 ] Apache Spark commented on SPARK-15434: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-15398) Update the warning message to recommend ML usage

2016-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15398: -- Assignee: zhengruifeng > Update the warning message to recommend ML usage > ---

[jira] [Assigned] (SPARK-15435) Append Command to all commands

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15435: Assignee: Reynold Xin (was: Apache Spark) > Append Command to all commands >

[jira] [Commented] (SPARK-15435) Append Command to all commands

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292798#comment-15292798 ] Apache Spark commented on SPARK-15435: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-15435) Append Command to all commands

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15435: Assignee: Apache Spark (was: Reynold Xin) > Append Command to all commands >

[jira] [Created] (SPARK-15438) Improve the explain of whole-stage codegen

2016-05-19 Thread Davies Liu (JIRA)
Davies Liu created SPARK-15438: -- Summary: Improve the explain of whole-stage codegen Key: SPARK-15438 URL: https://issues.apache.org/jira/browse/SPARK-15438 Project: Spark Issue Type: Improvemen

[jira] [Updated] (SPARK-15363) Example code shouldn't use VectorImplicits._, asML/fromML

2016-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15363: -- Assignee: Miao Wang > Example code shouldn't use VectorImplicits._, asML/fromML > -

[jira] [Resolved] (SPARK-15363) Example code shouldn't use VectorImplicits._, asML/fromML

2016-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-15363. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13213 [https://g

[jira] [Updated] (SPARK-15437) Failed to create HiveContext in SparkR

2016-05-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-15437: Description: Failed to create HiveContext in SparkR, even if we build the project with Hive support. {nof

[jira] [Updated] (SPARK-15172) Warning message should explicitly tell user initial coefficients is ignored if its size doesn't match expected size in LogisticRegression

2016-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15172: -- Fix Version/s: (was: 2.1.0) 2.0.0 > Warning message should explicitly te

[jira] [Created] (SPARK-15437) Failed to create HiveContext in SparkR

2016-05-19 Thread Xiao Li (JIRA)
Xiao Li created SPARK-15437: --- Summary: Failed to create HiveContext in SparkR Key: SPARK-15437 URL: https://issues.apache.org/jira/browse/SPARK-15437 Project: Spark Issue Type: Bug Compon

[jira] [Created] (SPARK-15436) Remove DescribeFunction and ShowFunctions

2016-05-19 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-15436: --- Summary: Remove DescribeFunction and ShowFunctions Key: SPARK-15436 URL: https://issues.apache.org/jira/browse/SPARK-15436 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-15435) Append Command to all commands

2016-05-19 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-15435: --- Summary: Append Command to all commands Key: SPARK-15435 URL: https://issues.apache.org/jira/browse/SPARK-15435 Project: Spark Issue Type: Sub-task C

[jira] [Updated] (SPARK-15335) Implement TRUNCATE TABLE Command

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15335: Affects Version/s: (was: 2.0.0) > Implement TRUNCATE TABLE Command > --

[jira] [Resolved] (SPARK-15335) Implement TRUNCATE TABLE Command

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15335. - Resolution: Fixed Assignee: Lianhui Wang Fix Version/s: 2.0.0 > Implement TRUNCAT

[jira] [Updated] (SPARK-15392) Improve default value of size estimation

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15392: Summary: Improve default value of size estimation (was: The default value of size estimation is no

[jira] [Resolved] (SPARK-15313) EmbedSerializerInFilter rule should keep exprIds of output of surrounded SerializeFromObject.

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15313. - Resolution: Fixed Assignee: Takuya Ueshin Fix Version/s: 2.0.0 > EmbedSerializerI

[jira] [Comment Edited] (SPARK-15393) Writing empty Dataframes doesn't save any _metadata files

2016-05-19 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292750#comment-15292750 ] Hyukjin Kwon edited comment on SPARK-15393 at 5/20/16 5:51 AM:

[jira] [Created] (SPARK-15434) improve EmbedSerializerInFilter rule

2016-05-19 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-15434: --- Summary: improve EmbedSerializerInFilter rule Key: SPARK-15434 URL: https://issues.apache.org/jira/browse/SPARK-15434 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-15393) Writing empty Dataframes doesn't save any _metadata files

2016-05-19 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292750#comment-15292750 ] Hyukjin Kwon commented on SPARK-15393: -- Hm.. I am trying to reproduce this exception

[jira] [Comment Edited] (SPARK-15393) Writing empty Dataframes doesn't save any _metadata files

2016-05-19 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292750#comment-15292750 ] Hyukjin Kwon edited comment on SPARK-15393 at 5/20/16 5:36 AM:

[jira] [Updated] (SPARK-15057) Remove stale TODO comment for making `enum` in GraphGenerators

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15057: Fix Version/s: 2.0.0 > Remove stale TODO comment for making `enum` in GraphGenerators > ---

[jira] [Updated] (SPARK-15057) Remove stale TODO comment for making `enum` in GraphGenerators

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15057: Fix Version/s: (was: 2.1.0) > Remove stale TODO comment for making `enum` in GraphGenerators >

[jira] [Updated] (SPARK-14261) Memory leak in Spark Thrift Server

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14261: Assignee: Oleg Danilov > Memory leak in Spark Thrift Server > -- >

[jira] [Resolved] (SPARK-14261) Memory leak in Spark Thrift Server

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14261. - Resolution: Fixed Fix Version/s: 2.0.0 1.6.2 > Memory leak in Spark Thr

[jira] [Commented] (SPARK-15433) PySpark core test should not use SerDe from PythonMLLibAPI

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292739#comment-15292739 ] Apache Spark commented on SPARK-15433: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-15433) PySpark core test should not use SerDe from PythonMLLibAPI

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15433: Assignee: Apache Spark > PySpark core test should not use SerDe from PythonMLLibAPI >

[jira] [Assigned] (SPARK-15433) PySpark core test should not use SerDe from PythonMLLibAPI

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15433: Assignee: (was: Apache Spark) > PySpark core test should not use SerDe from PythonMLLi

[jira] [Issue Comment Deleted] (SPARK-15433) PySpark core test should not use SerDe from PythonMLLibAPI

2016-05-19 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miao Wang updated SPARK-15433: -- Comment: was deleted (was: [~viirya] If you are not working on this one, I would like to take it. Than

[jira] [Commented] (SPARK-15433) PySpark core test should not use SerDe from PythonMLLibAPI

2016-05-19 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292738#comment-15292738 ] Miao Wang commented on SPARK-15433: --- [~viirya] If you are not working on this one, I wo

[jira] [Created] (SPARK-15433) PySpark core test should not use SerDe from PythonMLLibAPI

2016-05-19 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-15433: --- Summary: PySpark core test should not use SerDe from PythonMLLibAPI Key: SPARK-15433 URL: https://issues.apache.org/jira/browse/SPARK-15433 Project: Spark

[jira] [Resolved] (SPARK-14990) nvl, coalesce, array functions with parameter of type "array"

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14990. - Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 2.0.0 > nvl, coalesce, arr

[jira] [Commented] (SPARK-15363) Example code shouldn't use VectorImplicits._, asML/fromML

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292723#comment-15292723 ] Apache Spark commented on SPARK-15363: -- User 'wangmiao1981' has created a pull reque

[jira] [Assigned] (SPARK-15363) Example code shouldn't use VectorImplicits._, asML/fromML

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15363: Assignee: (was: Apache Spark) > Example code shouldn't use VectorImplicits._, asML/fro

[jira] [Assigned] (SPARK-15363) Example code shouldn't use VectorImplicits._, asML/fromML

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15363: Assignee: Apache Spark > Example code shouldn't use VectorImplicits._, asML/fromML > -

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

2016-05-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292719#comment-15292719 ] Maciej Bryński commented on SPARK-15345: Will try to test it with [~m1lan] today.

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292717#comment-15292717 ] Reynold Xin commented on SPARK-15345: - Haven't tested it :) I am a little bit busy l

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

2016-05-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292715#comment-15292715 ] Maciej Bryński commented on SPARK-15345: [~rxin] Are you planning another PR for

[jira] [Resolved] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15345. - Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 2.0.0 I think I have fixed

[jira] [Resolved] (SPARK-15075) Cleanup dependencies between SQLContext and SparkSession

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15075. - Resolution: Fixed Assignee: Reynold Xin > Cleanup dependencies between SQLContext and Spark

[jira] [Commented] (SPARK-15396) [Spark] [SQL] [DOC] It can't connect hive metastore database

2016-05-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292706#comment-15292706 ] Xiao Li commented on SPARK-15396: - Based on your description, it sounds like that is caus

[jira] [Updated] (SPARK-11827) Support java.math.BigInteger in Type-Inference utilities for POJOs

2016-05-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-11827: Assignee: kevin yu > Support java.math.BigInteger in Type-Inference utilities for POJOs > -

[jira] [Resolved] (SPARK-11827) Support java.math.BigInteger in Type-Inference utilities for POJOs

2016-05-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-11827. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10125 [https://githu

[jira] [Commented] (SPARK-15431) Support LIST FILE(s)|JAR(s) command natively

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292701#comment-15292701 ] Apache Spark commented on SPARK-15431: -- User 'xwu0226' has created a pull request fo

[jira] [Assigned] (SPARK-15431) Support LIST FILE(s)|JAR(s) command natively

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15431: Assignee: Apache Spark > Support LIST FILE(s)|JAR(s) command natively > --

[jira] [Assigned] (SPARK-15431) Support LIST FILE(s)|JAR(s) command natively

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15431: Assignee: (was: Apache Spark) > Support LIST FILE(s)|JAR(s) command natively > ---

[jira] [Commented] (SPARK-15363) Example code shouldn't use VectorImplicits._, asML/fromML

2016-05-19 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292689#comment-15292689 ] Miao Wang commented on SPARK-15363: --- [~mengxr] Yanbo pointed me https://github.com/apac

[jira] [Created] (SPARK-15432) Two executors with same id in Spark UI

2016-05-19 Thread Davies Liu (JIRA)
Davies Liu created SPARK-15432: -- Summary: Two executors with same id in Spark UI Key: SPARK-15432 URL: https://issues.apache.org/jira/browse/SPARK-15432 Project: Spark Issue Type: Bug Affect

[jira] [Resolved] (SPARK-15321) Encoding/decoding of Array[Timestamp] fails

2016-05-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15321. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13108 [https://githu

[jira] [Created] (SPARK-15431) Support LIST FILE(s)|JAR(s) command natively

2016-05-19 Thread Xin Wu (JIRA)
Xin Wu created SPARK-15431: -- Summary: Support LIST FILE(s)|JAR(s) command natively Key: SPARK-15431 URL: https://issues.apache.org/jira/browse/SPARK-15431 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-15430) Access ListAccumulator's value could possibly cause java.util.ConcurrentModificationException

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15430: Assignee: Apache Spark > Access ListAccumulator's value could possibly cause > java.util.

[jira] [Commented] (SPARK-15430) Access ListAccumulator's value could possibly cause java.util.ConcurrentModificationException

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292682#comment-15292682 ] Apache Spark commented on SPARK-15430: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-15430) Access ListAccumulator's value could possibly cause java.util.ConcurrentModificationException

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15430: Assignee: (was: Apache Spark) > Access ListAccumulator's value could possibly cause >

[jira] [Created] (SPARK-15430) Access ListAccumulator's value could possibly cause java.util.ConcurrentModificationException

2016-05-19 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-15430: --- Summary: Access ListAccumulator's value could possibly cause java.util.ConcurrentModificationException Key: SPARK-15430 URL: https://issues.apache.org/jira/browse/SPARK-1543

[jira] [Created] (SPARK-15429) When `spark.streaming.concurrentJobs > 1`, PIDRateEstimator cannot estimate the receiving rate accurately.

2016-05-19 Thread Albert Cheng (JIRA)
Albert Cheng created SPARK-15429: Summary: When `spark.streaming.concurrentJobs > 1`, PIDRateEstimator cannot estimate the receiving rate accurately. Key: SPARK-15429 URL: https://issues.apache.org/jira/browse/SPA

[jira] [Updated] (SPARK-15308) RowEncoder should preserve nested column name.

2016-05-19 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15308: - Target Version/s: 2.0.0 > RowEncoder should preserve nested column name. > --

[jira] [Updated] (SPARK-15313) EmbedSerializerInFilter rule should keep exprIds of output of surrounded SerializeFromObject.

2016-05-19 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15313: - Target Version/s: 2.0.0 > EmbedSerializerInFilter rule should keep exprIds of output of s

[jira] [Commented] (SPARK-15396) [Spark] [SQL] [DOC] It can't connect hive metastore database

2016-05-19 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292672#comment-15292672 ] Yi Zhou commented on SPARK-15396: - It seem it is not only a doc issue , it may be functio

[jira] [Commented] (SPARK-15396) [Spark] [SQL] [DOC] It can't connect hive metastore database

2016-05-19 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292655#comment-15292655 ] Yi Zhou commented on SPARK-15396: - Hi [~rxin] I saw a bug fix https://issues.apache.org/j

[jira] [Resolved] (SPARK-15296) Refactor All Java Tests that use SparkSession

2016-05-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-15296. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13101 [https://g

[jira] [Updated] (SPARK-15428) Disable support for multiple streaming aggregations

2016-05-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15428: -- Target Version/s: 2.0.0 > Disable support for multiple streaming aggregations > ---

[jira] [Assigned] (SPARK-15428) Disable support for multiple streaming aggregations

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15428: Assignee: Apache Spark (was: Tathagata Das) > Disable support for multiple streaming aggr

[jira] [Commented] (SPARK-15428) Disable support for multiple streaming aggregations

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292629#comment-15292629 ] Apache Spark commented on SPARK-15428: -- User 'tdas' has created a pull request for t

[jira] [Assigned] (SPARK-15428) Disable support for multiple streaming aggregations

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15428: Assignee: Tathagata Das (was: Apache Spark) > Disable support for multiple streaming aggr

[jira] [Created] (SPARK-15428) Disable support for multiple streaming aggregations

2016-05-19 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-15428: - Summary: Disable support for multiple streaming aggregations Key: SPARK-15428 URL: https://issues.apache.org/jira/browse/SPARK-15428 Project: Spark Issue T

[jira] [Updated] (SPARK-15427) Spark SQL doesn't support field case sensitive when load data use Phoenix

2016-05-19 Thread deng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deng updated SPARK-15427: - Description: I use sparkSql load data from Apache Phoenix. SQLContext sqlContext = new SQLContext(sc); Map opt

[jira] [Created] (SPARK-15427) Spark SQL doesn't support field case sensitive when load data use Phoenix

2016-05-19 Thread deng (JIRA)
deng created SPARK-15427: Summary: Spark SQL doesn't support field case sensitive when load data use Phoenix Key: SPARK-15427 URL: https://issues.apache.org/jira/browse/SPARK-15427 Project: Spark Is

[jira] [Commented] (SPARK-3821) Develop an automated way of creating Spark images (AMI, Docker, and others)

2016-05-19 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292599#comment-15292599 ] Nicholas Chammas commented on SPARK-3821: - You can deploy Spark today on Docker ju

[jira] [Assigned] (SPARK-15425) Disallow cartesian joins by default

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15425: Assignee: Apache Spark > Disallow cartesian joins by default > ---

[jira] [Commented] (SPARK-15425) Disallow cartesian joins by default

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292558#comment-15292558 ] Apache Spark commented on SPARK-15425: -- User 'sameeragarwal' has created a pull requ

[jira] [Assigned] (SPARK-15425) Disallow cartesian joins by default

2016-05-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15425: Assignee: (was: Apache Spark) > Disallow cartesian joins by default >

[jira] [Updated] (SPARK-15420) Repartition and sort before Parquet writes

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15420: Target Version/s: 2.1.0 > Repartition and sort before Parquet writes >

[jira] [Updated] (SPARK-14543) SQL/Hive insertInto has unexpected results

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14543: Target Version/s: 2.0.0 > SQL/Hive insertInto has unexpected results >

[jira] [Updated] (SPARK-15296) Refactor All Java Tests that use SparkSession

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15296: Assignee: Sandeep Singh Target Version/s: 2.0.0 > Refactor All Java Tests that use Spar

[jira] [Updated] (SPARK-14261) Memory leak in Spark Thrift Server

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14261: Target Version/s: 2.0.0 > Memory leak in Spark Thrift Server > -- >

[jira] [Updated] (SPARK-14261) Memory leak in Spark Thrift Server

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14261: Target Version/s: 1.6.2, 2.0.0 (was: 2.0.0) > Memory leak in Spark Thrift Server > ---

[jira] [Updated] (SPARK-15321) Encoding/decoding of Array[Timestamp] fails

2016-05-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15321: Assignee: Sumedh Mungee Affects Version/s: (was: 2.0.0) Target Version/s: 2.0.

  1   2   3   >