[jira] [Commented] (SPARK-14365) Repartition by column

2016-05-05 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273664#comment-15273664 ] Sun Rui commented on SPARK-14365: - [~dselivanov] Could you verify if SPARK-15110 can solve your problem?

[jira] [Closed] (SPARK-14365) Repartition by column

2016-05-05 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui closed SPARK-14365. --- Resolution: Duplicate > Repartition by column > - > > Key: SPARK-14365 >

[jira] [Commented] (SPARK-15159) Remove usage of HiveContext in SparkR.

2016-05-05 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273655#comment-15273655 ] Sun Rui commented on SPARK-15159: - [~felixcheung], I guess you are talking about SQLContext, not

[jira] [Commented] (SPARK-14476) Show table name or path in string of DataSourceScan

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273632#comment-15273632 ] Apache Spark commented on SPARK-14476: -- User 'clockfly' has created a pull request for this issue:

[jira] [Commented] (SPARK-14476) Show table name or path in string of DataSourceScan

2016-05-05 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273630#comment-15273630 ] Sean Zhong commented on SPARK-14476: Regression of SPARK-12012 > Show table name or path in string

[jira] [Assigned] (SPARK-14476) Show table name or path in string of DataSourceScan

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14476: Assignee: Cheng Lian (was: Apache Spark) > Show table name or path in string of

[jira] [Assigned] (SPARK-14476) Show table name or path in string of DataSourceScan

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14476: Assignee: Apache Spark (was: Cheng Lian) > Show table name or path in string of

[jira] [Commented] (SPARK-15085) Rename current streaming-kafka artifact to include kafka version

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273619#comment-15273619 ] Apache Spark commented on SPARK-15085: -- User 'koeninger' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15085) Rename current streaming-kafka artifact to include kafka version

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15085: Assignee: (was: Apache Spark) > Rename current streaming-kafka artifact to include

[jira] [Assigned] (SPARK-15085) Rename current streaming-kafka artifact to include kafka version

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15085: Assignee: Apache Spark > Rename current streaming-kafka artifact to include kafka version

[jira] [Updated] (SPARK-14809) R Examples: Check for new R APIs requiring example code in 2.0

2016-05-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14809: -- Assignee: Yanbo Liang > R Examples: Check for new R APIs requiring example code in 2.0

[jira] [Updated] (SPARK-15155) Optionally ignore default role resources

2016-05-05 Thread Chris Heller (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Heller updated SPARK-15155: - Description: SPARK-6284 added support for Mesos roles, but the framework will still accept

[jira] [Updated] (SPARK-15155) Optionally ignore default role resources

2016-05-05 Thread Chris Heller (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Heller updated SPARK-15155: - Summary: Optionally ignore default role resources (was: Selectively accept Mesos resources by

[jira] [Commented] (SPARK-15171) Deprecate registerTempTable and add dataset.createTempView

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273544#comment-15273544 ] Apache Spark commented on SPARK-15171: -- User 'clockfly' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15171) Deprecate registerTempTable and add dataset.createTempView

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15171: Assignee: Apache Spark > Deprecate registerTempTable and add dataset.createTempView >

[jira] [Assigned] (SPARK-15171) Deprecate registerTempTable and add dataset.createTempView

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15171: Assignee: (was: Apache Spark) > Deprecate registerTempTable and add

[jira] [Commented] (SPARK-8428) TimSort Comparison method violates its general contract with CLUSTER BY

2016-05-05 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273534#comment-15273534 ] Yi Zhou commented on SPARK-8428: We found the similar issue with Spark 1.6.1 in our larger data size

[jira] [Commented] (SPARK-15032) When we create a new JDBC session, we may need to create a new session of executionHive

2016-05-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273529#comment-15273529 ] Yin Huai commented on SPARK-15032: -- Can you explain more about "I think the problem is that it

[jira] [Created] (SPARK-15171) Deprecate registerTempTable and add dataset.createTempView

2016-05-05 Thread Sean Zhong (JIRA)
Sean Zhong created SPARK-15171: -- Summary: Deprecate registerTempTable and add dataset.createTempView Key: SPARK-15171 URL: https://issues.apache.org/jira/browse/SPARK-15171 Project: Spark Issue

[jira] [Commented] (SPARK-14809) R Examples: Check for new R APIs requiring example code in 2.0

2016-05-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273492#comment-15273492 ] Yanbo Liang commented on SPARK-14809: - I'm glad to help this. > R Examples: Check for new R APIs

[jira] [Resolved] (SPARK-11395) Support over and window specification in SparkR

2016-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11395. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-10043) Add window functions into SparkR

2016-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273475#comment-15273475 ] Shivaram Venkataraman commented on SPARK-10043: --- [~sunrui] Can we resolve this issue now ?

[jira] [Created] (SPARK-15170) Log error message in ExecutorAllocationManager

2016-05-05 Thread meiyoula (JIRA)
meiyoula created SPARK-15170: Summary: Log error message in ExecutorAllocationManager Key: SPARK-15170 URL: https://issues.apache.org/jira/browse/SPARK-15170 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15074) Spark shuffle service bottlenecked while fetching large amount of intermediate data

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273416#comment-15273416 ] Apache Spark commented on SPARK-15074: -- User 'sitalkedia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15074) Spark shuffle service bottlenecked while fetching large amount of intermediate data

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15074: Assignee: Apache Spark > Spark shuffle service bottlenecked while fetching large amount

[jira] [Assigned] (SPARK-15074) Spark shuffle service bottlenecked while fetching large amount of intermediate data

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15074: Assignee: (was: Apache Spark) > Spark shuffle service bottlenecked while fetching

[jira] [Commented] (SPARK-14963) YarnShuffleService should use YARN getRecoveryPath() for leveldb location

2016-05-05 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273412#comment-15273412 ] Saisai Shao commented on SPARK-14963: - OK, I will do it. > YarnShuffleService should use YARN

[jira] [Commented] (SPARK-15159) Remove usage of HiveContext in SparkR.

2016-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273396#comment-15273396 ] Shivaram Venkataraman commented on SPARK-15159: --- Is it being removed or is it being

[jira] [Commented] (SPARK-15168) Add missing params to Python's MultilayerPerceptronClassifier

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273391#comment-15273391 ] Apache Spark commented on SPARK-15168: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15168) Add missing params to Python's MultilayerPerceptronClassifier

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15168: Assignee: (was: Apache Spark) > Add missing params to Python's

[jira] [Assigned] (SPARK-15168) Add missing params to Python's MultilayerPerceptronClassifier

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15168: Assignee: Apache Spark > Add missing params to Python's MultilayerPerceptronClassifier >

[jira] [Commented] (SPARK-15159) Remove usage of HiveContext in SparkR.

2016-05-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273379#comment-15273379 ] Felix Cheung commented on SPARK-15159: -- With the updated goal, this seems to be a fairly big change,

[jira] [Created] (SPARK-15169) Consider improving HasSolver to allow generilization

2016-05-05 Thread holdenk (JIRA)
holdenk created SPARK-15169: --- Summary: Consider improving HasSolver to allow generilization Key: SPARK-15169 URL: https://issues.apache.org/jira/browse/SPARK-15169 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13566) Deadlock between MemoryStore and BlockManager

2016-05-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13566: -- Assignee: cen yuhai > Deadlock between MemoryStore and BlockManager >

[jira] [Updated] (SPARK-15168) Add missing params to Python's MultilayerPerceptronClassifier

2016-05-05 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-15168: Description: MultilayerPerceptronClassifier is missing step size, solver, and weights. Add these params.

[jira] [Created] (SPARK-15168) Add missing params to Python's MultilayerPerceptronClassifier

2016-05-05 Thread holdenk (JIRA)
holdenk created SPARK-15168: --- Summary: Add missing params to Python's MultilayerPerceptronClassifier Key: SPARK-15168 URL: https://issues.apache.org/jira/browse/SPARK-15168 Project: Spark Issue

[jira] [Updated] (SPARK-15159) Remove usage of HiveContext in SparkR.

2016-05-05 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui updated SPARK-15159: Description: HiveContext is to be deprecated in 2.0. Replace them with SparkSession.withHiveSupport in

[jira] [Updated] (SPARK-15159) Remove usage of HiveContext in SparkR.

2016-05-05 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui updated SPARK-15159: Summary: Remove usage of HiveContext in SparkR. (was: Remove usage of HiveContext in SparkR unit test

[jira] [Assigned] (SPARK-15167) Add public catalog implementation method to SparkSession

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15167: Assignee: Andrew Or (was: Apache Spark) > Add public catalog implementation method to

[jira] [Assigned] (SPARK-15167) Add public catalog implementation method to SparkSession

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15167: Assignee: Apache Spark (was: Andrew Or) > Add public catalog implementation method to

[jira] [Commented] (SPARK-15167) Add public catalog implementation method to SparkSession

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273368#comment-15273368 ] Apache Spark commented on SPARK-15167: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15166) Move hive-specific conf setting from SparkSession

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15166: Assignee: Andrew Or (was: Apache Spark) > Move hive-specific conf setting from

[jira] [Commented] (SPARK-15166) Move hive-specific conf setting from SparkSession

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273354#comment-15273354 ] Apache Spark commented on SPARK-15166: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15166) Move hive-specific conf setting from SparkSession

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15166: Assignee: Apache Spark (was: Andrew Or) > Move hive-specific conf setting from

[jira] [Updated] (SPARK-15165) Codegen can break because toCommentSafeString is not actually safe

2016-05-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15165: - Priority: Critical (was: Major) > Codegen can break because toCommentSafeString is not actually safe >

[jira] [Updated] (SPARK-15165) Codegen can break because toCommentSafeString is not actually safe

2016-05-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15165: - Target Version/s: 2.0.0 > Codegen can break because toCommentSafeString is not actually safe >

[jira] [Resolved] (SPARK-15152) Scaladoc and Code style Improvements

2016-05-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15152. --- Resolution: Fixed Assignee: Jacek Laskowski Fix Version/s: 2.0.0 Target

[jira] [Created] (SPARK-15167) Add public catalog implementation method to SparkSession

2016-05-05 Thread Andrew Or (JIRA)
Andrew Or created SPARK-15167: - Summary: Add public catalog implementation method to SparkSession Key: SPARK-15167 URL: https://issues.apache.org/jira/browse/SPARK-15167 Project: Spark Issue

[jira] [Updated] (SPARK-15166) Move hive-specific conf setting from SparkSession

2016-05-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15166: -- Summary: Move hive-specific conf setting from SparkSession (was: Move hive-specific conf setting to

[jira] [Created] (SPARK-15166) Move hive-specific conf setting to HiveSharedState

2016-05-05 Thread Andrew Or (JIRA)
Andrew Or created SPARK-15166: - Summary: Move hive-specific conf setting to HiveSharedState Key: SPARK-15166 URL: https://issues.apache.org/jira/browse/SPARK-15166 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15165) Codegen can break because toCommentSafeString is not actually safe

2016-05-05 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-15165: --- Description: toCommentSafeString method replaces "\u" with "\ \u" to avoid codegen breaking.

[jira] [Updated] (SPARK-15165) Codegen can break because toCommentSafeString is not actually safe

2016-05-05 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-15165: --- Description: toCommentSafeString method replaces "\u" with "u" to avoid codegen

[jira] [Updated] (SPARK-15165) Codegen can break because toCommentSafeString is not actually safe

2016-05-05 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-15165: --- Description: toCommentSafeString method replaces "\u" with "\\u" to avoid codegen breaking.

[jira] [Updated] (SPARK-15165) Codegen can break because toCommentSafeString is not actually safe

2016-05-05 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-15165: --- Description: toCommentSafeString method replaces "\u" with "\\\u" to avoid codegen breaking.

[jira] [Comment Edited] (SPARK-15074) Spark shuffle service bottlenecked while fetching large amount of intermediate data

2016-05-05 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273241#comment-15273241 ] Sital Kedia edited comment on SPARK-15074 at 5/5/16 10:32 PM: -- Okay, I made

[jira] [Commented] (SPARK-15074) Spark shuffle service bottlenecked while fetching large amount of intermediate data

2016-05-05 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273241#comment-15273241 ] Sital Kedia commented on SPARK-15074: - Okay, I made a change to cache the index file and that made

[jira] [Assigned] (SPARK-15165) Codegen can break because toCommentSafeString is not actually safe

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15165: Assignee: Apache Spark > Codegen can break because toCommentSafeString is not actually

[jira] [Commented] (SPARK-15165) Codegen can break because toCommentSafeString is not actually safe

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273238#comment-15273238 ] Apache Spark commented on SPARK-15165: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15165) Codegen can break because toCommentSafeString is not actually safe

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15165: Assignee: (was: Apache Spark) > Codegen can break because toCommentSafeString is not

[jira] [Created] (SPARK-15165) Codegen can break because toCommentSafeString is not actually safe

2016-05-05 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-15165: -- Summary: Codegen can break because toCommentSafeString is not actually safe Key: SPARK-15165 URL: https://issues.apache.org/jira/browse/SPARK-15165 Project:

[jira] [Closed] (SPARK-14977) Fine grained mode in Mesos is not fair

2016-05-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt closed SPARK-14977. --- Resolution: Not A Problem > Fine grained mode in Mesos is not fair >

[jira] [Commented] (SPARK-14977) Fine grained mode in Mesos is not fair

2016-05-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273202#comment-15273202 ] Michael Gummelt commented on SPARK-14977: - [~lethalman]: Fine-grained mode only release cores,

[jira] [Assigned] (SPARK-15162) Update PySpark LogisticRegression threshold PyDoc to be as complete as Scaladoc

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15162: Assignee: Apache Spark > Update PySpark LogisticRegression threshold PyDoc to be as

[jira] [Commented] (SPARK-15162) Update PySpark LogisticRegression threshold PyDoc to be as complete as Scaladoc

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273180#comment-15273180 ] Apache Spark commented on SPARK-15162: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-15164) Mark classification algorithms as experimental where marked so in scala

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273181#comment-15273181 ] Apache Spark commented on SPARK-15164: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15164) Mark classification algorithms as experimental where marked so in scala

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15164: Assignee: Apache Spark > Mark classification algorithms as experimental where marked so

[jira] [Assigned] (SPARK-15162) Update PySpark LogisticRegression threshold PyDoc to be as complete as Scaladoc

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15162: Assignee: (was: Apache Spark) > Update PySpark LogisticRegression threshold PyDoc to

[jira] [Assigned] (SPARK-15164) Mark classification algorithms as experimental where marked so in scala

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15164: Assignee: (was: Apache Spark) > Mark classification algorithms as experimental where

[jira] [Resolved] (SPARK-14893) Re-enable HiveSparkSubmitSuite SPARK-8489 test after HiveContext is removed

2016-05-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14893. --- Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.0.0 > Re-enable

[jira] [Assigned] (SPARK-14812) ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit

2016-05-05 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-14812: --- Assignee: DB Tsai > ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit >

[jira] [Updated] (SPARK-15158) Too aggressive logging in SizeBasedRollingPolicy?

2016-05-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15158: -- Assignee: Kai Wang > Too aggressive logging in SizeBasedRollingPolicy? >

[jira] [Resolved] (SPARK-9926) Parallelize file listing for partitioned Hive table

2016-05-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9926. -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Parallelize file

[jira] [Resolved] (SPARK-15158) Too aggressive logging in SizeBasedRollingPolicy?

2016-05-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15158. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Too aggressive

[jira] [Resolved] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

2016-05-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15134. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15135) Make sure SparkSession thread safe

2016-05-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15135. --- Resolution: Fixed Fix Version/s: 2.0.0 > Make sure SparkSession thread safe >

[jira] [Resolved] (SPARK-15072) Remove SparkSession.withHiveSupport

2016-05-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15072. --- Resolution: Fixed > Remove SparkSession.withHiveSupport > --- > >

[jira] [Commented] (SPARK-10653) Remove unnecessary things from SparkEnv

2016-05-05 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273117#comment-15273117 ] Alex Bozarth commented on SPARK-10653: -- I'm currently running tests on a fix for this and will open

[jira] [Commented] (SPARK-15140) ensure input object of encoder is not null

2016-05-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273100#comment-15273100 ] Michael Armbrust commented on SPARK-15140: -- The 2.0 behavior seems correct. Ideally

[jira] [Updated] (SPARK-14959) ​Problem Reading partitioned ORC or Parquet files

2016-05-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14959: - Priority: Critical (was: Major) > ​Problem Reading partitioned ORC or Parquet files >

[jira] [Updated] (SPARK-14959) ​Problem Reading partitioned ORC or Parquet files

2016-05-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14959: - Target Version/s: 2.0.0 Component/s: (was: Input/Output)

[jira] [Updated] (SPARK-10653) Remove unnecessary things from SparkEnv

2016-05-05 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Bozarth updated SPARK-10653: - Summary: Remove unnecessary things from SparkEnv (was: head) > Remove unnecessary things from

[jira] [Updated] (SPARK-10653) head

2016-05-05 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Bozarth updated SPARK-10653: - Summary: head (was: Remove unnecessary things from SparkEnv) > head > > >

[jira] [Updated] (SPARK-14813) ML 2.0 QA: API: Python API coverage

2016-05-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14813: -- Assignee: holdenk (was: Yanbo Liang) > ML 2.0 QA: API: Python API coverage >

[jira] [Comment Edited] (SPARK-15159) Remove usage of HiveContext in SparkR unit test cases.

2016-05-05 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272666#comment-15272666 ] Vijay Parmar edited comment on SPARK-15159 at 5/5/16 8:31 PM: -- Hi Sun, I am

[jira] [Comment Edited] (SPARK-15159) Remove usage of HiveContext in SparkR unit test cases.

2016-05-05 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272666#comment-15272666 ] Vijay Parmar edited comment on SPARK-15159 at 5/5/16 8:31 PM: -- Hi Sun, I am

[jira] [Updated] (SPARK-15163) Mark experimental algorithms experimental in PySpark

2016-05-05 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-15163: Component/s: PySpark > Mark experimental algorithms experimental in PySpark >

[jira] [Created] (SPARK-15164) Mark classification algorithms as experimental where marked so in scala

2016-05-05 Thread holdenk (JIRA)
holdenk created SPARK-15164: --- Summary: Mark classification algorithms as experimental where marked so in scala Key: SPARK-15164 URL: https://issues.apache.org/jira/browse/SPARK-15164 Project: Spark

[jira] [Created] (SPARK-15163) Mark experimental algorithms experimental in PySpark

2016-05-05 Thread holdenk (JIRA)
holdenk created SPARK-15163: --- Summary: Mark experimental algorithms experimental in PySpark Key: SPARK-15163 URL: https://issues.apache.org/jira/browse/SPARK-15163 Project: Spark Issue Type:

[jira] [Created] (SPARK-15162) Update PySpark LogisticRegression threshold PyDoc to be as complete as Scaladoc

2016-05-05 Thread holdenk (JIRA)
holdenk created SPARK-15162: --- Summary: Update PySpark LogisticRegression threshold PyDoc to be as complete as Scaladoc Key: SPARK-15162 URL: https://issues.apache.org/jira/browse/SPARK-15162 Project: Spark

[jira] [Commented] (SPARK-15092) toDebugString missing from ML DecisionTreeClassifier

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272956#comment-15272956 ] Apache Spark commented on SPARK-15092: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15080) Break copyAndReset into copy and reset

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15080: Assignee: Apache Spark > Break copyAndReset into copy and reset >

[jira] [Commented] (SPARK-15080) Break copyAndReset into copy and reset

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272945#comment-15272945 ] Apache Spark commented on SPARK-15080: -- User 'techaddict' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15080) Break copyAndReset into copy and reset

2016-05-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15080: Assignee: (was: Apache Spark) > Break copyAndReset into copy and reset >

[jira] [Updated] (SPARK-14915) Tasks that fail due to CommitDeniedException (a side-effect of speculation) can cause job to never complete

2016-05-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14915: -- Fix Version/s: 1.6.2 > Tasks that fail due to CommitDeniedException (a side-effect of speculation) >

[jira] [Commented] (SPARK-15138) Linkify ML PyDoc regression

2016-05-05 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272884#comment-15272884 ] holdenk commented on SPARK-15138: - cc [~yanboliang] > Linkify ML PyDoc regression >

[jira] [Commented] (SPARK-14854) Left outer join produces incorrect output when the join condition does not have left table key

2016-05-05 Thread kanika dhuria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272865#comment-15272865 ] kanika dhuria commented on SPARK-14854: --- Why do you think they are same issue? I was expecting all

[jira] [Resolved] (SPARK-15110) SparkR - Implement repartitionByColumn on DataFrame

2016-05-05 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-15110. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12887

[jira] [Updated] (SPARK-14811) ML, Graph 2.0 QA: API: New Scala APIs, docs

2016-05-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14811: -- Assignee: Yanbo Liang > ML, Graph 2.0 QA: API: New Scala APIs, docs >

[jira] [Updated] (SPARK-14813) ML 2.0 QA: API: Python API coverage

2016-05-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14813: -- Assignee: Yanbo Liang > ML 2.0 QA: API: Python API coverage >

[jira] [Created] (SPARK-15161) Consider moving featureImportances into TreeEnsemble models base class

2016-05-05 Thread holdenk (JIRA)
holdenk created SPARK-15161: --- Summary: Consider moving featureImportances into TreeEnsemble models base class Key: SPARK-15161 URL: https://issues.apache.org/jira/browse/SPARK-15161 Project: Spark

  1   2   3   >