[jira] [Resolved] (SPARK-20092) Trigger AppVeyor R tests for changes in Scala code related with R API

2017-03-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20092. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.2.0 Targe

[jira] [Commented] (SPARK-15665) spark-submit --kill and --status are not working

2017-03-25 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15942141#comment-15942141 ] Devaraj K commented on SPARK-15665: --- [~samuel-soubeyran], This issue has been resolved,

[jira] [Updated] (SPARK-20043) Decision Tree loader does not handle uppercase impurity param values

2017-03-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20043: -- Affects Version/s: 2.2.0 > Decision Tree loader does not handle uppercase impurity para

[jira] [Updated] (SPARK-20043) Decision Tree loader does not handle uppercase impurity param values

2017-03-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20043: -- Target Version/s: 2.1.1, 2.2.0 > Decision Tree loader does not handle uppercase impurit

[jira] [Updated] (SPARK-20043) Decision Tree loader does not handle uppercase impurity param values

2017-03-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20043: -- Shepherd: Joseph K. Bradley > Decision Tree loader does not handle uppercase impurity p

[jira] [Updated] (SPARK-20043) Decision Tree loader does not handle uppercase impurity param values

2017-03-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20043: -- Summary: Decision Tree loader does not handle uppercase impurity param values (was: De

[jira] [Updated] (SPARK-20043) Decision Tree loader does not recognize impurity "Gini" and "Entropy" on ML random forest and decision. Only "gini" and "entropy" (in lower case) are accepted

2017-03-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20043: -- Summary: Decision Tree loader does not recognize impurity "Gini" and "Entropy" on ML ra

[jira] [Commented] (SPARK-20099) Add transformSchema to pyspark.ml

2017-03-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15942082#comment-15942082 ] Joseph K. Bradley commented on SPARK-20099: --- Linking [SPARK-15574] since it bro

[jira] [Created] (SPARK-20099) Add transformSchema to pyspark.ml

2017-03-25 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-20099: - Summary: Add transformSchema to pyspark.ml Key: SPARK-20099 URL: https://issues.apache.org/jira/browse/SPARK-20099 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-15665) spark-submit --kill and --status are not working

2017-03-25 Thread Samuel Soubeyran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941869#comment-15941869 ] Samuel Soubeyran commented on SPARK-15665: -- When trying to do the same thing usi

[jira] [Commented] (SPARK-17670) Spark DataFrame/Dataset no longer supports Option[Map] in case classes

2017-03-25 Thread SaschaC (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941820#comment-15941820 ] SaschaC commented on SPARK-17670: - I can confirm that this bug is for real and it is a m

[jira] [Resolved] (SPARK-17137) Add compressed support for multinomial logistic regression coefficients

2017-03-25 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-17137. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17426 [https://github.com/ap

[jira] [Updated] (SPARK-20060) Support Standalone visiting secured HDFS

2017-03-25 Thread Kent Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-20060: - Description: h1. Brief design h2. Introductions The basic issue for Standalone mode to visit kerberos se

[jira] [Created] (SPARK-20098) DataType's typeName method returns with 'StructF' in case of StructField

2017-03-25 Thread Peter Szalai (JIRA)
Peter Szalai created SPARK-20098: Summary: DataType's typeName method returns with 'StructF' in case of StructField Key: SPARK-20098 URL: https://issues.apache.org/jira/browse/SPARK-20098 Project: Spa

[jira] [Updated] (SPARK-19674) Ignore driver accumulator updates don't belong to the execution when merging all accumulator updates

2017-03-25 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-19674: Fix Version/s: 2.1.1 > Ignore driver accumulator updates don't belong to the execution when merging

[jira] [Commented] (SPARK-20096) Expose the real queue name not null while using --verbose

2017-03-25 Thread Kent Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941712#comment-15941712 ] Kent Yao commented on SPARK-20096: -- [~sowen] example added > Expose the real queue name

[jira] [Updated] (SPARK-20096) Expose the real queue name not null while using --verbose

2017-03-25 Thread Kent Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-20096: - Description: while submit apps with -v or --verboseļ¼Œ we can print the right queue name, but if we set a

[jira] [Assigned] (SPARK-20097) Fix visibility discrepancy with numInstances and degreesOfFreedom in LR and GLR

2017-03-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20097: Assignee: Apache Spark > Fix visibility discrepancy with numInstances and degreesOfFreedom

[jira] [Assigned] (SPARK-20097) Fix visibility discrepancy with numInstances and degreesOfFreedom in LR and GLR

2017-03-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20097: Assignee: (was: Apache Spark) > Fix visibility discrepancy with numInstances and degre

[jira] [Commented] (SPARK-20097) Fix visibility discrepancy with numInstances and degreesOfFreedom in LR and GLR

2017-03-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941705#comment-15941705 ] Apache Spark commented on SPARK-20097: -- User 'BenFradet' has created a pull request

[jira] [Created] (SPARK-20097) Fix visibility discrepancy with numInstances and degreesOfFreedom in LR and GLR

2017-03-25 Thread Benjamin Fradet (JIRA)
Benjamin Fradet created SPARK-20097: --- Summary: Fix visibility discrepancy with numInstances and degreesOfFreedom in LR and GLR Key: SPARK-20097 URL: https://issues.apache.org/jira/browse/SPARK-20097

[jira] [Assigned] (SPARK-20096) Expose the real queue name not null while using --verbose

2017-03-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20096: Assignee: Apache Spark > Expose the real queue name not null while using --verbose > -

[jira] [Commented] (SPARK-20096) Expose the real queue name not null while using --verbose

2017-03-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941701#comment-15941701 ] Apache Spark commented on SPARK-20096: -- User 'yaooqinn' has created a pull request f

[jira] [Assigned] (SPARK-20096) Expose the real queue name not null while using --verbose

2017-03-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20096: Assignee: (was: Apache Spark) > Expose the real queue name not null while using --verb

[jira] [Commented] (SPARK-20096) Expose the real queue name not null while using --verbose

2017-03-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941699#comment-15941699 ] Sean Owen commented on SPARK-20096: --- got null where? This needs more detail. > Expose

[jira] [Updated] (SPARK-20096) Expose the real queue name not null while using --verbose

2017-03-25 Thread Kent Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-20096: - Summary: Expose the real queue name not null while using --verbose (was: Expose the real queue name not

[jira] [Created] (SPARK-20096) Expose the real queue name not null using --verbose

2017-03-25 Thread Kent Yao (JIRA)
Kent Yao created SPARK-20096: Summary: Expose the real queue name not null using --verbose Key: SPARK-20096 URL: https://issues.apache.org/jira/browse/SPARK-20096 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-20078) Mesos executor configurability for task name and labels

2017-03-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20078: - Assignee: Kalvin Chau > Mesos executor configurability for task name and labels > --

[jira] [Resolved] (SPARK-20078) Mesos executor configurability for task name and labels

2017-03-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20078. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17404 [https://github.co

[jira] [Created] (SPARK-20095) A code bug in CodegenContext.withSubExprEliminationExprs

2017-03-25 Thread song fengfei (JIRA)
song fengfei created SPARK-20095: Summary: A code bug in CodegenContext.withSubExprEliminationExprs Key: SPARK-20095 URL: https://issues.apache.org/jira/browse/SPARK-20095 Project: Spark Issu

[jira] [Resolved] (SPARK-19999) Test failures in Spark Core due to java.nio.Bits.unaligned()

2017-03-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1. --- Resolution: Won't Fix I'm open to reopening this to special-case PPC if anyone cares enough to open a

[jira] [Updated] (SPARK-20094) Putting predicate with IN subquery into join condition in ReorderJoin fails RewritePredicateSubquery.rewriteExistentialExpr

2017-03-25 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-20094: - Summary: Putting predicate with IN subquery into join condition in ReorderJoin fails RewritePredi

[jira] [Updated] (SPARK-20094) Putting predicate with IN subquery into join condition in ReorderJoin fails RewritePredicateSubquery.rewriteExistentialExpr

2017-03-25 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-20094: - Description: ReorderJoin collects all predicates and try to put them into join condition when cr

[jira] [Assigned] (SPARK-20094) Putting predicate with subquery into join condition in ReorderJoin fails RewritePredicateSubquery.rewriteExistentialExpr

2017-03-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20094: Assignee: Apache Spark > Putting predicate with subquery into join condition in ReorderJoi

[jira] [Commented] (SPARK-20094) Putting predicate with subquery into join condition in ReorderJoin fails RewritePredicateSubquery.rewriteExistentialExpr

2017-03-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941625#comment-15941625 ] Apache Spark commented on SPARK-20094: -- User 'wzhfy' has created a pull request for

[jira] [Assigned] (SPARK-20094) Putting predicate with subquery into join condition in ReorderJoin fails RewritePredicateSubquery.rewriteExistentialExpr

2017-03-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20094: Assignee: (was: Apache Spark) > Putting predicate with subquery into join condition in

[jira] [Created] (SPARK-20094) Putting predicate with subquery into join condition in ReorderJoin fails RewritePredicateSubquery.rewriteExistentialExpr

2017-03-25 Thread Zhenhua Wang (JIRA)
Zhenhua Wang created SPARK-20094: Summary: Putting predicate with subquery into join condition in ReorderJoin fails RewritePredicateSubquery.rewriteExistentialExpr Key: SPARK-20094 URL: https://issues.apache.org/j

[jira] [Created] (SPARK-20093) Exception when Joining dataframe with another dataframe generated by applying groupBy transformation on original one

2017-03-25 Thread Hosur Narahari (JIRA)
Hosur Narahari created SPARK-20093: -- Summary: Exception when Joining dataframe with another dataframe generated by applying groupBy transformation on original one Key: SPARK-20093 URL: https://issues.apache.org/j