[jira] [Commented] (SPARK-14687) Call path.getFileSystem(conf) instead of call FileSystem.get(conf)

[ https://issues.apache.org/jira/browse/SPARK-14687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244560#comment-15244560 ] Reynold Xin commented on SPARK-14687: - Can you explain the problems? > Call path.ge

[jira] [Commented] (SPARK-14687) Call path.getFileSystem(conf) instead of call FileSystem.get(conf)

[ https://issues.apache.org/jira/browse/SPARK-14687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244557#comment-15244557 ] Apache Spark commented on SPARK-14687: -- User 'lw-lin' has created a pull request for

[jira] [Assigned] (SPARK-14687) Call path.getFileSystem(conf) instead of call FileSystem.get(conf)

[ https://issues.apache.org/jira/browse/SPARK-14687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14687: Assignee: Apache Spark > Call path.getFileSystem(conf) instead of call FileSystem.get(conf

[jira] [Assigned] (SPARK-14687) Call path.getFileSystem(conf) instead of call FileSystem.get(conf)

[ https://issues.apache.org/jira/browse/SPARK-14687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14687: Assignee: (was: Apache Spark) > Call path.getFileSystem(conf) instead of call FileSyst

[jira] [Created] (SPARK-14687) Call path.getFileSystem(conf) instead of call FileSystem.get(conf)

Liwei Lin created SPARK-14687: - Summary: Call path.getFileSystem(conf) instead of call FileSystem.get(conf) Key: SPARK-14687 URL: https://issues.apache.org/jira/browse/SPARK-14687 Project: Spark

[jira] [Comment Edited] (SPARK-14682) Provide evaluateEachIteration method or equivalent for spark.ml GBTs

[ https://issues.apache.org/jira/browse/SPARK-14682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244555#comment-15244555 ] zhengruifeng edited comment on SPARK-14682 at 4/17/16 6:30 AM:

[jira] [Commented] (SPARK-14682) Provide evaluateEachIteration method or equivalent for spark.ml GBTs

[ https://issues.apache.org/jira/browse/SPARK-14682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244555#comment-15244555 ] zhengruifeng commented on SPARK-14682: -- [~josephkb] It is ml.tree.impl.GradientBoost

[jira] [Commented] (SPARK-14648) Spark EC2 script creates cluster but spark is not installed properly.

[ https://issues.apache.org/jira/browse/SPARK-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244480#comment-15244480 ] Josh Rosen commented on SPARK-14648: I think that this should have been fixed by now.

[jira] [Resolved] (SPARK-14648) Spark EC2 script creates cluster but spark is not installed properly.

[ https://issues.apache.org/jira/browse/SPARK-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14648. Resolution: Fixed > Spark EC2 script creates cluster but spark is not installed properly. > ---

[jira] [Commented] (SPARK-14686) Implement a non-inheritable localProperty facility

[ https://issues.apache.org/jira/browse/SPARK-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244479#comment-15244479 ] Marcin Tustin commented on SPARK-14686: --- [~joshrosen] I did suggest that in the ema

[jira] [Commented] (SPARK-14686) Implement a non-inheritable localProperty facility

[ https://issues.apache.org/jira/browse/SPARK-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244478#comment-15244478 ] Josh Rosen commented on SPARK-14686: The idea of making these properties non-inherita

[jira] [Created] (SPARK-14686) Implement a non-inheritable localProperty facility

Marcin Tustin created SPARK-14686: - Summary: Implement a non-inheritable localProperty facility Key: SPARK-14686 URL: https://issues.apache.org/jira/browse/SPARK-14686 Project: Spark Issue Ty

[jira] [Commented] (SPARK-14674) Move HiveContext.hiveconf to HiveSessionState

[ https://issues.apache.org/jira/browse/SPARK-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244462#comment-15244462 ] Apache Spark commented on SPARK-14674: -- User 'yhuai' has created a pull request for

[jira] [Created] (SPARK-14685) Properly document heritability of localProperties

Marcin Tustin created SPARK-14685: - Summary: Properly document heritability of localProperties Key: SPARK-14685 URL: https://issues.apache.org/jira/browse/SPARK-14685 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-14672) Move HiveContext analyze logic to AnalyzeTable

[ https://issues.apache.org/jira/browse/SPARK-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14672. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12448 [https://github.com/

[jira] [Commented] (SPARK-14672) Move HiveContext analyze logic to AnalyzeTable

[ https://issues.apache.org/jira/browse/SPARK-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244407#comment-15244407 ] Apache Spark commented on SPARK-14672: -- User 'yhuai' has created a pull request for

[jira] [Resolved] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14647. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12447 [https://github.com/

[jira] [Commented] (SPARK-14647) Group SQLContext/HiveContext state into PersistentState

[ https://issues.apache.org/jira/browse/SPARK-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244350#comment-15244350 ] Apache Spark commented on SPARK-14647: -- User 'yhuai' has created a pull request for

[jira] [Resolved] (SPARK-14683) Configure external links in ScalaDoc

[ https://issues.apache.org/jira/browse/SPARK-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14683. - Resolution: Fixed Assignee: Yang Bo Fix Version/s: 2.0.0 > Configure external lin

[jira] [Resolved] (SPARK-14605) Python spark.ml classes should use unicode uid

[ https://issues.apache.org/jira/browse/SPARK-14605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14605. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12368 [h

[jira] [Assigned] (SPARK-14684) Verification of partition specs in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14684: Assignee: (was: Apache Spark) > Verification of partition specs in SessionCatalog > --

[jira] [Commented] (SPARK-14684) Verification of partition specs in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244295#comment-15244295 ] Apache Spark commented on SPARK-14684: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-14684) Verification of partition specs in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14684: Assignee: Apache Spark > Verification of partition specs in SessionCatalog > -

[jira] [Created] (SPARK-14684) Verification of partition specs in SessionCatalog

Xiao Li created SPARK-14684: --- Summary: Verification of partition specs in SessionCatalog Key: SPARK-14684 URL: https://issues.apache.org/jira/browse/SPARK-14684 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14683) Configure external links in ScalaDoc

[ https://issues.apache.org/jira/browse/SPARK-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244234#comment-15244234 ] Yang Bo commented on SPARK-14683: - I created a pull request for this issue: https://gith

[jira] [Issue Comment Deleted] (SPARK-14683) Configure external links in ScalaDoc

[ https://issues.apache.org/jira/browse/SPARK-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Bo updated SPARK-14683: Comment: was deleted (was: I created a pull request for this issue: https://github.com/apache/spark/pull/1

[jira] [Assigned] (SPARK-14683) Configure external links in ScalaDoc

[ https://issues.apache.org/jira/browse/SPARK-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14683: Assignee: Apache Spark > Configure external links in ScalaDoc > --

[jira] [Commented] (SPARK-14683) Configure external links in ScalaDoc

[ https://issues.apache.org/jira/browse/SPARK-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244233#comment-15244233 ] Apache Spark commented on SPARK-14683: -- User 'Atry' has created a pull request for t

[jira] [Assigned] (SPARK-14683) Configure external links in ScalaDoc

[ https://issues.apache.org/jira/browse/SPARK-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14683: Assignee: (was: Apache Spark) > Configure external links in ScalaDoc > ---

[jira] [Updated] (SPARK-14683) Configure external links in ScalaDoc

[ https://issues.apache.org/jira/browse/SPARK-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Bo updated SPARK-14683: Description: Right now [Spark's Scaladoc|https://spark.apache.org/docs/latest/api/scala/] does not link to

[jira] [Created] (SPARK-14683) Configure external links in ScalaDoc

Yang Bo created SPARK-14683: --- Summary: Configure external links in ScalaDoc Key: SPARK-14683 URL: https://issues.apache.org/jira/browse/SPARK-14683 Project: Spark Issue Type: Bug Componen

[jira] [Updated] (SPARK-14655) Add `assert_true` function

[ https://issues.apache.org/jira/browse/SPARK-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14655: -- Description: This issue aims to implement `assert_true` function. It's [Hive Generic UDF Funct

[jira] [Comment Edited] (SPARK-14623) add label binarizer

[ https://issues.apache.org/jira/browse/SPARK-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244061#comment-15244061 ] hujiayin edited comment on SPARK-14623 at 4/16/16 8:24 AM: --- Hi

[jira] [Commented] (SPARK-13944) Separate out local linear algebra as a standalone module without Spark dependency

[ https://issues.apache.org/jira/browse/SPARK-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244088#comment-15244088 ] Sean Owen commented on SPARK-13944: --- Here you're referring to *MLlib's local linear alg

[jira] [Commented] (SPARK-14677) Make the max number of iterations configurable for Catalyst

[ https://issues.apache.org/jira/browse/SPARK-14677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244083#comment-15244083 ] Apache Spark commented on SPARK-14677: -- User 'rxin' has created a pull request for t

[jira] [Resolved] (SPARK-14376) Review spark.ml parity for trees

[ https://issues.apache.org/jira/browse/SPARK-14376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14376. --- Resolution: Done Fix Version/s: 2.0.0 Marking complete since I believe I have

[jira] [Created] (SPARK-14682) Provide evaluateEachIteration method or equivalent for spark.ml GBTs

Joseph K. Bradley created SPARK-14682: - Summary: Provide evaluateEachIteration method or equivalent for spark.ml GBTs Key: SPARK-14682 URL: https://issues.apache.org/jira/browse/SPARK-14682 Projec

[jira] [Comment Edited] (SPARK-14376) Review spark.ml parity for trees

[ https://issues.apache.org/jira/browse/SPARK-14376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225044#comment-15225044 ] Joseph K. Bradley edited comment on SPARK-14376 at 4/16/16 8:05 AM: ---

[jira] [Created] (SPARK-14681) Provide label/impurity stats for spark.ml decision tree nodes

Joseph K. Bradley created SPARK-14681: - Summary: Provide label/impurity stats for spark.ml decision tree nodes Key: SPARK-14681 URL: https://issues.apache.org/jira/browse/SPARK-14681 Project: Spar

[jira] [Comment Edited] (SPARK-14376) Review spark.ml parity for trees

[ https://issues.apache.org/jira/browse/SPARK-14376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225044#comment-15225044 ] Joseph K. Bradley edited comment on SPARK-14376 at 4/16/16 8:01 AM: ---

[jira] [Assigned] (SPARK-14680) Support all datatypes to use VectorizedHashmap in TungstenAggregate

[ https://issues.apache.org/jira/browse/SPARK-14680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14680: Assignee: Apache Spark > Support all datatypes to use VectorizedHashmap in TungstenAggrega

[jira] [Assigned] (SPARK-14680) Support all datatypes to use VectorizedHashmap in TungstenAggregate

[ https://issues.apache.org/jira/browse/SPARK-14680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14680: Assignee: (was: Apache Spark) > Support all datatypes to use VectorizedHashmap in Tung

[jira] [Commented] (SPARK-14680) Support all datatypes to use VectorizedHashmap in TungstenAggregate

[ https://issues.apache.org/jira/browse/SPARK-14680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244070#comment-15244070 ] Apache Spark commented on SPARK-14680: -- User 'sameeragarwal' has created a pull requ

[jira] [Created] (SPARK-14680) Support all datatypes to use VectorizedHashmap in TungstenAggregate

Sameer Agarwal created SPARK-14680: -- Summary: Support all datatypes to use VectorizedHashmap in TungstenAggregate Key: SPARK-14680 URL: https://issues.apache.org/jira/browse/SPARK-14680 Project: Spar

[jira] [Resolved] (SPARK-13363) Aggregator not working with DataFrame

[ https://issues.apache.org/jira/browse/SPARK-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13363. - Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.0.0 > Aggregator not wor

[jira] [Commented] (SPARK-14623) add label binarizer

[ https://issues.apache.org/jira/browse/SPARK-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244061#comment-15244061 ] hujiayin commented on SPARK-14623: -- Hi Joseph, I think it is similar as the combination

[jira] [Commented] (SPARK-14377) Review spark.ml parity for classification, except trees

[ https://issues.apache.org/jira/browse/SPARK-14377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244059#comment-15244059 ] Joseph K. Bradley commented on SPARK-14377: --- * ClassificationModel ** single-r