[jira] [Commented] (SPARK-7264) SparkR API for parallel functions

2015-07-29 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647268#comment-14647268 ] Rick Moritz commented on SPARK-7264: I've also added a bit of commentary. > SparkR AP

[jira] [Resolved] (SPARK-8005) Support INPUT__FILE__NAME virtual column

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8005. Resolution: Fixed Assignee: Joseph Batchik Fix Version/s: 1.5.0 > Support INPUT__FIL

[jira] [Resolved] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8007. Resolution: Won't Fix These are now just functions. > Support resolving virtual columns in DataFra

[jira] [Commented] (SPARK-9396) Spark yarn allocator does not call "removeContainerRequest" for allocated Container requests, resulting in bloated ask[] toYarn RM.

2015-07-29 Thread prakhar jauhari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647258#comment-14647258 ] prakhar jauhari commented on SPARK-9396: Can you please assign this issue to me, I

[jira] [Resolved] (SPARK-8002) Support virtual columns in SQL and DataFrames

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8002. Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 1.5.0 We ended up just creati

[jira] [Assigned] (SPARK-9464) Add property-based tests for UTF8String

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9464: --- Assignee: Apache Spark > Add property-based tests for UTF8String > --

[jira] [Updated] (SPARK-9464) Add property-based tests for UTF8String

2015-07-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9464: -- Assignee: (was: Josh Rosen) > Add property-based tests for UTF8String >

[jira] [Commented] (SPARK-9464) Add property-based tests for UTF8String

2015-07-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647252#comment-14647252 ] Josh Rosen commented on SPARK-9464: --- Unassigning this myself since I don't have time to

[jira] [Assigned] (SPARK-9464) Add property-based tests for UTF8String

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9464: --- Assignee: (was: Apache Spark) > Add property-based tests for UTF8String > ---

[jira] [Updated] (SPARK-9464) Add property-based tests for UTF8String

2015-07-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9464: -- Target Version/s: 1.5.0 Priority: Critical (was: Major) > Add property-based tests for UTF8

[jira] [Comment Edited] (SPARK-8786) Create a wrapper for BinaryType

2015-07-29 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647248#comment-14647248 ] Takeshi Yamamuro edited comment on SPARK-8786 at 7/30/15 6:28 AM: --

[jira] [Comment Edited] (SPARK-8786) Create a wrapper for BinaryType

2015-07-29 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647248#comment-14647248 ] Takeshi Yamamuro edited comment on SPARK-8786 at 7/30/15 6:26 AM: --

[jira] [Commented] (SPARK-8786) Create a wrapper for BinaryType

2015-07-29 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647248#comment-14647248 ] Takeshi Yamamuro commented on SPARK-8786: - Sorry to make you confused though, a ma

[jira] [Resolved] (SPARK-9428) Add test cases for null inputs for expression unit tests

2015-07-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9428. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7748 [https://github.com/

[jira] [Assigned] (SPARK-9231) DistributedLDAModel method for top topics per document

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9231: --- Assignee: Apache Spark > DistributedLDAModel method for top topics per document > ---

[jira] [Assigned] (SPARK-9231) DistributedLDAModel method for top topics per document

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9231: --- Assignee: (was: Apache Spark) > DistributedLDAModel method for top topics per document >

[jira] [Commented] (SPARK-9231) DistributedLDAModel method for top topics per document

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647233#comment-14647233 ] Apache Spark commented on SPARK-9231: - User 'hhbyyh' has created a pull request for th

[jira] [Commented] (SPARK-8998) Collect enough frequent prefixes before projection in PrefixSpan

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647225#comment-14647225 ] Apache Spark commented on SPARK-8998: - User 'feynmanliang' has created a pull request

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647224#comment-14647224 ] Joseph K. Bradley commented on SPARK-9461: -- The tests do often pass...which is th

[jira] [Commented] (SPARK-9401) Fully implement code generation for ConcatWs

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647222#comment-14647222 ] Apache Spark commented on SPARK-9401: - User 'tarekauel' has created a pull request for

[jira] [Assigned] (SPARK-9401) Fully implement code generation for ConcatWs

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9401: --- Assignee: (was: Apache Spark) > Fully implement code generation for ConcatWs > --

[jira] [Assigned] (SPARK-9401) Fully implement code generation for ConcatWs

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9401: --- Assignee: Apache Spark > Fully implement code generation for ConcatWs > -

[jira] [Commented] (SPARK-9231) DistributedLDAModel method for top topics per document

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647221#comment-14647221 ] Joseph K. Bradley commented on SPARK-9231: -- Sounds great---thank you! > Distribu

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-29 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647220#comment-14647220 ] Jeremy Freeman commented on SPARK-9461: --- I'd definitely be curious to see if these t

[jira] [Commented] (SPARK-3644) REST API for Spark application info (jobs / stages / tasks / storage info)

2015-07-29 Thread Xiaoyong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647219#comment-14647219 ] Xiaoyong Zhu commented on SPARK-3644: - Josh, could you help to provide the link to the

[jira] [Assigned] (SPARK-9469) TungstenSort should not do safe -> unsafe conversion itself

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9469: --- Assignee: Reynold Xin (was: Apache Spark) > TungstenSort should not do safe -> unsafe conver

[jira] [Commented] (SPARK-9469) TungstenSort should not do safe -> unsafe conversion itself

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647218#comment-14647218 ] Apache Spark commented on SPARK-9469: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9469) TungstenSort should not do safe -> unsafe conversion itself

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9469: --- Assignee: Apache Spark (was: Reynold Xin) > TungstenSort should not do safe -> unsafe conver

[jira] [Commented] (SPARK-9464) Add property-based tests for UTF8String

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647216#comment-14647216 ] Apache Spark commented on SPARK-9464: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-9464) Add property-based tests for UTF8String

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9464: --- Assignee: Josh Rosen (was: Apache Spark) > Add property-based tests for UTF8String > ---

[jira] [Assigned] (SPARK-9464) Add property-based tests for UTF8String

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9464: --- Assignee: Apache Spark (was: Josh Rosen) > Add property-based tests for UTF8String > ---

[jira] [Created] (SPARK-9469) TungstenSort should not do safe -> unsafe conversion itself

2015-07-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9469: -- Summary: TungstenSort should not do safe -> unsafe conversion itself Key: SPARK-9469 URL: https://issues.apache.org/jira/browse/SPARK-9469 Project: Spark Issue

[jira] [Created] (SPARK-9468) Avoid scheduling tasks on preemption executors

2015-07-29 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-9468: -- Summary: Avoid scheduling tasks on preemption executors Key: SPARK-9468 URL: https://issues.apache.org/jira/browse/SPARK-9468 Project: Spark Issue Type: Improvem

[jira] [Resolved] (SPARK-9116) python UDT in __main__ cannot be serialized by PySpark

2015-07-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9116. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7453 [https://github.com/

[jira] [Commented] (SPARK-8998) Collect enough frequent prefixes before projection in PrefixSpan

2015-07-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647208#comment-14647208 ] Feynman Liang commented on SPARK-8998: -- Discussed over e-mail. Summary: * This PR is

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647201#comment-14647201 ] Joseph K. Bradley commented on SPARK-9461: -- I'm trying to check to see just how f

[jira] [Commented] (SPARK-9400) Implement code generation for StringLocate

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647189#comment-14647189 ] Apache Spark commented on SPARK-9400: - User 'tarekauel' has created a pull request for

[jira] [Assigned] (SPARK-9400) Implement code generation for StringLocate

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9400: --- Assignee: (was: Apache Spark) > Implement code generation for StringLocate >

[jira] [Assigned] (SPARK-9400) Implement code generation for StringLocate

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9400: --- Assignee: Apache Spark > Implement code generation for StringLocate > ---

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-29 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647186#comment-14647186 ] Jeremy Freeman commented on SPARK-9461: --- A couple initial observations: - the Scala

[jira] [Assigned] (SPARK-9403) Implement code generation for In / InSet

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9403: --- Assignee: (was: Apache Spark) > Implement code generation for In / InSet > --

[jira] [Commented] (SPARK-9403) Implement code generation for In / InSet

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647180#comment-14647180 ] Apache Spark commented on SPARK-9403: - User 'tarekauel' has created a pull request for

[jira] [Assigned] (SPARK-9403) Implement code generation for In / InSet

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9403: --- Assignee: Apache Spark > Implement code generation for In / InSet > -

[jira] [Created] (SPARK-9467) Specialized accumulators

2015-07-29 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-9467: --- Summary: Specialized accumulators Key: SPARK-9467 URL: https://issues.apache.org/jira/browse/SPARK-9467 Project: Spark Issue Type: Sub-task Component

[jira] [Commented] (SPARK-4144) Support incremental model training of Naive Bayes classifier

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647173#comment-14647173 ] Joseph K. Bradley commented on SPARK-4144: -- [~cfregly] Reassigned to you. Thanks

[jira] [Updated] (SPARK-4144) Support incremental model training of Naive Bayes classifier

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-4144: - Target Version/s: (was: 1.5.0) > Support incremental model training of Naive Bayes class

[jira] [Updated] (SPARK-4144) Support incremental model training of Naive Bayes classifier

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-4144: - Assignee: Chris Fregly (was: Jeremy Freeman) > Support incremental model training of Naiv

[jira] [Assigned] (SPARK-9466) Flaky test: org.apache.spark.sql.hive.thriftserver.CliSuite

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9466: --- Assignee: (was: Apache Spark) > Flaky test: org.apache.spark.sql.hive.thriftserver.CliSui

[jira] [Assigned] (SPARK-9466) Flaky test: org.apache.spark.sql.hive.thriftserver.CliSuite

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9466: --- Assignee: Apache Spark > Flaky test: org.apache.spark.sql.hive.thriftserver.CliSuite > --

[jira] [Commented] (SPARK-9466) Flaky test: org.apache.spark.sql.hive.thriftserver.CliSuite

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647166#comment-14647166 ] Apache Spark commented on SPARK-9466: - User 'yhuai' has created a pull request for thi

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647165#comment-14647165 ] Joseph K. Bradley commented on SPARK-9461: -- Maybe from streaming? [https://ampla

[jira] [Commented] (SPARK-9466) Flaky test: org.apache.spark.sql.hive.thriftserver.CliSuite

2015-07-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647164#comment-14647164 ] Yin Huai commented on SPARK-9466: - Tests in this sutie have 1 minute timeout. But, seems e

[jira] [Created] (SPARK-9466) Flaky test: org.apache.spark.sql.hive.thriftserver.CliSuite

2015-07-29 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9466: --- Summary: Flaky test: org.apache.spark.sql.hive.thriftserver.CliSuite Key: SPARK-9466 URL: https://issues.apache.org/jira/browse/SPARK-9466 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9461: --- Assignee: Jeremy Freeman (was: Apache Spark) > Possibly slightly flaky PySpark StreamingLine

[jira] [Assigned] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9461: --- Assignee: Apache Spark (was: Jeremy Freeman) > Possibly slightly flaky PySpark StreamingLine

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647159#comment-14647159 ] Apache Spark commented on SPARK-9461: - User 'jkbradley' has created a pull request for

[jira] [Resolved] (SPARK-8860) RDDOperationScope.withScope should accept a list of accumulators to display in the web UI

2015-07-29 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-8860. - Resolution: Won't Fix Sending accumulators to RDDOperationScope.withScope doesn't make sense becau

[jira] [Updated] (SPARK-9192) add initialization phase for nondeterministic expression in code generation

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9192: --- Summary: add initialization phase for nondeterministic expression in code generation (was: add initia

[jira] [Updated] (SPARK-9192) add initialization phase for nondeterministic expression

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9192: --- Summary: add initialization phase for nondeterministic expression (was: add initialization phase for

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647155#comment-14647155 ] Joseph K. Bradley commented on SPARK-9461: -- Not the only one apparently. {code} =

[jira] [Updated] (SPARK-9192) add initialization phase for nondeterministic expression

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9192: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-8599 > add initialization phase for non

[jira] [Updated] (SPARK-9462) Initialize nondeterministic expressions in code gen fallback mode

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9462: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-8599 > Initialize nondeterministic expressions

[jira] [Resolved] (SPARK-9462) Initialize nondeterministic expressions in code gen fallback mode

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9462. Resolution: Fixed Fix Version/s: 1.5.0 > Initialize nondeterministic expressions in code gen

[jira] [Resolved] (SPARK-9460) Avoid byte array allocation in StringPrefixComparator

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9460. Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 1.5.0 > Avoid byte array allo

[jira] [Assigned] (SPARK-9454) LDASuite should use vector comparisons

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9454: --- Assignee: (was: Apache Spark) > LDASuite should use vector comparisons >

[jira] [Assigned] (SPARK-9454) LDASuite should use vector comparisons

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9454: --- Assignee: Apache Spark > LDASuite should use vector comparisons > ---

[jira] [Commented] (SPARK-9231) DistributedLDAModel method for top topics per document

2015-07-29 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647144#comment-14647144 ] yuhao yang commented on SPARK-9231: --- I'd like to send a PR on this soon since it's targe

[jira] [Commented] (SPARK-9454) LDASuite should use vector comparisons

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647146#comment-14647146 ] Apache Spark commented on SPARK-9454: - User 'feynmanliang' has created a pull request

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-29 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647141#comment-14647141 ] Samphel Norden commented on SPARK-9347: --- That will be ideal. > spark load of exist

[jira] [Commented] (SPARK-8862) Add a web UI page that visualizes physical plans (SparkPlan)

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647140#comment-14647140 ] Apache Spark commented on SPARK-8862: - User 'zsxwing' has created a pull request for t

[jira] [Assigned] (SPARK-8862) Add a web UI page that visualizes physical plans (SparkPlan)

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8862: --- Assignee: (was: Apache Spark) > Add a web UI page that visualizes physical plans (SparkPl

[jira] [Assigned] (SPARK-8862) Add a web UI page that visualizes physical plans (SparkPlan)

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8862: --- Assignee: Apache Spark > Add a web UI page that visualizes physical plans (SparkPlan) > -

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647136#comment-14647136 ] Liang-Chi Hsieh commented on SPARK-9347: You concern should be solved in the lates

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647134#comment-14647134 ] Liang-Chi Hsieh commented on SPARK-9347: OK. The latest development is, we will sk

[jira] [Resolved] (SPARK-9458) Avoid object allocation in prefix generation

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9458. Resolution: Fixed Fix Version/s: 1.5.0 > Avoid object allocation in prefix generation > -

[jira] [Commented] (SPARK-3270) Spark API for Application Extensions

2015-07-29 Thread Michal Malohlava (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647127#comment-14647127 ] Michal Malohlava commented on SPARK-3270: - Hi Steve, yes, agree, it would be real

[jira] [Commented] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

2015-07-29 Thread Samphel Norden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647126#comment-14647126 ] Samphel Norden commented on SPARK-9347: --- No. I havent tried the latest. Assuming tha

[jira] [Updated] (SPARK-9465) Could not read parquet table after recreating it with the same table name

2015-07-29 Thread StanZhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] StanZhai updated SPARK-9465: Description: I'am using SparkSQL in Spark 1.4.1. I encounter an error when using parquet table after recrea

[jira] [Created] (SPARK-9465) Could not read parquet table after recreating it with the same table name

2015-07-29 Thread StanZhai (JIRA)
StanZhai created SPARK-9465: --- Summary: Could not read parquet table after recreating it with the same table name Key: SPARK-9465 URL: https://issues.apache.org/jira/browse/SPARK-9465 Project: Spark

[jira] [Created] (SPARK-9464) Add property-based tests for UTF8String

2015-07-29 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9464: - Summary: Add property-based tests for UTF8String Key: SPARK-9464 URL: https://issues.apache.org/jira/browse/SPARK-9464 Project: Spark Issue Type: New Feature

[jira] [Comment Edited] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-07-29 Thread Nam Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647115#comment-14647115 ] Nam Ma edited comment on SPARK-5133 at 7/30/15 3:19 AM: As far as

[jira] [Commented] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-07-29 Thread Nam Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647115#comment-14647115 ] Nam Ma commented on SPARK-5133: --- As far as I know, feature importance in scikit-learn is bas

[jira] [Commented] (SPARK-2205) Unnecessary exchange operators in a join on multiple tables with the same join key.

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647108#comment-14647108 ] Apache Spark commented on SPARK-2205: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

2015-07-29 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647104#comment-14647104 ] Saisai Shao commented on SPARK-4352: Hi [~tgraves], location is got from DAGScheduler

[jira] [Commented] (SPARK-4229) Create hadoop configuration in a consistent way

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647102#comment-14647102 ] Apache Spark commented on SPARK-4229: - User 'koeninger' has created a pull request for

[jira] [Commented] (SPARK-9463) Expose model coefficients with names in SparkR RFormula

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647100#comment-14647100 ] Apache Spark commented on SPARK-9463: - User 'ericl' has created a pull request for thi

[jira] [Assigned] (SPARK-9463) Expose model coefficients with names in SparkR RFormula

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9463: --- Assignee: (was: Apache Spark) > Expose model coefficients with names in SparkR RFormula >

[jira] [Assigned] (SPARK-8735) Expose metrics for runtime memory usage

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8735: --- Assignee: Andrew Or (was: Apache Spark) > Expose metrics for runtime memory usage >

[jira] [Assigned] (SPARK-9463) Expose model coefficients with names in SparkR RFormula

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9463: --- Assignee: Apache Spark > Expose model coefficients with names in SparkR RFormula > --

[jira] [Commented] (SPARK-8735) Expose metrics for runtime memory usage

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647099#comment-14647099 ] Apache Spark commented on SPARK-8735: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-8735) Expose metrics for runtime memory usage

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8735: --- Assignee: Apache Spark (was: Andrew Or) > Expose metrics for runtime memory usage >

[jira] [Commented] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

2015-07-29 Thread Swapan Golla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647098#comment-14647098 ] Swapan Golla commented on SPARK-2356: - Same issue for me. I am on Win7/64bit and using

[jira] [Commented] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-29 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647096#comment-14647096 ] Meihua Wu commented on SPARK-9246: -- I have submitted a PR including the code, ScalaDoc an

[jira] [Commented] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647093#comment-14647093 ] Apache Spark commented on SPARK-9246: - User 'rotationsymmetry' has created a pull requ

[jira] [Assigned] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9246: --- Assignee: Apache Spark > DistributedLDAModel predict top docs per topic > ---

[jira] [Assigned] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9246: --- Assignee: (was: Apache Spark) > DistributedLDAModel predict top docs per topic >

[jira] [Issue Comment Deleted] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-29 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Meihua Wu updated SPARK-9246: - Comment: was deleted (was: Got it. Thanks!) > DistributedLDAModel predict top docs per topic > --

[jira] [Issue Comment Deleted] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-29 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Meihua Wu updated SPARK-9246: - Comment: was deleted (was: Got it. Thanks!) > DistributedLDAModel predict top docs per topic > --

[jira] [Created] (SPARK-9463) Expose model coefficients with names in SparkR RFormula

2015-07-29 Thread Eric Liang (JIRA)
Eric Liang created SPARK-9463: - Summary: Expose model coefficients with names in SparkR RFormula Key: SPARK-9463 URL: https://issues.apache.org/jira/browse/SPARK-9463 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-9372) For a join operator, rows with null equal join key expression can be filtered out early

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647083#comment-14647083 ] Apache Spark commented on SPARK-9372: - User 'JoshRosen' has created a pull request for

  1   2   3   4   >