[jira] [Commented] (SPARK-8781) Pusblished POMs are no longer effective POMs

2015-07-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611571#comment-14611571 ] Sean Owen commented on SPARK-8781: -- Does this affect release artifacts or just the snapsh

[jira] [Commented] (SPARK-6573) Convert inbound NaN values as null

2015-07-01 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611565#comment-14611565 ] Josh Rosen commented on SPARK-6573: --- NaN can lead to confusing exceptions during sorting

[jira] [Assigned] (SPARK-8783) CTAS with WITH clause does not work

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8783: --- Assignee: Apache Spark > CTAS with WITH clause does not work > --

[jira] [Commented] (SPARK-8783) CTAS with WITH clause does not work

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611556#comment-14611556 ] Apache Spark commented on SPARK-8783: - User 'sirpkt' has created a pull request for th

[jira] [Assigned] (SPARK-8783) CTAS with WITH clause does not work

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8783: --- Assignee: (was: Apache Spark) > CTAS with WITH clause does not work > ---

[jira] [Commented] (SPARK-8708) MatrixFactorizationModel.predictAll() populates single partition only

2015-07-01 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611555#comment-14611555 ] Antony Mayi commented on SPARK-8708: bq. Antony Mayi In your real case, how many parti

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

2015-07-01 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611553#comment-14611553 ] hujiayin commented on SPARK-5682: - Since the encrypted shuffle in spark is focus on the co

[jira] [Created] (SPARK-8783) CTAS with WITH clause does not work

2015-07-01 Thread Keuntae Park (JIRA)
Keuntae Park created SPARK-8783: --- Summary: CTAS with WITH clause does not work Key: SPARK-8783 URL: https://issues.apache.org/jira/browse/SPARK-8783 Project: Spark Issue Type: Bug Com

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

2015-07-01 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611547#comment-14611547 ] liyunzhang_intel commented on SPARK-5682: - [~hujiayin]: thanks for your comment.

[jira] [Assigned] (SPARK-8782) GenerateOrdering fails for NullType (i.e. ORDER BY NULL crashes)

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8782: --- Assignee: Josh Rosen (was: Apache Spark) > GenerateOrdering fails for NullType (i.e. ORDER B

[jira] [Assigned] (SPARK-8782) GenerateOrdering fails for NullType (i.e. ORDER BY NULL crashes)

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8782: --- Assignee: Apache Spark (was: Josh Rosen) > GenerateOrdering fails for NullType (i.e. ORDER B

[jira] [Commented] (SPARK-8782) GenerateOrdering fails for NullType (i.e. ORDER BY NULL crashes)

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611543#comment-14611543 ] Apache Spark commented on SPARK-8782: - User 'JoshRosen' has created a pull request for

[jira] [Updated] (SPARK-8687) Spark on yarn-client mode can't send `spark.yarn.credentials.file` to executor.

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8687: - Fix Version/s: 1.4.2 > Spark on yarn-client mode can't send `spark.yarn.credentials.file` to > executor.

[jira] [Updated] (SPARK-8687) Spark on yarn-client mode can't send `spark.yarn.credentials.file` to executor.

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8687: - Target Version/s: 1.5.0, 1.4.2 (was: 1.5.0) > Spark on yarn-client mode can't send `spark.yarn.credential

[jira] [Closed] (SPARK-8687) Spark on yarn-client mode can't send `spark.yarn.credentials.file` to executor.

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8687. Resolution: Fixed Assignee: SaintBacchus Fix Version/s: 1.5.0 Target Version/s:

[jira] [Closed] (SPARK-3071) Increase default driver memory

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3071. Resolution: Fixed Fix Version/s: 1.5.0 > Increase default driver memory > ---

[jira] [Comment Edited] (SPARK-5682) Add encrypted shuffle in spark

2015-07-01 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611527#comment-14611527 ] hujiayin edited comment on SPARK-5682 at 7/2/15 6:10 AM: - Steps we

[jira] [Closed] (SPARK-8740) Support GitHub OAuth tokens in dev/merge_spark_pr.py

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8740. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Support GitHub OAuth token

[jira] [Closed] (SPARK-8769) toLocalIterator should mention it results in many jobs

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8769. Resolution: Fixed Assignee: holdenk Fix Version/s: 1.4.2 1.5.0

[jira] [Closed] (SPARK-8771) Actor system deprecation tag uses deprecated deprecation tag

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8771. Resolution: Fixed Assignee: holdenk Fix Version/s: 1.5.0 Target Version/s: 1.5.0

[jira] [Updated] (SPARK-8771) Actor system deprecation tag uses deprecated deprecation tag

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8771: - Affects Version/s: 1.4.0 > Actor system deprecation tag uses deprecated deprecation tag >

[jira] [Comment Edited] (SPARK-5682) Add encrypted shuffle in spark

2015-07-01 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611527#comment-14611527 ] hujiayin edited comment on SPARK-5682 at 7/2/15 6:03 AM: - Steps we

[jira] [Closed] (SPARK-8688) Hadoop Configuration has to disable client cache when writing or reading delegation tokens.

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8688. Resolution: Fixed Assignee: SaintBacchus Fix Version/s: 1.5.0 Target Version/s:

[jira] [Comment Edited] (SPARK-5682) Add encrypted shuffle in spark

2015-07-01 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611527#comment-14611527 ] hujiayin edited comment on SPARK-5682 at 7/2/15 6:02 AM: - steps we

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

2015-07-01 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611527#comment-14611527 ] hujiayin commented on SPARK-5682: - steps were added to encode and decode the data, the per

[jira] [Closed] (SPARK-8754) YarnClientSchedulerBackend doesn't stop gracefully in failure conditions

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8754. Resolution: Fixed Fix Version/s: 1.4.2 1.5.0 Target Version/s: 1.5.0,

[jira] [Commented] (SPARK-8708) MatrixFactorizationModel.predictAll() populates single partition only

2015-07-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611505#comment-14611505 ] Xiangrui Meng commented on SPARK-8708: -- [~antonymayi] In your real case, how many par

[jira] [Created] (SPARK-8782) GenerateOrdering fails for NullType (i.e. ORDER BY NULL crashes)

2015-07-01 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-8782: - Summary: GenerateOrdering fails for NullType (i.e. ORDER BY NULL crashes) Key: SPARK-8782 URL: https://issues.apache.org/jira/browse/SPARK-8782 Project: Spark Iss

[jira] [Created] (SPARK-8781) Pusblished POMs are no longer effective POMs

2015-07-01 Thread Konstantin Shaposhnikov (JIRA)
Konstantin Shaposhnikov created SPARK-8781: -- Summary: Pusblished POMs are no longer effective POMs Key: SPARK-8781 URL: https://issues.apache.org/jira/browse/SPARK-8781 Project: Spark

[jira] [Created] (SPARK-8780) Move Python doctest code example from models to algorithms

2015-07-01 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-8780: -- Summary: Move Python doctest code example from models to algorithms Key: SPARK-8780 URL: https://issues.apache.org/jira/browse/SPARK-8780 Project: Spark Issue Ty

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

2015-07-01 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611491#comment-14611491 ] liyunzhang_intel commented on SPARK-5682: - [~hujiayin]: thanks for your comment {

[jira] [Resolved] (SPARK-8227) math function: unhex

2015-07-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8227. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7113 [https://github.com/

[jira] [Created] (SPARK-8779) Add documentation for Python's FP-growth

2015-07-01 Thread Hrishikesh (JIRA)
Hrishikesh created SPARK-8779: - Summary: Add documentation for Python's FP-growth Key: SPARK-8779 URL: https://issues.apache.org/jira/browse/SPARK-8779 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-8224) math function: shiftright

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611459#comment-14611459 ] Apache Spark commented on SPARK-8224: - User 'zhichao-li' has created a pull request fo

[jira] [Commented] (SPARK-8223) math function: shiftleft

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611458#comment-14611458 ] Apache Spark commented on SPARK-8223: - User 'zhichao-li' has created a pull request fo

[jira] [Assigned] (SPARK-8223) math function: shiftleft

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8223: --- Assignee: Apache Spark (was: zhichao-li) > math function: shiftleft > --

[jira] [Commented] (SPARK-8223) math function: shiftleft

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611448#comment-14611448 ] Apache Spark commented on SPARK-8223: - User 'tarekauel' has created a pull request for

[jira] [Commented] (SPARK-8224) math function: shiftright

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611449#comment-14611449 ] Apache Spark commented on SPARK-8224: - User 'tarekauel' has created a pull request for

[jira] [Assigned] (SPARK-8224) math function: shiftright

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8224: --- Assignee: Apache Spark (was: zhichao-li) > math function: shiftright > -

[jira] [Assigned] (SPARK-8223) math function: shiftleft

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8223: --- Assignee: zhichao-li (was: Apache Spark) > math function: shiftleft > --

[jira] [Assigned] (SPARK-8224) math function: shiftright

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8224: --- Assignee: zhichao-li (was: Apache Spark) > math function: shiftright > -

[jira] [Resolved] (SPARK-8770) BinaryOperator expression

2015-07-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8770. Resolution: Fixed > BinaryOperator expression > - > > Key: S

[jira] [Commented] (SPARK-8765) Flaky PySpark PowerIterationClustering test

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611440#comment-14611440 ] Apache Spark commented on SPARK-8765: - User 'yanboliang' has created a pull request fo

[jira] [Updated] (SPARK-8778) The item of "Scheduler delay" is not consistent between "Event Timeline" and "Task List"

2015-07-01 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxiongfei updated SPARK-8778: - Description: In the page "Details for Stage" of Spark Web UI, "Scheduler delay" of some running

[jira] [Updated] (SPARK-8778) The item of "Scheduler delay" is not consistent between "Event Timeline" and "Task List"

2015-07-01 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxiongfei updated SPARK-8778: - Attachment: Event Timeline.png Tasks.png > The item of "Scheduler delay" is not co

[jira] [Created] (SPARK-8778) The item of "Scheduler delay" is not consistent between "Event Timeline" and "Task List"

2015-07-01 Thread zhangxiongfei (JIRA)
zhangxiongfei created SPARK-8778: Summary: The item of "Scheduler delay" is not consistent between "Event Timeline" and "Task List" Key: SPARK-8778 URL: https://issues.apache.org/jira/browse/SPARK-8778

[jira] [Assigned] (SPARK-8777) Add random data generation test utilities to Spark SQL

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8777: --- Assignee: Apache Spark (was: Josh Rosen) > Add random data generation test utilities to Spar

[jira] [Assigned] (SPARK-8777) Add random data generation test utilities to Spark SQL

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8777: --- Assignee: Josh Rosen (was: Apache Spark) > Add random data generation test utilities to Spar

[jira] [Commented] (SPARK-8777) Add random data generation test utilities to Spark SQL

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611404#comment-14611404 ] Apache Spark commented on SPARK-8777: - User 'JoshRosen' has created a pull request for

[jira] [Created] (SPARK-8777) Add random data generation test utilities to Spark SQL

2015-07-01 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-8777: - Summary: Add random data generation test utilities to Spark SQL Key: SPARK-8777 URL: https://issues.apache.org/jira/browse/SPARK-8777 Project: Spark Issue Type: Ne

[jira] [Created] (SPARK-8776) Increase the default MaxPermSize

2015-07-01 Thread Yin Huai (JIRA)
Yin Huai created SPARK-8776: --- Summary: Increase the default MaxPermSize Key: SPARK-8776 URL: https://issues.apache.org/jira/browse/SPARK-8776 Project: Spark Issue Type: Improvement Compon

[jira] [Created] (SPARK-8775) Move expression specific type coercion into expression themselves

2015-07-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8775: -- Summary: Move expression specific type coercion into expression themselves Key: SPARK-8775 URL: https://issues.apache.org/jira/browse/SPARK-8775 Project: Spark

[jira] [Assigned] (SPARK-8772) Implement implicit type cast for expressions that define expected input types

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8772: --- Assignee: Reynold Xin (was: Apache Spark) > Implement implicit type cast for expressions tha

[jira] [Commented] (SPARK-8772) Implement implicit type cast for expressions that define expected input types

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611360#comment-14611360 ] Apache Spark commented on SPARK-8772: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8772) Implement implicit type cast for expressions that define expected input types

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8772: --- Assignee: Apache Spark (was: Reynold Xin) > Implement implicit type cast for expressions tha

[jira] [Reopened] (SPARK-8770) BinaryOperator expression

2015-07-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-8770: Reverted the commit since it failed Python tests. > BinaryOperator expression > --

[jira] [Commented] (SPARK-8770) BinaryOperator expression

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611351#comment-14611351 ] Apache Spark commented on SPARK-8770: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

2015-07-01 Thread S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611347#comment-14611347 ] S commented on SPARK-7483: -- I encountered the same bug. Adding sparkConf.registerKryoClasses(Arr

[jira] [Commented] (SPARK-5682) Add encrypted shuffle in spark

2015-07-01 Thread hujiayin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611328#comment-14611328 ] hujiayin commented on SPARK-5682: - The solution relied on hadoop API and maybe downgrade t

[jira] [Commented] (SPARK-7835) Refactor HeartbeatReceiverSuite for coverage and clean up

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611315#comment-14611315 ] Apache Spark commented on SPARK-7835: - User 'andrewor14' has created a pull request fo

[jira] [Commented] (SPARK-8708) MatrixFactorizationModel.predictAll() populates single partition only

2015-07-01 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611304#comment-14611304 ] Antony Mayi commented on SPARK-8708: I suspect this issue with all data in single part

[jira] [Commented] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

2015-07-01 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611258#comment-14611258 ] Tathagata Das commented on SPARK-8743: -- I have assigned this to you. > Deregister Co

[jira] [Updated] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

2015-07-01 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8743: - Assignee: Neelesh Srinivas Salian > Deregister Codahale metrics for streaming when StreamingContex

[jira] [Commented] (SPARK-8069) Add support for cutoff to RandomForestClassifier

2015-07-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611244#comment-14611244 ] Joseph K. Bradley commented on SPARK-8069: -- I like the idea of including it in an

[jira] [Commented] (SPARK-5222) YARN client and cluster modes have different app name behaviors

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611241#comment-14611241 ] Andrew Or commented on SPARK-5222: -- I'm inclined to close this as a "Won't Fix" because t

[jira] [Updated] (SPARK-8016) YARN cluster / client modes have different app names for python

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8016: - Priority: Minor (was: Major) > YARN cluster / client modes have different app names for python >

[jira] [Updated] (SPARK-5222) YARN client and cluster modes have different app name behaviors

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5222: - Priority: Minor (was: Major) > YARN client and cluster modes have different app name behaviors >

[jira] [Assigned] (SPARK-8774) Add R model formula with basic support as a transformer

2015-07-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-8774: Assignee: Xiangrui Meng > Add R model formula with basic support as a transformer > ---

[jira] [Commented] (SPARK-8069) Add support for cutoff to RandomForestClassifier

2015-07-01 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611224#comment-14611224 ] holdenk commented on SPARK-8069: So I started working on doing this for the randomforestcl

[jira] [Created] (SPARK-8774) Add R model formula with basic support as a transformer

2015-07-01 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-8774: Summary: Add R model formula with basic support as a transformer Key: SPARK-8774 URL: https://issues.apache.org/jira/browse/SPARK-8774 Project: Spark Issue T

[jira] [Updated] (SPARK-6805) ML Pipeline API in SparkR

2015-07-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6805: - Assignee: (was: Xiangrui Meng) > ML Pipeline API in SparkR > - > >

[jira] [Assigned] (SPARK-6805) ML Pipeline API in SparkR

2015-07-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-6805: Assignee: Xiangrui Meng > ML Pipeline API in SparkR > - > >

[jira] [Resolved] (SPARK-8770) BinaryOperator expression

2015-07-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8770. Resolution: Fixed Fix Version/s: 1.5.0 > BinaryOperator expression >

[jira] [Created] (SPARK-8773) Throw type mismatch in check analysis for expressions with expected input types defined

2015-07-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8773: -- Summary: Throw type mismatch in check analysis for expressions with expected input types defined Key: SPARK-8773 URL: https://issues.apache.org/jira/browse/SPARK-8773 Pro

[jira] [Created] (SPARK-8772) Implement implicit type cast for expressions that define expected input types

2015-07-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8772: -- Summary: Implement implicit type cast for expressions that define expected input types Key: SPARK-8772 URL: https://issues.apache.org/jira/browse/SPARK-8772 Project: Spar

[jira] [Resolved] (SPARK-8766) DataFrame Python API should work with column which has non-ascii character in it

2015-07-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8766. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7165 [https://github.com/

[jira] [Updated] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

2015-07-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6707: - Target Version/s: 1.5.0 > Mesos Scheduler should allow the user to specify constraints based on slave > a

[jira] [Commented] (SPARK-7079) Cache-aware external sort

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611141#comment-14611141 ] Apache Spark commented on SPARK-7079: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-7078) Cache-aware binary processing in-memory sort

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7078: --- Assignee: Apache Spark (was: Josh Rosen) > Cache-aware binary processing in-memory sort > --

[jira] [Commented] (SPARK-7078) Cache-aware binary processing in-memory sort

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611140#comment-14611140 ] Apache Spark commented on SPARK-7078: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-7079) Cache-aware external sort

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7079: --- Assignee: Josh Rosen (was: Apache Spark) > Cache-aware external sort > -

[jira] [Assigned] (SPARK-7079) Cache-aware external sort

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7079: --- Assignee: Apache Spark (was: Josh Rosen) > Cache-aware external sort > -

[jira] [Assigned] (SPARK-7078) Cache-aware binary processing in-memory sort

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7078: --- Assignee: Josh Rosen (was: Apache Spark) > Cache-aware binary processing in-memory sort > --

[jira] [Commented] (SPARK-8771) Actor system deprecation tag uses deprecated deprecation tag

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1460#comment-1460 ] Apache Spark commented on SPARK-8771: - User 'holdenk' has created a pull request for t

[jira] [Assigned] (SPARK-8771) Actor system deprecation tag uses deprecated deprecation tag

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8771: --- Assignee: (was: Apache Spark) > Actor system deprecation tag uses deprecated deprecation

[jira] [Assigned] (SPARK-8771) Actor system deprecation tag uses deprecated deprecation tag

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8771: --- Assignee: Apache Spark > Actor system deprecation tag uses deprecated deprecation tag > -

[jira] [Commented] (SPARK-8769) toLocalIterator should mention it results in many jobs

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611107#comment-14611107 ] Apache Spark commented on SPARK-8769: - User 'holdenk' has created a pull request for t

[jira] [Assigned] (SPARK-8769) toLocalIterator should mention it results in many jobs

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8769: --- Assignee: (was: Apache Spark) > toLocalIterator should mention it results in many jobs >

[jira] [Assigned] (SPARK-8769) toLocalIterator should mention it results in many jobs

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8769: --- Assignee: Apache Spark > toLocalIterator should mention it results in many jobs > ---

[jira] [Assigned] (SPARK-8770) BinaryOperator expression

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8770: --- Assignee: Reynold Xin (was: Apache Spark) > BinaryOperator expression >

[jira] [Assigned] (SPARK-8770) BinaryOperator expression

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8770: --- Assignee: Apache Spark (was: Reynold Xin) > BinaryOperator expression >

[jira] [Updated] (SPARK-8770) BinaryOperator expression

2015-07-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8770: Shepherd: Michael Armbrust > BinaryOperator expression > - > >

[jira] [Commented] (SPARK-8770) BinaryOperator expression

2015-07-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611101#comment-14611101 ] Apache Spark commented on SPARK-8770: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-8770) BinaryOperator expression

2015-07-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8770: -- Summary: BinaryOperator expression Key: SPARK-8770 URL: https://issues.apache.org/jira/browse/SPARK-8770 Project: Spark Issue Type: Sub-task Components

[jira] [Created] (SPARK-8771) Actor system deprecation tag uses deprecated deprecation tag

2015-07-01 Thread holdenk (JIRA)
holdenk created SPARK-8771: -- Summary: Actor system deprecation tag uses deprecated deprecation tag Key: SPARK-8771 URL: https://issues.apache.org/jira/browse/SPARK-8771 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-8766) DataFrame Python API should work with column which has non-ascii character in it

2015-07-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8766: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-6116 > DataFrame Python API should work with co

[jira] [Updated] (SPARK-8769) toLocalIterator should mention it results in many jobs

2015-07-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8769: - Component/s: Documentation > toLocalIterator should mention it results in many jobs >

[jira] [Updated] (SPARK-8766) DataFrame Python API should work with column which has non-ascii character in it

2015-07-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8766: - Component/s: PySpark > DataFrame Python API should work with column which has non-ascii character in > it

[jira] [Commented] (SPARK-8753) Create an IntervalType data type

2015-07-01 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611067#comment-14611067 ] holdenk commented on SPARK-8753: I could give this a shot if people want :) > Create an I

[jira] [Updated] (SPARK-8763) executing run-tests.py with Python 2.6 fails with absence of subprocess.check_output function

2015-07-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8763: - Assignee: Tomohiko K. > executing run-tests.py with Python 2.6 fails with absence of > subprocess.check_o

  1   2   3   >