[jira] [Created] (SPARK-13671) Use different physical plan for existing RDD and data sources

2016-03-04 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13671: -- Summary: Use different physical plan for existing RDD and data sources Key: SPARK-13671 URL: https://issues.apache.org/jira/browse/SPARK-13671 Project: Spark Is

[jira] [Comment Edited] (SPARK-10610) Using AppName instead of AppId in the name of all metrics

2016-03-04 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179507#comment-15179507 ] Pete Robbins edited comment on SPARK-10610 at 3/4/16 8:01 AM: -

[jira] [Commented] (SPARK-13671) Use different physical plan for existing RDD and data sources

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179538#comment-15179538 ] Apache Spark commented on SPARK-13671: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-13671) Use different physical plan for existing RDD and data sources

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13671: Assignee: Apache Spark (was: Davies Liu) > Use different physical plan for existing RDD a

[jira] [Assigned] (SPARK-13671) Use different physical plan for existing RDD and data sources

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13671: Assignee: Davies Liu (was: Apache Spark) > Use different physical plan for existing RDD a

[jira] [Resolved] (SPARK-13603) SQL generation for subquery

2016-03-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13603. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11453 [https://github.

[jira] [Created] (SPARK-13672) Add python examples of BisectingKMeans in ML and MLLIB

2016-03-04 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-13672: Summary: Add python examples of BisectingKMeans in ML and MLLIB Key: SPARK-13672 URL: https://issues.apache.org/jira/browse/SPARK-13672 Project: Spark Issue

[jira] [Assigned] (SPARK-13672) Add python examples of BisectingKMeans in ML and MLLIB

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13672: Assignee: (was: Apache Spark) > Add python examples of BisectingKMeans in ML and MLLIB

[jira] [Assigned] (SPARK-13672) Add python examples of BisectingKMeans in ML and MLLIB

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13672: Assignee: Apache Spark > Add python examples of BisectingKMeans in ML and MLLIB >

[jira] [Commented] (SPARK-13672) Add python examples of BisectingKMeans in ML and MLLIB

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179555#comment-15179555 ] Apache Spark commented on SPARK-13672: -- User 'zhengruifeng' has created a pull reque

[jira] [Created] (SPARK-13673) script bin\beeline.cmd pollutes environment variables in Windows.

2016-03-04 Thread Masayoshi TSUZUKI (JIRA)
Masayoshi TSUZUKI created SPARK-13673: - Summary: script bin\beeline.cmd pollutes environment variables in Windows. Key: SPARK-13673 URL: https://issues.apache.org/jira/browse/SPARK-13673 Project:

[jira] [Commented] (SPARK-13629) Add binary toggle Param to CountVectorizer

2016-03-04 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179571#comment-15179571 ] Nick Pentreath commented on SPARK-13629: Only the word count would be set to 1 (f

[jira] [Assigned] (SPARK-13673) script bin\beeline.cmd pollutes environment variables in Windows.

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13673: Assignee: (was: Apache Spark) > script bin\beeline.cmd pollutes environment variables

[jira] [Commented] (SPARK-13673) script bin\beeline.cmd pollutes environment variables in Windows.

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179578#comment-15179578 ] Apache Spark commented on SPARK-13673: -- User 'tsudukim' has created a pull request f

[jira] [Assigned] (SPARK-13673) script bin\beeline.cmd pollutes environment variables in Windows.

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13673: Assignee: Apache Spark > script bin\beeline.cmd pollutes environment variables in Windows.

[jira] [Closed] (SPARK-13652) TransportClient.sendRpcSync returns wrong results

2016-03-04 Thread huangyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huangyu closed SPARK-13652. --- This issue has been fixed by Shixiong Zhu > TransportClient.sendRpcSync returns wrong results >

[jira] [Commented] (SPARK-13663) Upgrade Snappy Java to 1.1.2.1

2016-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179593#comment-15179593 ] Sean Owen commented on SPARK-13663: --- OK to update for master/1.6 > Upgrade Snappy Java

[jira] [Created] (SPARK-13674) Add wholestage codegen support to Sample

2016-03-04 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-13674: --- Summary: Add wholestage codegen support to Sample Key: SPARK-13674 URL: https://issues.apache.org/jira/browse/SPARK-13674 Project: Spark Issue Type: Im

[jira] [Assigned] (SPARK-13674) Add wholestage codegen support to Sample

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13674: Assignee: (was: Apache Spark) > Add wholestage codegen support to Sample > ---

[jira] [Assigned] (SPARK-13674) Add wholestage codegen support to Sample

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13674: Assignee: Apache Spark > Add wholestage codegen support to Sample > --

[jira] [Commented] (SPARK-13674) Add wholestage codegen support to Sample

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179639#comment-15179639 ] Apache Spark commented on SPARK-13674: -- User 'viirya' has created a pull request for

[jira] [Resolved] (SPARK-13646) QuantileDiscretizer counts dataset twice in getSampledInput

2016-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13646. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11491 [https://github.co

[jira] [Updated] (SPARK-13646) QuantileDiscretizer counts dataset twice in getSampledInput

2016-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13646: -- Assignee: Abou Haydar Elias > QuantileDiscretizer counts dataset twice in getSampledInput > ---

[jira] [Created] (SPARK-13675) The url link in historypage is not correct for application running in yarn cluster mode

2016-03-04 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-13675: --- Summary: The url link in historypage is not correct for application running in yarn cluster mode Key: SPARK-13675 URL: https://issues.apache.org/jira/browse/SPARK-13675

[jira] [Updated] (SPARK-13675) The url link in historypage is not correct for application running in yarn cluster mode

2016-03-04 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-13675: Description: Current URL for each application to access history UI is like: http://localhost:18080

[jira] [Updated] (SPARK-13675) The url link in historypage is not correct for application running in yarn cluster mode

2016-03-04 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-13675: Description: Current URL for each application to access history UI is like: http://localhost:18080

[jira] [Updated] (SPARK-13675) The url link in historypage is not correct for application running in yarn cluster mode

2016-03-04 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-13675: Attachment: Screen Shot 2016-02-29 at 3.57.32 PM.png > The url link in historypage is not correct f

[jira] [Assigned] (SPARK-13675) The url link in historypage is not correct for application running in yarn cluster mode

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13675: Assignee: (was: Apache Spark) > The url link in historypage is not correct for applica

[jira] [Assigned] (SPARK-13675) The url link in historypage is not correct for application running in yarn cluster mode

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13675: Assignee: Apache Spark > The url link in historypage is not correct for application runnin

[jira] [Commented] (SPARK-13675) The url link in historypage is not correct for application running in yarn cluster mode

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179683#comment-15179683 ] Apache Spark commented on SPARK-13675: -- User 'jerryshao' has created a pull request

[jira] [Resolved] (SPARK-13398) Move away from deprecated ThreadPoolTaskSupport

2016-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13398. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11423 [https://github.co

[jira] [Updated] (SPARK-13398) Move away from deprecated ThreadPoolTaskSupport

2016-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13398: -- Assignee: holdenk > Move away from deprecated ThreadPoolTaskSupport > -

[jira] [Updated] (SPARK-12925) Improve HiveInspectors.unwrap for StringObjectInspector.getPrimitiveWritableObject

2016-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12925: -- Priority: Minor (was: Major) > Improve HiveInspectors.unwrap for > StringObjectInspector.getPrimitive

[jira] [Created] (SPARK-13676) Fix mismatched default values for regParam in LogisticRegression

2016-03-04 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-13676: - Summary: Fix mismatched default values for regParam in LogisticRegression Key: SPARK-13676 URL: https://issues.apache.org/jira/browse/SPARK-13676 Project: Spark

[jira] [Updated] (SPARK-13676) Fix mismatched default values for regParam in LogisticRegression

2016-03-04 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13676: -- Component/s: MLlib > Fix mismatched default values for regParam in LogisticRegression > ---

[jira] [Commented] (SPARK-13676) Fix mismatched default values for regParam in LogisticRegression

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179792#comment-15179792 ] Apache Spark commented on SPARK-13676: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-13676) Fix mismatched default values for regParam in LogisticRegression

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13676: Assignee: (was: Apache Spark) > Fix mismatched default values for regParam in Logistic

[jira] [Assigned] (SPARK-13676) Fix mismatched default values for regParam in LogisticRegression

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13676: Assignee: Apache Spark > Fix mismatched default values for regParam in LogisticRegression

[jira] [Commented] (SPARK-13596) Move misc top-level build files into appropriate subdirs

2016-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179796#comment-15179796 ] Sean Owen commented on SPARK-13596: --- [~nchammas] do you happen to know how we can confi

[jira] [Created] (SPARK-13677) Support Tree-Based Feature Transformation for mllib

2016-03-04 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-13677: Summary: Support Tree-Based Feature Transformation for mllib Key: SPARK-13677 URL: https://issues.apache.org/jira/browse/SPARK-13677 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-13677) Support Tree-Based Feature Transformation for mllib

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13677: Assignee: Apache Spark > Support Tree-Based Feature Transformation for mllib > ---

[jira] [Commented] (SPARK-13677) Support Tree-Based Feature Transformation for mllib

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179827#comment-15179827 ] Apache Spark commented on SPARK-13677: -- User 'zhengruifeng' has created a pull reque

[jira] [Assigned] (SPARK-13677) Support Tree-Based Feature Transformation for mllib

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13677: Assignee: (was: Apache Spark) > Support Tree-Based Feature Transformation for mllib >

[jira] [Commented] (SPARK-13489) GSoC 2016 project ideas for MLlib

2016-03-04 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179833#comment-15179833 ] Kai Jiang commented on SPARK-13489: --- [~josephkb] Thanks for your explanation! It seems

[jira] [Created] (SPARK-13678) transformExpressions should exclude expression that is not inside QueryPlan.expressions

2016-03-04 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-13678: --- Summary: transformExpressions should exclude expression that is not inside QueryPlan.expressions Key: SPARK-13678 URL: https://issues.apache.org/jira/browse/SPARK-13678

[jira] [Updated] (SPARK-13678) transformExpressions should only apply on QueryPlan.expressions

2016-03-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-13678: Summary: transformExpressions should only apply on QueryPlan.expressions (was: transformExpression

[jira] [Assigned] (SPARK-13678) transformExpressions should only apply on QueryPlan.expressions

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13678: Assignee: Apache Spark > transformExpressions should only apply on QueryPlan.expressions >

[jira] [Commented] (SPARK-13678) transformExpressions should only apply on QueryPlan.expressions

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179871#comment-15179871 ] Apache Spark commented on SPARK-13678: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-13678) transformExpressions should only apply on QueryPlan.expressions

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13678: Assignee: (was: Apache Spark) > transformExpressions should only apply on QueryPlan.ex

[jira] [Assigned] (SPARK-13596) Move misc top-level build files into appropriate subdirs

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13596: Assignee: Apache Spark > Move misc top-level build files into appropriate subdirs > --

[jira] [Commented] (SPARK-13596) Move misc top-level build files into appropriate subdirs

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179894#comment-15179894 ] Apache Spark commented on SPARK-13596: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-13596) Move misc top-level build files into appropriate subdirs

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13596: Assignee: (was: Apache Spark) > Move misc top-level build files into appropriate subdi

[jira] [Updated] (SPARK-13673) script bin\beeline.cmd pollutes environment variables in Windows.

2016-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13673: -- Assignee: Masayoshi TSUZUKI > script bin\beeline.cmd pollutes environment variables in Windows. > -

[jira] [Resolved] (SPARK-13673) script bin\beeline.cmd pollutes environment variables in Windows.

2016-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13673. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11516 [https://github.co

[jira] [Updated] (SPARK-11515) QuantileDiscretizer should take random seed

2016-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11515: -- Fix Version/s: 1.6.2 > QuantileDiscretizer should take random seed > --

[jira] [Commented] (SPARK-10795) FileNotFoundException while deploying pyspark job on cluster

2016-03-04 Thread Daniel Jouany (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180011#comment-15180011 ] Daniel Jouany commented on SPARK-10795: --- Hi there, If i follow your suggestions, it

[jira] [Comment Edited] (SPARK-10795) FileNotFoundException while deploying pyspark job on cluster

2016-03-04 Thread Daniel Jouany (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180011#comment-15180011 ] Daniel Jouany edited comment on SPARK-10795 at 3/4/16 3:30 PM:

[jira] [Commented] (SPARK-3374) Spark on Yarn remove deprecated configs for 2.0

2016-03-04 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180027#comment-15180027 ] Thomas Graves commented on SPARK-3374: -- [~srowen] can you add [~jerrypeng] as a cont

[jira] [Commented] (SPARK-3374) Spark on Yarn remove deprecated configs for 2.0

2016-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180031#comment-15180031 ] Sean Owen commented on SPARK-3374: -- Yes and I'll make you an admin so you can assign. >

[jira] [Commented] (SPARK-13595) Move docker, extras modules into external

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180037#comment-15180037 ] Apache Spark commented on SPARK-13595: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-13595) Move docker, extras modules into external

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13595: Assignee: (was: Apache Spark) > Move docker, extras modules into external > --

[jira] [Assigned] (SPARK-13595) Move docker, extras modules into external

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13595: Assignee: Apache Spark > Move docker, extras modules into external > -

[jira] [Commented] (SPARK-13663) Upgrade Snappy Java to 1.1.2.1

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180047#comment-15180047 ] Apache Spark commented on SPARK-13663: -- User 'yy2016' has created a pull request for

[jira] [Assigned] (SPARK-13663) Upgrade Snappy Java to 1.1.2.1

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13663: Assignee: Apache Spark > Upgrade Snappy Java to 1.1.2.1 > -- >

[jira] [Assigned] (SPARK-13663) Upgrade Snappy Java to 1.1.2.1

2016-03-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13663: Assignee: (was: Apache Spark) > Upgrade Snappy Java to 1.1.2.1 > -

[jira] [Created] (SPARK-13679) Pyspark job fails with Oozie

2016-03-04 Thread Alexandre Linte (JIRA)
Alexandre Linte created SPARK-13679: --- Summary: Pyspark job fails with Oozie Key: SPARK-13679 URL: https://issues.apache.org/jira/browse/SPARK-13679 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-13596) Move misc top-level build files into appropriate subdirs

2016-03-04 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180072#comment-15180072 ] Nicholas Chammas commented on SPARK-13596: -- Looks like {{tox.ini}} is only used

[jira] [Created] (SPARK-13680) Java UDAF with more than one intermediate argument returns wrong results

2016-03-04 Thread Yael Aharon (JIRA)
Yael Aharon created SPARK-13680: --- Summary: Java UDAF with more than one intermediate argument returns wrong results Key: SPARK-13680 URL: https://issues.apache.org/jira/browse/SPARK-13680 Project: Spark

[jira] [Updated] (SPARK-13680) Java UDAF with more than one intermediate argument returns wrong results

2016-03-04 Thread Yael Aharon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yael Aharon updated SPARK-13680: Attachment: data.csv > Java UDAF with more than one intermediate argument returns wrong results > -

[jira] [Resolved] (SPARK-13676) Fix mismatched default values for regParam in LogisticRegression

2016-03-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13676. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11519 [https://g

[jira] [Commented] (SPARK-13680) Java UDAF with more than one intermediate argument returns wrong results

2016-03-04 Thread Yael Aharon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180096#comment-15180096 ] Yael Aharon commented on SPARK-13680: - I attached data.csv which is the data used for

[jira] [Updated] (SPARK-13676) Fix mismatched default values for regParam in LogisticRegression

2016-03-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13676: -- Target Version/s: 2.0.0 > Fix mismatched default values for regParam in LogisticRegression > --

[jira] [Updated] (SPARK-13676) Fix mismatched default values for regParam in LogisticRegression

2016-03-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13676: -- Assignee: Dongjoon Hyun > Fix mismatched default values for regParam in LogisticRegression > --

[jira] [Resolved] (SPARK-13036) PySpark ml.feature support export/import

2016-03-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13036. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11203 [https://g

[jira] [Updated] (SPARK-13318) Model export/import for spark.ml: ElementwiseProduct

2016-03-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13318: -- Target Version/s: 2.0.0 > Model export/import for spark.ml: ElementwiseProduct > --

[jira] [Resolved] (SPARK-13319) Pyspark VectorSlicer, StopWordsRemvoer should have setDefault

2016-03-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13319. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11203 [https://g

[jira] [Updated] (SPARK-13319) Pyspark VectorSlicer, StopWordsRemvoer should have setDefault

2016-03-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13319: -- Target Version/s: 2.0.0 > Pyspark VectorSlicer, StopWordsRemvoer should have setDefault > -

[jira] [Resolved] (SPARK-13318) Model export/import for spark.ml: ElementwiseProduct

2016-03-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13318. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11203 [https://g

[jira] [Updated] (SPARK-13319) Pyspark VectorSlicer, StopWordsRemvoer should have setDefault

2016-03-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13319: -- Assignee: Xusen Yin > Pyspark VectorSlicer, StopWordsRemvoer should have setDefault > -

[jira] [Updated] (SPARK-13318) Model export/import for spark.ml: ElementwiseProduct

2016-03-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13318: -- Assignee: Xusen Yin > Model export/import for spark.ml: ElementwiseProduct > --

[jira] [Comment Edited] (SPARK-13494) Cannot sort on a column which is of type "array"

2016-03-04 Thread Yael Aharon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15172115#comment-15172115 ] Yael Aharon edited comment on SPARK-13494 at 3/4/16 4:35 PM: -

[jira] [Updated] (SPARK-13680) Java UDAF with more than one intermediate argument returns wrong results

2016-03-04 Thread Yael Aharon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yael Aharon updated SPARK-13680: Description: I am trying to incorporate the Java UDAF from https://github.com/apache/spark/blob/ma

[jira] [Comment Edited] (SPARK-13680) Java UDAF with more than one intermediate argument returns wrong results

2016-03-04 Thread Yael Aharon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180120#comment-15180120 ] Yael Aharon edited comment on SPARK-13680 at 3/4/16 4:42 PM: -

[jira] [Commented] (SPARK-13680) Java UDAF with more than one intermediate argument returns wrong results

2016-03-04 Thread Yael Aharon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180120#comment-15180120 ] Yael Aharon commented on SPARK-13680: - I found this in the spark executor logs when r

[jira] [Commented] (SPARK-13230) HashMap.merged not working properly with Spark

2016-03-04 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180216#comment-15180216 ] Łukasz Gieroń commented on SPARK-13230: --- The issue here is the bug in Scala library

[jira] [Comment Edited] (SPARK-13230) HashMap.merged not working properly with Spark

2016-03-04 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180216#comment-15180216 ] Łukasz Gieroń edited comment on SPARK-13230 at 3/4/16 5:34 PM:

[jira] [Comment Edited] (SPARK-13230) HashMap.merged not working properly with Spark

2016-03-04 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180216#comment-15180216 ] Łukasz Gieroń edited comment on SPARK-13230 at 3/4/16 5:35 PM:

[jira] [Comment Edited] (SPARK-13230) HashMap.merged not working properly with Spark

2016-03-04 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180216#comment-15180216 ] Łukasz Gieroń edited comment on SPARK-13230 at 3/4/16 5:36 PM:

[jira] [Commented] (SPARK-13230) HashMap.merged not working properly with Spark

2016-03-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180234#comment-15180234 ] Sean Owen commented on SPARK-13230: --- Thanks, that's a great analysis. It sounds like we

[jira] [Commented] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-03-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180241#comment-15180241 ] Joseph K. Bradley commented on SPARK-13048: --- I'd say the best fix would be to a

[jira] [Commented] (SPARK-13434) Reduce Spark RandomForest memory footprint

2016-03-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180243#comment-15180243 ] Joseph K. Bradley commented on SPARK-13434: --- There are a few options here: * Te

[jira] [Updated] (SPARK-13680) Java UDAF with more than one intermediate argument returns wrong results

2016-03-04 Thread Yael Aharon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yael Aharon updated SPARK-13680: Attachment: setup.hql > Java UDAF with more than one intermediate argument returns wrong results >

[jira] [Commented] (SPARK-13494) Cannot sort on a column which is of type "array"

2016-03-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180289#comment-15180289 ] Xiao Li commented on SPARK-13494: - Can you try the other newer versions? You know, a lot

[jira] [Resolved] (SPARK-13633) Move parser classes to o.a.s.sql.catalyst.parser package

2016-03-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13633. --- Resolution: Fixed Fix Version/s: 2.0.0 > Move parser classes to o.a.s.sql.catalyst.parser pack

[jira] [Created] (SPARK-13681) Reimplement CommitFailureTestRelationSuite

2016-03-04 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-13681: Summary: Reimplement CommitFailureTestRelationSuite Key: SPARK-13681 URL: https://issues.apache.org/jira/browse/SPARK-13681 Project: Spark Issue Type

[jira] [Updated] (SPARK-13681) Reimplement CommitFailureTestRelationSuite

2016-03-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13681: - Description: This test case got broken by [#11509|https://github.com/apache/spark/pull/11

[jira] [Created] (SPARK-13682) Finalize the public API for FileFormat

2016-03-04 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-13682: Summary: Finalize the public API for FileFormat Key: SPARK-13682 URL: https://issues.apache.org/jira/browse/SPARK-13682 Project: Spark Issue Type: Su

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

2016-03-04 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180427#comment-15180427 ] Marcelo Vanzin commented on SPARK-13670: After some fun playing with arcane bash

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

2016-03-04 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180444#comment-15180444 ] Marcelo Vanzin commented on SPARK-13670: Note that will probably leave a bash pro

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

2016-03-04 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180455#comment-15180455 ] Marcelo Vanzin commented on SPARK-13670: Actually scrap that, it breaks things wh

  1   2   >