[jira] [Assigned] (SPARK-16691) move BucketSpec to catalyst module and use it in CatalogTable

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16691: Assignee: Apache Spark (was: Wenchen Fan) > move BucketSpec to catalyst module and use it

[jira] [Commented] (SPARK-16691) move BucketSpec to catalyst module and use it in CatalogTable

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390947#comment-15390947 ] Apache Spark commented on SPARK-16691: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-16691) move BucketSpec to catalyst module and use it in CatalogTable

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16691: Assignee: Wenchen Fan (was: Apache Spark) > move BucketSpec to catalyst module and use it

[jira] [Commented] (SPARK-16693) Remove R deprecated methods

2016-07-23 Thread Mark Hamstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390865#comment-15390865 ] Mark Hamstra commented on SPARK-16693: -- The 2.1.0 release is the very earliest that

[jira] [Commented] (SPARK-16693) Remove R deprecated methods

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390857#comment-15390857 ] Apache Spark commented on SPARK-16693: -- User 'felixcheung' has created a pull reques

[jira] [Assigned] (SPARK-16693) Remove R deprecated methods

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16693: Assignee: (was: Apache Spark) > Remove R deprecated methods >

[jira] [Assigned] (SPARK-16693) Remove R deprecated methods

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16693: Assignee: Apache Spark > Remove R deprecated methods > --- > >

[jira] [Created] (SPARK-16693) Remove R deprecated methods

2016-07-23 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-16693: Summary: Remove R deprecated methods Key: SPARK-16693 URL: https://issues.apache.org/jira/browse/SPARK-16693 Project: Spark Issue Type: Bug Compone

[jira] [Commented] (SPARK-16611) Expose several hidden DataFrame/RDD functions

2016-07-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390856#comment-15390856 ] Felix Cheung commented on SPARK-16611: -- where are we on this? I'm working on removin

[jira] [Resolved] (SPARK-8871) Add maximal frequent itemsets filter in Spark MLib FPGrowth

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8871. -- Resolution: Duplicate > Add maximal frequent itemsets filter in Spark MLib FPGrowth > --

[jira] [Commented] (SPARK-8871) Add maximal frequent itemsets filter in Spark MLib FPGrowth

2016-07-23 Thread Jonathan Svirsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390841#comment-15390841 ] Jonathan Svirsky commented on SPARK-8871: - Hi Sean, You are right. The main idea u

[jira] [Commented] (SPARK-8871) Add maximal frequent itemsets filter in Spark MLib FPGrowth

2016-07-23 Thread Jonathan Svirsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390840#comment-15390840 ] Jonathan Svirsky commented on SPARK-8871: - An item set is maximal if it is frequen

[jira] [Commented] (SPARK-13979) Killed executor is respawned without AWS keys in standalone spark cluster

2016-07-23 Thread Mitesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390833#comment-15390833 ] Mitesh commented on SPARK-13979: Yeah that sounds like it. We worked around it by adding

[jira] [Commented] (SPARK-13979) Killed executor is respawned without AWS keys in standalone spark cluster

2016-07-23 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390831#comment-15390831 ] Luciano Resende commented on SPARK-13979: - This scenario usually happens when you

[jira] [Updated] (SPARK-16690) rename SQLTestUtils.withTempTable to withTempView

2016-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16690: Fix Version/s: 2.0.1 > rename SQLTestUtils.withTempTable to withTempView >

[jira] [Resolved] (SPARK-16380) Update SQL examples and programming guide for Python language binding

2016-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16380. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Update SQL examples and

[jira] [Resolved] (SPARK-16690) rename SQLTestUtils.withTempTable to withTempView

2016-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16690. - Resolution: Fixed Fix Version/s: 2.1.0 > rename SQLTestUtils.withTempTable to withTempView

[jira] [Comment Edited] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2016-07-23 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390615#comment-15390615 ] cen yuhai edited comment on SPARK-16441 at 7/23/16 4:09 PM: A

[jira] [Resolved] (SPARK-16662) The HiveContext deprecate warning in python always shown even if do not use HiveContext

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16662. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14301 [https://github.co

[jira] [Updated] (SPARK-16662) The HiveContext deprecate warning in python always shown even if do not use HiveContext

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16662: -- Assignee: Weichen Xu Affects Version/s: (was: 2.0.1) (was: 2

[jira] [Updated] (SPARK-16561) Potential numerial problem in MultivariateOnlineSummarizer min/max

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16561: -- Assignee: Weichen Xu > Potential numerial problem in MultivariateOnlineSummarizer min/max > ---

[jira] [Updated] (SPARK-16561) Potential numerial problem in MultivariateOnlineSummarizer min/max

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16561: -- Affects Version/s: (was: 2.0.1) (was: 2.1.0) > Potential numerial proble

[jira] [Resolved] (SPARK-16561) Potential numerial problem in MultivariateOnlineSummarizer min/max

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16561. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14216 [https://github.co

[jira] [Commented] (SPARK-16688) OpenHashSet.MAX_CAPACITY is always based on Int even when using Long

2016-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390659#comment-15390659 ] Sean Owen commented on SPARK-16688: --- I don't think that's a design goal, no. This is an

[jira] [Assigned] (SPARK-16686) Dataset.sample with seed: result seems to depend on downstream usage

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16686: Assignee: Apache Spark > Dataset.sample with seed: result seems to depend on downstream us

[jira] [Assigned] (SPARK-16686) Dataset.sample with seed: result seems to depend on downstream usage

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16686: Assignee: (was: Apache Spark) > Dataset.sample with seed: result seems to depend on do

[jira] [Commented] (SPARK-16686) Dataset.sample with seed: result seems to depend on downstream usage

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390650#comment-15390650 ] Apache Spark commented on SPARK-16686: -- User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-11976) Support "." character in DataFrame column name

2016-07-23 Thread rerngvit yanggratoke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390635#comment-15390635 ] rerngvit yanggratoke commented on SPARK-11976: -- We need to have support in t

[jira] [Commented] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2016-07-23 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390615#comment-15390615 ] cen yuhai commented on SPARK-16441: --- Some applications which runs a long time like spar

[jira] [Comment Edited] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2016-07-23 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390602#comment-15390602 ] cen yuhai edited comment on SPARK-16441 at 7/23/16 7:49 AM: N

[jira] [Commented] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2016-07-23 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390602#comment-15390602 ] cen yuhai commented on SPARK-16441: --- No, it is a complicated problem. I also find that

[jira] [Comment Edited] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2016-07-23 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390602#comment-15390602 ] cen yuhai edited comment on SPARK-16441 at 7/23/16 7:49 AM: N

[jira] [Assigned] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3181: --- Assignee: Yanbo Liang (was: Apache Spark) > Add Robust Regression Algorithm with Huber Estim

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390588#comment-15390588 ] Apache Spark commented on SPARK-3181: - User 'yanboliang' has created a pull request fo

[jira] [Assigned] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3181: --- Assignee: Apache Spark (was: Yanbo Liang) > Add Robust Regression Algorithm with Huber Estim

[jira] [Commented] (SPARK-2183) Avoid loading/shuffling data twice in self-join query

2016-07-23 Thread Emma Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390586#comment-15390586 ] Emma Tang commented on SPARK-2183: -- [~khussein] You're right, it does not load from sourc