[jira] [Updated] (SPARK-7320) Add rollup and cube support to DataFrame DSL

2015-05-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7320: --- Labels: starter (was: ) > Add rollup and cube support to DataFrame DSL >

[jira] [Created] (SPARK-7320) Add rollup and cube support to DataFrame DSL

2015-05-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7320: -- Summary: Add rollup and cube support to DataFrame DSL Key: SPARK-7320 URL: https://issues.apache.org/jira/browse/SPARK-7320 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-7121) ClosureCleaner does not handle nesting properly

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7121. Resolution: Fixed Fix Version/s: 1.4.0 > ClosureCleaner does not handle nesting prope

[jira] [Resolved] (SPARK-7120) ClosureCleaner lacks documentation

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7120. Resolution: Fixed Fix Version/s: 1.4.0 > ClosureCleaner lacks documentation > ---

[jira] [Resolved] (SPARK-7242) Frequent items for DataFrames

2015-05-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7242. Resolution: Fixed Fix Version/s: 1.4.0 > Frequent items for DataFrames >

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525096#comment-14525096 ] haiyang commented on SPARK-7149: If we give no alias to a function in project,the SqlParse

[jira] [Updated] (SPARK-7319) Improve the output from DataFrame.show()

2015-05-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7319: --- Labels: starter (was: ) > Improve the output from DataFrame.show() >

[jira] [Created] (SPARK-7319) Improve the output from DataFrame.show()

2015-05-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7319: -- Summary: Improve the output from DataFrame.show() Key: SPARK-7319 URL: https://issues.apache.org/jira/browse/SPARK-7319 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-6986) Makes SparkSqlSerializer2 support sort-based shuffle with sort merge

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525070#comment-14525070 ] Apache Spark commented on SPARK-6986: - User 'yhuai' has created a pull request for thi

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525065#comment-14525065 ] Apache Spark commented on SPARK-7149: - User 'haiyangsea' has created a pull request fo

[jira] [Assigned] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7149: --- Assignee: (was: Apache Spark) > Defalt system alias problem > ---

[jira] [Assigned] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7149: --- Assignee: Apache Spark > Defalt system alias problem > --- > >

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the pars

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the pars

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the pars

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the pars

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the pars

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the pars

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the pars

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the pars

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the pars

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525063#comment-14525063 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a func

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the pars

[jira] [Issue Comment Deleted] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Comment: was deleted (was: This is SqlParser problem,when we give no alias to a function in project, the pars

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525062#comment-14525062 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a func

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525054#comment-14525054 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a func

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525061#comment-14525061 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a func

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525057#comment-14525057 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a func

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525059#comment-14525059 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a func

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525056#comment-14525056 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a func

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525055#comment-14525055 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a func

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525058#comment-14525058 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a func

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525060#comment-14525060 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a func

[jira] [Commented] (SPARK-7318) DStream isn't cleaning closures correctly

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525052#comment-14525052 ] Apache Spark commented on SPARK-7318: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-7318) DStream isn't cleaning closures correctly

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7318: --- Assignee: Andrew Or (was: Apache Spark) > DStream isn't cleaning closures correctly > --

[jira] [Assigned] (SPARK-7318) DStream isn't cleaning closures correctly

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7318: --- Assignee: Apache Spark (was: Andrew Or) > DStream isn't cleaning closures correctly > --

[jira] [Commented] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525051#comment-14525051 ] haiyang commented on SPARK-7149: This is SqlParser problem,when we give no alias to a func

[jira] [Updated] (SPARK-7318) DStream isn't cleaning closures correctly

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7318: - Description: {code} def transform[U: ClassTag](transformFunc: RDD[T] => RDD[U]): DStream[U] = { tran

[jira] [Created] (SPARK-7318) DStream isn't cleaning closures correctly

2015-05-01 Thread Andrew Or (JIRA)
Andrew Or created SPARK-7318: Summary: DStream isn't cleaning closures correctly Key: SPARK-7318 URL: https://issues.apache.org/jira/browse/SPARK-7318 Project: Spark Issue Type: Bug Com

[jira] [Updated] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Description: Fix default system alias problem. execute the sql statement will cause problem: select substr(

[jira] [Updated] (SPARK-7149) Defalt system alias problem

2015-05-01 Thread haiyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyang updated SPARK-7149: --- Description: Fix default system alias problem. execute the sql statement will cause problem: select substr(

[jira] [Resolved] (SPARK-7317) ShuffleHandle needs to be exposed

2015-05-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7317. Resolution: Fixed Fix Version/s: 1.4.0 > ShuffleHandle needs to be exposed >

[jira] [Commented] (SPARK-7242) Frequent items for DataFrames

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524575#comment-14524575 ] Apache Spark commented on SPARK-7242: - User 'brkyvz' has created a pull request for th

[jira] [Commented] (SPARK-7113) Add the direct stream related information to the streaming listener and web UI

2015-05-01 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524536#comment-14524536 ] Saisai Shao commented on SPARK-7113: Yes, I will do it. Thanks a lot :). > Add the di

[jira] [Assigned] (SPARK-7241) Pearson correlation for DataFrames

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7241: --- Assignee: Apache Spark (was: Burak Yavuz) > Pearson correlation for DataFrames > ---

[jira] [Assigned] (SPARK-7241) Pearson correlation for DataFrames

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7241: --- Assignee: Burak Yavuz (was: Apache Spark) > Pearson correlation for DataFrames > ---

[jira] [Commented] (SPARK-7241) Pearson correlation for DataFrames

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524489#comment-14524489 ] Apache Spark commented on SPARK-7241: - User 'brkyvz' has created a pull request for th

[jira] [Assigned] (SPARK-7317) ShuffleHandle needs to be exposed

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7317: --- Assignee: Mridul Muralidharan (was: Apache Spark) > ShuffleHandle needs to be exposed >

[jira] [Commented] (SPARK-7317) ShuffleHandle needs to be exposed

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524469#comment-14524469 ] Apache Spark commented on SPARK-7317: - User 'mridulm' has created a pull request for t

[jira] [Assigned] (SPARK-7317) ShuffleHandle needs to be exposed

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7317: --- Assignee: Apache Spark (was: Mridul Muralidharan) > ShuffleHandle needs to be exposed >

[jira] [Commented] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524466#comment-14524466 ] Apache Spark commented on SPARK-6954: - User 'sryza' has created a pull request for thi

[jira] [Created] (SPARK-7317) ShuffleHandle needs to be exposed

2015-05-01 Thread Mridul Muralidharan (JIRA)
Mridul Muralidharan created SPARK-7317: -- Summary: ShuffleHandle needs to be exposed Key: SPARK-7317 URL: https://issues.apache.org/jira/browse/SPARK-7317 Project: Spark Issue Type: Impro

[jira] [Resolved] (SPARK-6229) Support SASL encryption in network/common module

2015-05-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6229. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Marcelo Vanzin > Support SASL encry

[jira] [Updated] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2691: - Assignee: (was: Timothy Chen) > Allow Spark on Mesos to be launched with Docker >

[jira] [Closed] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2691. Resolution: Fixed Fix Version/s: 1.4.0 > Allow Spark on Mesos to be launched with Docker > --

[jira] [Updated] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2691: - Assignee: Chris Heller > Allow Spark on Mesos to be launched with Docker > ---

[jira] [Updated] (SPARK-7216) Show driver details in Mesos cluster UI

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7216: - Affects Version/s: 1.4.0 > Show driver details in Mesos cluster UI > -

[jira] [Closed] (SPARK-7216) Show driver details in Mesos cluster UI

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7216. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Timothy Chen Target Version/s:

[jira] [Closed] (SPARK-6443) Support HA in standalone cluster mode

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-6443. Resolution: Fixed Fix Version/s: 1.4.0 Target Version/s: 1.4.0 > Support HA in standalone c

[jira] [Updated] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6954: - Labels: backport-needed yarn (was: yarn) > ExecutorAllocationManager can end up requesting a negative num

[jira] [Updated] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6954: - Target Version/s: 1.3.2, 1.4.0 (was: 1.3.1, 1.4.0) > ExecutorAllocationManager can end up requesting a ne

[jira] [Reopened] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-6954: -- > ExecutorAllocationManager can end up requesting a negative number of executors > -

[jira] [Closed] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-6954. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Sandy Ryza (was: Cheolsoo Park)

[jira] [Updated] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

2015-05-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6954: - Target Version/s: 1.3.1, 1.4.0 (was: 1.4.0) > ExecutorAllocationManager can end up requesting a negative

[jira] [Resolved] (SPARK-7260) Support changing Spark's log level programatically

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7260. Resolution: Duplicate > Support changing Spark's log level programatically > ---

[jira] [Resolved] (SPARK-3444) Provide a way to easily change the log level in the Spark shell while running

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3444. Resolution: Fixed Fix Version/s: 1.4.0 > Provide a way to easily change the log level

[jira] [Resolved] (SPARK-2808) update kafka to version 0.8.2

2015-05-01 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-2808. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Cody Koeninger > update kafka t

[jira] [Commented] (SPARK-7113) Add the direct stream related information to the streaming listener and web UI

2015-05-01 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524408#comment-14524408 ] Tathagata Das commented on SPARK-7113: -- [~jerryshao] Since this other sub task is don

[jira] [Resolved] (SPARK-7112) Add InputInfoTracker to have a generic way to track input data rates for all input streams.

2015-05-01 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7112. -- Resolution: Fixed > Add InputInfoTracker to have a generic way to track input data rates for all

[jira] [Resolved] (SPARK-7309) Shutdown the thread pools in ReceivedBlockHandler and DAGScheduler

2015-05-01 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7309. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Shixiong Zhu > Shutdown the thr

[jira] [Resolved] (SPARK-6999) infinite recursion with createDataFrame(JavaRDD[Row], java.util.List[String])

2015-05-01 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-6999. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5804 [https://github.

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFoundException with Kryo, Guava 14

2015-05-01 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524372#comment-14524372 ] Russell Alexander Spitzer commented on SPARK-6069: -- Running with --conf s

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFoundException with Kryo, Guava 14

2015-05-01 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524363#comment-14524363 ] Russell Alexander Spitzer commented on SPARK-6069: -- We've seen the same i

[jira] [Updated] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7304: --- Assignee: Rajendra > Include $@ in call to mvn in make-distribution.sh > -

[jira] [Resolved] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7304. Resolution: Fixed Fix Version/s: 1.4.0 > Include $@ in call to mvn in make-distributi

[jira] [Resolved] (SPARK-7312) SPARK-6913 broke jdk6 build

2015-05-01 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7312. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5847 [https:/

[jira] [Assigned] (SPARK-7316) Add step capability to RDD sliding window

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7316: --- Assignee: Apache Spark > Add step capability to RDD sliding window >

[jira] [Assigned] (SPARK-7316) Add step capability to RDD sliding window

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7316: --- Assignee: (was: Apache Spark) > Add step capability to RDD sliding window > -

[jira] [Commented] (SPARK-7316) Add step capability to RDD sliding window

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524309#comment-14524309 ] Apache Spark commented on SPARK-7316: - User 'avulanov' has created a pull request for

[jira] [Created] (SPARK-7316) Add step capability to RDD sliding window

2015-05-01 Thread Alexander Ulanov (JIRA)
Alexander Ulanov created SPARK-7316: --- Summary: Add step capability to RDD sliding window Key: SPARK-7316 URL: https://issues.apache.org/jira/browse/SPARK-7316 Project: Spark Issue Type: Imp

[jira] [Assigned] (SPARK-7315) Flaky Test: WriteAheadLogBackedBlockRDDSuite

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7315: --- Assignee: Apache Spark (was: Tathagata Das) > Flaky Test: WriteAheadLogBackedBlockRDDSuite >

[jira] [Assigned] (SPARK-7315) Flaky Test: WriteAheadLogBackedBlockRDDSuite

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7315: --- Assignee: Tathagata Das (was: Apache Spark) > Flaky Test: WriteAheadLogBackedBlockRDDSuite >

[jira] [Commented] (SPARK-7315) Flaky Test: WriteAheadLogBackedBlockRDDSuite

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524252#comment-14524252 ] Apache Spark commented on SPARK-7315: - User 'tdas' has created a pull request for this

[jira] [Created] (SPARK-7315) Flaky Test: WriteAheadLogBackedBlockRDDSuite

2015-05-01 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-7315: Summary: Flaky Test: WriteAheadLogBackedBlockRDDSuite Key: SPARK-7315 URL: https://issues.apache.org/jira/browse/SPARK-7315 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6166: --- Assignee: Apache Spark > Add config to limit number of concurrent outbound connections for sh

[jira] [Assigned] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6166: --- Assignee: (was: Apache Spark) > Add config to limit number of concurrent outbound connect

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524205#comment-14524205 ] Apache Spark commented on SPARK-6166: - User 'mridulm' has created a pull request for t

[jira] [Commented] (SPARK-6907) Create an isolated classloader for the Hive Client.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524161#comment-14524161 ] Apache Spark commented on SPARK-6907: - User 'marmbrus' has created a pull request for

[jira] [Assigned] (SPARK-6907) Create an isolated classloader for the Hive Client.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6907: --- Assignee: Michael Armbrust (was: Apache Spark) > Create an isolated classloader for the Hive

[jira] [Assigned] (SPARK-6907) Create an isolated classloader for the Hive Client.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6907: --- Assignee: Apache Spark (was: Michael Armbrust) > Create an isolated classloader for the Hive

[jira] [Assigned] (SPARK-7314) Upgrade Pyrolite with patches

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7314: --- Assignee: Xiangrui Meng (was: Apache Spark) > Upgrade Pyrolite with patches > --

[jira] [Commented] (SPARK-7314) Upgrade Pyrolite with patches

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524130#comment-14524130 ] Apache Spark commented on SPARK-7314: - User 'mengxr' has created a pull request for th

[jira] [Assigned] (SPARK-7314) Upgrade Pyrolite with patches

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7314: --- Assignee: Apache Spark (was: Xiangrui Meng) > Upgrade Pyrolite with patches > --

[jira] [Commented] (SPARK-6368) Build a specialized serializer for Exchange operator.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524117#comment-14524117 ] Apache Spark commented on SPARK-6368: - User 'yhuai' has created a pull request for thi

[jira] [Assigned] (SPARK-7313) Allow for configuring max_samples in range partitioner.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7313: --- Assignee: Apache Spark (was: Mridul Muralidharan) > Allow for configuring max_samples in ran

[jira] [Commented] (SPARK-7313) Allow for configuring max_samples in range partitioner.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524105#comment-14524105 ] Apache Spark commented on SPARK-7313: - User 'mridulm' has created a pull request for t

[jira] [Assigned] (SPARK-7313) Allow for configuring max_samples in range partitioner.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7313: --- Assignee: Mridul Muralidharan (was: Apache Spark) > Allow for configuring max_samples in ran

[jira] [Created] (SPARK-7314) Upgrade Pyrolite with patches

2015-05-01 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7314: Summary: Upgrade Pyrolite with patches Key: SPARK-7314 URL: https://issues.apache.org/jira/browse/SPARK-7314 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-7313) Allow for configuring max_samples in range partitioner.

2015-05-01 Thread Mridul Muralidharan (JIRA)
Mridul Muralidharan created SPARK-7313: -- Summary: Allow for configuring max_samples in range partitioner. Key: SPARK-7313 URL: https://issues.apache.org/jira/browse/SPARK-7313 Project: Spark

[jira] [Commented] (SPARK-7312) SPARK-6913 broke jdk6 build

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524070#comment-14524070 ] Apache Spark commented on SPARK-7312: - User 'yhuai' has created a pull request for thi

  1   2   3   >