[jira] [Created] (SPARK-11166) HIVE ON SPARK : yarn-cluster mode , if memory is busy,have no enough resource. app wil failed

2015-10-17 Thread yindu_asan (JIRA)
yindu_asan created SPARK-11166: -- Summary: HIVE ON SPARK : yarn-cluster mode , if memory is busy,have no enough resource. app wil failed Key: SPARK-11166 URL: https://issues.apache.org/jira/browse/SPARK-11166

[jira] [Updated] (SPARK-11166) HIVE ON SPARK : yarn-cluster mode , if memory is busy,have no enough resource. app wil failed

2015-10-17 Thread yindu_asan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yindu_asan updated SPARK-11166: --- Labels: test (was: ) > HIVE ON SPARK : yarn-cluster mode , if memory is busy,have no enough > res

[jira] [Created] (SPARK-11167) Incorrect type resolution on heterogeneous data structures

2015-10-17 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-11167: -- Summary: Incorrect type resolution on heterogeneous data structures Key: SPARK-11167 URL: https://issues.apache.org/jira/browse/SPARK-11167 Project: Spark

[jira] [Commented] (SPARK-11147) HTTP 500 if try to access Spark UI in yarn-cluster

2015-10-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961959#comment-14961959 ] Steve Loughran commented on SPARK-11147: looks like the RM proxy is having the co

[jira] [Resolved] (SPARK-11029) Add computeCost to KMeansModel in spark.ml

2015-10-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11029. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9073 [ht

[jira] [Updated] (SPARK-9963) ML RandomForest cleanup: Move predictNodeIndex to LearningNode

2015-10-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9963: - Assignee: Luvsandondov Lkhamsuren > ML RandomForest cleanup: Move predictNodeIndex to Lear

[jira] [Updated] (SPARK-9963) ML RandomForest cleanup: Move predictNodeIndex to LearningNode

2015-10-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9963: - Target Version/s: 1.6.0 > ML RandomForest cleanup: Move predictNodeIndex to LearningNode >

[jira] [Resolved] (SPARK-9963) ML RandomForest cleanup: Move predictNodeIndex to LearningNode

2015-10-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9963. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8609 [https

[jira] [Resolved] (SPARK-11166) HIVE ON SPARK : yarn-cluster mode , if memory is busy,have no enough resource. app wil failed

2015-10-17 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11166. Resolution: Invalid That's not a bug, that's a configuration problem in your cluster and /

[jira] [Commented] (SPARK-11147) HTTP 500 if try to access Spark UI in yarn-cluster

2015-10-17 Thread Sebastian YEPES FERNANDEZ (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962043#comment-14962043 ] Sebastian YEPES FERNANDEZ commented on SPARK-11147: --- ​ Ok I have found

[jira] [Updated] (SPARK-11147) HTTP 500 if try to access Spark UI in yarn-cluster

2015-10-17 Thread Sebastian YEPES FERNANDEZ (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian YEPES FERNANDEZ updated SPARK-11147: -- Attachment: SparkUI.png > HTTP 500 if try to access Spark UI in yarn-cl

[jira] [Updated] (SPARK-11147) HTTP 500 if try to access Spark UI in yarn-cluster

2015-10-17 Thread Sebastian YEPES FERNANDEZ (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian YEPES FERNANDEZ updated SPARK-11147: -- Attachment: SparkUI.png > HTTP 500 if try to access Spark UI in yarn-cl

[jira] [Created] (SPARK-11168) Explore precise behavior of treeAggregate

2015-10-17 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11168: - Summary: Explore precise behavior of treeAggregate Key: SPARK-11168 URL: https://issues.apache.org/jira/browse/SPARK-11168 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-11165) Logging trait should be private - not DeveloperApi

2015-10-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11165. - Resolution: Fixed Fix Version/s: 1.6.0 > Logging trait should be private - not DeveloperAp

[jira] [Commented] (SPARK-11057) SQL: corr and cov for many columns

2015-10-17 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962071#comment-14962071 ] Narine Kokhlikyan commented on SPARK-11057: --- Thank you for your quick response.

[jira] [Created] (SPARK-11169) Remove the extra spaces in merge script

2015-10-17 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11169: --- Summary: Remove the extra spaces in merge script Key: SPARK-11169 URL: https://issues.apache.org/jira/browse/SPARK-11169 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-11169) Remove the extra spaces in merge script

2015-10-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11169: Description: Our merge script now turns {code} [SPARK-1234][SPARK-1235][SPARK-1236][SQL] descript

[jira] [Commented] (SPARK-11169) Remove the extra spaces in merge script

2015-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962074#comment-14962074 ] Apache Spark commented on SPARK-11169: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-11169) Remove the extra spaces in merge script

2015-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11169: Assignee: Reynold Xin (was: Apache Spark) > Remove the extra spaces in merge script > ---

[jira] [Assigned] (SPARK-11169) Remove the extra spaces in merge script

2015-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11169: Assignee: Apache Spark (was: Reynold Xin) > Remove the extra spaces in merge script > ---

[jira] [Commented] (SPARK-11057) SQL: corr and cov for many columns

2015-10-17 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962085#comment-14962085 ] Narine Kokhlikyan commented on SPARK-11057: --- Thank you for you quick response [

[jira] [Created] (SPARK-11170) ​ EOFException on History server reading in progress lz4

2015-10-17 Thread Sebastian YEPES FERNANDEZ (JIRA)
Sebastian YEPES FERNANDEZ created SPARK-11170: - Summary: ​ EOFException on History server reading in progress lz4 Key: SPARK-11170 URL: https://issues.apache.org/jira/browse/SPARK-11170 Pro

[jira] [Comment Edited] (SPARK-11057) SQL: corr and cov for many columns

2015-10-17 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962085#comment-14962085 ] Narine Kokhlikyan edited comment on SPARK-11057 at 10/17/15 9:16 PM: --

[jira] [Created] (SPARK-11171) PMML for Pipelines API

2015-10-17 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11171: - Summary: PMML for Pipelines API Key: SPARK-11171 URL: https://issues.apache.org/jira/browse/SPARK-11171 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-10185) Spark SQL does not handle comma separates paths on Hadoop FileSystem

2015-10-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10185. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8416 [https://github.c

[jira] [Commented] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-10-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962093#comment-14962093 ] Davies Liu commented on SPARK-10877: Yes > Assertions fail straightforward DataFrame

[jira] [Commented] (SPARK-11170) ​ EOFException on History server reading in progress lz4

2015-10-17 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962102#comment-14962102 ] Josh Rosen commented on SPARK-11170: [~vanzin], why do we use the IO compression code

[jira] [Resolved] (SPARK-11129) Link Spark WebUI in Mesos WebUI

2015-10-17 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11129. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9135 [https://github.c

[jira] [Updated] (SPARK-11129) Link Spark WebUI in Mesos WebUI

2015-10-17 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11129: --- Assignee: Philipp Hoffmann > Link Spark WebUI in Mesos WebUI > --- > >

[jira] [Commented] (SPARK-11170) ​ EOFException on History server reading in progress lz4

2015-10-17 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962104#comment-14962104 ] Marcelo Vanzin commented on SPARK-11170: It's not enabled by default ({{spark.eve

[jira] [Commented] (SPARK-11170) ​ EOFException on History server reading in progress lz4

2015-10-17 Thread Sebastian YEPES FERNANDEZ (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962107#comment-14962107 ] Sebastian YEPES FERNANDEZ commented on SPARK-11170: --- I also tried 'spar

[jira] [Comment Edited] (SPARK-11170) ​ EOFException on History server reading in progress lz4

2015-10-17 Thread Sebastian YEPES FERNANDEZ (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962107#comment-14962107 ] Sebastian YEPES FERNANDEZ edited comment on SPARK-11170 at 10/17/15 11:06 PM: -

[jira] [Created] (SPARK-11172) Close JsonParser/Generator in test

2015-10-17 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11172: -- Summary: Close JsonParser/Generator in test Key: SPARK-11172 URL: https://issues.apache.org/jira/browse/SPARK-11172 Project: Spark Issue Type: Task Reporter:

[jira] [Assigned] (SPARK-11172) Close JsonParser/Generator in test

2015-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11172: Assignee: (was: Apache Spark) > Close JsonParser/Generator in test > -

[jira] [Commented] (SPARK-11172) Close JsonParser/Generator in test

2015-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962110#comment-14962110 ] Apache Spark commented on SPARK-11172: -- User 'tedyu' has created a pull request for

[jira] [Assigned] (SPARK-11172) Close JsonParser/Generator in test

2015-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11172: Assignee: Apache Spark > Close JsonParser/Generator in test >

[jira] [Resolved] (SPARK-11000) Derby have booted the database twice in yarn security mode.

2015-10-17 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11000. Resolution: Fixed Assignee: SaintBacchus Fix Version/s: 1.6.0 > Derby have

[jira] [Commented] (SPARK-11083) insert overwrite table failed when beeline reconnect

2015-10-17 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962140#comment-14962140 ] Weizhong commented on SPARK-11083: -- Right, this PR can fix this issue, thank you! > ins

[jira] [Commented] (SPARK-11155) Stage summary json should include stage duration

2015-10-17 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962151#comment-14962151 ] Imran Rashid commented on SPARK-11155: -- [~kayousterhout] I'm referring to the http e

[jira] [Updated] (SPARK-11155) Stage summary json should include stage duration

2015-10-17 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-11155: - Assignee: Xin Ren > Stage summary json should include stage duration > -

[jira] [Commented] (SPARK-11155) Stage summary json should include stage duration

2015-10-17 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962152#comment-14962152 ] Imran Rashid commented on SPARK-11155: -- Thanks for taking it on [~iamshrek]! I have

[jira] [Commented] (SPARK-10513) Springleaf Marketing Response

2015-10-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962160#comment-14962160 ] Yanbo Liang commented on SPARK-10513: - I agree. > Springleaf Marketing Response > --

[jira] [Commented] (SPARK-9695) Add random seed Param to ML Pipeline

2015-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962161#comment-14962161 ] Apache Spark commented on SPARK-9695: - User 'yanboliang' has created a pull request fo

[jira] [Assigned] (SPARK-9695) Add random seed Param to ML Pipeline

2015-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9695: --- Assignee: Apache Spark > Add random seed Param to ML Pipeline > -

[jira] [Assigned] (SPARK-9695) Add random seed Param to ML Pipeline

2015-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9695: --- Assignee: (was: Apache Spark) > Add random seed Param to ML Pipeline > --

[jira] [Updated] (SPARK-10185) Spark SQL does not handle comma separates paths on Hadoop FileSystem

2015-10-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10185: Assignee: Koert Kuipers > Spark SQL does not handle comma separates paths on Hadoop FileSystem > --