[jira] [Comment Edited] (SPARK-27220) Remove Yarn specific leftover from CoarseGrainedSchedulerBackend

2019-04-02 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808011#comment-16808011 ] Jacek Lewandowski edited comment on SPARK-27220 at 4/2/19 7:52 PM: ---

[jira] [Commented] (SPARK-27220) Remove Yarn specific leftover from CoarseGrainedSchedulerBackend

2019-04-02 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808011#comment-16808011 ] Jacek Lewandowski commented on SPARK-27220: --- Thank you [~irashid]. It is not a custom fork

[jira] [Commented] (SPARK-27220) Remove Yarn specific leftover from CoarseGrainedSchedulerBackend

2019-04-02 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807434#comment-16807434 ] Jacek Lewandowski commented on SPARK-27220: --- I know it looks very minor, but in our case it is

[jira] [Updated] (SPARK-27220) Remove Yarn specific leftover from CoarseGrainedSchedulerBackend

2019-03-20 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-27220: -- Description: {{CoarseGrainedSchedulerBackend}} has the following field: {code:scala}

[jira] [Created] (SPARK-27220) Remove Yarn specific leftover from CoarseGrainedSchedulerBackend

2019-03-20 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-27220: - Summary: Remove Yarn specific leftover from CoarseGrainedSchedulerBackend Key: SPARK-27220 URL: https://issues.apache.org/jira/browse/SPARK-27220 Project:

[jira] [Created] (SPARK-19367) Hive metastore temporary configuration doesn't specify default filesystem

2017-01-26 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-19367: - Summary: Hive metastore temporary configuration doesn't specify default filesystem Key: SPARK-19367 URL: https://issues.apache.org/jira/browse/SPARK-19367

[jira] [Commented] (SPARK-13331) AES support for over-the-wire encryption

2017-01-10 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816350#comment-15816350 ] Jacek Lewandowski commented on SPARK-13331: --- I wonder where those changes is going to end up.

[jira] [Comment Edited] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

2016-08-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15444942#comment-15444942 ] Jacek Lewandowski edited comment on SPARK-13117 at 8/29/16 6:18 AM:

[jira] [Reopened] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

2016-08-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski reopened SPARK-13117: --- The provided solution is wrong because it is inconsistent with the rest of Spark. In

[jira] [Commented] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

2016-07-14 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377892#comment-15377892 ] Jacek Lewandowski commented on SPARK-16528: --- so it won't be available in 2.0.0 ? it hasn't been

[jira] [Commented] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

2016-07-13 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376323#comment-15376323 ] Jacek Lewandowski commented on SPARK-16528: --- Ok, I'll fix it today > HiveClientImpl throws NPE

[jira] [Created] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

2016-07-13 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-16528: - Summary: HiveClientImpl throws NPE when reading database from a custom metastore Key: SPARK-16528 URL: https://issues.apache.org/jira/browse/SPARK-16528

[jira] [Comment Edited] (SPARK-11326) Support for authentication and encryption in standalone mode

2015-11-23 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021848#comment-15021848 ] Jacek Lewandowski edited comment on SPARK-11326 at 11/23/15 9:41 AM: -

[jira] [Commented] (SPARK-11326) Support for authentication and encryption in standalone mode

2015-11-23 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021848#comment-15021848 ] Jacek Lewandowski commented on SPARK-11326: --- [~pwendell] - are you interested in reviewing this

[jira] [Created] (SPARK-11882) Allow for running Spark applications against a custom coarse grained scheduler

2015-11-20 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-11882: - Summary: Allow for running Spark applications against a custom coarse grained scheduler Key: SPARK-11882 URL: https://issues.apache.org/jira/browse/SPARK-11882

[jira] [Commented] (SPARK-11726) Legacy Netty-RPC based submission in standalone mode does not work

2015-11-17 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010238#comment-15010238 ] Jacek Lewandowski commented on SPARK-11726: --- btw [~andrewor14] - you messed assignee ;) >

[jira] [Commented] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

2015-11-13 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003879#comment-15003879 ] Jacek Lewandowski commented on SPARK-11617: --- This also happens in standalone mode, Netty based

[jira] [Created] (SPARK-11726) Legacy Netty-RPC based submission in standalone mode does not work

2015-11-13 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-11726: - Summary: Legacy Netty-RPC based submission in standalone mode does not work Key: SPARK-11726 URL: https://issues.apache.org/jira/browse/SPARK-11726

[jira] [Updated] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-12 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-11707: -- Description: When authentication (and encryption) is enabled (at least in standalone

[jira] [Updated] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-12 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-11707: -- Description: When authentication is enabled (at least in standalone mode), the

[jira] [Created] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-12 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-11707: - Summary: StreamCorruptedException if authentication is enabled Key: SPARK-11707 URL: https://issues.apache.org/jira/browse/SPARK-11707 Project: Spark

[jira] [Commented] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-12 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003585#comment-15003585 ] Jacek Lewandowski commented on SPARK-11707: --- Some more info: {noformat} scala> val x =

[jira] [Commented] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-12 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003564#comment-15003564 ] Jacek Lewandowski commented on SPARK-11707: --- I simply expect that the code which works fine

[jira] [Commented] (SPARK-11326) Support for authentication and encryption in standalone mode

2015-11-11 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001727#comment-15001727 ] Jacek Lewandowski commented on SPARK-11326: --- [~pwendell] this leverage the current Spark

[jira] [Updated] (SPARK-11326) Support for authentication and encryption in standalone mode

2015-11-09 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-11326: -- Description: h3.The idea Currently, in standalone mode, all components, for all

[jira] [Updated] (SPARK-11326) Support for authentication and encryption in standalone mode

2015-11-09 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-11326: -- Summary: Support for authentication and encryption in standalone mode (was: Split

[jira] [Commented] (SPARK-11326) Split networking in standalone mode

2015-11-05 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992477#comment-14992477 ] Jacek Lewandowski commented on SPARK-11326: --- [~markhamstra] fyi - it is designed in the way

[jira] [Commented] (SPARK-11326) Split networking in standalone mode

2015-11-05 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992425#comment-14992425 ] Jacek Lewandowski commented on SPARK-11326: --- [~vanzin] of course, this does not add much

[jira] [Comment Edited] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982030#comment-14982030 ] Jacek Lewandowski edited comment on SPARK-11402 at 10/30/15 7:18 AM: -

[jira] [Commented] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982030#comment-14982030 ] Jacek Lewandowski commented on SPARK-11402: --- That's right, this is not only introduction of

[jira] [Comment Edited] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982030#comment-14982030 ] Jacek Lewandowski edited comment on SPARK-11402 at 10/30/15 8:04 AM: -

[jira] [Commented] (SPARK-11326) Split networking in standalone mode

2015-10-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982544#comment-14982544 ] Jacek Lewandowski commented on SPARK-11326: --- Working on tests and docs > Split networking in

[jira] [Updated] (SPARK-11326) Split networking in standalone mode

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-11326: -- Description: h3.The idea Currently, in standalone mode, all components, for all

[jira] [Commented] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980454#comment-14980454 ] Jacek Lewandowski commented on SPARK-11402: --- I'm not sure if I get what do you mean. Do you

[jira] [Created] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-29 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-11402: - Summary: Allow to define a custom driver runner and executor runner Key: SPARK-11402 URL: https://issues.apache.org/jira/browse/SPARK-11402 Project: Spark

[jira] [Commented] (SPARK-11326) Split networking in standalone mode

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980383#comment-14980383 ] Jacek Lewandowski commented on SPARK-11326: --- [~vanzin] I'll really appreciate if you can take a

[jira] [Commented] (SPARK-6373) Add SSL/TLS for the Netty based BlockTransferService

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980508#comment-14980508 ] Jacek Lewandowski commented on SPARK-6373: -- [~turp1twin] so are you going to continue working on

[jira] [Commented] (SPARK-11140) Replace file server in driver with RPC-based alternative

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980526#comment-14980526 ] Jacek Lewandowski commented on SPARK-11140: --- [~vanzin] it would be better to use SSL key-pair

[jira] [Commented] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981170#comment-14981170 ] Jacek Lewandowski commented on SPARK-11402: --- [~CodingCat] for example environment, command line

[jira] [Created] (SPARK-11344) ApplicationDescription should be immutable case class

2015-10-27 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-11344: - Summary: ApplicationDescription should be immutable case class Key: SPARK-11344 URL: https://issues.apache.org/jira/browse/SPARK-11344 Project: Spark

[jira] [Commented] (SPARK-11344) ApplicationDescription should be immutable case class

2015-10-27 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976250#comment-14976250 ] Jacek Lewandowski commented on SPARK-11344: --- [~srowen] I was going to update it, but something

[jira] [Created] (SPARK-11326) Split networking in standalone mode

2015-10-26 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-11326: - Summary: Split networking in standalone mode Key: SPARK-11326 URL: https://issues.apache.org/jira/browse/SPARK-11326 Project: Spark Issue Type:

[jira] [Commented] (SPARK-6363) make scala 2.11 default language

2015-09-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14937708#comment-14937708 ] Jacek Lewandowski commented on SPARK-6363: -- So what? > make scala 2.11 default language >

[jira] [Commented] (SPARK-6028) Provide an alternative RPC implementation based on the network transport module

2015-09-17 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14802968#comment-14802968 ] Jacek Lewandowski commented on SPARK-6028: -- Hey - what's the estimated date of delivery of this

[jira] [Commented] (SPARK-8562) Annoying messages about executor lost after stopping SparkContext

2015-06-23 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597581#comment-14597581 ] Jacek Lewandowski commented on SPARK-8562: -- [~vanzin] could you please take a

[jira] [Created] (SPARK-8562) Annoying messages about executor lost after stopping SparkContext

2015-06-23 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-8562: Summary: Annoying messages about executor lost after stopping SparkContext Key: SPARK-8562 URL: https://issues.apache.org/jira/browse/SPARK-8562 Project:

[jira] [Commented] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-06-19 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593165#comment-14593165 ] Jacek Lewandowski commented on SPARK-7169: -- [~vanzin] its fix version is set to

[jira] [Created] (SPARK-7436) Cannot implement nor use custom StandaloneRecoveryModeFactory implementations

2015-05-07 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-7436: Summary: Cannot implement nor use custom StandaloneRecoveryModeFactory implementations Key: SPARK-7436 URL: https://issues.apache.org/jira/browse/SPARK-7436

[jira] [Updated] (SPARK-7436) Cannot implement nor use custom StandaloneRecoveryModeFactory implementations

2015-05-07 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-7436: - Description: At least, this code fragment is buggy ({{Master.scala}}): {code} case

[jira] [Commented] (SPARK-7436) Cannot implement nor use custom StandaloneRecoveryModeFactory implementations

2015-05-07 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533007#comment-14533007 ] Jacek Lewandowski commented on SPARK-7436: -- [~joshrosen] It is awaiting the

[jira] [Updated] (SPARK-7171) Allow for more flexible use of metric sources

2015-04-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-7171: - Description: With the current API, the user is allowed to add a custom metric source by

[jira] [Commented] (SPARK-7171) Allow for more flexible use of metric sources

2015-04-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521131#comment-14521131 ] Jacek Lewandowski commented on SPARK-7171: --

[jira] [Commented] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519983#comment-14519983 ] Jacek Lewandowski commented on SPARK-7169: -- [~jerryshao] unfortunately you are

[jira] [Commented] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520170#comment-14520170 ] Jacek Lewandowski commented on SPARK-7169: --

[jira] [Comment Edited] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520170#comment-14520170 ] Jacek Lewandowski edited comment on SPARK-7169 at 4/29/15 8:33 PM:

[jira] [Closed] (SPARK-7170) Allow to add register SparkListener specified in SparkConf

2015-04-29 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski closed SPARK-7170. Resolution: Duplicate I found that this is already implemented. I don't know how I could

[jira] [Commented] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-27 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514334#comment-14514334 ] Jacek Lewandowski commented on SPARK-7169: -- Ok, thanks [~srowen] Allow to

[jira] [Commented] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-27 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514282#comment-14514282 ] Jacek Lewandowski commented on SPARK-7169: -- I'd like to start working on this,

[jira] [Created] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-27 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-7169: Summary: Allow to specify metrics configuration more flexibly Key: SPARK-7169 URL: https://issues.apache.org/jira/browse/SPARK-7169 Project: Spark

[jira] [Created] (SPARK-7171) Allow for more flexible use of metric sources

2015-04-27 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-7171: Summary: Allow for more flexible use of metric sources Key: SPARK-7171 URL: https://issues.apache.org/jira/browse/SPARK-7171 Project: Spark Issue

[jira] [Commented] (SPARK-7172) Worker includes ExecutorRunner and DriverRunner in Akka messages

2015-04-27 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514460#comment-14514460 ] Jacek Lewandowski commented on SPARK-7172: -- [~srowen] sorry, just followed

[jira] [Created] (SPARK-7172) Worker includes ExecutorRunner and DriverRunner in Akka messages

2015-04-27 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-7172: Summary: Worker includes ExecutorRunner and DriverRunner in Akka messages Key: SPARK-7172 URL: https://issues.apache.org/jira/browse/SPARK-7172 Project:

[jira] [Updated] (SPARK-7172) Worker includes ExecutorRunner and DriverRunner in Akka messages

2015-04-27 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-7172: - Issue Type: Improvement (was: Bug) Worker includes ExecutorRunner and DriverRunner in

[jira] [Commented] (SPARK-3266) JavaDoubleRDD doesn't contain max()

2015-03-25 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14380915#comment-14380915 ] Jacek Lewandowski commented on SPARK-3266: -- Thanks a lot [~joshrosen], really

[jira] [Commented] (SPARK-3266) JavaDoubleRDD doesn't contain max()

2015-03-22 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14374859#comment-14374859 ] Jacek Lewandowski commented on SPARK-3266: -- [~joshrosen] it would be awesome to

[jira] [Commented] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-16 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14323354#comment-14323354 ] Jacek Lewandowski commented on SPARK-5548: -- :( Flaky test:

[jira] [Commented] (SPARK-5745) Allow to use custom TaskMetrics implementation

2015-02-16 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322594#comment-14322594 ] Jacek Lewandowski commented on SPARK-5745: -- Thanks [~pwendell] for your reply.

[jira] [Created] (SPARK-5745) Allow to use custom TaskMetrics implementation

2015-02-11 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-5745: Summary: Allow to use custom TaskMetrics implementation Key: SPARK-5745 URL: https://issues.apache.org/jira/browse/SPARK-5745 Project: Spark Issue

[jira] [Updated] (SPARK-5745) Allow to use custom TaskMetrics implementation

2015-02-11 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5745: - Description: There can be various RDDs implemented and the {{TaskMetrics}} provides a

[jira] [Commented] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-03 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303252#comment-14303252 ] Jacek Lewandowski commented on SPARK-5548: -- I tried also on ubuntu with Java 7 -

[jira] [Commented] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-03 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303648#comment-14303648 ] Jacek Lewandowski commented on SPARK-5548: -- Java 6 test passed... except kinesis

[jira] [Commented] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-03 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303953#comment-14303953 ] Jacek Lewandowski commented on SPARK-5548: -- You are absolutely right

[jira] [Commented] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-03 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303921#comment-14303921 ] Jacek Lewandowski commented on SPARK-5548: -- I'll definitely check it. However I

[jira] [Commented] (SPARK-5524) Remove messy dependencies to log4j

2015-02-02 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301124#comment-14301124 ] Jacek Lewandowski commented on SPARK-5524: -- [~srowen] thanks for reply. I meant

[jira] [Updated] (SPARK-5524) Remove messy dependencies to log4j

2015-02-02 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5524: - Issue Type: Task (was: Bug) Remove messy dependencies to log4j

[jira] [Commented] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-02 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302888#comment-14302888 ] Jacek Lewandowski commented on SPARK-5548: -- This test passes on my laptop (OSX).

[jira] [Created] (SPARK-5524) Remove messy dependencies to log4j

2015-02-02 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-5524: Summary: Remove messy dependencies to log4j Key: SPARK-5524 URL: https://issues.apache.org/jira/browse/SPARK-5524 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-5425) ConcurrentModificationException during SparkConf creation

2015-01-27 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-5425: Summary: ConcurrentModificationException during SparkConf creation Key: SPARK-5425 URL: https://issues.apache.org/jira/browse/SPARK-5425 Project: Spark

[jira] [Updated] (SPARK-5425) ConcurrentModificationException during SparkConf creation

2015-01-27 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5425: - Description: This fragment of code: {code} if (loadDefaults) { // Load any spark.*

[jira] [Commented] (SPARK-5425) ConcurrentModificationException during SparkConf creation

2015-01-27 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293424#comment-14293424 ] Jacek Lewandowski commented on SPARK-5425: -- [~joshrosen] can you take a look?

[jira] [Updated] (SPARK-5382) Scripts do not use SPARK_CONF_DIR where they should

2015-01-27 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5382: - Fix Version/s: 1.2.1 1.3.0 Scripts do not use SPARK_CONF_DIR where

[jira] [Updated] (SPARK-5408) MaxPermSize is ignored by ExecutorRunner and DriverRunner

2015-01-26 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5408: - Summary: MaxPermSize is ignored by ExecutorRunner and DriverRunner (was: MaxPermGen is

[jira] [Updated] (SPARK-5408) MaxPermSize is ignored by ExecutorRunner and DriverRunner

2015-01-26 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5408: - Description: ExecutorRunner and DriverRunner uses CommandUtils to build the command which

[jira] [Commented] (SPARK-5408) MaxPermSize is ignored by ExecutorRunner and DriverRunner

2015-01-26 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291585#comment-14291585 ] Jacek Lewandowski commented on SPARK-5408: -- Can anybody take a look?

[jira] [Created] (SPARK-5408) MaxPermGen is ignored by ExecutorRunner and DriverRunner

2015-01-26 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-5408: Summary: MaxPermGen is ignored by ExecutorRunner and DriverRunner Key: SPARK-5408 URL: https://issues.apache.org/jira/browse/SPARK-5408 Project: Spark

[jira] [Updated] (SPARK-5408) MaxPermSize is ignored by ExecutorRunner and DriverRunner

2015-01-26 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5408: - Fix Version/s: 1.2.1 1.3.0 MaxPermSize is ignored by ExecutorRunner

[jira] [Resolved] (SPARK-5382) Scripts do not use SPARK_CONF_DIR where they should

2015-01-25 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski resolved SPARK-5382. -- Resolution: Fixed Scripts do not use SPARK_CONF_DIR where they should

[jira] [Updated] (SPARK-5382) Scripts do not use SPARK_CONF_DIR where they should

2015-01-23 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5382: - Target Version/s: 1.3.0, 1.2.1 (was: 1.2.1) Affects Version/s: 1.3.0 Scripts do

[jira] [Commented] (SPARK-5382) Scripts do not use SPARK_CONF_DIR where they should

2015-01-23 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289060#comment-14289060 ] Jacek Lewandowski commented on SPARK-5382: --

[jira] [Issue Comment Deleted] (SPARK-5382) Scripts do not use SPARK_CONF_DIR where they should

2015-01-23 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-5382: - Comment: was deleted (was: https://github.com/apache/spark/pull/4177) Scripts do not

[jira] [Created] (SPARK-5382) Scripts do not use SPARK_CONF_DIR where they should

2015-01-23 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-5382: Summary: Scripts do not use SPARK_CONF_DIR where they should Key: SPARK-5382 URL: https://issues.apache.org/jira/browse/SPARK-5382 Project: Spark

[jira] [Commented] (SPARK-5382) Scripts do not use SPARK_CONF_DIR where they should

2015-01-23 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289067#comment-14289067 ] Jacek Lewandowski commented on SPARK-5382: -- [~joshrosen] is it something which

[jira] [Commented] (SPARK-4660) JavaSerializer uses wrong classloader

2015-01-19 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283454#comment-14283454 ] Jacek Lewandowski commented on SPARK-4660: -- Pull requests for 1.2 and master

[jira] [Created] (SPARK-3883) Provide SSL support for Akka and HttpServer based connections

2014-10-09 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-3883: Summary: Provide SSL support for Akka and HttpServer based connections Key: SPARK-3883 URL: https://issues.apache.org/jira/browse/SPARK-3883 Project: Spark

[jira] [Commented] (SPARK-3883) Provide SSL support for Akka and HttpServer based connections

2014-10-09 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14165986#comment-14165986 ] Jacek Lewandowski commented on SPARK-3883: --

[jira] [Created] (SPARK-3009) ApplicationInfo doesn't get initialised after deserialisation during recovery

2014-08-13 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-3009: Summary: ApplicationInfo doesn't get initialised after deserialisation during recovery Key: SPARK-3009 URL: https://issues.apache.org/jira/browse/SPARK-3009

[jira] [Commented] (SPARK-3009) ApplicationInfo doesn't get initialised after deserialisation during recovery

2014-08-13 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095483#comment-14095483 ] Jacek Lewandowski commented on SPARK-3009: -- [~andrewor14] could you review it