[jira] [Comment Edited] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623704#comment-14623704 ] Yanbo Liang edited comment on SPARK-9003 at 7/12/15 8:19 AM: -

[jira] [Commented] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623704#comment-14623704 ] Yanbo Liang commented on SPARK-9003: Yes, I can provide an example which may be

[jira] [Created] (SPARK-9006) TimestampType may loss a microsecond after a round trip in Python DataFrame

2015-07-12 Thread Davies Liu (JIRA)
Davies Liu created SPARK-9006: - Summary: TimestampType may loss a microsecond after a round trip in Python DataFrame Key: SPARK-9006 URL: https://issues.apache.org/jira/browse/SPARK-9006 Project: Spark

[jira] [Updated] (SPARK-9006) TimestampType may loss a microsecond after a round trip in Python DataFrame

2015-07-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9006: -- Description: This bug causes SQLTests.test_time_with_timezone flaky in Python 3. (was: This bug causes

[jira] [Assigned] (SPARK-9006) TimestampType may loss a microsecond after a round trip in Python DataFrame

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9006: --- Assignee: Apache Spark (was: Davies Liu) TimestampType may loss a microsecond after a

[jira] [Assigned] (SPARK-9006) TimestampType may loss a microsecond after a round trip in Python DataFrame

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9006: --- Assignee: Davies Liu (was: Apache Spark) TimestampType may loss a microsecond after a

[jira] [Commented] (SPARK-9006) TimestampType may loss a microsecond after a round trip in Python DataFrame

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624144#comment-14624144 ] Apache Spark commented on SPARK-9006: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-9007) start-slave.sh changed API in 1.4 and the documentation got updated to mention the old API

2015-07-12 Thread Jesper Lundgren (JIRA)
Jesper Lundgren created SPARK-9007: -- Summary: start-slave.sh changed API in 1.4 and the documentation got updated to mention the old API Key: SPARK-9007 URL: https://issues.apache.org/jira/browse/SPARK-9007

[jira] [Created] (SPARK-9008) Stop and remove driver from supervised mode in spark-master interface

2015-07-12 Thread Jesper Lundgren (JIRA)
Jesper Lundgren created SPARK-9008: -- Summary: Stop and remove driver from supervised mode in spark-master interface Key: SPARK-9008 URL: https://issues.apache.org/jira/browse/SPARK-9008 Project:

[jira] [Commented] (SPARK-5571) LDA should handle text as well

2015-07-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624152#comment-14624152 ] Feynman Liang commented on SPARK-5571: -- [~a...@jivesoftware.com], are you still

[jira] [Commented] (SPARK-8941) Standalone cluster worker does not accept multiple masters on launch

2015-07-12 Thread Jesper Lundgren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624151#comment-14624151 ] Jesper Lundgren commented on SPARK-8941: I've created two new JIRA tickets, can

[jira] [Updated] (SPARK-9008) Stop and remove driver from supervised mode in spark-master interface

2015-07-12 Thread Jesper Lundgren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesper Lundgren updated SPARK-9008: --- Description: The cluster will automatically restart failing drivers when launched in

[jira] [Resolved] (SPARK-9006) TimestampType may loss a microsecond after a round trip in Python DataFrame

2015-07-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9006. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7363

[jira] [Updated] (SPARK-8488) HOG Feature Transformer

2015-07-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-8488: - Description: Histogram of oriented gradients (HOG) is method utilizing local orientation

[jira] [Commented] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-07-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623956#comment-14623956 ] Josh Rosen commented on SPARK-4879: --- [~darabos], do you think that this issue might have

[jira] [Commented] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-07-12 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624000#comment-14624000 ] Daniel Darabos commented on SPARK-4879: --- Good idea! I'll try with 1.3.1 next week.

[jira] [Created] (SPARK-9005) RegressionMetrics computing incorrect explainedVariance and r2

2015-07-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9005: Summary: RegressionMetrics computing incorrect explainedVariance and r2 Key: SPARK-9005 URL: https://issues.apache.org/jira/browse/SPARK-9005 Project: Spark

[jira] [Commented] (SPARK-8941) Standalone cluster worker does not accept multiple masters on launch

2015-07-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623952#comment-14623952 ] Josh Rosen commented on SPARK-8941: --- SGTM; do you want to open a new JIRA to follow up

[jira] [Commented] (SPARK-9005) RegressionMetrics computing incorrect explainedVariance and r2

2015-07-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623944#comment-14623944 ] Feynman Liang commented on SPARK-9005: -- I will be working on this.

[jira] [Commented] (SPARK-8450) PySpark write.parquet raises Unsupported datatype DecimalType()

2015-07-12 Thread Peter Hoffmann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623999#comment-14623999 ] Peter Hoffmann commented on SPARK-8450: --- I have tried it with todays

[jira] [Commented] (SPARK-2089) With YARN, preferredNodeLocalityData isn't honored

2015-07-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624086#comment-14624086 ] Patrick Wendell commented on SPARK-2089: Yeah - we can open it again later if

[jira] [Updated] (SPARK-9005) RegressionMetrics computing incorrect explainedVariance and r2

2015-07-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9005: - Description: {{RegressionMetrics}} currently computes explainedVariance using

[jira] [Commented] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624113#comment-14624113 ] Apache Spark commented on SPARK-8743: - User 'nssalian' has created a pull request for

[jira] [Resolved] (SPARK-8880) Fix confusing Stage.attemptId member variable

2015-07-12 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-8880. --- Resolution: Fixed Fix Version/s: 1.5.0 Fix confusing Stage.attemptId member variable

[jira] [Commented] (SPARK-8956) Rollup produces incorrect result when group by contains expressions

2015-07-12 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624121#comment-14624121 ] Cheng Hao commented on SPARK-8956: -- Sorry, I didn't notice this jira issue when I created

[jira] [Updated] (SPARK-8972) Incorrect result for rollup

2015-07-12 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-8972: - Description: {code:java} import sqlContext.implicits._ case class KeyValue(key: Int, value: String) val

[jira] [Commented] (SPARK-8415) Jenkins compilation spends lots of time re-resolving dependencies and waiting to acquire Ivy cache lock

2015-07-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624058#comment-14624058 ] Josh Rosen commented on SPARK-8415: --- I figured out how to configure AMPLab Jenkins to

[jira] [Resolved] (SPARK-8415) Jenkins compilation spends lots of time re-resolving dependencies and waiting to acquire Ivy cache lock

2015-07-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8415. --- Resolution: Fixed Assignee: Josh Rosen Jenkins compilation spends lots of time re-resolving

[jira] [Commented] (SPARK-8415) Jenkins compilation spends lots of time re-resolving dependencies and waiting to acquire Ivy cache lock

2015-07-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624061#comment-14624061 ] Josh Rosen commented on SPARK-8415: --- Oh, and I also added a {{mkdir -p $HOME}} to the

[jira] [Assigned] (SPARK-9005) RegressionMetrics computing incorrect explainedVariance and r2

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9005: --- Assignee: (was: Apache Spark) RegressionMetrics computing incorrect explainedVariance

[jira] [Commented] (SPARK-9005) RegressionMetrics computing incorrect explainedVariance and r2

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624077#comment-14624077 ] Apache Spark commented on SPARK-9005: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-9005) RegressionMetrics computing incorrect explainedVariance and r2

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9005: --- Assignee: Apache Spark RegressionMetrics computing incorrect explainedVariance and r2

[jira] [Updated] (SPARK-9005) RegressionMetrics computing incorrect explainedVariance and r2

2015-07-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9005: - Description: {{RegressionMetrics}} currently computes explainedVariance using

[jira] [Comment Edited] (SPARK-8997) Improve LocalPrefixSpan performance

2015-07-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623292#comment-14623292 ] Feynman Liang edited comment on SPARK-8997 at 7/12/15 11:43 PM:

[jira] [Assigned] (SPARK-8997) Improve LocalPrefixSpan performance

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8997: --- Assignee: Apache Spark (was: Feynman Liang) Improve LocalPrefixSpan performance

[jira] [Commented] (SPARK-8997) Improve LocalPrefixSpan performance

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624068#comment-14624068 ] Apache Spark commented on SPARK-8997: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-8997) Improve LocalPrefixSpan performance

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8997: --- Assignee: Feynman Liang (was: Apache Spark) Improve LocalPrefixSpan performance

[jira] [Created] (SPARK-9009) SPARK Encryption FileNotFoundException for truststore

2015-07-12 Thread kumar ranganathan (JIRA)
kumar ranganathan created SPARK-9009: Summary: SPARK Encryption FileNotFoundException for truststore Key: SPARK-9009 URL: https://issues.apache.org/jira/browse/SPARK-9009 Project: Spark

[jira] [Updated] (SPARK-9009) SPARK Encryption FileNotFoundException for truststore

2015-07-12 Thread kumar ranganathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kumar ranganathan updated SPARK-9009: - Description: I got FileNotFoundException in the application master when running the

[jira] [Assigned] (SPARK-8761) Master.removeApplication is not thread-safe but is called from multiple threads

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8761: --- Assignee: (was: Apache Spark) Master.removeApplication is not thread-safe but is called

[jira] [Commented] (SPARK-8761) Master.removeApplication is not thread-safe but is called from multiple threads

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624236#comment-14624236 ] Apache Spark commented on SPARK-8761: - User 'vinodkc' has created a pull request for

[jira] [Assigned] (SPARK-8761) Master.removeApplication is not thread-safe but is called from multiple threads

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8761: --- Assignee: Apache Spark Master.removeApplication is not thread-safe but is called from

[jira] [Updated] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9003: --- Description: MLlib/Vector only support foreachActive function and is short of map/update which is

[jira] [Comment Edited] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623704#comment-14623704 ] Yanbo Liang edited comment on SPARK-9003 at 7/12/15 8:38 AM: -

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

2015-07-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623703#comment-14623703 ] Sean Owen commented on SPARK-8981: -- I think it's OK if you can do this via the slf4j API

[jira] [Comment Edited] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623704#comment-14623704 ] Yanbo Liang edited comment on SPARK-9003 at 7/12/15 9:36 AM: -

[jira] [Assigned] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9003: --- Assignee: Apache Spark Add map/update function to MLlib/Vector

[jira] [Created] (SPARK-9004) Add s3 bytes read/written metrics

2015-07-12 Thread Abhishek Modi (JIRA)
Abhishek Modi created SPARK-9004: Summary: Add s3 bytes read/written metrics Key: SPARK-9004 URL: https://issues.apache.org/jira/browse/SPARK-9004 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-9004) Add s3 bytes read/written metrics

2015-07-12 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated SPARK-9004: - Affects Version/s: (was: 1.4.0) Add s3 bytes read/written metrics

[jira] [Updated] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9003: --- Description: MLlib/Vector is short of map/update function which is inconvenience for some Vector

[jira] [Created] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-9003: -- Summary: Add map/update function to MLlib/Vector Key: SPARK-9003 URL: https://issues.apache.org/jira/browse/SPARK-9003 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9003: --- Description: MLlib/Vector only support foreachActive function and is short of map/update which is

[jira] [Commented] (SPARK-3155) Support DecisionTree pruning

2015-07-12 Thread Walter Petersen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623719#comment-14623719 ] Walter Petersen commented on SPARK-3155: Ok, fine. Thanks a lot. Support

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

2015-07-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623726#comment-14623726 ] Sean Owen commented on SPARK-8981: -- The constructors? Have a look through

[jira] [Commented] (SPARK-8671) Add isotonic regression to the pipeline API

2015-07-12 Thread Martin Zapletal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623786#comment-14623786 ] Martin Zapletal commented on SPARK-8671: I am on it. Add isotonic regression to

[jira] [Updated] (SPARK-9004) Add s3 bytes read/written metrics

2015-07-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9004: - Target Version/s: (was: 1.4.0) Please read

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

2015-07-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623712#comment-14623712 ] Sean Owen commented on SPARK-8981: -- Can MDC methods be invoked during executor

[jira] [Commented] (SPARK-3155) Support DecisionTree pruning

2015-07-12 Thread Walter Petersen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623721#comment-14623721 ] Walter Petersen commented on SPARK-3155: Ok, fine. Thanks a lot [~josephkb].

[jira] [Issue Comment Deleted] (SPARK-3155) Support DecisionTree pruning

2015-07-12 Thread Walter Petersen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Petersen updated SPARK-3155: --- Comment: was deleted (was: Ok, fine. Thanks a lot.) Support DecisionTree pruning

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

2015-07-12 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623720#comment-14623720 ] Paweł Kopiczko commented on SPARK-8981: --- I think so. Would you mind pointing me to

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

2015-07-12 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623700#comment-14623700 ] Paweł Kopiczko commented on SPARK-8981: --- slf4j supports MDC as well:

[jira] [Commented] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623702#comment-14623702 ] Sean Owen commented on SPARK-9003: -- I think the idea was that this is not supposed to

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

2015-07-12 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623707#comment-14623707 ] Paweł Kopiczko commented on SPARK-8981: --- ??MDC has static methods?? Yes, but I'm not

[jira] [Comment Edited] (SPARK-8981) Set applicationId and appName in log4j MDC

2015-07-12 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623707#comment-14623707 ] Paweł Kopiczko edited comment on SPARK-8981 at 7/12/15 8:26 AM:

[jira] [Updated] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9003: --- Description: MLlib/Vector only support foreachActive function and is short of map/update which is

[jira] [Commented] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623724#comment-14623724 ] Apache Spark commented on SPARK-9003: - User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9003: --- Assignee: (was: Apache Spark) Add map/update function to MLlib/Vector

[jira] [Commented] (SPARK-9004) Add s3 bytes read/written metrics

2015-07-12 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623834#comment-14623834 ] Abhishek Modi commented on SPARK-9004: -- Hadoop separates HDFS bytes, local filesystem

[jira] [Updated] (SPARK-9004) Add s3 bytes read/written metrics

2015-07-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9004: - Component/s: Input/Output The metrics are tracked by the InputFormat / OutputFormat right? that might

[jira] [Updated] (SPARK-8982) Worker hostnames not showing in Master web ui when launched with start-slaves.sh

2015-07-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8982: - Target Version/s: (was: 1.4.0) Worker hostnames not showing in Master web ui when launched with

[jira] [Assigned] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5159: --- Assignee: (was: Apache Spark) Thrift server does not respect

[jira] [Assigned] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5159: --- Assignee: Apache Spark Thrift server does not respect hive.server2.enable.doAs=true

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2015-07-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623898#comment-14623898 ] Apache Spark commented on SPARK-5159: - User 'ilovesoup' has created a pull request for

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2015-07-12 Thread Ma Xiaoyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623909#comment-14623909 ] Ma Xiaoyu commented on SPARK-5159: -- Above is my first PR to spark. New to Spark and