[jira] [Commented] (SPARK-8279) udf_round_3 test fails

2015-06-15 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585743#comment-14585743 ] Yijie Shen commented on SPARK-8279: --- Seems this has been fixed in master branch?

[jira] [Assigned] (SPARK-8283) udf_struct test failure

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8283: --- Assignee: Apache Spark udf_struct test failure ---

[jira] [Commented] (SPARK-8283) udf_struct test failure

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585661#comment-14585661 ] Apache Spark commented on SPARK-8283: - User 'yijieshen' has created a pull request for

[jira] [Assigned] (SPARK-8283) udf_struct test failure

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8283: --- Assignee: (was: Apache Spark) udf_struct test failure ---

[jira] [Created] (SPARK-8375) BinaryClassificationMetrics in ML Lib has odd API

2015-06-15 Thread sam (JIRA)
sam created SPARK-8375: -- Summary: BinaryClassificationMetrics in ML Lib has odd API Key: SPARK-8375 URL: https://issues.apache.org/jira/browse/SPARK-8375 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2898) Failed to connect to daemon

2015-06-15 Thread Peter Taylor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585809#comment-14585809 ] Peter Taylor commented on SPARK-2898: - FYI java.io.IOException: Cannot run program

[jira] [Created] (SPARK-8374) Job frequently hangs after YARN preemption

2015-06-15 Thread Shay Rojansky (JIRA)
Shay Rojansky created SPARK-8374: Summary: Job frequently hangs after YARN preemption Key: SPARK-8374 URL: https://issues.apache.org/jira/browse/SPARK-8374 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8375) BinaryClassificationMetrics in ML Lib has odd API

2015-06-15 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sam updated SPARK-8375: --- Description: According to

[jira] [Created] (SPARK-8376) Commons Lang 3 is one of the required JAR of Spark Flume Sink but is missing in the docs

2015-06-15 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8376: --- Summary: Commons Lang 3 is one of the required JAR of Spark Flume Sink but is missing in the docs Key: SPARK-8376 URL: https://issues.apache.org/jira/browse/SPARK-8376

[jira] [Commented] (SPARK-8373) When an RDD has no partition, Python sum will throw Can not reduce() empty RDD

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585884#comment-14585884 ] Sean Owen commented on SPARK-8373: -- Really the same as SPARK-6878

[jira] [Commented] (SPARK-6666) org.apache.spark.sql.jdbc.JDBCRDD does not escape/quote column names

2015-06-15 Thread Santiago M. Mola (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585883#comment-14585883 ] Santiago M. Mola commented on SPARK-: - I opened SPARK-8377 to track the

[jira] [Commented] (SPARK-4644) Implement skewed join

2015-06-15 Thread Nathan McCarthy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586076#comment-14586076 ] Nathan McCarthy commented on SPARK-4644: Something like this to make working with

[jira] [Created] (SPARK-8377) Identifiers caseness information should be available at any time

2015-06-15 Thread Santiago M. Mola (JIRA)
Santiago M. Mola created SPARK-8377: --- Summary: Identifiers caseness information should be available at any time Key: SPARK-8377 URL: https://issues.apache.org/jira/browse/SPARK-8377 Project: Spark

[jira] [Resolved] (SPARK-8375) BinaryClassificationMetrics in ML Lib has odd API

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8375. -- Resolution: Invalid @sam This is a discussion for the mailing list rather than a JIRA.

[jira] [Updated] (SPARK-8373) When an RDD has no partition, Python sum will throw Can not reduce() empty RDD

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8373: - Priority: Minor (was: Major) When an RDD has no partition, Python sum will throw Can not reduce() empty

[jira] [Assigned] (SPARK-8253) string function: ltrim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8253: --- Assignee: Apache Spark (was: Cheng Hao) string function: ltrim --

[jira] [Commented] (SPARK-8260) string function: rtrim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585934#comment-14585934 ] Apache Spark commented on SPARK-8260: - User 'chenghao-intel' has created a pull

[jira] [Assigned] (SPARK-8267) string function: trim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8267: --- Assignee: Apache Spark (was: Cheng Hao) string function: trim -

[jira] [Assigned] (SPARK-8260) string function: rtrim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8260: --- Assignee: Apache Spark (was: Cheng Hao) string function: rtrim --

[jira] [Assigned] (SPARK-8267) string function: trim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8267: --- Assignee: Cheng Hao (was: Apache Spark) string function: trim -

[jira] [Commented] (SPARK-8253) string function: ltrim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585933#comment-14585933 ] Apache Spark commented on SPARK-8253: - User 'chenghao-intel' has created a pull

[jira] [Assigned] (SPARK-8253) string function: ltrim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8253: --- Assignee: Cheng Hao (was: Apache Spark) string function: ltrim --

[jira] [Commented] (SPARK-8267) string function: trim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585935#comment-14585935 ] Apache Spark commented on SPARK-8267: - User 'chenghao-intel' has created a pull

[jira] [Assigned] (SPARK-8260) string function: rtrim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8260: --- Assignee: Cheng Hao (was: Apache Spark) string function: rtrim --

[jira] [Commented] (SPARK-8376) Commons Lang 3 is one of the required JAR of Spark Flume Sink but is missing in the docs

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585833#comment-14585833 ] Apache Spark commented on SPARK-8376: - User 'zsxwing' has created a pull request for

[jira] [Assigned] (SPARK-8376) Commons Lang 3 is one of the required JAR of Spark Flume Sink but is missing in the docs

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8376: --- Assignee: Apache Spark Commons Lang 3 is one of the required JAR of Spark Flume Sink but is

[jira] [Assigned] (SPARK-8376) Commons Lang 3 is one of the required JAR of Spark Flume Sink but is missing in the docs

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8376: --- Assignee: (was: Apache Spark) Commons Lang 3 is one of the required JAR of Spark Flume

[jira] [Assigned] (SPARK-8378) Add Spark Flume Python API

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8378: --- Assignee: (was: Apache Spark) Add Spark Flume Python API --

[jira] [Assigned] (SPARK-8378) Add Spark Flume Python API

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8378: --- Assignee: Apache Spark Add Spark Flume Python API --

[jira] [Resolved] (SPARK-8350) R unit tests output should be logged to unit-tests.log

2015-06-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8350. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Issue Comment Deleted] (SPARK-5081) Shuffle write increases

2015-06-15 Thread Roi Reshef (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roi Reshef updated SPARK-5081: -- Comment: was deleted (was: Hi Guys, Was this issue already solved by any chance? I'm using Spark 1.3.1

[jira] [Commented] (SPARK-8378) Add Spark Flume Python API

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586144#comment-14586144 ] Apache Spark commented on SPARK-8378: - User 'zsxwing' has created a pull request for

[jira] [Commented] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-15 Thread Sebastian Walz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586248#comment-14586248 ] Sebastian Walz commented on SPARK-8335: --- Yeah I am sure, that is a really a

[jira] [Created] (SPARK-8378) Add Spark Flume Python API

2015-06-15 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8378: --- Summary: Add Spark Flume Python API Key: SPARK-8378 URL: https://issues.apache.org/jira/browse/SPARK-8378 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-8379) LeaseExpiredException when using dynamic partition with speculative execution

2015-06-15 Thread jeanlyn (JIRA)
jeanlyn created SPARK-8379: -- Summary: LeaseExpiredException when using dynamic partition with speculative execution Key: SPARK-8379 URL: https://issues.apache.org/jira/browse/SPARK-8379 Project: Spark

[jira] [Commented] (SPARK-7104) Support model save/load in Python's Word2Vec

2015-06-15 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585488#comment-14585488 ] Yu Ishikawa commented on SPARK-7104: It would be nice to refactor Python's Word2Vec.

[jira] [Commented] (SPARK-7550) Support setting the right schema serde when writing to Hive metastore

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585489#comment-14585489 ] Apache Spark commented on SPARK-7550: - User 'chenghao-intel' has created a pull

[jira] [Assigned] (SPARK-8379) LeaseExpiredException when using dynamic partition with speculative execution

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8379: --- Assignee: Apache Spark LeaseExpiredException when using dynamic partition with speculative

[jira] [Assigned] (SPARK-8379) LeaseExpiredException when using dynamic partition with speculative execution

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8379: --- Assignee: (was: Apache Spark) LeaseExpiredException when using dynamic partition with

[jira] [Commented] (SPARK-8379) LeaseExpiredException when using dynamic partition with speculative execution

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587322#comment-14587322 ] Apache Spark commented on SPARK-8379: - User 'jeanlyn' has created a pull request for

[jira] [Created] (SPARK-8386) DataFrame and JDBC regression

2015-06-15 Thread Peter Haumer (JIRA)
Peter Haumer created SPARK-8386: --- Summary: DataFrame and JDBC regression Key: SPARK-8386 URL: https://issues.apache.org/jira/browse/SPARK-8386 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-6724) Model import/export for FPGrowth

2015-06-15 Thread Hrishikesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583139#comment-14583139 ] Hrishikesh edited comment on SPARK-6724 at 6/16/15 4:22 AM:

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-06-15 Thread zhangyouhua (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587299#comment-14587299 ] zhangyouhua commented on SPARK-6932: @Qiping Li in your idea the PS client run in

[jira] [Updated] (SPARK-8368) ClassNotFoundException in closure for map

2015-06-15 Thread CHEN Zhiwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CHEN Zhiwei updated SPARK-8368: --- Description: After upgraded the cluster from spark 1.3.0 to 1.4.0(rc4), I encountered the following

[jira] [Commented] (SPARK-8275) HistoryServer caches incomplete App UIs

2015-06-15 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587360#comment-14587360 ] Carson Wang commented on SPARK-8275: This seems to be the same issue to SPARK-7889

[jira] [Assigned] (SPARK-8387) [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8387: --- Assignee: (was: Apache Spark) [SPARK][Web-UI] Only show 4096 bytes content for executor

[jira] [Commented] (SPARK-8387) [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587421#comment-14587421 ] Apache Spark commented on SPARK-8387: - User 'suyanNone' has created a pull request for

[jira] [Created] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

2015-06-15 Thread Peter Haumer (JIRA)
Peter Haumer created SPARK-8385: --- Summary: java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation Key: SPARK-8385 URL: https://issues.apache.org/jira/browse/SPARK-8385

[jira] [Assigned] (SPARK-8280) udf7 failed due to null vs nan semantics

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8280: --- Assignee: Apache Spark udf7 failed due to null vs nan semantics

[jira] [Commented] (SPARK-8281) udf_asin and udf_acos test failure

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587462#comment-14587462 ] Apache Spark commented on SPARK-8281: - User 'yijieshen' has created a pull request for

[jira] [Assigned] (SPARK-8281) udf_asin and udf_acos test failure

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8281: --- Assignee: (was: Apache Spark) udf_asin and udf_acos test failure

[jira] [Commented] (SPARK-8280) udf7 failed due to null vs nan semantics

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587461#comment-14587461 ] Apache Spark commented on SPARK-8280: - User 'yijieshen' has created a pull request for

[jira] [Assigned] (SPARK-8280) udf7 failed due to null vs nan semantics

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8280: --- Assignee: (was: Apache Spark) udf7 failed due to null vs nan semantics

[jira] [Assigned] (SPARK-8281) udf_asin and udf_acos test failure

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8281: --- Assignee: Apache Spark udf_asin and udf_acos test failure

[jira] [Commented] (SPARK-8280) udf7 failed due to null vs nan semantics

2015-06-15 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587335#comment-14587335 ] Yijie Shen commented on SPARK-8280: --- I'll take this udf7 failed due to null vs nan

[jira] [Commented] (SPARK-8281) udf_asin and udf_acos test failure

2015-06-15 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587333#comment-14587333 ] Yijie Shen commented on SPARK-8281: --- I'll take this udf_asin and udf_acos test failure

[jira] [Updated] (SPARK-7888) Be able to disable intercept in Linear Regression in ML package

2015-06-15 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-7888: --- Assignee: holdenk Be able to disable intercept in Linear Regression in ML package

[jira] [Commented] (SPARK-8206) math function: round

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587509#comment-14587509 ] Apache Spark commented on SPARK-8206: - User 'zhichao-li' has created a pull request

[jira] [Commented] (SPARK-7633) Streaming Logistic Regression- Python bindings

2015-06-15 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587286#comment-14587286 ] Mike Dusenberry commented on SPARK-7633: I can work on this one! Streaming

[jira] [Commented] (SPARK-7674) R-like stats for ML models

2015-06-15 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587376#comment-14587376 ] holdenk commented on SPARK-7674: I'd love to help with this if thats cool :) R-like

[jira] [Assigned] (SPARK-8387) [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8387: --- Assignee: Apache Spark [SPARK][Web-UI] Only show 4096 bytes content for executor log

[jira] [Commented] (SPARK-8368) ClassNotFoundException in closure for map

2015-06-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587459#comment-14587459 ] Yin Huai commented on SPARK-8368: - @CHEN Zhiwei How was the application submitted?

[jira] [Comment Edited] (SPARK-8368) ClassNotFoundException in closure for map

2015-06-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587459#comment-14587459 ] Yin Huai edited comment on SPARK-8368 at 6/16/15 4:35 AM: --

[jira] [Commented] (SPARK-7837) NPE when save as parquet in speculative tasks

2015-06-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587491#comment-14587491 ] Yin Huai commented on SPARK-7837: - Seems

[jira] [Updated] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type

2015-06-15 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-8381: Description: This method CatalystTypeConverters.convertToCatalyst is slow, so for batch conversion

[jira] [Assigned] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8381: --- Assignee: Apache Spark reuse typeConvert when convert Seq[Row] to catalyst type

[jira] [Assigned] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8381: --- Assignee: (was: Apache Spark) reuse typeConvert when convert Seq[Row] to catalyst type

[jira] [Created] (SPARK-8382) Improve Analysis Unit test framework

2015-06-15 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-8382: --- Summary: Improve Analysis Unit test framework Key: SPARK-8382 URL: https://issues.apache.org/jira/browse/SPARK-8382 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-6583) Support aggregated function in order by

2015-06-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6583. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6816

[jira] [Commented] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

2015-06-15 Thread Daniel LaBar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586276#comment-14586276 ] Daniel LaBar commented on SPARK-6220: - [~nchammas], I also need IAM support and [made

[jira] [Commented] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586330#comment-14586330 ] Apache Spark commented on SPARK-8381: - User 'lianhuiwang' has created a pull request

[jira] [Commented] (SPARK-7721) Generate test coverage report from Python

2015-06-15 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586280#comment-14586280 ] Josh Rosen commented on SPARK-7721: --- We now have the Jenkins HTML publisher plugin

[jira] [Created] (SPARK-8380) SparkR mis-counts

2015-06-15 Thread Rick Moritz (JIRA)
Rick Moritz created SPARK-8380: -- Summary: SparkR mis-counts Key: SPARK-8380 URL: https://issues.apache.org/jira/browse/SPARK-8380 Project: Spark Issue Type: Bug Components: SparkR

[jira] [Closed] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-15 Thread Mark Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Smith closed SPARK-8322. - Thanks for making my first PR so painless guys. EC2 script not fully updated for 1.4.0 release

[jira] [Commented] (SPARK-8380) SparkR mis-counts

2015-06-15 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586262#comment-14586262 ] Rick Moritz commented on SPARK-8380: I will attempt to reproduce this with an

[jira] [Commented] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-06-15 Thread Igor Berman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586266#comment-14586266 ] Igor Berman commented on SPARK-4879: I'm experiencing this issue. Sometimes rdd with 4

[jira] [Commented] (SPARK-8380) SparkR mis-counts

2015-06-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586277#comment-14586277 ] Shivaram Venkataraman commented on SPARK-8380: -- [~RPCMoritz] Couple of things

[jira] [Created] (SPARK-8381) reuse-typeConvert when convert Seq[Row] to CatalystType

2015-06-15 Thread Lianhui Wang (JIRA)
Lianhui Wang created SPARK-8381: --- Summary: reuse-typeConvert when convert Seq[Row] to CatalystType Key: SPARK-8381 URL: https://issues.apache.org/jira/browse/SPARK-8381 Project: Spark Issue

[jira] [Updated] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type

2015-06-15 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-8381: Summary: reuse typeConvert when convert Seq[Row] to catalyst type (was: reuse-typeConvert when

[jira] [Updated] (SPARK-8381) reuse-typeConvert when convert Seq[Row] to catalyst type

2015-06-15 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-8381: Summary: reuse-typeConvert when convert Seq[Row] to catalyst type (was: reuse-typeConvert when

[jira] [Commented] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

2015-06-15 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586334#comment-14586334 ] Nicholas Chammas commented on SPARK-6220: - please forgive my greenness No need.

[jira] [Commented] (SPARK-8383) Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed

2015-06-15 Thread Irina Easterling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586648#comment-14586648 ] Irina Easterling commented on SPARK-8383: - Spark History Server shows Last Updated

[jira] [Created] (SPARK-8383) Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed

2015-06-15 Thread Irina Easterling (JIRA)
Irina Easterling created SPARK-8383: --- Summary: Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed Key: SPARK-8383 URL: https://issues.apache.org/jira/browse/SPARK-8383

[jira] [Updated] (SPARK-8383) Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed

2015-06-15 Thread Irina Easterling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Irina Easterling updated SPARK-8383: Attachment: Spark_WrongLastUpdatedDate.png Spark History Server shows Last Updated as

[jira] [Commented] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

2015-06-15 Thread Daniel LaBar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586616#comment-14586616 ] Daniel LaBar commented on SPARK-6220: - Ok, I'll create a new JIRA with a reference to

[jira] [Updated] (SPARK-8383) Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed

2015-06-15 Thread Irina Easterling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Irina Easterling updated SPARK-8383: Attachment: YARN_SparkJobCompleted.PNG Spark History Server shows Last Updated as

[jira] [Commented] (SPARK-5680) Sum function on all null values, should return zero

2015-06-15 Thread Venkata Ramana G (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587473#comment-14587473 ] Venkata Ramana G commented on SPARK-5680: - Holman, You are right that column with

[jira] [Commented] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587013#comment-14587013 ] Sean Owen commented on SPARK-8335: -- Go ahead and propose a PR. The sticky issue here is

[jira] [Created] (SPARK-8370) Add API for data sources to register databases

2015-06-15 Thread Santiago M. Mola (JIRA)
Santiago M. Mola created SPARK-8370: --- Summary: Add API for data sources to register databases Key: SPARK-8370 URL: https://issues.apache.org/jira/browse/SPARK-8370 Project: Spark Issue

[jira] [Created] (SPARK-8371) improve unit test for MaxOf and MinOf

2015-06-15 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-8371: -- Summary: improve unit test for MaxOf and MinOf Key: SPARK-8371 URL: https://issues.apache.org/jira/browse/SPARK-8371 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-8370) Add API for data sources to register databases

2015-06-15 Thread Santiago M. Mola (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santiago M. Mola updated SPARK-8370: Component/s: SQL Add API for data sources to register databases

[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585613#comment-14585613 ] Apache Spark commented on SPARK-8348: - User 'yu-iskw' has created a pull request for

[jira] [Assigned] (SPARK-8348) Add in operator to DataFrame Column

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8348: --- Assignee: (was: Apache Spark) Add in operator to DataFrame Column

[jira] [Assigned] (SPARK-8348) Add in operator to DataFrame Column

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8348: --- Assignee: Apache Spark Add in operator to DataFrame Column

[jira] [Assigned] (SPARK-8371) improve unit test for MaxOf and MinOf

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8371: --- Assignee: Apache Spark improve unit test for MaxOf and MinOf

[jira] [Commented] (SPARK-8371) improve unit test for MaxOf and MinOf

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585615#comment-14585615 ] Apache Spark commented on SPARK-8371: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-8371) improve unit test for MaxOf and MinOf

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8371: --- Assignee: (was: Apache Spark) improve unit test for MaxOf and MinOf

[jira] [Created] (SPARK-8372) History server shows incorrect information for application not started

2015-06-15 Thread Carson Wang (JIRA)
Carson Wang created SPARK-8372: -- Summary: History server shows incorrect information for application not started Key: SPARK-8372 URL: https://issues.apache.org/jira/browse/SPARK-8372 Project: Spark

[jira] [Created] (SPARK-8373) When an RDD has no partition, Python sum will throw Can not reduce() empty RDD

2015-06-15 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8373: --- Summary: When an RDD has no partition, Python sum will throw Can not reduce() empty RDD Key: SPARK-8373 URL: https://issues.apache.org/jira/browse/SPARK-8373 Project:

[jira] [Updated] (SPARK-8372) History server shows incorrect information for application not started

2015-06-15 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carson Wang updated SPARK-8372: --- Attachment: IncorrectAppInfo.png History server shows incorrect information for application not

  1   2   >