[jira] [Created] (SPARK-8388) The script "docs/_plugins/copy_api_dirs.rb" should be run anywhere

2015-06-15 Thread KaiXinXIaoLei (JIRA)
KaiXinXIaoLei created SPARK-8388: Summary: The script "docs/_plugins/copy_api_dirs.rb" should be run anywhere Key: SPARK-8388 URL: https://issues.apache.org/jira/browse/SPARK-8388 Project: Spark

[jira] [Updated] (SPARK-8129) Securely pass auth secrets to executors in standalone cluster mode

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8129: - Priority: Minor (was: Critical) > Securely pass auth secrets to executors in standalone cluster mode > --

[jira] [Updated] (SPARK-8129) Securely pass auth secrets to executors in standalone cluster mode

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8129: - Assignee: Kan Zhang > Securely pass auth secrets to executors in standalone cluster mode > ---

[jira] [Closed] (SPARK-8380) SparkR mis-counts

2015-06-15 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rick Moritz closed SPARK-8380. -- Resolution: Invalid I got my columns mixed up, late in the evening after a frustrating day with SparkR'

[jira] [Resolved] (SPARK-8129) Securely pass auth secrets to executors in standalone cluster mode

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8129. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6774 [https://github.com/ap

[jira] [Resolved] (SPARK-8367) ReliableKafka will loss data when `spark.streaming.blockInterval` was 0

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8367. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 > ReliableKafka will loss data wh

[jira] [Updated] (SPARK-8367) ReliableKafka will loss data when `spark.streaming.blockInterval` was 0

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8367: - Assignee: SaintBacchus > ReliableKafka will loss data when `spark.streaming.blockInterval` was 0 > ---

[jira] [Commented] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587527#comment-14587527 ] Sean Owen commented on SPARK-8385: -- What is the TFS file system? it sounds like you are m

[jira] [Resolved] (SPARK-8384) Can not set checkpointDuration or Interval in spark 1.3 and later

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8384. -- Resolution: Invalid > Can not set checkpointDuration or Interval in spark 1.3 and later > --

[jira] [Commented] (SPARK-8384) Can not set checkpointDuration or Interval in spark 1.3 and later

2015-06-15 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587515#comment-14587515 ] Saisai Shao commented on SPARK-8384: Hi [~nhe150], I'm not sure why you need to set ch

[jira] [Resolved] (SPARK-7184) Investigate turning codegen on by default

2015-06-15 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7184. Resolution: Fixed Fix Version/s: 1.5.0 > Investigate turning codegen on by default >

[jira] [Commented] (SPARK-8206) math function: round

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587509#comment-14587509 ] Apache Spark commented on SPARK-8206: - User 'zhichao-li' has created a pull request fo

[jira] [Commented] (SPARK-7837) NPE when save as parquet in speculative tasks

2015-06-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587491#comment-14587491 ] Yin Huai commented on SPARK-7837: - Seems https://www.mail-archive.com/user@spark.apache.or

[jira] [Commented] (SPARK-5680) Sum function on all null values, should return zero

2015-06-15 Thread Venkata Ramana G (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587473#comment-14587473 ] Venkata Ramana G commented on SPARK-5680: - Holman, You are right that column with

[jira] [Assigned] (SPARK-8281) udf_asin and udf_acos test failure

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8281: --- Assignee: (was: Apache Spark) > udf_asin and udf_acos test failure >

[jira] [Assigned] (SPARK-8280) udf7 failed due to null vs nan semantics

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8280: --- Assignee: Apache Spark > udf7 failed due to null vs nan semantics > -

[jira] [Commented] (SPARK-8281) udf_asin and udf_acos test failure

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587462#comment-14587462 ] Apache Spark commented on SPARK-8281: - User 'yijieshen' has created a pull request for

[jira] [Commented] (SPARK-8280) udf7 failed due to null vs nan semantics

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587461#comment-14587461 ] Apache Spark commented on SPARK-8280: - User 'yijieshen' has created a pull request for

[jira] [Assigned] (SPARK-8280) udf7 failed due to null vs nan semantics

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8280: --- Assignee: (was: Apache Spark) > udf7 failed due to null vs nan semantics > --

[jira] [Assigned] (SPARK-8281) udf_asin and udf_acos test failure

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8281: --- Assignee: Apache Spark > udf_asin and udf_acos test failure > ---

[jira] [Comment Edited] (SPARK-8368) ClassNotFoundException in closure for map

2015-06-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587459#comment-14587459 ] Yin Huai edited comment on SPARK-8368 at 6/16/15 4:35 AM: -- [~zwCh

[jira] [Commented] (SPARK-8368) ClassNotFoundException in closure for map

2015-06-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587459#comment-14587459 ] Yin Huai commented on SPARK-8368: - @CHEN Zhiwei How was the application submitted? > Clas

[jira] [Comment Edited] (SPARK-6724) Model import/export for FPGrowth

2015-06-15 Thread Hrishikesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583139#comment-14583139 ] Hrishikesh edited comment on SPARK-6724 at 6/16/15 4:22 AM: [~

[jira] [Assigned] (SPARK-8387) [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8387: --- Assignee: (was: Apache Spark) > [SPARK][Web-UI] Only show 4096 bytes content for executor

[jira] [Commented] (SPARK-8387) [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587421#comment-14587421 ] Apache Spark commented on SPARK-8387: - User 'suyanNone' has created a pull request for

[jira] [Assigned] (SPARK-8387) [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8387: --- Assignee: Apache Spark > [SPARK][Web-UI] Only show 4096 bytes content for executor log instea

[jira] [Created] (SPARK-8387) [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all

2015-06-15 Thread SuYan (JIRA)
SuYan created SPARK-8387: Summary: [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all Key: SPARK-8387 URL: https://issues.apache.org/jira/browse/SPARK-8387 Project: Spark Issu

[jira] [Comment Edited] (SPARK-7127) Broadcast spark.ml tree ensemble models for predict

2015-06-15 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587081#comment-14587081 ] Bryan Cutler edited comment on SPARK-7127 at 6/16/15 3:47 AM: --

[jira] [Updated] (SPARK-7888) Be able to disable intercept in Linear Regression in ML package

2015-06-15 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-7888: --- Assignee: holdenk > Be able to disable intercept in Linear Regression in ML package >

[jira] [Commented] (SPARK-7674) R-like stats for ML models

2015-06-15 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587376#comment-14587376 ] holdenk commented on SPARK-7674: I'd love to help with this if thats cool :) > R-like sta

[jira] [Commented] (SPARK-8275) HistoryServer caches incomplete App UIs

2015-06-15 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587360#comment-14587360 ] Carson Wang commented on SPARK-8275: This seems to be the same issue to SPARK-7889 >

[jira] [Created] (SPARK-8386) DataFrame and JDBC regression

2015-06-15 Thread Peter Haumer (JIRA)
Peter Haumer created SPARK-8386: --- Summary: DataFrame and JDBC regression Key: SPARK-8386 URL: https://issues.apache.org/jira/browse/SPARK-8386 Project: Spark Issue Type: Bug Component

[jira] [Created] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

2015-06-15 Thread Peter Haumer (JIRA)
Peter Haumer created SPARK-8385: --- Summary: java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation Key: SPARK-8385 URL: https://issues.apache.org/jira/browse/SPARK-8385

[jira] [Updated] (SPARK-8368) ClassNotFoundException in closure for map

2015-06-15 Thread CHEN Zhiwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CHEN Zhiwei updated SPARK-8368: --- Description: After upgraded the cluster from spark 1.3.0 to 1.4.0(rc4), I encountered the following e

[jira] [Commented] (SPARK-8281) udf_asin and udf_acos test failure

2015-06-15 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587333#comment-14587333 ] Yijie Shen commented on SPARK-8281: --- I'll take this > udf_asin and udf_acos test failur

[jira] [Commented] (SPARK-8280) udf7 failed due to null vs nan semantics

2015-06-15 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587335#comment-14587335 ] Yijie Shen commented on SPARK-8280: --- I'll take this > udf7 failed due to null vs nan se

[jira] [Assigned] (SPARK-8379) LeaseExpiredException when using dynamic partition with speculative execution

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8379: --- Assignee: Apache Spark > LeaseExpiredException when using dynamic partition with speculative

[jira] [Assigned] (SPARK-8379) LeaseExpiredException when using dynamic partition with speculative execution

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8379: --- Assignee: (was: Apache Spark) > LeaseExpiredException when using dynamic partition with s

[jira] [Commented] (SPARK-8379) LeaseExpiredException when using dynamic partition with speculative execution

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587322#comment-14587322 ] Apache Spark commented on SPARK-8379: - User 'jeanlyn' has created a pull request for t

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-06-15 Thread zhangyouhua (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587299#comment-14587299 ] zhangyouhua commented on SPARK-6932: @Qiping Li in your idea the PS client run in slav

[jira] [Commented] (SPARK-7633) Streaming Logistic Regression- Python bindings

2015-06-15 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587286#comment-14587286 ] Mike Dusenberry commented on SPARK-7633: I can work on this one! > Streaming Logi

[jira] [Updated] (SPARK-7555) User guide update for ElasticNet

2015-06-15 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-7555: --- Assignee: Shuo Xiang (was: DB Tsai) > User guide update for ElasticNet > > >

[jira] [Updated] (SPARK-7685) Handle high imbalanced data and apply weights to different samples in Logistic Regression

2015-06-15 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-7685: --- Assignee: Shuo Xiang > Handle high imbalanced data and apply weights to different samples in > Logistic Regre

[jira] [Resolved] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-15 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8336. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Target Version/s:

[jira] [Created] (SPARK-8384) Can not set checkpointDuration or Interval in spark 1.3 and later

2015-06-15 Thread Norman He (JIRA)
Norman He created SPARK-8384: Summary: Can not set checkpointDuration or Interval in spark 1.3 and later Key: SPARK-8384 URL: https://issues.apache.org/jira/browse/SPARK-8384 Project: Spark Issu

[jira] [Commented] (SPARK-7127) Broadcast spark.ml tree ensemble models for predict

2015-06-15 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587081#comment-14587081 ] Bryan Cutler commented on SPARK-7127: - Hi [~josephkb], I added some commits that allo

[jira] [Commented] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587013#comment-14587013 ] Sean Owen commented on SPARK-8335: -- Go ahead and propose a PR. The sticky issue here is w

[jira] [Commented] (SPARK-8383) Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed

2015-06-15 Thread Irina Easterling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586648#comment-14586648 ] Irina Easterling commented on SPARK-8383: - Spark History Server shows Last Updated

[jira] [Updated] (SPARK-8383) Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed

2015-06-15 Thread Irina Easterling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Irina Easterling updated SPARK-8383: Attachment: YARN_SparkJobCompleted.PNG > Spark History Server shows Last Updated as 1969/12/

[jira] [Updated] (SPARK-8383) Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed

2015-06-15 Thread Irina Easterling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Irina Easterling updated SPARK-8383: Attachment: Spark_WrongLastUpdatedDate.png > Spark History Server shows Last Updated as 1969

[jira] [Created] (SPARK-8383) Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed

2015-06-15 Thread Irina Easterling (JIRA)
Irina Easterling created SPARK-8383: --- Summary: Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed Key: SPARK-8383 URL: https://issues.apache.org/jira/browse/SPARK-8383

[jira] [Commented] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

2015-06-15 Thread Daniel LaBar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586616#comment-14586616 ] Daniel LaBar commented on SPARK-6220: - Ok, I'll create a new JIRA with a reference to

[jira] [Resolved] (SPARK-6583) Support aggregated function in order by

2015-06-15 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6583. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6816 [https:/

[jira] [Created] (SPARK-8382) Improve Analysis Unit test framework

2015-06-15 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-8382: --- Summary: Improve Analysis Unit test framework Key: SPARK-8382 URL: https://issues.apache.org/jira/browse/SPARK-8382 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

2015-06-15 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586334#comment-14586334 ] Nicholas Chammas commented on SPARK-6220: - > please forgive my greenness No need.

[jira] [Updated] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type

2015-06-15 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-8381: Description: This method CatalystTypeConverters.convertToCatalyst is slow, so for batch conversion w

[jira] [Assigned] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8381: --- Assignee: Apache Spark > reuse typeConvert when convert Seq[Row] to catalyst type > -

[jira] [Assigned] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8381: --- Assignee: (was: Apache Spark) > reuse typeConvert when convert Seq[Row] to catalyst type

[jira] [Commented] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586330#comment-14586330 ] Apache Spark commented on SPARK-8381: - User 'lianhuiwang' has created a pull request f

[jira] [Updated] (SPARK-8381) reuse typeConvert when convert Seq[Row] to catalyst type

2015-06-15 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-8381: Summary: reuse typeConvert when convert Seq[Row] to catalyst type (was: reuse-typeConvert when conv

[jira] [Updated] (SPARK-8381) reuse-typeConvert when convert Seq[Row] to catalyst type

2015-06-15 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-8381: Summary: reuse-typeConvert when convert Seq[Row] to catalyst type (was: reuse-typeConvert when conv

[jira] [Created] (SPARK-8381) reuse-typeConvert when convert Seq[Row] to CatalystType

2015-06-15 Thread Lianhui Wang (JIRA)
Lianhui Wang created SPARK-8381: --- Summary: reuse-typeConvert when convert Seq[Row] to CatalystType Key: SPARK-8381 URL: https://issues.apache.org/jira/browse/SPARK-8381 Project: Spark Issue Typ

[jira] [Closed] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-15 Thread Mark Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Smith closed SPARK-8322. - Thanks for making my first PR so painless guys. > EC2 script not fully updated for 1.4.0 release > --

[jira] [Commented] (SPARK-7721) Generate test coverage report from Python

2015-06-15 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586280#comment-14586280 ] Josh Rosen commented on SPARK-7721: --- We now have the Jenkins HTML publisher plugin insta

[jira] [Commented] (SPARK-8380) SparkR mis-counts

2015-06-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586277#comment-14586277 ] Shivaram Venkataraman commented on SPARK-8380: -- [~RPCMoritz] Couple of things

[jira] [Commented] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

2015-06-15 Thread Daniel LaBar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586276#comment-14586276 ] Daniel LaBar commented on SPARK-6220: - [~nchammas], I also need IAM support and [made

[jira] [Commented] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-06-15 Thread Igor Berman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586266#comment-14586266 ] Igor Berman commented on SPARK-4879: I'm experiencing this issue. Sometimes rdd with 4

[jira] [Commented] (SPARK-8380) SparkR mis-counts

2015-06-15 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586262#comment-14586262 ] Rick Moritz commented on SPARK-8380: I will attempt to reproduce this with an alternat

[jira] [Created] (SPARK-8380) SparkR mis-counts

2015-06-15 Thread Rick Moritz (JIRA)
Rick Moritz created SPARK-8380: -- Summary: SparkR mis-counts Key: SPARK-8380 URL: https://issues.apache.org/jira/browse/SPARK-8380 Project: Spark Issue Type: Bug Components: SparkR

[jira] [Commented] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-15 Thread Sebastian Walz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586248#comment-14586248 ] Sebastian Walz commented on SPARK-8335: --- Yeah I am sure, that is a really a scala.Do

[jira] [Created] (SPARK-8379) LeaseExpiredException when using dynamic partition with speculative execution

2015-06-15 Thread jeanlyn (JIRA)
jeanlyn created SPARK-8379: -- Summary: LeaseExpiredException when using dynamic partition with speculative execution Key: SPARK-8379 URL: https://issues.apache.org/jira/browse/SPARK-8379 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-5081) Shuffle write increases

2015-06-15 Thread Roi Reshef (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roi Reshef updated SPARK-5081: -- Comment: was deleted (was: Hi Guys, Was this issue already solved by any chance? I'm using Spark 1.3.1 f

[jira] [Resolved] (SPARK-8350) R unit tests output should be logged to "unit-tests.log"

2015-06-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8350. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 680

[jira] [Commented] (SPARK-8378) Add Spark Flume Python API

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586144#comment-14586144 ] Apache Spark commented on SPARK-8378: - User 'zsxwing' has created a pull request for t

[jira] [Created] (SPARK-8378) Add Spark Flume Python API

2015-06-15 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8378: --- Summary: Add Spark Flume Python API Key: SPARK-8378 URL: https://issues.apache.org/jira/browse/SPARK-8378 Project: Spark Issue Type: Improvement Comp

[jira] [Assigned] (SPARK-8378) Add Spark Flume Python API

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8378: --- Assignee: Apache Spark > Add Spark Flume Python API > -- > >

[jira] [Assigned] (SPARK-8378) Add Spark Flume Python API

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8378: --- Assignee: (was: Apache Spark) > Add Spark Flume Python API > -- >

[jira] [Commented] (SPARK-4644) Implement skewed join

2015-06-15 Thread Nathan McCarthy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14586076#comment-14586076 ] Nathan McCarthy commented on SPARK-4644: Something like this to make working with

[jira] [Assigned] (SPARK-8267) string function: trim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8267: --- Assignee: Apache Spark (was: Cheng Hao) > string function: trim > - > >

[jira] [Assigned] (SPARK-8253) string function: ltrim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8253: --- Assignee: Apache Spark (was: Cheng Hao) > string function: ltrim > -- >

[jira] [Commented] (SPARK-8260) string function: rtrim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14585934#comment-14585934 ] Apache Spark commented on SPARK-8260: - User 'chenghao-intel' has created a pull reques

[jira] [Assigned] (SPARK-8260) string function: rtrim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8260: --- Assignee: Cheng Hao (was: Apache Spark) > string function: rtrim > -- >

[jira] [Assigned] (SPARK-8253) string function: ltrim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8253: --- Assignee: Cheng Hao (was: Apache Spark) > string function: ltrim > -- >

[jira] [Commented] (SPARK-8267) string function: trim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14585935#comment-14585935 ] Apache Spark commented on SPARK-8267: - User 'chenghao-intel' has created a pull reques

[jira] [Commented] (SPARK-8253) string function: ltrim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14585933#comment-14585933 ] Apache Spark commented on SPARK-8253: - User 'chenghao-intel' has created a pull reques

[jira] [Assigned] (SPARK-8267) string function: trim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8267: --- Assignee: Cheng Hao (was: Apache Spark) > string function: trim > - > >

[jira] [Assigned] (SPARK-8260) string function: rtrim

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8260: --- Assignee: Apache Spark (was: Cheng Hao) > string function: rtrim > -- >

[jira] [Updated] (SPARK-8373) When an RDD has no partition, Python sum will throw "Can not reduce() empty RDD"

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8373: - Priority: Minor (was: Major) > When an RDD has no partition, Python sum will throw "Can not reduce() empt

[jira] [Commented] (SPARK-8373) When an RDD has no partition, Python sum will throw "Can not reduce() empty RDD"

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14585884#comment-14585884 ] Sean Owen commented on SPARK-8373: -- Really the same as SPARK-6878 https://github.com/apac

[jira] [Commented] (SPARK-6666) org.apache.spark.sql.jdbc.JDBCRDD does not escape/quote column names

2015-06-15 Thread Santiago M. Mola (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14585883#comment-14585883 ] Santiago M. Mola commented on SPARK-: - I opened SPARK-8377 to track the genera

[jira] [Created] (SPARK-8377) Identifiers caseness information should be available at any time

2015-06-15 Thread Santiago M. Mola (JIRA)
Santiago M. Mola created SPARK-8377: --- Summary: Identifiers caseness information should be available at any time Key: SPARK-8377 URL: https://issues.apache.org/jira/browse/SPARK-8377 Project: Spark

[jira] [Resolved] (SPARK-8375) BinaryClassificationMetrics in ML Lib has odd API

2015-06-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8375. -- Resolution: Invalid @sam This is a discussion for the mailing list rather than a JIRA. https://cwiki.apa

[jira] [Assigned] (SPARK-8376) Commons Lang 3 is one of the required JAR of Spark Flume Sink but is missing in the docs

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8376: --- Assignee: (was: Apache Spark) > Commons Lang 3 is one of the required JAR of Spark Flume

[jira] [Assigned] (SPARK-8376) Commons Lang 3 is one of the required JAR of Spark Flume Sink but is missing in the docs

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8376: --- Assignee: Apache Spark > Commons Lang 3 is one of the required JAR of Spark Flume Sink but is

[jira] [Commented] (SPARK-8376) Commons Lang 3 is one of the required JAR of Spark Flume Sink but is missing in the docs

2015-06-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14585833#comment-14585833 ] Apache Spark commented on SPARK-8376: - User 'zsxwing' has created a pull request for t

[jira] [Created] (SPARK-8376) Commons Lang 3 is one of the required JAR of Spark Flume Sink but is missing in the docs

2015-06-15 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8376: --- Summary: Commons Lang 3 is one of the required JAR of Spark Flume Sink but is missing in the docs Key: SPARK-8376 URL: https://issues.apache.org/jira/browse/SPARK-8376

[jira] [Updated] (SPARK-8375) BinaryClassificationMetrics in ML Lib has odd API

2015-06-15 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sam updated SPARK-8375: --- Description: According to https://spark.apache.org/docs/1.0.0/api/scala/index.html#org.apache.spark.mllib.evaluation.

[jira] [Created] (SPARK-8375) BinaryClassificationMetrics in ML Lib has odd API

2015-06-15 Thread sam (JIRA)
sam created SPARK-8375: -- Summary: BinaryClassificationMetrics in ML Lib has odd API Key: SPARK-8375 URL: https://issues.apache.org/jira/browse/SPARK-8375 Project: Spark Issue Type: Bug Compone

[jira] [Commented] (SPARK-2898) Failed to connect to daemon

2015-06-15 Thread Peter Taylor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14585809#comment-14585809 ] Peter Taylor commented on SPARK-2898: - FYI java.io.IOException: Cannot run program "

[jira] [Created] (SPARK-8374) Job frequently hangs after YARN preemption

2015-06-15 Thread Shay Rojansky (JIRA)
Shay Rojansky created SPARK-8374: Summary: Job frequently hangs after YARN preemption Key: SPARK-8374 URL: https://issues.apache.org/jira/browse/SPARK-8374 Project: Spark Issue Type: Bug

  1   2   >