[jira] [Assigned] (SPARK-8221) math function: pmod

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8221: --- Assignee: zhichao-li (was: Apache Spark) > math function: pmod > --- > >

[jira] [Commented] (SPARK-8221) math function: pmod

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583068#comment-14583068 ] Apache Spark commented on SPARK-8221: - User 'zhichao-li' has created a pull request fo

[jira] [Assigned] (SPARK-8221) math function: pmod

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8221: --- Assignee: Apache Spark (was: zhichao-li) > math function: pmod > --- > >

[jira] [Comment Edited] (SPARK-7106) Support model save/load in Python's FPGrowth

2015-06-12 Thread Hrishikesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581754#comment-14581754 ] Hrishikesh edited comment on SPARK-7106 at 6/12/15 7:32 AM: [~

[jira] [Commented] (SPARK-7106) Support model save/load in Python's FPGrowth

2015-06-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583106#comment-14583106 ] Joseph K. Bradley commented on SPARK-7106: -- [~hrishikesh91] Yes, it should. Adde

[jira] [Commented] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-06-12 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583115#comment-14583115 ] Saisai Shao commented on SPARK-8297: Hi [~mridulm80], I'm trying to simulate your scen

[jira] [Commented] (SPARK-6724) Model import/export for FPGrowth

2015-06-12 Thread Hrishikesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583139#comment-14583139 ] Hrishikesh commented on SPARK-6724: --- [~josephkb], please assign this ticket to me. > Mo

[jira] [Commented] (SPARK-7938) Use errorprone in Spark

2015-06-12 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583143#comment-14583143 ] Yijie Shen commented on SPARK-7938: --- What's the status of this ticket? Do we still need

[jira] [Commented] (SPARK-7938) Use errorprone in Spark

2015-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583147#comment-14583147 ] Reynold Xin commented on SPARK-7938: Yes. Just super swamped prior to Spark Summit. >

[jira] [Commented] (SPARK-8237) misc function: sha2

2015-06-12 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583167#comment-14583167 ] Liang-Chi Hsieh commented on SPARK-8237: I'll take this. Thanks. > misc function:

[jira] [Commented] (SPARK-7938) Use errorprone in Spark

2015-06-12 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583191#comment-14583191 ] Yijie Shen commented on SPARK-7938: --- Get it. :) > Use errorprone in Spark > ---

[jira] [Updated] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6197: - Target Version/s: 1.3.2, 1.4.1 (was: 1.3.2, 1.4.0) > handle json parse exception for eventlog file not fi

[jira] [Updated] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6197: - Fix Version/s: (was: 1.4.0) > handle json parse exception for eventlog file not finished writing > --

[jira] [Updated] (SPARK-8119) Spark will set total executor when some executors fail.

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8119: - Fix Version/s: (was: 1.4.0) > Spark will set total executor when some executors fail. > --

[jira] [Updated] (SPARK-8287) Filters not pushed with substitution through aggregation

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8287: - Target Version/s: (was: 1.5.0) > Filters not pushed with substitution through aggregation >

[jira] [Updated] (SPARK-8287) Filters not pushed with substitution through aggregation

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8287: - Fix Version/s: (was: 1.4.0) > Filters not pushed with substitution through aggregation > -

[jira] [Commented] (SPARK-8311) saveAsTextFile with Hadoop1 could lead to errors

2015-06-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583202#comment-14583202 ] Cheng Lian commented on SPARK-8311: --- Hi [~shivaram], what version of Hadoop 1 were you u

[jira] [Resolved] (SPARK-8173) A class which holds all the constants should be present

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8173. -- Resolution: Won't Fix > A class which holds all the constants should be present > --

[jira] [Commented] (SPARK-7993) Improve DataFrame.show() output

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583218#comment-14583218 ] Apache Spark commented on SPARK-7993: - User 'zsxwing' has created a pull request for t

[jira] [Created] (SPARK-8324) Register Query as view through JDBC interface

2015-06-12 Thread Mayoor Rao (JIRA)
Mayoor Rao created SPARK-8324: - Summary: Register Query as view through JDBC interface Key: SPARK-8324 URL: https://issues.apache.org/jira/browse/SPARK-8324 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-8324) Register Query as view through JDBC interface

2015-06-12 Thread Mayoor Rao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayoor Rao updated SPARK-8324: -- Description: We currently have capability of adding csv, json, parquet, etc files as table through beel

[jira] [Updated] (SPARK-8324) Register Query as view through JDBC interface

2015-06-12 Thread Mayoor Rao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayoor Rao updated SPARK-8324: -- Attachment: Jira_request_register_query_as_view.docx Further details are covered in the document > Regi

[jira] [Created] (SPARK-8325) Ability to provide role based row level authorization through Spark SQL

2015-06-12 Thread Mayoor Rao (JIRA)
Mayoor Rao created SPARK-8325: - Summary: Ability to provide role based row level authorization through Spark SQL Key: SPARK-8325 URL: https://issues.apache.org/jira/browse/SPARK-8325 Project: Spark

[jira] [Updated] (SPARK-8325) Ability to provide role based row level authorization through Spark SQL

2015-06-12 Thread Mayoor Rao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayoor Rao updated SPARK-8325: -- Attachment: Jira_request_table_authorization.docx More details are covered in the attached document > A

[jira] [Created] (SPARK-8326) Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'spark_2_2_*'' returned 1. Error: Nothing to do

2015-06-12 Thread Judge Hiciano (JIRA)
Judge Hiciano created SPARK-8326: Summary: Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'spark_2_2_*'' returned 1. Error: Nothing to do Key: SPARK-8326 URL: https://issues.apache.org/jira/browse/SPARK-832

[jira] [Resolved] (SPARK-8326) Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'spark_2_2_*'' returned 1. Error: Nothing to do

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8326. -- Resolution: Invalid This is not related to any packaging provided by spark. > Fail: Execution of '/usr/

[jira] [Created] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
Vladimir Vladimirov created SPARK-8327: -- Summary: Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2 Key: SPARK-8327 URL: https://issues.apache.org/jira/browse/SPARK-8327

[jira] [Commented] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583400#comment-14583400 ] Vladimir Vladimirov commented on SPARK-8327: There is a fix for spark 1.3.1 in

[jira] [Commented] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583418#comment-14583418 ] Vladimir Vladimirov commented on SPARK-8327: Root cause: ganglia/init.sh scrip

[jira] [Commented] (SPARK-8159) Improve SQL/DataFrame expression coverage

2015-06-12 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583423#comment-14583423 ] Jérémy Subtil commented on SPARK-8159: -- I'd be interested by {{collect_set}} and {{co

[jira] [Updated] (SPARK-8128) Schema Merging Broken: Dataframe Fails to Recognize Column in Schema

2015-06-12 Thread Brad Willard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brad Willard updated SPARK-8128: Description: I'm loading a folder of parquet files with about 600 parquet files and loading it into

[jira] [Resolved] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8322. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 677

[jira] [Commented] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583559#comment-14583559 ] Shivaram Venkataraman commented on SPARK-8322: -- [~srowen] Could you assign th

[jira] [Commented] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-06-12 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583560#comment-14583560 ] Mridul Muralidharan commented on SPARK-8297: I am not sure why the spark appl

[jira] [Commented] (SPARK-8311) saveAsTextFile with Hadoop1 could lead to errors

2015-06-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583561#comment-14583561 ] Shivaram Venkataraman commented on SPARK-8311: -- [~lian cheng] I was using Had

[jira] [Resolved] (SPARK-8143) Spark application history cannot be found even for finished jobs

2015-06-12 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani resolved SPARK-8143. Resolution: Fixed Fix Version/s: 1.4.0 Verified, history for killed jobs are now available in

[jira] [Updated] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8322: - Assignee: Mark Smith > EC2 script not fully updated for 1.4.0 release > --

[jira] [Created] (SPARK-8328) Add a CheckAnalysis rule to ensure that Union branches have the same schema

2015-06-12 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-8328: - Summary: Add a CheckAnalysis rule to ensure that Union branches have the same schema Key: SPARK-8328 URL: https://issues.apache.org/jira/browse/SPARK-8328 Project: Spark

[jira] [Updated] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-8327: --- Description: exception shown {code} [FAILED] Starting httpd: httpd: Syntax error on li

[jira] [Comment Edited] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583418#comment-14583418 ] Vladimir Vladimirov edited comment on SPARK-8327 at 6/12/15 4:05 PM: ---

[jira] [Updated] (SPARK-8329) DataSource options parser no longer accepts '_' or '.'

2015-06-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8329: Description: This is a regression from 1.3.1 > DataSource options parser no longer accepts '

[jira] [Created] (SPARK-8329) DataSource options parser no longer accepts '_' or '.'

2015-06-12 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-8329: --- Summary: DataSource options parser no longer accepts '_' or '.' Key: SPARK-8329 URL: https://issues.apache.org/jira/browse/SPARK-8329 Project: Spark Is

[jira] [Resolved] (SPARK-7993) Improve DataFrame.show() output

2015-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7993. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Akhil Thatipamula > Improve DataFra

[jira] [Commented] (SPARK-6723) Model import/export for ChiSqSelector

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583753#comment-14583753 ] Apache Spark commented on SPARK-6723: - User 'jayantshekhar' has created a pull request

[jira] [Assigned] (SPARK-6723) Model import/export for ChiSqSelector

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6723: --- Assignee: (was: Apache Spark) > Model import/export for ChiSqSelector > -

[jira] [Assigned] (SPARK-6723) Model import/export for ChiSqSelector

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6723: --- Assignee: Apache Spark > Model import/export for ChiSqSelector >

[jira] [Commented] (SPARK-8159) Improve SQL/DataFrame expression coverage

2015-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583758#comment-14583758 ] Reynold Xin commented on SPARK-8159: [~jersub] sure -- let's wait a bit though. The re

[jira] [Commented] (SPARK-8301) Improve UTF8String substring/startsWith/endsWith/contains performance

2015-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583760#comment-14583760 ] Reynold Xin commented on SPARK-8301: I think we can take whatever the JVM source code

[jira] [Updated] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8322: - Fix Version/s: 1.4.1 > EC2 script not fully updated for 1.4.0 release > --

[jira] [Updated] (SPARK-8329) DataSource options parser no longer accepts '_'

2015-06-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8329: Summary: DataSource options parser no longer accepts '_' (was: DataSource options parser no

[jira] [Created] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Andrew Or (JIRA)
Andrew Or created SPARK-8330: Summary: DAG visualization: trim whitespace from input Key: SPARK-8330 URL: https://issues.apache.org/jira/browse/SPARK-8330 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-8329) DataSource options parser no longer accepts '_'

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8329: --- Assignee: Apache Spark (was: Michael Armbrust) > DataSource options parser no longer accepts

[jira] [Commented] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583781#comment-14583781 ] Andrew Or commented on SPARK-8330: -- First part is merged here https://github.com/apache/s

[jira] [Updated] (SPARK-7463) DAG visualization improvements

2015-06-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7463: - Summary: DAG visualization improvements (was: Dag visualization improvements) > DAG visualization improv

[jira] [Assigned] (SPARK-8329) DataSource options parser no longer accepts '_'

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8329: --- Assignee: Michael Armbrust (was: Apache Spark) > DataSource options parser no longer accepts

[jira] [Commented] (SPARK-8329) DataSource options parser no longer accepts '_'

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583779#comment-14583779 ] Apache Spark commented on SPARK-8329: - User 'marmbrus' has created a pull request for

[jira] [Commented] (SPARK-6723) Model import/export for ChiSqSelector

2015-06-12 Thread Jayant Shekhar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583794#comment-14583794 ] Jayant Shekhar commented on SPARK-6723: --- Hey Joseph, I created a pull request for t

[jira] [Commented] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583806#comment-14583806 ] Apache Spark commented on SPARK-8330: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8330: --- Assignee: Andrew Or (was: Apache Spark) > DAG visualization: trim whitespace from input > --

[jira] [Assigned] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8330: --- Assignee: Apache Spark (was: Andrew Or) > DAG visualization: trim whitespace from input > --

[jira] [Created] (SPARK-8331) DirectStream wont work

2015-06-12 Thread sid (JIRA)
sid created SPARK-8331: -- Summary: DirectStream wont work Key: SPARK-8331 URL: https://issues.apache.org/jira/browse/SPARK-8331 Project: Spark Issue Type: Bug Components: Streaming Affects

[jira] [Resolved] (SPARK-8331) DirectStream wont work

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8331. -- Resolution: Invalid I think this should start as a question on user@ since there are really a bunch of

[jira] [Commented] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583822#comment-14583822 ] Andrew Or commented on SPARK-8330: -- Second part is merged here: https://github.com/apache

[jira] [Closed] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8330. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 > DAG visualization: trim whitespace

[jira] [Commented] (SPARK-7028) Add filterNot to RDD

2015-06-12 Thread Eran Medan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583826#comment-14583826 ] Eran Medan commented on SPARK-7028: --- [~srowen] - I completely agreed with you, until I s

[jira] [Commented] (SPARK-7028) Add filterNot to RDD

2015-06-12 Thread Eran Medan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583835#comment-14583835 ] Eran Medan commented on SPARK-7028: --- Oh, just realised I can just click reply instead of

[jira] [Commented] (SPARK-2336) Approximate k-NN Models for MLLib

2015-06-12 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583886#comment-14583886 ] Debasish Das commented on SPARK-2336: - Very cool idea Sen. Did you also look into FLAN

[jira] [Comment Edited] (SPARK-2336) Approximate k-NN Models for MLLib

2015-06-12 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583886#comment-14583886 ] Debasish Das edited comment on SPARK-2336 at 6/12/15 6:51 PM: --

[jira] [Created] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-06-12 Thread Tao Li (JIRA)
Tao Li created SPARK-8332: - Summary: NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer Key: SPARK-8332 URL: https://issues.apache.org/jira/browse/SPARK-8332 Project: Spark

[jira] [Updated] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-06-12 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated SPARK-8332: -- Description: I complied new spark 1.4.0 versio. But when I run a simple WordCount demo, it throws NoSuchMethodE

[jira] [Commented] (SPARK-8095) Spark package dependencies not resolved when package is in local-ivy-cache

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583916#comment-14583916 ] Apache Spark commented on SPARK-8095: - User 'brkyvz' has created a pull request for th

[jira] [Commented] (SPARK-4233) Simplify the Aggregation Function implementation

2015-06-12 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583931#comment-14583931 ] Herman van Hovell tot Westerflier commented on SPARK-4233: -- Ok, s

[jira] [Reopened] (SPARK-7897) Column with an unsigned bigint should be treated as DecimalType in JDBCRDD

2015-06-12 Thread Rene Treffer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rene Treffer reopened SPARK-7897: - I think this should be Decimal(20,0), not Decimal.Unlimited > Column with an unsigned bigint should b

[jira] [Commented] (SPARK-7897) Column with an unsigned bigint should be treated as DecimalType in JDBCRDD

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583937#comment-14583937 ] Apache Spark commented on SPARK-7897: - User 'rtreffer' has created a pull request for

[jira] [Created] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2015-06-12 Thread sheng (JIRA)
sheng created SPARK-8333: Summary: Spark failed to delete temp directory created by HiveContext Key: SPARK-8333 URL: https://issues.apache.org/jira/browse/SPARK-8333 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Navis (JIRA)
Navis created SPARK-8334: Summary: Binary logical plan should provide more realistic statistics Key: SPARK-8334 URL: https://issues.apache.org/jira/browse/SPARK-8334 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-7712) Native Spark Window Functions & Performance Improvements

2015-06-12 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583966#comment-14583966 ] Herman van Hovell tot Westerflier commented on SPARK-7712: -- A sma

[jira] [Comment Edited] (SPARK-7712) Native Spark Window Functions & Performance Improvements

2015-06-12 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583966#comment-14583966 ] Herman van Hovell tot Westerflier edited comment on SPARK-7712 at 6/12/15 7:49 PM:

[jira] [Comment Edited] (SPARK-7712) Native Spark Window Functions & Performance Improvements

2015-06-12 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583966#comment-14583966 ] Herman van Hovell tot Westerflier edited comment on SPARK-7712 at 6/12/15 7:49 PM:

[jira] [Assigned] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8334: --- Assignee: (was: Apache Spark) > Binary logical plan should provide more realistic statist

[jira] [Commented] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583980#comment-14583980 ] Apache Spark commented on SPARK-8334: - User 'navis' has created a pull request for thi

[jira] [Assigned] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8334: --- Assignee: Apache Spark > Binary logical plan should provide more realistic statistics > -

[jira] [Assigned] (SPARK-6259) Python API for LDA

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6259: --- Assignee: Apache Spark > Python API for LDA > -- > > Key: SPA

[jira] [Commented] (SPARK-6259) Python API for LDA

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584010#comment-14584010 ] Apache Spark commented on SPARK-6259: - User 'yu-iskw' has created a pull request for t

[jira] [Assigned] (SPARK-6259) Python API for LDA

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6259: --- Assignee: (was: Apache Spark) > Python API for LDA > -- > >

[jira] [Commented] (SPARK-6892) Recovery from checkpoint will also reuse the application id when write eventLog in yarn-cluster mode

2015-06-12 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584086#comment-14584086 ] Hari Shreedharan commented on SPARK-6892: - This should have been fixed by SPARK-48

[jira] [Assigned] (SPARK-7186) Decouple internal Row from external Row

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7186: --- Assignee: Apache Spark (was: Davies Liu) > Decouple internal Row from external Row > ---

[jira] [Assigned] (SPARK-7186) Decouple internal Row from external Row

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7186: --- Assignee: Davies Liu (was: Apache Spark) > Decouple internal Row from external Row > ---

[jira] [Commented] (SPARK-7186) Decouple internal Row from external Row

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584151#comment-14584151 ] Apache Spark commented on SPARK-7186: - User 'davies' has created a pull request for th

[jira] [Resolved] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-06-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7819. - Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Yin Huai > Isolated Hive

[jira] [Resolved] (SPARK-7284) Update streaming documentation for Spark 1.4.0 release

2015-06-12 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7284. -- Resolution: Fixed Fix Version/s: 1.4.1 > Update streaming documentation for Spark 1.4.0 r

[jira] [Created] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-12 Thread Sebastian Walz (JIRA)
Sebastian Walz created SPARK-8335: - Summary: DecisionTreeModel.predict() return type not convenient! Key: SPARK-8335 URL: https://issues.apache.org/jira/browse/SPARK-8335 Project: Spark Issue

[jira] [Updated] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-12 Thread Sebastian Walz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Walz updated SPARK-8335: -- Description: org.apache.spark.mllib.tree.model.DecisionTreeModel has a predict method: def pred

[jira] [Updated] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-12 Thread Sebastian Walz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Walz updated SPARK-8335: -- Labels: easyfix machine_learning (was: easyfix) > DecisionTreeModel.predict() return type not c

[jira] [Created] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Ted Yu (JIRA)
Ted Yu created SPARK-8336: - Summary: Fix NullPointerException with functions.rand() Key: SPARK-8336 URL: https://issues.apache.org/jira/browse/SPARK-8336 Project: Spark Issue Type: Bug Re

[jira] [Commented] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584294#comment-14584294 ] Apache Spark commented on SPARK-8336: - User 'tedyu' has created a pull request for thi

[jira] [Assigned] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8336: --- Assignee: Apache Spark > Fix NullPointerException with functions.rand() > ---

[jira] [Assigned] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8336: --- Assignee: (was: Apache Spark) > Fix NullPointerException with functions.rand() >

[jira] [Updated] (SPARK-8318) Spark Streaming Starter JIRAs

2015-06-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8318: --- Issue Type: Improvement (was: Bug) > Spark Streaming Starter JIRAs >

[jira] [Updated] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8336: --- Component/s: SQL > Fix NullPointerException with functions.rand() > --

  1   2   >