[jira] [Updated] (SPARK-8268) string function: unbase64

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8268: --- Labels: missing-python (was: ) > string function: unbase64 > - > >

[jira] [Resolved] (SPARK-8268) string function: unbase64

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8268. Resolution: Fixed Fix Version/s: 1.5.0 > string function: unbase64 >

[jira] [Updated] (SPARK-8238) string function: ascii

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8238: --- Labels: missing-python (was: ) > string function: ascii > -- > >

[jira] [Updated] (SPARK-8239) string function: base64

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8239: --- Labels: missing-python (was: ) > string function: base64 > --- > >

[jira] [Updated] (SPARK-8242) string function: decode

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8242: --- Labels: missing-python (was: ) > string function: decode > --- > >

[jira] [Updated] (SPARK-8243) string function: encode

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8243: --- Labels: missing-python (was: ) > string function: encode > --- > >

[jira] [Resolved] (SPARK-8243) string function: encode

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8243. Resolution: Fixed Fix Version/s: 1.5.0 > string function: encode > --- >

[jira] [Resolved] (SPARK-8242) string function: decode

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8242. Resolution: Fixed Fix Version/s: 1.5.0 > string function: decode > --- >

[jira] [Resolved] (SPARK-8238) string function: ascii

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8238. Resolution: Fixed Fix Version/s: 1.5.0 > string function: ascii > -- > >

[jira] [Resolved] (SPARK-8239) string function: base64

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8239. Resolution: Fixed Fix Version/s: 1.5.0 > string function: base64 > --- >

[jira] [Updated] (SPARK-8270) string function: levenshtein

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8270: --- Assignee: Tarek Auel (was: Cheng Hao) > string function: levenshtein > >

[jira] [Resolved] (SPARK-8777) Add random data generation test utilities to Spark SQL

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8777. Resolution: Fixed Fix Version/s: 1.5.0 > Add random data generation test utilities to Spark S

[jira] [Assigned] (SPARK-8822) clean up type checking in math.scala

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8822: --- Assignee: Apache Spark (was: Reynold Xin) > clean up type checking in math.scala > -

[jira] [Assigned] (SPARK-8822) clean up type checking in math.scala

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8822: --- Assignee: Reynold Xin (was: Apache Spark) > clean up type checking in math.scala > -

[jira] [Commented] (SPARK-8822) clean up type checking in math.scala

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613573#comment-14613573 ] Apache Spark commented on SPARK-8822: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-8822) clean up type checking in math.scala

2015-07-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8822: -- Summary: clean up type checking in math.scala Key: SPARK-8822 URL: https://issues.apache.org/jira/browse/SPARK-8822 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-8811) Read array struct data from parquet error

2015-07-03 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8811: -- Shepherd: Cheng Lian > Read array struct data from parquet error > -

[jira] [Created] (SPARK-8821) The ec2 script doesn't run on python 3 with an utf8 env

2015-07-03 Thread Simon Hafner (JIRA)
Simon Hafner created SPARK-8821: --- Summary: The ec2 script doesn't run on python 3 with an utf8 env Key: SPARK-8821 URL: https://issues.apache.org/jira/browse/SPARK-8821 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-8193) date/time function: current_timestamp

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8193. Resolution: Fixed Assignee: Adrian Wang Fix Version/s: 1.5.0 > date/time function: c

[jira] [Resolved] (SPARK-8192) date/time function: current_date

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8192. Resolution: Fixed Assignee: Adrian Wang Fix Version/s: 1.5.0 > date/time function: c

[jira] [Resolved] (SPARK-8572) Type coercion for ScalaUDFs

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8572. Resolution: Fixed Assignee: Cheolsoo Park Fix Version/s: 1.5.0 > Type coercion for S

[jira] [Assigned] (SPARK-8819) Spark doesn't compile with maven 3.3.x

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8819: --- Assignee: Andrew Or (was: Apache Spark) > Spark doesn't compile with maven 3.3.x > -

[jira] [Commented] (SPARK-8819) Spark doesn't compile with maven 3.3.x

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613565#comment-14613565 ] Apache Spark commented on SPARK-8819: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-8819) Spark doesn't compile with maven 3.3.x

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8819: --- Assignee: Apache Spark (was: Andrew Or) > Spark doesn't compile with maven 3.3.x > -

[jira] [Assigned] (SPARK-8820) Add a configuration to set the checkpoint directory for convenience.

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8820: --- Assignee: (was: Apache Spark) > Add a configuration to set the checkpoint directory for c

[jira] [Commented] (SPARK-8820) Add a configuration to set the checkpoint directory for convenience.

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613562#comment-14613562 ] Apache Spark commented on SPARK-8820: - User 'SaintBacchus' has created a pull request

[jira] [Assigned] (SPARK-8820) Add a configuration to set the checkpoint directory for convenience.

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8820: --- Assignee: Apache Spark > Add a configuration to set the checkpoint directory for convenience.

[jira] [Created] (SPARK-8820) Add a configuration to set the checkpoint directory for convenience.

2015-07-03 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-8820: --- Summary: Add a configuration to set the checkpoint directory for convenience. Key: SPARK-8820 URL: https://issues.apache.org/jira/browse/SPARK-8820 Project: Spark

[jira] [Updated] (SPARK-8819) Spark doesn't compile with maven 3.3.x

2015-07-03 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8819: - Description: Simple reproduction: Install maven 3.3.3 and run "build/mvn clean package -DskipTests" This

[jira] [Created] (SPARK-8819) Spark doesn't compile with maven 3.3.x

2015-07-03 Thread Andrew Or (JIRA)
Andrew Or created SPARK-8819: Summary: Spark doesn't compile with maven 3.3.x Key: SPARK-8819 URL: https://issues.apache.org/jira/browse/SPARK-8819 Project: Spark Issue Type: Bug Compon

[jira] [Resolved] (SPARK-8810) Gaps in SQL UDF test coverage

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8810. Resolution: Fixed Assignee: Spiro Michaylov Fix Version/s: 1.5.0 > Gaps in SQL UDF t

[jira] [Commented] (SPARK-8706) Implement Pylint / Prospector checks for PySpark

2015-07-03 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613546#comment-14613546 ] Josh Rosen commented on SPARK-8706: --- Good question. I don't know that we necessarily hav

[jira] [Commented] (SPARK-8815) illegal java package names in jar

2015-07-03 Thread Sam Halliday (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613534#comment-14613534 ] Sam Halliday commented on SPARK-8815: - I wouldn't feel too bad about it, the SUN/Oracl

[jira] [Resolved] (SPARK-7401) Dot product and squared_distances should be vectorized in Vectors

2015-07-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-7401. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 5946 [https://github.com/

[jira] [Commented] (SPARK-8657) Fail to upload conf archive to viewfs

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613493#comment-14613493 ] Apache Spark commented on SPARK-8657: - User 'litao-buptsse' has created a pull request

[jira] [Commented] (SPARK-8636) CaseKeyWhen has incorrect NULL handling

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613492#comment-14613492 ] Apache Spark commented on SPARK-8636: - User 'animeshbaranawal' has created a pull requ

[jira] [Resolved] (SPARK-8226) math function: shiftrightunsigned

2015-07-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8226. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7035 [https://github.com/

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613468#comment-14613468 ] Apache Spark commented on SPARK-6910: - User 'piaozhexiu' has created a pull request fo

[jira] [Commented] (SPARK-6485) Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark

2015-07-03 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613447#comment-14613447 ] Mike Dusenberry commented on SPARK-6485: I've been delayed by a few other tasks, b

[jira] [Commented] (SPARK-8806) run-tests scala style must fail if it does not adhere to Spark Code Style Guide

2015-07-03 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613445#comment-14613445 ] Rekha Joshi commented on SPARK-8806: thank you [~joshrosen] that makes sense, added my

[jira] [Assigned] (SPARK-8270) string function: levenshtein

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8270: --- Assignee: Apache Spark (was: Cheng Hao) > string function: levenshtein > ---

[jira] [Assigned] (SPARK-8270) string function: levenshtein

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8270: --- Assignee: Cheng Hao (was: Apache Spark) > string function: levenshtein > ---

[jira] [Commented] (SPARK-8270) string function: levenshtein

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613437#comment-14613437 ] Apache Spark commented on SPARK-8270: - User 'tarekauel' has created a pull request for

[jira] [Created] (SPARK-8818) In should not take Any not Column

2015-07-03 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-8818: --- Summary: In should not take Any not Column Key: SPARK-8818 URL: https://issues.apache.org/jira/browse/SPARK-8818 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5707: --- Assignee: Apache Spark (was: Ram Sriharsha) > Enabling spark.sql.codegen throws ClassNotFoun

[jira] [Assigned] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5707: --- Assignee: Ram Sriharsha (was: Apache Spark) > Enabling spark.sql.codegen throws ClassNotFoun

[jira] [Commented] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613412#comment-14613412 ] Apache Spark commented on SPARK-5707: - User 'marmbrus' has created a pull request for

[jira] [Commented] (SPARK-8817) DataFrame should not allow duplicate colum names

2015-07-03 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613389#comment-14613389 ] koert kuipers commented on SPARK-8817: -- its also worth pointing out that panda's deci

[jira] [Commented] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

2015-07-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613383#comment-14613383 ] Michael Armbrust commented on SPARK-5707: - This is still broken even with the rece

[jira] [Created] (SPARK-8817) DataFrame should not allow duplicate colum names

2015-07-03 Thread koert kuipers (JIRA)
koert kuipers created SPARK-8817: Summary: DataFrame should not allow duplicate colum names Key: SPARK-8817 URL: https://issues.apache.org/jira/browse/SPARK-8817 Project: Spark Issue Type: Bu

[jira] [Resolved] (SPARK-8806) run-tests scala style must fail if it does not adhere to Spark Code Style Guide

2015-07-03 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8806. --- Resolution: Duplicate > run-tests scala style must fail if it does not adhere to Spark Code Style > G

[jira] [Commented] (SPARK-8806) run-tests scala style must fail if it does not adhere to Spark Code Style Guide

2015-07-03 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613363#comment-14613363 ] Josh Rosen commented on SPARK-8806: --- https://issues.apache.org/jira/browse/SPARK-3849 tr

[jira] [Commented] (SPARK-8815) illegal java package names in jar

2015-07-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613308#comment-14613308 ] Sean Owen commented on SPARK-8815: -- Hm, where in the JLS do you see that? I couldn't find

[jira] [Updated] (SPARK-8638) Window Function Performance Improvements

2015-07-03 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-8638: - Description: Improve the performance of Spark Window Funct

[jira] [Created] (SPARK-8816) Improve Performance of Unbounded Following Window Frame Processing

2015-07-03 Thread Herman van Hovell tot Westerflier (JIRA)
Herman van Hovell tot Westerflier created SPARK-8816: Summary: Improve Performance of Unbounded Following Window Frame Processing Key: SPARK-8816 URL: https://issues.apache.org/jira/browse/SPAR

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613277#comment-14613277 ] Shivaram Venkataraman commented on SPARK-8684: -- Yeah I tried to hack on this

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613273#comment-14613273 ] Shivaram Venkataraman commented on SPARK-8596: -- Some points that might be hel

[jira] [Created] (SPARK-8815) illegal java package names in jar

2015-07-03 Thread Sam Halliday (JIRA)
Sam Halliday created SPARK-8815: --- Summary: illegal java package names in jar Key: SPARK-8815 URL: https://issues.apache.org/jira/browse/SPARK-8815 Project: Spark Issue Type: Bug Rep

[jira] [Commented] (SPARK-8518) Log-linear models for survival analysis

2015-07-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613258#comment-14613258 ] Yanbo Liang commented on SPARK-8518: I will work on it. > Log-linear models for survi

[jira] [Assigned] (SPARK-6305) Add support for log4j 2.x to Spark

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6305: --- Assignee: Apache Spark > Add support for log4j 2.x to Spark > ---

[jira] [Assigned] (SPARK-6305) Add support for log4j 2.x to Spark

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6305: --- Assignee: (was: Apache Spark) > Add support for log4j 2.x to Spark >

[jira] [Assigned] (SPARK-8800) Spark SQL Decimal Division operation loss of precision/scale when type is defined as DecimalType.Unlimited

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8800: --- Assignee: (was: Apache Spark) > Spark SQL Decimal Division operation loss of precision/sc

[jira] [Assigned] (SPARK-8800) Spark SQL Decimal Division operation loss of precision/scale when type is defined as DecimalType.Unlimited

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8800: --- Assignee: Apache Spark > Spark SQL Decimal Division operation loss of precision/scale when ty

[jira] [Commented] (SPARK-8800) Spark SQL Decimal Division operation loss of precision/scale when type is defined as DecimalType.Unlimited

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613242#comment-14613242 ] Apache Spark commented on SPARK-8800: - User 'viirya' has created a pull request for th

[jira] [Commented] (SPARK-7398) Add back-pressure to Spark Streaming

2015-07-03 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613240#comment-14613240 ] Iulian Dragos commented on SPARK-7398: -- Document updated. > Add back-pressure to Spa

[jira] [Commented] (SPARK-8370) Add API for data sources to register databases

2015-07-03 Thread SATHISH KUMARAN VAIRAVELU (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613239#comment-14613239 ] SATHISH KUMARAN VAIRAVELU commented on SPARK-8370: -- The data source API c

[jira] [Updated] (SPARK-8796) make sure SparkPlan is only executed at driver side

2015-07-03 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-8796: --- Summary: make sure SparkPlan is only executed at driver side (was: mark child as transient in InsertI

[jira] [Issue Comment Deleted] (SPARK-8796) make sure SparkPlan is only executed at driver side

2015-07-03 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-8796: --- Comment: was deleted (was: we can still avoid transient in `TakeOrderedAndProject`) > make sure Spark

[jira] [Resolved] (SPARK-8814) Ganglia (apache) does not start on its own Amazon Linux

2015-07-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8814. -- Resolution: Invalid Not Spark-related? > Ganglia (apache) does not start on its own Amazon Linux >

[jira] [Created] (SPARK-8814) Ganglia (apache) does not start on its own Amazon Linux

2015-07-03 Thread Abhishek Amralkar (JIRA)
Abhishek Amralkar created SPARK-8814: Summary: Ganglia (apache) does not start on its own Amazon Linux Key: SPARK-8814 URL: https://issues.apache.org/jira/browse/SPARK-8814 Project: Spark

[jira] [Comment Edited] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-03 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613018#comment-14613018 ] Vincent Warmerdam edited comment on SPARK-8596 at 7/3/15 10:21 AM: -

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-03 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613100#comment-14613100 ] Vincent Warmerdam commented on SPARK-8596: -- We just found that `chmod a+w /mnt/sp

[jira] [Comment Edited] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-03 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613018#comment-14613018 ] Vincent Warmerdam edited comment on SPARK-8596 at 7/3/15 9:59 AM: --

[jira] [Updated] (SPARK-8678) Default values in Pipeline API should be immutable

2015-07-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8678: - Fix Version/s: (was: 1.4.2.) 1.4.2 > Default values in Pipeline API should be immut

[jira] [Updated] (SPARK-8800) Spark SQL Decimal Division operation loss of precision/scale when type is defined as DecimalType.Unlimited

2015-07-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8800: - Component/s: SQL > Spark SQL Decimal Division operation loss of precision/scale when type is > defined as

[jira] [Assigned] (SPARK-8531) Update ML user guide for MinMaxScaler

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8531: --- Assignee: Apache Spark > Update ML user guide for MinMaxScaler >

[jira] [Assigned] (SPARK-8531) Update ML user guide for MinMaxScaler

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8531: --- Assignee: (was: Apache Spark) > Update ML user guide for MinMaxScaler > -

[jira] [Commented] (SPARK-8531) Update ML user guide for MinMaxScaler

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613025#comment-14613025 ] Apache Spark commented on SPARK-8531: - User 'hhbyyh' has created a pull request for th

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-03 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613018#comment-14613018 ] Vincent Warmerdam commented on SPARK-8596: -- I now have a more elegant way to get

[jira] [Assigned] (SPARK-8813) Support combine text/parquet format file in SQL

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8813: --- Assignee: (was: Apache Spark) > Support combine text/parquet format file in SQL > ---

[jira] [Assigned] (SPARK-8813) Support combine text/parquet format file in SQL

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8813: --- Assignee: Apache Spark > Support combine text/parquet format file in SQL > --

[jira] [Commented] (SPARK-8813) Support combine text/parquet format file in SQL

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14613002#comment-14613002 ] Apache Spark commented on SPARK-8813: - User 'watermen' has created a pull request for

[jira] [Updated] (SPARK-8813) Support combine text/parquet format file in SQL

2015-07-03 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-8813: - Summary: Support combine text/parquet format file in SQL (was: Support combine text/parquet format file i

[jira] [Created] (SPARK-8813) Support combine text/parquet format file in SQL.

2015-07-03 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-8813: Summary: Support combine text/parquet format file in SQL. Key: SPARK-8813 URL: https://issues.apache.org/jira/browse/SPARK-8813 Project: Spark Issue Type: Improvemen

[jira] [Created] (SPARK-8812) Support combine text/parquet format file in sql

2015-07-03 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-8812: Summary: Support combine text/parquet format file in sql Key: SPARK-8812 URL: https://issues.apache.org/jira/browse/SPARK-8812 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-8811) Read array struct data from parquet error

2015-07-03 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-8811: Description: Now we have a table which have some array> fields, we save the table data as parquet. But we

[jira] [Assigned] (SPARK-8811) Read array struct data from parquet error

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8811: --- Assignee: Apache Spark > Read array struct data from parquet error >

[jira] [Commented] (SPARK-8811) Read array struct data from parquet error

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14612986#comment-14612986 ] Apache Spark commented on SPARK-8811: - User 'Sephiroth-Lin' has created a pull request

[jira] [Assigned] (SPARK-8811) Read array struct data from parquet error

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8811: --- Assignee: (was: Apache Spark) > Read array struct data from parquet error > -

[jira] [Created] (SPARK-8811) Read array struct data from parquet error

2015-07-03 Thread Weizhong (JIRA)
Weizhong created SPARK-8811: --- Summary: Read array struct data from parquet error Key: SPARK-8811 URL: https://issues.apache.org/jira/browse/SPARK-8811 Project: Spark Issue Type: Bug Compo

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-03 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14612964#comment-14612964 ] Vincent Warmerdam commented on SPARK-8684: -- I've tried a different approach, whic

[jira] [Resolved] (SPARK-8805) Spark shell not working

2015-07-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8805. -- Resolution: Cannot Reproduce I can't reproduce this on any version of bash, and since it would probably

[jira] [Assigned] (SPARK-8269) string function: initcap

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8269: --- Assignee: Cheng Hao (was: Apache Spark) > string function: initcap > ---

[jira] [Commented] (SPARK-8269) string function: initcap

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14612935#comment-14612935 ] Apache Spark commented on SPARK-8269: - User 'HuJiayin' has created a pull request for

[jira] [Assigned] (SPARK-8269) string function: initcap

2015-07-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8269: --- Assignee: Apache Spark (was: Cheng Hao) > string function: initcap > ---

[jira] [Resolved] (SPARK-8809) Remove ConvertNaNs analyzer rule

2015-07-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8809. Resolution: Fixed Fix Version/s: 1.5.0 > Remove ConvertNaNs analyzer rule > -

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

2015-07-03 Thread Tomasz Bartczak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14612929#comment-14612929 ] Tomasz Bartczak commented on SPARK-7483: hmm that's right - adding it in FPGrowthS