[jira] [Commented] (SPARK-8370) Add API for data sources to register databases

[ https://issues.apache.org/jira/browse/SPARK-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613239#comment-14613239 ] SATHISH KUMARAN VAIRAVELU commented on SPARK-8370: -- The data source API

[jira] [Updated] (SPARK-8796) make sure SparkPlan is only executed at driver side

[ https://issues.apache.org/jira/browse/SPARK-8796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-8796: --- Summary: make sure SparkPlan is only executed at driver side (was: mark child as transient in

[jira] [Resolved] (SPARK-8814) Ganglia (apache) does not start on its own Amazon Linux

[ https://issues.apache.org/jira/browse/SPARK-8814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8814. -- Resolution: Invalid Not Spark-related? Ganglia (apache) does not start on its own Amazon Linux

[jira] [Commented] (SPARK-8800) Spark SQL Decimal Division operation loss of precision/scale when type is defined as DecimalType.Unlimited

[ https://issues.apache.org/jira/browse/SPARK-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613242#comment-14613242 ] Apache Spark commented on SPARK-8800: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-8800) Spark SQL Decimal Division operation loss of precision/scale when type is defined as DecimalType.Unlimited

[ https://issues.apache.org/jira/browse/SPARK-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8800: --- Assignee: Apache Spark Spark SQL Decimal Division operation loss of precision/scale when

[jira] [Commented] (SPARK-7398) Add back-pressure to Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613240#comment-14613240 ] Iulian Dragos commented on SPARK-7398: -- Document updated. Add back-pressure to

[jira] [Created] (SPARK-8814) Ganglia (apache) does not start on its own Amazon Linux

Abhishek Amralkar created SPARK-8814: Summary: Ganglia (apache) does not start on its own Amazon Linux Key: SPARK-8814 URL: https://issues.apache.org/jira/browse/SPARK-8814 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-8796) make sure SparkPlan is only executed at driver side

[ https://issues.apache.org/jira/browse/SPARK-8796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-8796: --- Comment: was deleted (was: we can still avoid transient in `TakeOrderedAndProject`) make sure

[jira] [Assigned] (SPARK-8800) Spark SQL Decimal Division operation loss of precision/scale when type is defined as DecimalType.Unlimited

[ https://issues.apache.org/jira/browse/SPARK-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8800: --- Assignee: (was: Apache Spark) Spark SQL Decimal Division operation loss of

[jira] [Resolved] (SPARK-8806) run-tests scala style must fail if it does not adhere to Spark Code Style Guide

[ https://issues.apache.org/jira/browse/SPARK-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8806. --- Resolution: Duplicate run-tests scala style must fail if it does not adhere to Spark Code Style

[jira] [Created] (SPARK-8815) illegal java package names in jar

Sam Halliday created SPARK-8815: --- Summary: illegal java package names in jar Key: SPARK-8815 URL: https://issues.apache.org/jira/browse/SPARK-8815 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613277#comment-14613277 ] Shivaram Venkataraman commented on SPARK-8684: -- Yeah I tried to hack on this

[jira] [Commented] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613383#comment-14613383 ] Michael Armbrust commented on SPARK-5707: - This is still broken even with the

[jira] [Assigned] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6305: --- Assignee: (was: Apache Spark) Add support for log4j 2.x to Spark

[jira] [Assigned] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6305: --- Assignee: Apache Spark Add support for log4j 2.x to Spark

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613273#comment-14613273 ] Shivaram Venkataraman commented on SPARK-8596: -- Some points that might be

[jira] [Updated] (SPARK-8638) Window Function Performance Improvements

[ https://issues.apache.org/jira/browse/SPARK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-8638: - Description: Improve the performance of Spark Window

[jira] [Commented] (SPARK-8815) illegal java package names in jar

[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613308#comment-14613308 ] Sean Owen commented on SPARK-8815: -- Hm, where in the JLS do you see that? I couldn't find

[jira] [Commented] (SPARK-8817) DataFrame should not allow duplicate colum names

[ https://issues.apache.org/jira/browse/SPARK-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613389#comment-14613389 ] koert kuipers commented on SPARK-8817: -- its also worth pointing out that panda's

[jira] [Assigned] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5707: --- Assignee: Ram Sriharsha (was: Apache Spark) Enabling spark.sql.codegen throws

[jira] [Commented] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613412#comment-14613412 ] Apache Spark commented on SPARK-5707: - User 'marmbrus' has created a pull request for

[jira] [Assigned] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5707: --- Assignee: Apache Spark (was: Ram Sriharsha) Enabling spark.sql.codegen throws

[jira] [Created] (SPARK-8816) Improve Performance of Unbounded Following Window Frame Processing

Herman van Hovell tot Westerflier created SPARK-8816: Summary: Improve Performance of Unbounded Following Window Frame Processing Key: SPARK-8816 URL:

[jira] [Created] (SPARK-8817) DataFrame should not allow duplicate colum names

koert kuipers created SPARK-8817: Summary: DataFrame should not allow duplicate colum names Key: SPARK-8817 URL: https://issues.apache.org/jira/browse/SPARK-8817 Project: Spark Issue Type:

[jira] [Updated] (SPARK-8819) Spark doesn't compile with maven 3.3.x

[ https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8819: - Description: Simple reproduction: Install maven 3.3.3 and run build/mvn clean package -DskipTests This

[jira] [Resolved] (SPARK-8193) date/time function: current_timestamp

[ https://issues.apache.org/jira/browse/SPARK-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8193. Resolution: Fixed Assignee: Adrian Wang Fix Version/s: 1.5.0 date/time function:

[jira] [Resolved] (SPARK-8192) date/time function: current_date

[ https://issues.apache.org/jira/browse/SPARK-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8192. Resolution: Fixed Assignee: Adrian Wang Fix Version/s: 1.5.0 date/time function:

[jira] [Created] (SPARK-8821) The ec2 script doesn't run on python 3 with an utf8 env

Simon Hafner created SPARK-8821: --- Summary: The ec2 script doesn't run on python 3 with an utf8 env Key: SPARK-8821 URL: https://issues.apache.org/jira/browse/SPARK-8821 Project: Spark Issue

[jira] [Commented] (SPARK-8518) Log-linear models for survival analysis

[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613258#comment-14613258 ] Yanbo Liang commented on SPARK-8518: I will work on it. Log-linear models for

[jira] [Commented] (SPARK-8806) run-tests scala style must fail if it does not adhere to Spark Code Style Guide

[ https://issues.apache.org/jira/browse/SPARK-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613363#comment-14613363 ] Josh Rosen commented on SPARK-8806: --- https://issues.apache.org/jira/browse/SPARK-3849

[jira] [Resolved] (SPARK-8810) Gaps in SQL UDF test coverage

[ https://issues.apache.org/jira/browse/SPARK-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8810. Resolution: Fixed Assignee: Spiro Michaylov Fix Version/s: 1.5.0 Gaps in SQL UDF

[jira] [Created] (SPARK-8819) Spark doesn't compile with maven 3.3.x

Andrew Or created SPARK-8819: Summary: Spark doesn't compile with maven 3.3.x Key: SPARK-8819 URL: https://issues.apache.org/jira/browse/SPARK-8819 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-8820) Add a configuration to set the checkpoint directory for convenience.

SaintBacchus created SPARK-8820: --- Summary: Add a configuration to set the checkpoint directory for convenience. Key: SPARK-8820 URL: https://issues.apache.org/jira/browse/SPARK-8820 Project: Spark

[jira] [Assigned] (SPARK-8820) Add a configuration to set the checkpoint directory for convenience.

[ https://issues.apache.org/jira/browse/SPARK-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8820: --- Assignee: Apache Spark Add a configuration to set the checkpoint directory for convenience.

[jira] [Assigned] (SPARK-8820) Add a configuration to set the checkpoint directory for convenience.

[ https://issues.apache.org/jira/browse/SPARK-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8820: --- Assignee: (was: Apache Spark) Add a configuration to set the checkpoint directory for

[jira] [Commented] (SPARK-8820) Add a configuration to set the checkpoint directory for convenience.

[ https://issues.apache.org/jira/browse/SPARK-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613562#comment-14613562 ] Apache Spark commented on SPARK-8820: - User 'SaintBacchus' has created a pull request

[jira] [Assigned] (SPARK-8819) Spark doesn't compile with maven 3.3.x

[ https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8819: --- Assignee: Andrew Or (was: Apache Spark) Spark doesn't compile with maven 3.3.x

[jira] [Commented] (SPARK-8819) Spark doesn't compile with maven 3.3.x

[ https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613565#comment-14613565 ] Apache Spark commented on SPARK-8819: - User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-8819) Spark doesn't compile with maven 3.3.x

[ https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8819: --- Assignee: Apache Spark (was: Andrew Or) Spark doesn't compile with maven 3.3.x

[jira] [Resolved] (SPARK-8572) Type coercion for ScalaUDFs

[ https://issues.apache.org/jira/browse/SPARK-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8572. Resolution: Fixed Assignee: Cheolsoo Park Fix Version/s: 1.5.0 Type coercion for

[jira] [Updated] (SPARK-8811) Read array struct data from parquet error

[ https://issues.apache.org/jira/browse/SPARK-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8811: -- Shepherd: Cheng Lian Read array struct data from parquet error

[jira] [Commented] (SPARK-8822) clean up type checking in math.scala

[ https://issues.apache.org/jira/browse/SPARK-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613573#comment-14613573 ] Apache Spark commented on SPARK-8822: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8822) clean up type checking in math.scala

[ https://issues.apache.org/jira/browse/SPARK-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8822: --- Assignee: Reynold Xin (was: Apache Spark) clean up type checking in math.scala

[jira] [Created] (SPARK-8822) clean up type checking in math.scala

Reynold Xin created SPARK-8822: -- Summary: clean up type checking in math.scala Key: SPARK-8822 URL: https://issues.apache.org/jira/browse/SPARK-8822 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-8822) clean up type checking in math.scala

[ https://issues.apache.org/jira/browse/SPARK-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8822: --- Assignee: Apache Spark (was: Reynold Xin) clean up type checking in math.scala

[jira] [Resolved] (SPARK-7401) Dot product and squared_distances should be vectorized in Vectors

[ https://issues.apache.org/jira/browse/SPARK-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-7401. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 5946

[jira] [Commented] (SPARK-8636) CaseKeyWhen has incorrect NULL handling

[ https://issues.apache.org/jira/browse/SPARK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613492#comment-14613492 ] Apache Spark commented on SPARK-8636: - User 'animeshbaranawal' has created a pull

[jira] [Commented] (SPARK-8657) Fail to upload conf archive to viewfs

[ https://issues.apache.org/jira/browse/SPARK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613493#comment-14613493 ] Apache Spark commented on SPARK-8657: - User 'litao-buptsse' has created a pull request

[jira] [Resolved] (SPARK-8226) math function: shiftrightunsigned

[ https://issues.apache.org/jira/browse/SPARK-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8226. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7035

[jira] [Commented] (SPARK-8815) illegal java package names in jar

[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613534#comment-14613534 ] Sam Halliday commented on SPARK-8815: - I wouldn't feel too bad about it, the

[jira] [Commented] (SPARK-8706) Implement Pylint / Prospector checks for PySpark

[ https://issues.apache.org/jira/browse/SPARK-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613546#comment-14613546 ] Josh Rosen commented on SPARK-8706: --- Good question. I don't know that we necessarily

[jira] [Commented] (SPARK-8270) string function: levenshtein

[ https://issues.apache.org/jira/browse/SPARK-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613437#comment-14613437 ] Apache Spark commented on SPARK-8270: - User 'tarekauel' has created a pull request for

[jira] [Assigned] (SPARK-8270) string function: levenshtein

[ https://issues.apache.org/jira/browse/SPARK-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8270: --- Assignee: Cheng Hao (was: Apache Spark) string function: levenshtein

[jira] [Assigned] (SPARK-8270) string function: levenshtein

[ https://issues.apache.org/jira/browse/SPARK-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8270: --- Assignee: Apache Spark (was: Cheng Hao) string function: levenshtein

[jira] [Commented] (SPARK-6485) Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark

[ https://issues.apache.org/jira/browse/SPARK-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613447#comment-14613447 ] Mike Dusenberry commented on SPARK-6485: I've been delayed by a few other tasks,

[jira] [Created] (SPARK-8818) In should not take Any not Column

Michael Armbrust created SPARK-8818: --- Summary: In should not take Any not Column Key: SPARK-8818 URL: https://issues.apache.org/jira/browse/SPARK-8818 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613468#comment-14613468 ] Apache Spark commented on SPARK-6910: - User 'piaozhexiu' has created a pull request

[jira] [Commented] (SPARK-8806) run-tests scala style must fail if it does not adhere to Spark Code Style Guide

[ https://issues.apache.org/jira/browse/SPARK-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613445#comment-14613445 ] Rekha Joshi commented on SPARK-8806: thank you [~joshrosen] that makes sense, added

[jira] [Resolved] (SPARK-8805) Spark shell not working

[ https://issues.apache.org/jira/browse/SPARK-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8805. -- Resolution: Cannot Reproduce I can't reproduce this on any version of bash, and since it would probably

[jira] [Updated] (SPARK-8811) Read array struct data from parquet error

[ https://issues.apache.org/jira/browse/SPARK-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-8811: Description: Now we have a table which have some arraystruct... fields, we save the table data as

[jira] [Created] (SPARK-8813) Support combine text/parquet format file in SQL.

Yadong Qi created SPARK-8813: Summary: Support combine text/parquet format file in SQL. Key: SPARK-8813 URL: https://issues.apache.org/jira/browse/SPARK-8813 Project: Spark Issue Type:

[jira] [Updated] (SPARK-8813) Support combine text/parquet format file in SQL

[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-8813: - Summary: Support combine text/parquet format file in SQL (was: Support combine text/parquet format file

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613018#comment-14613018 ] Vincent Warmerdam commented on SPARK-8596: -- I now have a more elegant way to get

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612929#comment-14612929 ] Tomasz Bartczak commented on SPARK-7483: hmm that's right - adding it in

[jira] [Assigned] (SPARK-8269) string function: initcap

[ https://issues.apache.org/jira/browse/SPARK-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8269: --- Assignee: Cheng Hao (was: Apache Spark) string function: initcap

[jira] [Commented] (SPARK-8269) string function: initcap

[ https://issues.apache.org/jira/browse/SPARK-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612935#comment-14612935 ] Apache Spark commented on SPARK-8269: - User 'HuJiayin' has created a pull request for

[jira] [Assigned] (SPARK-8269) string function: initcap

[ https://issues.apache.org/jira/browse/SPARK-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8269: --- Assignee: Apache Spark (was: Cheng Hao) string function: initcap

[jira] [Created] (SPARK-8811) Read array struct data from parquet error

Weizhong created SPARK-8811: --- Summary: Read array struct data from parquet error Key: SPARK-8811 URL: https://issues.apache.org/jira/browse/SPARK-8811 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612964#comment-14612964 ] Vincent Warmerdam commented on SPARK-8684: -- I've tried a different approach,

[jira] [Created] (SPARK-8812) Support combine text/parquet format file in sql

Yadong Qi created SPARK-8812: Summary: Support combine text/parquet format file in sql Key: SPARK-8812 URL: https://issues.apache.org/jira/browse/SPARK-8812 Project: Spark Issue Type:

[jira] [Commented] (SPARK-8813) Support combine text/parquet format file in SQL

[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613002#comment-14613002 ] Apache Spark commented on SPARK-8813: - User 'watermen' has created a pull request for

[jira] [Assigned] (SPARK-8813) Support combine text/parquet format file in SQL

[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8813: --- Assignee: (was: Apache Spark) Support combine text/parquet format file in SQL

[jira] [Assigned] (SPARK-8813) Support combine text/parquet format file in SQL

[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8813: --- Assignee: Apache Spark Support combine text/parquet format file in SQL

[jira] [Resolved] (SPARK-8809) Remove ConvertNaNs analyzer rule

[ https://issues.apache.org/jira/browse/SPARK-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8809. Resolution: Fixed Fix Version/s: 1.5.0 Remove ConvertNaNs analyzer rule

[jira] [Assigned] (SPARK-8811) Read array struct data from parquet error

[ https://issues.apache.org/jira/browse/SPARK-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8811: --- Assignee: Apache Spark Read array struct data from parquet error

[jira] [Assigned] (SPARK-8811) Read array struct data from parquet error

[ https://issues.apache.org/jira/browse/SPARK-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8811: --- Assignee: (was: Apache Spark) Read array struct data from parquet error

[jira] [Commented] (SPARK-8811) Read array struct data from parquet error

[ https://issues.apache.org/jira/browse/SPARK-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612986#comment-14612986 ] Apache Spark commented on SPARK-8811: - User 'Sephiroth-Lin' has created a pull request

[jira] [Commented] (SPARK-8531) Update ML user guide for MinMaxScaler

[ https://issues.apache.org/jira/browse/SPARK-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613025#comment-14613025 ] Apache Spark commented on SPARK-8531: - User 'hhbyyh' has created a pull request for

[jira] [Assigned] (SPARK-8531) Update ML user guide for MinMaxScaler

[ https://issues.apache.org/jira/browse/SPARK-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8531: --- Assignee: (was: Apache Spark) Update ML user guide for MinMaxScaler

[jira] [Assigned] (SPARK-8810) Gaps in SQL UDF test coverage

[ https://issues.apache.org/jira/browse/SPARK-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8810: --- Assignee: (was: Apache Spark) Gaps in SQL UDF test coverage

[jira] [Updated] (SPARK-8176) date/time function: to_date

[ https://issues.apache.org/jira/browse/SPARK-8176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8176: --- Description: parse a timestamp string and return the date portion {code} to_date(string timestamp):

[jira] [Updated] (SPARK-8176) date/time function: to_date

[ https://issues.apache.org/jira/browse/SPARK-8176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8176: --- Description: parse a timestamp string and return the date portion {code} to_date(string timestamp):

[jira] [Updated] (SPARK-8176) date/time function: to_date

[ https://issues.apache.org/jira/browse/SPARK-8176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8176: --- Description: # parse a timestamp string and return the date portion to_date(string timestamp): date

[jira] [Updated] (SPARK-8177) date/time function: year

[ https://issues.apache.org/jira/browse/SPARK-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8177: --- Description: {code} year(timestamp time): int {code} Returns the year part of a date or a timestamp

[jira] [Updated] (SPARK-8753) Create an IntervalType data type

[ https://issues.apache.org/jira/browse/SPARK-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8753: --- Issue Type: Sub-task (was: New Feature) Parent: SPARK-8159 Create an IntervalType data type

[jira] [Commented] (SPARK-8810) Gaps in SQL UDF test coverage

[ https://issues.apache.org/jira/browse/SPARK-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612871#comment-14612871 ] Apache Spark commented on SPARK-8810: - User 'spirom' has created a pull request for

[jira] [Assigned] (SPARK-8810) Gaps in SQL UDF test coverage

[ https://issues.apache.org/jira/browse/SPARK-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8810: --- Assignee: Apache Spark Gaps in SQL UDF test coverage -

[jira] [Assigned] (SPARK-8531) Update ML user guide for MinMaxScaler

[ https://issues.apache.org/jira/browse/SPARK-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8531: --- Assignee: Apache Spark Update ML user guide for MinMaxScaler

[jira] [Updated] (SPARK-8800) Spark SQL Decimal Division operation loss of precision/scale when type is defined as DecimalType.Unlimited

[ https://issues.apache.org/jira/browse/SPARK-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8800: - Component/s: SQL Spark SQL Decimal Division operation loss of precision/scale when type is defined as

[jira] [Comment Edited] (SPARK-8596) Install and configure RStudio server on Spark EC2

[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613018#comment-14613018 ] Vincent Warmerdam edited comment on SPARK-8596 at 7/3/15 9:59 AM:

[jira] [Updated] (SPARK-8678) Default values in Pipeline API should be immutable

[ https://issues.apache.org/jira/browse/SPARK-8678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8678: - Fix Version/s: (was: 1.4.2.) 1.4.2 Default values in Pipeline API should be

[jira] [Comment Edited] (SPARK-8596) Install and configure RStudio server on Spark EC2

[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613018#comment-14613018 ] Vincent Warmerdam edited comment on SPARK-8596 at 7/3/15 10:21 AM:

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613100#comment-14613100 ] Vincent Warmerdam commented on SPARK-8596: -- We just found that `chmod a+w