[jira] [Commented] (SPARK-8667) Improve Spark UI behavior at scale

2015-06-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604000#comment-14604000 ] Patrick Wendell commented on SPARK-8667: Thanks Sean. I looked for a while for an

[jira] [Updated] (SPARK-3629) Improvements to YARN doc

2015-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3629: - Assignee: Neelesh Srinivas Salian Priority: Minor (was: Major) Improvements to YARN doc

[jira] [Resolved] (SPARK-3629) Improvements to YARN doc

2015-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3629. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Issue resolved by pull request

[jira] [Resolved] (SPARK-8512) Web UI Inconsistent with History Server in Standalone Mode

2015-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8512. -- Resolution: Invalid (You might also look at recent JIRAs about finding the state of incomplete apps

[jira] [Commented] (SPARK-8646) PySpark does not run on YARN

2015-06-27 Thread Juliet Hougland (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604014#comment-14604014 ] Juliet Hougland commented on SPARK-8646: When I configure spark to use my

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-27 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604053#comment-14604053 ] Vincent Warmerdam commented on SPARK-8596: -- I'm writing a small tutorial to get

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-06-27 Thread Olivier Girardot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604046#comment-14604046 ] Olivier Girardot commented on SPARK-8332: - Great [~jonathak] can you please post

[jira] [Commented] (SPARK-8649) Mapr repository is not defined properly

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604057#comment-14604057 ] Apache Spark commented on SPARK-8649: - User 'tszym' has created a pull request for

[jira] [Assigned] (SPARK-8649) Mapr repository is not defined properly

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8649: --- Assignee: (was: Apache Spark) Mapr repository is not defined properly

[jira] [Assigned] (SPARK-8649) Mapr repository is not defined properly

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8649: --- Assignee: Apache Spark Mapr repository is not defined properly

[jira] [Updated] (SPARK-8669) Parquet 1.7 files that store binary enums crash when inferring schema

2015-06-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8669: -- Assignee: Steven She Parquet 1.7 files that store binary enums crash when inferring schema

[jira] [Updated] (SPARK-8663) Dirver will be hang if there is a job submit during SparkContex stop Interval

2015-06-27 Thread yuemeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated SPARK-8663: --- Fix Version/s: 1.2.2 1.3.0 Dirver will be hang if there is a job submit during

[jira] [Comment Edited] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-27 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604053#comment-14604053 ] Vincent Warmerdam edited comment on SPARK-8596 at 6/27/15 8:31 AM:

[jira] [Commented] (SPARK-8359) Spark SQL Decimal type precision loss on multiplication

2015-06-27 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604073#comment-14604073 ] Liang-Chi Hsieh commented on SPARK-8359: Thanks for reporting this. I am going to

[jira] [Commented] (SPARK-8359) Spark SQL Decimal type precision loss on multiplication

2015-06-27 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604041#comment-14604041 ] Jihong MA commented on SPARK-8359: -- This fix is causing issue with divide over

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-27 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604055#comment-14604055 ] Vincent Warmerdam commented on SPARK-8596: -- Can we make an issue on the R

[jira] [Commented] (SPARK-8663) Dirver will be hang if there is a job submit during SparkContex stop Interval

2015-06-27 Thread yuemeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604065#comment-14604065 ] yuemeng commented on SPARK-8663: thanks a lot for your remind,Do you have any idea about

[jira] [Resolved] (SPARK-8667) Improve Spark UI behavior at scale

2015-06-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-8667. Resolution: Duplicate Improve Spark UI behavior at scale

[jira] [Comment Edited] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-27 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604053#comment-14604053 ] Vincent Warmerdam edited comment on SPARK-8596 at 6/27/15 8:03 AM:

[jira] [Comment Edited] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-27 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604053#comment-14604053 ] Vincent Warmerdam edited comment on SPARK-8596 at 6/27/15 8:04 AM:

[jira] [Created] (SPARK-8677) Decimal divide operation throws ArithmeticException

2015-06-27 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-8677: -- Summary: Decimal divide operation throws ArithmeticException Key: SPARK-8677 URL: https://issues.apache.org/jira/browse/SPARK-8677 Project: Spark Issue

[jira] [Commented] (SPARK-8677) Decimal divide operation throws ArithmeticException

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604110#comment-14604110 ] Apache Spark commented on SPARK-8677: - User 'viirya' has created a pull request for

[jira] [Updated] (SPARK-8663) Dirver will be hang if there is a job submit during SparkContex stop Interval

2015-06-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8663: - Fix Version/s: (was: 1.2.2) (was: 1.3.0) You set them again. Do *not* set Fiz

[jira] [Updated] (SPARK-8677) Decimal divide operation throws ArithmeticException

2015-06-27 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-8677: --- Description: Please refer to [BigDecimal

[jira] [Assigned] (SPARK-8677) Decimal divide operation throws ArithmeticException

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8677: --- Assignee: Apache Spark Decimal divide operation throws ArithmeticException

[jira] [Assigned] (SPARK-8677) Decimal divide operation throws ArithmeticException

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8677: --- Assignee: (was: Apache Spark) Decimal divide operation throws ArithmeticException

[jira] [Commented] (SPARK-8657) Fail to upload conf archive to viewfs

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604103#comment-14604103 ] Apache Spark commented on SPARK-8657: - User 'litao-buptsse' has created a pull request

[jira] [Updated] (SPARK-8659) Spark SQL Thrift Server does NOT honour hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactory

2015-06-27 Thread Premchandra Preetham Kukillaya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Premchandra Preetham Kukillaya updated SPARK-8659: -- Summary: Spark SQL Thrift Server does NOT honour

[jira] [Commented] (SPARK-8623) Hadoop RDDs fail to properly serialize configuration

2015-06-27 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604180#comment-14604180 ] Bolke de Bruin commented on SPARK-8623: --- Thanks Sandy, I applied the patch and error

[jira] [Created] (SPARK-8680) PropagateTypes is very slow when there are lots of columns

2015-06-27 Thread Davies Liu (JIRA)
Davies Liu created SPARK-8680: - Summary: PropagateTypes is very slow when there are lots of columns Key: SPARK-8680 URL: https://issues.apache.org/jira/browse/SPARK-8680 Project: Spark Issue

[jira] [Updated] (SPARK-8680) PropagateTypes is very slow when there are lots of columns

2015-06-27 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-8680: -- Description: The time for PropagateTypes is O(N*N), N is the number of columns, which is very slow if

[jira] [Created] (SPARK-8679) remove dummy java class BaseRow and BaseMutableRow

2015-06-27 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-8679: -- Summary: remove dummy java class BaseRow and BaseMutableRow Key: SPARK-8679 URL: https://issues.apache.org/jira/browse/SPARK-8679 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-8638) Window Function Performance Improvements

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8638: --- Assignee: (was: Apache Spark) Window Function Performance Improvements

[jira] [Assigned] (SPARK-8638) Window Function Performance Improvements

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8638: --- Assignee: Apache Spark Window Function Performance Improvements

[jira] [Commented] (SPARK-8638) Window Function Performance Improvements

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604224#comment-14604224 ] Apache Spark commented on SPARK-8638: - User 'hvanhovell' has created a pull request

[jira] [Created] (SPARK-8678) Default values in Pipeline API should be immutable

2015-06-27 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-8678: -- Summary: Default values in Pipeline API should be immutable Key: SPARK-8678 URL: https://issues.apache.org/jira/browse/SPARK-8678 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-8679) remove dummy java class BaseRow and BaseMutableRow

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8679: --- Assignee: (was: Apache Spark) remove dummy java class BaseRow and BaseMutableRow

[jira] [Commented] (SPARK-8679) remove dummy java class BaseRow and BaseMutableRow

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604242#comment-14604242 ] Apache Spark commented on SPARK-8679: - User 'MechCoder' has created a pull request for

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604307#comment-14604307 ] Shivaram Venkataraman commented on SPARK-8596: -- [~cantdutchthis] Thanks for

[jira] [Created] (SPARK-8681) crosstab column names in wrong order

2015-06-27 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-8681: -- Summary: crosstab column names in wrong order Key: SPARK-8681 URL: https://issues.apache.org/jira/browse/SPARK-8681 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-27 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604328#comment-14604328 ] Vincent Warmerdam commented on SPARK-8596: -- Rstudio doesn't want to be run as a

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-27 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604333#comment-14604333 ] Vincent Warmerdam commented on SPARK-6813: -- What is the current consensus on the

[jira] [Comment Edited] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-27 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604328#comment-14604328 ] Vincent Warmerdam edited comment on SPARK-8596 at 6/27/15 8:07 PM:

[jira] [Updated] (SPARK-8638) Window Function Performance Improvements

2015-06-27 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-8638: - Description: Improve the performance of Spark Window

[jira] [Commented] (SPARK-8577) ScalaReflectionLock.synchronized can cause deadlock

2015-06-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604374#comment-14604374 ] Josh Rosen commented on SPARK-8577: --- Do you have a way to reliably reproduce this in

[jira] [Resolved] (SPARK-8606) Exceptions in RDD.getPreferredLocations() and getPartitions() should not be able to crash DAGScheduler

2015-06-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8606. --- Resolution: Fixed Fix Version/s: 1.5.0 1.3.2 1.4.2 Issue

[jira] [Commented] (SPARK-8623) Hadoop RDDs fail to properly serialize configuration

2015-06-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604377#comment-14604377 ] Josh Rosen commented on SPARK-8623: --- Thanks for confirming that Sandy's patch fixes the

[jira] [Created] (SPARK-8683) Depend on mockito-core instead of mockito-all

2015-06-27 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-8683: - Summary: Depend on mockito-core instead of mockito-all Key: SPARK-8683 URL: https://issues.apache.org/jira/browse/SPARK-8683 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8683) Depend on mockito-core instead of mockito-all

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604421#comment-14604421 ] Apache Spark commented on SPARK-8683: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-8683) Depend on mockito-core instead of mockito-all

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8683: --- Assignee: Josh Rosen (was: Apache Spark) Depend on mockito-core instead of mockito-all

[jira] [Assigned] (SPARK-8683) Depend on mockito-core instead of mockito-all

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8683: --- Assignee: Apache Spark (was: Josh Rosen) Depend on mockito-core instead of mockito-all

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604435#comment-14604435 ] Shivaram Venkataraman commented on SPARK-6813: -- [~cantdutchthis] This style

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604440#comment-14604440 ] Shivaram Venkataraman commented on SPARK-8596: -- Thanks ! These are very

[jira] [Commented] (SPARK-5331) Spark workers can't find tachyon master as spark-ec2 doesn't set spark.tachyonStore.url

2015-06-27 Thread cheng chang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604455#comment-14604455 ] cheng chang commented on SPARK-5331: fixed in PR:

[jira] [Commented] (SPARK-8572) Type coercion for ScalaUDFs

2015-06-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604356#comment-14604356 ] Yin Huai commented on SPARK-8572: - [~cloud_fan] Will you have time to fix this? Type

[jira] [Resolved] (SPARK-7904) Exclude parquet 1.3.2 from Hive

2015-06-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7904. - Resolution: Not A Problem Seems we still need to include it to use Hive Parquet SerDe. I am resolving it

[jira] [Commented] (SPARK-6830) Memoize frequently queried vals in RDD, such as numPartitions, count etc.

2015-06-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604447#comment-14604447 ] Shivaram Venkataraman commented on SPARK-6830: -- The RDD here refers to the

[jira] [Created] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-27 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-8684: Summary: Update R version in Spark EC2 AMI Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7845) Bump Hadoop 1 tests to version 1.2.1

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604457#comment-14604457 ] Apache Spark commented on SPARK-7845: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604449#comment-14604449 ] Shivaram Venkataraman commented on SPARK-8684: -- [~cantdutchthis] Continuing

[jira] [Reopened] (SPARK-7845) Bump Hadoop 1 tests to version 1.2.1

2015-06-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reopened SPARK-7845: --- [PR #5694|https://github.com/apache/spark/pull/5694] reverted [PR

[jira] [Resolved] (SPARK-8623) Hadoop RDDs fail to properly serialize configuration

2015-06-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8623. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7050

[jira] [Updated] (SPARK-8672) throws NPE when running spark sql thrift server with session state authenticator

2015-06-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8672: -- Shepherd: Cheng Lian Environment: Hive 0.13.1 throws NPE when running spark sql thrift server

[jira] [Updated] (SPARK-8638) Window Function Performance Improvements

2015-06-27 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-8638: - Attachment: perf_test.scala Example code for performance

[jira] [Assigned] (SPARK-8681) crosstab column names in wrong order

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8681: --- Assignee: (was: Apache Spark) crosstab column names in wrong order

[jira] [Commented] (SPARK-8681) crosstab column names in wrong order

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604351#comment-14604351 ] Apache Spark commented on SPARK-8681: - User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-8681) crosstab column names in wrong order

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8681: --- Assignee: Apache Spark crosstab column names in wrong order

[jira] [Created] (SPARK-8682) Range Join for Spark SQL

2015-06-27 Thread Herman van Hovell tot Westerflier (JIRA)
Herman van Hovell tot Westerflier created SPARK-8682: Summary: Range Join for Spark SQL Key: SPARK-8682 URL: https://issues.apache.org/jira/browse/SPARK-8682 Project: Spark

[jira] [Assigned] (SPARK-8686) DataFrame should support `where` with expression represented by String

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8686: --- Assignee: (was: Apache Spark) DataFrame should support `where` with expression

[jira] [Assigned] (SPARK-5562) LDA should handle empty documents

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5562: --- Assignee: Apache Spark LDA should handle empty documents -

[jira] [Assigned] (SPARK-5562) LDA should handle empty documents

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5562: --- Assignee: (was: Apache Spark) LDA should handle empty documents

[jira] [Commented] (SPARK-5562) LDA should handle empty documents

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604521#comment-14604521 ] Apache Spark commented on SPARK-5562: - User 'aloknsingh' has created a pull request

[jira] [Created] (SPARK-8685) dataframe left joins are not working as expected in pyspark

2015-06-27 Thread axel dahl (JIRA)
axel dahl created SPARK-8685: Summary: dataframe left joins are not working as expected in pyspark Key: SPARK-8685 URL: https://issues.apache.org/jira/browse/SPARK-8685 Project: Spark Issue

[jira] [Resolved] (SPARK-8583) Refactor python/run-tests to integrate with dev/run-test's module system

2015-06-27 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8583. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6967

[jira] [Resolved] (SPARK-5482) Allow individual test suites in python/run-tests

2015-06-27 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-5482. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6967

[jira] [Updated] (SPARK-8685) dataframe left joins are not working as expected in pyspark

2015-06-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8685: Shepherd: Yin Huai dataframe left joins are not working as expected in pyspark

[jira] [Updated] (SPARK-8685) dataframe left joins are not working as expected in pyspark

2015-06-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8685: Issue Type: Sub-task (was: Bug) Parent: SPARK-6116 dataframe left joins are not working as

[jira] [Created] (SPARK-8686) DataFrame should support `where` with expression represented by String

2015-06-27 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-8686: - Summary: DataFrame should support `where` with expression represented by String Key: SPARK-8686 URL: https://issues.apache.org/jira/browse/SPARK-8686 Project:

[jira] [Commented] (SPARK-8686) DataFrame should support `where` with expression represented by String

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604519#comment-14604519 ] Apache Spark commented on SPARK-8686: - User 'sarutak' has created a pull request for

[jira] [Assigned] (SPARK-8686) DataFrame should support `where` with expression represented by String

2015-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8686: --- Assignee: Apache Spark DataFrame should support `where` with expression represented by

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2015-06-27 Thread Premchandra Preetham Kukillaya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604517#comment-14604517 ] Premchandra Preetham Kukillaya commented on SPARK-5159: --- +1. @Tao it

[jira] [Updated] (SPARK-8685) dataframe left joins are not working as expected in pyspark

2015-06-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8685: Description: I have the following code: {code} from pyspark import SQLContext d1 = [{'name':'bob',

[jira] [Updated] (SPARK-8685) dataframe left joins are not working as expected in pyspark

2015-06-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8685: Target Version/s: 1.5.0, 1.4.2 Priority: Critical (was: Major) dataframe left joins are not