[jira] [Updated] (SPARK-8237) misc function: sha2

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8237: - Assignee: Liang-Chi Hsieh misc function: sha2 --- Key: SPARK-8237

[jira] [Updated] (SPARK-7088) [REGRESSION] Spark 1.3.1 breaks analysis of third-party logical plans

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7088: - Assignee: Santiago M. Mola [REGRESSION] Spark 1.3.1 breaks analysis of third-party logical plans

[jira] [Updated] (SPARK-6777) Implement backwards-compatibility rules in Parquet schema converters

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6777: - Assignee: Cheng Lian Implement backwards-compatibility rules in Parquet schema converters

[jira] [Commented] (SPARK-6777) Implement backwards-compatibility rules in Parquet schema converters

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604619#comment-14604619 ] Sean Owen commented on SPARK-6777: -- [~lian cheng] can you please assign JIRAs when you

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-28 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604642#comment-14604642 ] Vincent Warmerdam commented on SPARK-8684: -- I have an initial commit that I would

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-28 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604600#comment-14604600 ] Vincent Warmerdam commented on SPARK-8684: -- I'll double check. I've done this

[jira] [Updated] (SPARK-5482) Allow individual test suites in python/run-tests

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5482: - Assignee: Josh Rosen Allow individual test suites in python/run-tests

[jira] [Updated] (SPARK-8603) In Windows,Not able to create a Spark context from R studio

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8603: - Target Version/s: (was: 1.4.0) Fix Version/s: (was: 1.4.0) [~Prakashpc] Before opening a

[jira] [Created] (SPARK-8690) Add a setting to disable SparkSQL parquet schema merge by using datasource API

2015-06-28 Thread thegiive (JIRA)
thegiive created SPARK-8690: --- Summary: Add a setting to disable SparkSQL parquet schema merge by using datasource API Key: SPARK-8690 URL: https://issues.apache.org/jira/browse/SPARK-8690 Project: Spark

[jira] [Commented] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

2015-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604633#comment-14604633 ] Juan Rodríguez Hortalá commented on SPARK-8337: --- Hi, I have worked a bit

[jira] [Comment Edited] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-28 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604600#comment-14604600 ] Vincent Warmerdam edited comment on SPARK-8684 at 6/28/15 11:26 AM:

[jira] [Commented] (SPARK-8688) Hadoop Configuration has to disable client cache when writing or reading delegation tokens.

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604613#comment-14604613 ] Apache Spark commented on SPARK-8688: - User 'SaintBacchus' has created a pull request

[jira] [Assigned] (SPARK-8688) Hadoop Configuration has to disable client cache when writing or reading delegation tokens.

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8688: --- Assignee: (was: Apache Spark) Hadoop Configuration has to disable client cache when

[jira] [Assigned] (SPARK-8688) Hadoop Configuration has to disable client cache when writing or reading delegation tokens.

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8688: --- Assignee: Apache Spark Hadoop Configuration has to disable client cache when writing or

[jira] [Updated] (SPARK-8635) improve performance of CatalystTypeConverters

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8635: - Assignee: Wenchen Fan improve performance of CatalystTypeConverters

[jira] [Updated] (SPARK-8645) Incorrect expression analysis with Hive

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8645: - Component/s: SQL Please read https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark Set

[jira] [Updated] (SPARK-8680) PropagateTypes is very slow when there are lots of columns

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8680: - Component/s: SQL PropagateTypes is very slow when there are lots of columns

[jira] [Assigned] (SPARK-8690) Add a setting to disable SparkSQL parquet schema merge by using datasource API

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8690: --- Assignee: Apache Spark Add a setting to disable SparkSQL parquet schema merge by using

[jira] [Assigned] (SPARK-8690) Add a setting to disable SparkSQL parquet schema merge by using datasource API

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8690: --- Assignee: (was: Apache Spark) Add a setting to disable SparkSQL parquet schema merge by

[jira] [Commented] (SPARK-8690) Add a setting to disable SparkSQL parquet schema merge by using datasource API

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604631#comment-14604631 ] Apache Spark commented on SPARK-8690: - User 'thegiive' has created a pull request for

[jira] [Commented] (SPARK-5281) Registering table on RDD is giving MissingRequirementError

2015-06-28 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604632#comment-14604632 ] Littlestar commented on SPARK-5281: --- Does this patch merge to spark 1.3 branch, thanks.

[jira] [Created] (SPARK-8688) Hadoop Configuration has to disable client cache when writing or reading delegation tokens.

2015-06-28 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-8688: --- Summary: Hadoop Configuration has to disable client cache when writing or reading delegation tokens. Key: SPARK-8688 URL: https://issues.apache.org/jira/browse/SPARK-8688

[jira] [Updated] (SPARK-8676) After TGT expires, Thrift Server get No valid credentials provided exception

2015-06-28 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-8676: Summary: After TGT expires, Thrift Server get No valid credentials provided exception (was: After TGT

[jira] [Assigned] (SPARK-8664) Add PCA transformer

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8664: --- Assignee: Apache Spark (was: Yanbo Liang) Add PCA transformer ---

[jira] [Assigned] (SPARK-8664) Add PCA transformer

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8664: --- Assignee: Yanbo Liang (was: Apache Spark) Add PCA transformer ---

[jira] [Commented] (SPARK-8664) Add PCA transformer

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604577#comment-14604577 ] Apache Spark commented on SPARK-8664: - User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-8560) The Executors page will have negative if having resubmitted tasks

2015-06-28 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604582#comment-14604582 ] meiyoula commented on SPARK-8560: - Sorry, I think you misunderstand what I described. It's

[jira] [Assigned] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8596: --- Assignee: Apache Spark Install and configure RStudio server on Spark EC2

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604588#comment-14604588 ] Apache Spark commented on SPARK-8596: - User 'koaning' has created a pull request for

[jira] [Assigned] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8596: --- Assignee: (was: Apache Spark) Install and configure RStudio server on Spark EC2

[jira] [Created] (SPARK-8687) Spark on yarn can't send `spark.yarn.credentials.file` to executor.

2015-06-28 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-8687: --- Summary: Spark on yarn can't send `spark.yarn.credentials.file` to executor. Key: SPARK-8687 URL: https://issues.apache.org/jira/browse/SPARK-8687 Project: Spark

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604587#comment-14604587 ] Vincent Warmerdam commented on SPARK-8596: -- 1. on it. Install and configure

[jira] [Comment Edited] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604587#comment-14604587 ] Vincent Warmerdam edited comment on SPARK-8596 at 6/28/15 8:49 AM:

[jira] [Assigned] (SPARK-8689) Add get* methods with fieldName to Row

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8689: --- Assignee: (was: Apache Spark) Add get* methods with fieldName to Row

[jira] [Commented] (SPARK-8689) Add get* methods with fieldName to Row

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604586#comment-14604586 ] Apache Spark commented on SPARK-8689: - User 'sarutak' has created a pull request for

[jira] [Assigned] (SPARK-8689) Add get* methods with fieldName to Row

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8689: --- Assignee: Apache Spark Add get* methods with fieldName to Row

[jira] [Created] (SPARK-8689) Add get* methods with fieldName to Row

2015-06-28 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-8689: - Summary: Add get* methods with fieldName to Row Key: SPARK-8689 URL: https://issues.apache.org/jira/browse/SPARK-8689 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-8649) Mapr repository is not defined properly

2015-06-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-8649. Resolution: Fixed Fix Version/s: 1.5.0 Mapr repository is not defined properly

[jira] [Assigned] (SPARK-8687) Spark on yarn can't send `spark.yarn.credentials.file` to executor.

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8687: --- Assignee: (was: Apache Spark) Spark on yarn can't send `spark.yarn.credentials.file` to

[jira] [Commented] (SPARK-8687) Spark on yarn can't send `spark.yarn.credentials.file` to executor.

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604580#comment-14604580 ] Apache Spark commented on SPARK-8687: - User 'SaintBacchus' has created a pull request

[jira] [Assigned] (SPARK-8687) Spark on yarn can't send `spark.yarn.credentials.file` to executor.

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8687: --- Assignee: Apache Spark Spark on yarn can't send `spark.yarn.credentials.file` to executor.

[jira] [Assigned] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2017: --- Assignee: (was: Apache Spark) web ui stage page becomes unresponsive when the number of

[jira] [Assigned] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2017: --- Assignee: Apache Spark web ui stage page becomes unresponsive when the number of tasks is

[jira] [Commented] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604723#comment-14604723 ] Apache Spark commented on SPARK-2017: - User 'zsxwing' has created a pull request for

[jira] [Created] (SPARK-8692) improve date and timestamp handling

2015-06-28 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-8692: -- Summary: improve date and timestamp handling Key: SPARK-8692 URL: https://issues.apache.org/jira/browse/SPARK-8692 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-8610) Separate Row and InternalRow (part 2)

2015-06-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8610. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7003

[jira] [Assigned] (SPARK-8692) improve date and timestamp handling

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8692: --- Assignee: Apache Spark improve date and timestamp handling

[jira] [Created] (SPARK-8691) Enable GZip for Web UI

2015-06-28 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8691: --- Summary: Enable GZip for Web UI Key: SPARK-8691 URL: https://issues.apache.org/jira/browse/SPARK-8691 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-8636) CaseKeyWhen has incorrect NULL handling

2015-06-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604724#comment-14604724 ] Davies Liu commented on SPARK-8636: --- [~animeshbaranawal] What happen if there is null in

[jira] [Assigned] (SPARK-8691) Enable GZip for Web UI

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8691: --- Assignee: Apache Spark Enable GZip for Web UI --

[jira] [Resolved] (SPARK-8686) DataFrame should support `where` with expression represented by String

2015-06-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8686. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7063

[jira] [Assigned] (SPARK-8691) Enable GZip for Web UI

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8691: --- Assignee: (was: Apache Spark) Enable GZip for Web UI --

[jira] [Commented] (SPARK-8691) Enable GZip for Web UI

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604733#comment-14604733 ] Apache Spark commented on SPARK-8691: - User 'zsxwing' has created a pull request for

[jira] [Closed] (SPARK-8645) Incorrect expression analysis with Hive

2015-06-28 Thread Eugene Zhulenev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Zhulenev closed SPARK-8645. -- Resolution: Won't Fix Incorrect expression analysis with Hive

[jira] [Comment Edited] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-28 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604600#comment-14604600 ] Vincent Warmerdam edited comment on SPARK-8684 at 6/28/15 9:52 AM:

[jira] [Updated] (SPARK-8679) remove dummy java class BaseRow and BaseMutableRow

2015-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8679: - Priority: Minor (was: Major) Component/s: SQL Issue Type: Improvement (was: Bug)

[jira] [Assigned] (SPARK-8674) 2-sample, 2-sided Kolmogorov Smirnov Test Implementation

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8674: --- Assignee: (was: Apache Spark) 2-sample, 2-sided Kolmogorov Smirnov Test Implementation

[jira] [Commented] (SPARK-8674) 2-sample, 2-sided Kolmogorov Smirnov Test Implementation

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604898#comment-14604898 ] Apache Spark commented on SPARK-8674: - User 'josepablocam' has created a pull request

[jira] [Assigned] (SPARK-8674) 2-sample, 2-sided Kolmogorov Smirnov Test Implementation

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8674: --- Assignee: Apache Spark 2-sample, 2-sided Kolmogorov Smirnov Test Implementation

[jira] [Updated] (SPARK-8677) Decimal divide operation throws ArithmeticException

2015-06-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-8677: -- Assignee: Liang-Chi Hsieh Decimal divide operation throws ArithmeticException

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604897#comment-14604897 ] Shivaram Venkataraman commented on SPARK-8596: -- Merged

[jira] [Commented] (SPARK-8577) ScalaReflectionLock.synchronized can cause deadlock

2015-06-28 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604935#comment-14604935 ] koert kuipers commented on SPARK-8577: -- i do not have a way to reproduce this in

[jira] [Assigned] (SPARK-7894) Graph Union Operator

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7894: --- Assignee: (was: Apache Spark) Graph Union Operator

[jira] [Assigned] (SPARK-7894) Graph Union Operator

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7894: --- Assignee: Apache Spark Graph Union Operator Key:

[jira] [Commented] (SPARK-7894) Graph Union Operator

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604830#comment-14604830 ] Apache Spark commented on SPARK-7894: - User 'arnabguin' has created a pull request for

[jira] [Assigned] (SPARK-8692) improve date and timestamp handling

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8692: --- Assignee: (was: Apache Spark) improve date and timestamp handling

[jira] [Commented] (SPARK-8692) improve date and timestamp handling

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604773#comment-14604773 ] Apache Spark commented on SPARK-8692: - User 'cloud-fan' has created a pull request for

[jira] [Comment Edited] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

2015-06-28 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604633#comment-14604633 ] Juan Rodríguez Hortalá edited comment on SPARK-8337 at 6/28/15 6:16 PM:

[jira] [Closed] (SPARK-8424) Add blacklist mechanism for task scheduler and Yarn container allocation

2015-06-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao closed SPARK-8424. -- Resolution: Duplicate Add blacklist mechanism for task scheduler and Yarn container allocation

[jira] [Commented] (SPARK-8424) Add blacklist mechanism for task scheduler and Yarn container allocation

2015-06-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605001#comment-14605001 ] Saisai Shao commented on SPARK-8424: OK, I will close this JIRA. Add blacklist

[jira] [Updated] (SPARK-8692) re-order the case statements that handling catalyst data types

2015-06-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8692: -- Shepherd: Cheng Lian re-order the case statements that handling catalyst data types

[jira] [Updated] (SPARK-8692) refactor the handling of date and timestamp

2015-06-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-8692: --- Summary: refactor the handling of date and timestamp (was: improve date and timestamp handling)

[jira] [Assigned] (SPARK-8443) GenerateMutableProjection Exceeds JVM Code Size Limits

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8443: --- Assignee: (was: Apache Spark) GenerateMutableProjection Exceeds JVM Code Size Limits

[jira] [Commented] (SPARK-8443) GenerateMutableProjection Exceeds JVM Code Size Limits

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605028#comment-14605028 ] Apache Spark commented on SPARK-8443: - User 'saurfang' has created a pull request for

[jira] [Assigned] (SPARK-8443) GenerateMutableProjection Exceeds JVM Code Size Limits

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8443: --- Assignee: Apache Spark GenerateMutableProjection Exceeds JVM Code Size Limits

[jira] [Commented] (SPARK-8693) profiles and goals are not printed in a nice way

2015-06-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605044#comment-14605044 ] Yin Huai commented on SPARK-8693: - [~boyork] Can you take a look at it when you get time?

[jira] [Created] (SPARK-8693) profiles and goals are not printed in a nice way

2015-06-28 Thread Yin Huai (JIRA)
Yin Huai created SPARK-8693: --- Summary: profiles and goals are not printed in a nice way Key: SPARK-8693 URL: https://issues.apache.org/jira/browse/SPARK-8693 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-7845) Bump Hadoop 1 tests to version 1.2.1

2015-06-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7845. - Resolution: Fixed Assignee: Cheng Lian (was: Yin Huai) Target Version/s: 1.4.0,

[jira] [Updated] (SPARK-7845) Bump Hadoop 1 tests to version 1.2.1

2015-06-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7845: Fix Version/s: 1.5.0 Bump Hadoop 1 tests to version 1.2.1 --

[jira] [Commented] (SPARK-8651) Lasso with SGD not Converging properly

2015-06-28 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605056#comment-14605056 ] yuhao yang commented on SPARK-8651: --- [~aazout] I know someone met the similar issue.

[jira] [Comment Edited] (SPARK-8616) SQLContext doesn't handle tricky column names when loading from JDBC

2015-06-28 Thread Gergely Svigruha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605078#comment-14605078 ] Gergely Svigruha edited comment on SPARK-8616 at 6/29/15 3:43 AM:

[jira] [Commented] (SPARK-8616) SQLContext doesn't handle tricky column names when loading from JDBC

2015-06-28 Thread Gergely Svigruha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605078#comment-14605078 ] Gergely Svigruha commented on SPARK-8616: - FYI, MYSQL may allow double quotes if

[jira] [Created] (SPARK-8694) Defer executing drawTaskAssignmentTimeline until page loaded to avoid to freeze the page

2015-06-28 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-8694: - Summary: Defer executing drawTaskAssignmentTimeline until page loaded to avoid to freeze the page Key: SPARK-8694 URL: https://issues.apache.org/jira/browse/SPARK-8694

[jira] [Resolved] (SPARK-7212) Frequent pattern mining for sequential item sets

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7212. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6997

[jira] [Created] (SPARK-8697) MatchIterator not serializable exception in RegexTokeinzer

2015-06-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-8697: Summary: MatchIterator not serializable exception in RegexTokeinzer Key: SPARK-8697 URL: https://issues.apache.org/jira/browse/SPARK-8697 Project: Spark

[jira] [Commented] (SPARK-8405) Show executor logs on Web UI when Yarn log aggregation is enabled

2015-06-28 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605126#comment-14605126 ] Carson Wang commented on SPARK-8405: Thank you very much, [~hshreedharan] After I

[jira] [Commented] (SPARK-8694) Defer executing drawTaskAssignmentTimeline until page loaded to avoid to freeze the page

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605123#comment-14605123 ] Apache Spark commented on SPARK-8694: - User 'zsxwing' has created a pull request for

[jira] [Assigned] (SPARK-8694) Defer executing drawTaskAssignmentTimeline until page loaded to avoid to freeze the page

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8694: --- Assignee: Apache Spark Defer executing drawTaskAssignmentTimeline until page loaded to

[jira] [Assigned] (SPARK-8694) Defer executing drawTaskAssignmentTimeline until page loaded to avoid to freeze the page

2015-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8694: --- Assignee: (was: Apache Spark) Defer executing drawTaskAssignmentTimeline until page

[jira] [Commented] (SPARK-8636) CaseKeyWhen has incorrect NULL handling

2015-06-28 Thread Animesh Baranawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605112#comment-14605112 ] Animesh Baranawal commented on SPARK-8636: -- No a row with null will not be equal

[jira] [Created] (SPARK-8695) TreeAggregation shouldn't be triggered for 5 partitions

2015-06-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-8695: Summary: TreeAggregation shouldn't be triggered for 5 partitions Key: SPARK-8695 URL: https://issues.apache.org/jira/browse/SPARK-8695 Project: Spark Issue

[jira] [Updated] (SPARK-8695) TreeAggregation shouldn't be triggered for 5 partitions

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8695: - Priority: Minor (was: Major) TreeAggregation shouldn't be triggered for 5 partitions

[jira] [Updated] (SPARK-7739) Improve ChiSqSelector example code in the user guide

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7739: - Assignee: Seth Hendrickson Improve ChiSqSelector example code in the user guide

[jira] [Updated] (SPARK-7739) Improve ChiSqSelector example code in the user guide

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7739: - Target Version/s: 1.5.0 Improve ChiSqSelector example code in the user guide

[jira] [Created] (SPARK-8696) StreamingLDA

2015-06-28 Thread yuhao yang (JIRA)
yuhao yang created SPARK-8696: - Summary: StreamingLDA Key: SPARK-8696 URL: https://issues.apache.org/jira/browse/SPARK-8696 Project: Spark Issue Type: New Feature Components: MLlib

[jira] [Resolved] (SPARK-5962) [MLLIB] Python support for Power Iteration Clustering

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5962. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6992

[jira] [Commented] (SPARK-8374) Job frequently hangs after YARN preemption

2015-06-28 Thread Shay Rojansky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605117#comment-14605117 ] Shay Rojansky commented on SPARK-8374: -- Any chance someone can look at this bug, at

[jira] [Resolved] (SPARK-8575) Deprecate callUDF in favor of udf

2015-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8575. -- Resolution: Fixed Issue resolved by pull request 6993