[jira] [Assigned] (SPARK-20907) Use testQuietly for test suites that generate long log output

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20907: Assignee: Apache Spark > Use testQuietly for test suites that generate long log output >

[jira] [Commented] (SPARK-20907) Use testQuietly for test suites that generate long log output

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027707#comment-16027707 ] Apache Spark commented on SPARK-20907: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20907) Use testQuietly for test suites that generate long log output

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20907: Assignee: (was: Apache Spark) > Use testQuietly for test suites that generate long

[jira] [Assigned] (SPARK-20909) Build-in SQL Function Support - DAYOFWEEK

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20909: Assignee: Apache Spark > Build-in SQL Function Support - DAYOFWEEK >

[jira] [Assigned] (SPARK-20909) Build-in SQL Function Support - DAYOFWEEK

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20909: Assignee: (was: Apache Spark) > Build-in SQL Function Support - DAYOFWEEK >

[jira] [Commented] (SPARK-20909) Build-in SQL Function Support - DAYOFWEEK

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027705#comment-16027705 ] Apache Spark commented on SPARK-20909: -- User 'wangyum' has created a pull request for this issue:

[jira] [Resolved] (SPARK-20908) Cache Manager: Hint should be ignored in plan matching

2017-05-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20908. - Resolution: Fixed Fix Version/s: 2.2.0 > Cache Manager: Hint should be ignored in plan matching >

[jira] [Commented] (SPARK-20909) Build-in SQL Function Support - DAYOFWEEK

2017-05-27 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027694#comment-16027694 ] Yuming Wang commented on SPARK-20909: - I'm work on this. > Build-in SQL Function Support - DAYOFWEEK

[jira] [Created] (SPARK-20909) Build-in SQL Function Support - DAYOFWEEK

2017-05-27 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-20909: --- Summary: Build-in SQL Function Support - DAYOFWEEK Key: SPARK-20909 URL: https://issues.apache.org/jira/browse/SPARK-20909 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-20894) Error while checkpointing to HDFS (similar to JIRA SPARK-19268)

2017-05-27 Thread kant kodali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027685#comment-16027685 ] kant kodali commented on SPARK-20894: - Not a Bug. > Error while checkpointing to HDFS (similar to

[jira] [Closed] (SPARK-20894) Error while checkpointing to HDFS (similar to JIRA SPARK-19268)

2017-05-27 Thread kant kodali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kant kodali closed SPARK-20894. --- Resolution: Not A Problem > Error while checkpointing to HDFS (similar to JIRA SPARK-19268) >

[jira] [Commented] (SPARK-8184) date/time function: weekofyear

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027680#comment-16027680 ] Apache Spark commented on SPARK-8184: - User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20908) Cache Manager: Hint should be ignored in plan matching

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20908: Assignee: Apache Spark (was: Xiao Li) > Cache Manager: Hint should be ignored in plan

[jira] [Assigned] (SPARK-20908) Cache Manager: Hint should be ignored in plan matching

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20908: Assignee: Xiao Li (was: Apache Spark) > Cache Manager: Hint should be ignored in plan

[jira] [Commented] (SPARK-20908) Cache Manager: Hint should be ignored in plan matching

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027660#comment-16027660 ] Apache Spark commented on SPARK-20908: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Updated] (SPARK-20908) Cache Manager: Hint should be ignored in plan matching

2017-05-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20908: Description: In Cache manager, the plan matching should ignore Hint. {noformat} val df1 =

[jira] [Created] (SPARK-20908) Cache Manager: Hint should be ignored in plan matching

2017-05-27 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20908: --- Summary: Cache Manager: Hint should be ignored in plan matching Key: SPARK-20908 URL: https://issues.apache.org/jira/browse/SPARK-20908 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-20876) If the input parameter is float type for ceil or floor ,the result is not we expected

2017-05-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20876: --- Assignee: liuxian > If the input parameter is float type for ceil or floor ,the result is not we

[jira] [Resolved] (SPARK-20876) If the input parameter is float type for ceil or floor ,the result is not we expected

2017-05-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20876. - Resolution: Fixed Fix Version/s: 2.3.0 > If the input parameter is float type for ceil or floor

[jira] [Resolved] (SPARK-20897) cached self-join should not fail

2017-05-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20897. - Resolution: Fixed Fix Version/s: 2.2.0 > cached self-join should not fail >

[jira] [Created] (SPARK-20907) Use testQuietly for test suites that generate long log output

2017-05-27 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-20907: Summary: Use testQuietly for test suites that generate long log output Key: SPARK-20907 URL: https://issues.apache.org/jira/browse/SPARK-20907 Project: Spark

[jira] [Comment Edited] (SPARK-19809) NullPointerException on empty ORC file

2017-05-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027476#comment-16027476 ] Dongjoon Hyun edited comment on SPARK-19809 at 5/27/17 4:18 PM:

[jira] [Commented] (SPARK-19809) NullPointerException on empty ORC file

2017-05-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027476#comment-16027476 ] Dongjoon Hyun commented on SPARK-19809: --- [~hyukjin.kwon]. I don't think so. Parquet file does not

[jira] [Assigned] (SPARK-20875) Spark should print the log when the directory has been deleted

2017-05-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20875: - Assignee: liuzhaokun Priority: Trivial (was: Major) > Spark should print the log when the

[jira] [Resolved] (SPARK-20875) Spark should print the log when the directory has been deleted

2017-05-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20875. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18102

[jira] [Updated] (SPARK-20393) Strengthen Spark to prevent XSS vulnerabilities

2017-05-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20393: -- Priority: Major (was: Minor) Fix Version/s: 2.1.2 > Strengthen Spark to prevent XSS

[jira] [Commented] (SPARK-20896) spark executor get java.lang.ClassCastException when trigger two job at same time

2017-05-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027389#comment-16027389 ] Sean Owen commented on SPARK-20896: --- I don't think it has anything to do with running two jobs at the

[jira] [Commented] (SPARK-20320) AnalysisException: Columns of grouping_id (count(value#17L)) does not match grouping columns (count(value#17L))

2017-05-27 Thread lyc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027384#comment-16027384 ] lyc commented on SPARK-20320: - It seems `count("value")` should not be in `cube`, there should only be column

[jira] [Commented] (SPARK-20891) Reduce duplicate code in typedaggregators.scala

2017-05-27 Thread Ruben Janssen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027381#comment-16027381 ] Ruben Janssen commented on SPARK-20891: --- Ok I will take that approach next time, thanks for the

[jira] [Resolved] (SPARK-20905) When running spark with yarn-client, large executor-cores will lead to bad performance.

2017-05-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20905. --- Resolution: Invalid Questions should go to the mailing list, not JIRA > When running spark with

[jira] [Updated] (SPARK-20894) Error while checkpointing to HDFS (similar to JIRA SPARK-19268)

2017-05-27 Thread kant kodali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kant kodali updated SPARK-20894: Attachment: driver_info_log > Error while checkpointing to HDFS (similar to JIRA SPARK-19268) >

[jira] [Updated] (SPARK-20894) Error while checkpointing to HDFS (similar to JIRA SPARK-19268)

2017-05-27 Thread kant kodali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kant kodali updated SPARK-20894: Attachment: (was: driver_log) > Error while checkpointing to HDFS (similar to JIRA

[jira] [Updated] (SPARK-20897) cached self-join should not fail

2017-05-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-20897: Target Version/s: 2.2.0 > cached self-join should not fail > > >

[jira] [Commented] (SPARK-19809) NullPointerException on empty ORC file

2017-05-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027361#comment-16027361 ] Hyukjin Kwon commented on SPARK-19809: -- I think this is then rather about handling malformed files

[jira] [Assigned] (SPARK-20365) Not so accurate classpath format for AM and Containers

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20365: Assignee: (was: Apache Spark) > Not so accurate classpath format for AM and

[jira] [Assigned] (SPARK-20365) Not so accurate classpath format for AM and Containers

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20365: Assignee: Apache Spark > Not so accurate classpath format for AM and Containers >

[jira] [Commented] (SPARK-20365) Not so accurate classpath format for AM and Containers

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027350#comment-16027350 ] Apache Spark commented on SPARK-20365: -- User 'liyichao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20906) Constrained Logistic Regression for SparkR

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20906: Assignee: Apache Spark > Constrained Logistic Regression for SparkR >

[jira] [Assigned] (SPARK-20906) Constrained Logistic Regression for SparkR

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20906: Assignee: (was: Apache Spark) > Constrained Logistic Regression for SparkR >

[jira] [Commented] (SPARK-20906) Constrained Logistic Regression for SparkR

2017-05-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027320#comment-16027320 ] Apache Spark commented on SPARK-20906: -- User 'wangmiao1981' has created a pull request for this

[jira] [Created] (SPARK-20906) Constrained Logistic Regression for SparkR

2017-05-27 Thread Miao Wang (JIRA)
Miao Wang created SPARK-20906: - Summary: Constrained Logistic Regression for SparkR Key: SPARK-20906 URL: https://issues.apache.org/jira/browse/SPARK-20906 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-20894) Error while checkpointing to HDFS (similar to JIRA SPARK-19268)

2017-05-27 Thread kant kodali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kant kodali updated SPARK-20894: Attachment: executor2_log executor1_log driver_log Attached Driver

[jira] [Commented] (SPARK-19372) Code generation for Filter predicate including many OR conditions exceeds JVM method size limit

2017-05-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027270#comment-16027270 ] Dongjoon Hyun commented on SPARK-19372: --- Thank you so much all! > Code generation for Filter