[jira] [Resolved] (SPARK-22255) SPARK-22255 FileAppender InputStream Read timeout and blocking state

2017-10-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22255. --- Resolution: Not A Problem > SPARK-22255 FileAppender InputStream Read timeout and blocking state > --

[jira] [Resolved] (SPARK-22233) filter out empty InputSplit in HadoopRDD

2017-10-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22233. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19464 [https://git

[jira] [Assigned] (SPARK-22233) filter out empty InputSplit in HadoopRDD

2017-10-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22233: Assignee: Lijia Liu > filter out empty InputSplit in HadoopRDD > -

[jira] [Commented] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform

2017-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204645#comment-16204645 ] Apache Spark commented on SPARK-17756: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform

2017-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17756: Assignee: (was: Apache Spark) > java.lang.ClassCastException when using cartesian with

[jira] [Assigned] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform

2017-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17756: Assignee: Apache Spark > java.lang.ClassCastException when using cartesian with DStream.tr

[jira] [Resolved] (SPARK-15731) orc writer directory permissions

2017-10-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-15731. --- Resolution: Cannot Reproduce If this is reproducible in these days, please reopen this with t

[jira] [Created] (SPARK-22279) Turn on spark.sql.hive.convertMetastoreOrc by default

2017-10-14 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-22279: - Summary: Turn on spark.sql.hive.convertMetastoreOrc by default Key: SPARK-22279 URL: https://issues.apache.org/jira/browse/SPARK-22279 Project: Spark Issue

[jira] [Assigned] (SPARK-22279) Turn on spark.sql.hive.convertMetastoreOrc by default

2017-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22279: Assignee: (was: Apache Spark) > Turn on spark.sql.hive.convertMetastoreOrc by default

[jira] [Commented] (SPARK-22279) Turn on spark.sql.hive.convertMetastoreOrc by default

2017-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204781#comment-16204781 ] Apache Spark commented on SPARK-22279: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-22279) Turn on spark.sql.hive.convertMetastoreOrc by default

2017-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22279: Assignee: Apache Spark > Turn on spark.sql.hive.convertMetastoreOrc by default > -

[jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12

2017-10-14 Thread CasterKKK (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204862#comment-16204862 ] CasterKKK commented on SPARK-14220: --- Hello I wonder is everything ok? When could we use

[jira] [Resolved] (SPARK-22238) EnsureStatefulOpPartitioning shouldn't ask for the child RDD before planning is completed

2017-10-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-22238. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 19467 [https://g

[jira] [Created] (SPARK-22280) Improve StatisticsSuite to test `convertMetastoreXXX` properly

2017-10-14 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-22280: - Summary: Improve StatisticsSuite to test `convertMetastoreXXX` properly Key: SPARK-22280 URL: https://issues.apache.org/jira/browse/SPARK-22280 Project: Spark

[jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22280: -- Description: This issue aims to improve StatisticsSuite to test `convertMetastore` configuratio

[jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22280: -- Summary: Improve StatisticsSuite to test `convertMetastore` properly (was: Improve StatisticsS

[jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22280: -- Component/s: Tests > Improve StatisticsSuite to test `convertMetastore` properly >

[jira] [Assigned] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22280: Assignee: Apache Spark > Improve StatisticsSuite to test `convertMetastore` properly > ---

[jira] [Assigned] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22280: Assignee: (was: Apache Spark) > Improve StatisticsSuite to test `convertMetastore` pro

[jira] [Commented] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16205008#comment-16205008 ] Apache Spark commented on SPARK-22280: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Comment Edited] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

2017-10-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16199789#comment-16199789 ] Liang-Chi Hsieh edited comment on SPARK-22231 at 10/15/17 4:02 AM:

[jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22280: -- Affects Version/s: 2.2.0 > Improve StatisticsSuite to test `convertMetastore` properly > --

[jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22280: -- Affects Version/s: (was: 2.3.0) > Improve StatisticsSuite to test `convertMetastore` proper

[jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22280: -- Affects Version/s: 2.1.1 > Improve StatisticsSuite to test `convertMetastore` properly > --

[jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22280: -- Affects Version/s: (was: 2.1.1) > Improve StatisticsSuite to test `convertMetastore` proper

[jira] [Commented] (SPARK-22242) streaming job failed to restart from checkpoint

2017-10-14 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16205018#comment-16205018 ] Saisai Shao commented on SPARK-22242: - It is not resolved, but it is the same type of

[jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22280: -- Affects Version/s: (was: 2.2.0) 2.3.0 > Improve StatisticsSuite to t

[jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22280: -- Description: This issue aims to improve StatisticsSuite to test `convertMetastore` configurati

[jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22280: -- Description: This issue aims to improve StatisticsSuite to test `convertMetastore` configurati

[jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

2017-10-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22280: -- Description: This issue aims to improve StatisticsSuite to test `convertMetastore` configurati

[jira] [Assigned] (SPARK-22223) ObjectHashAggregate introduces unnecessary shuffle

2017-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: Apache Spark > ObjectHashAggregate introduces unnecessary shuffle >

[jira] [Commented] (SPARK-22223) ObjectHashAggregate introduces unnecessary shuffle

2017-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16205038#comment-16205038 ] Apache Spark commented on SPARK-3: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-22223) ObjectHashAggregate introduces unnecessary shuffle

2017-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: (was: Apache Spark) > ObjectHashAggregate introduces unnecessary shuffle > -

[jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12

2017-10-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16205046#comment-16205046 ] Sean Owen commented on SPARK-14220: --- It is hung up on a Scala compiler problem fixed in