[jira] [Commented] (SPARK-25610) DatasetCacheSuite: cache UDF result correctly 25 seconds

2018-10-05 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639378#comment-16639378 ] Dilip Biswal commented on SPARK-25610: -- I would like to work on this one. > Datase

[jira] [Assigned] (SPARK-25610) DatasetCacheSuite: cache UDF result correctly 25 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25610: Assignee: (was: Apache Spark) > DatasetCacheSuite: cache UDF result correctly 25 seco

[jira] [Commented] (SPARK-25610) DatasetCacheSuite: cache UDF result correctly 25 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639444#comment-16639444 ] Apache Spark commented on SPARK-25610: -- User 'dilipbiswal' has created a pull reque

[jira] [Commented] (SPARK-25610) DatasetCacheSuite: cache UDF result correctly 25 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639446#comment-16639446 ] Apache Spark commented on SPARK-25610: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-25610) DatasetCacheSuite: cache UDF result correctly 25 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25610: Assignee: Apache Spark > DatasetCacheSuite: cache UDF result correctly 25 seconds > -

[jira] [Resolved] (SPARK-24601) Bump Jackson version to 2.9.6

2018-10-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24601. -- Resolution: Fixed Fix Version/s: 3.0.0 Fixed in https://github.com/apache/spark/pull/21

[jira] [Created] (SPARK-25647) Add spark streaming compatibility suite for kubernetes.

2018-10-05 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-25647: --- Summary: Add spark streaming compatibility suite for kubernetes. Key: SPARK-25647 URL: https://issues.apache.org/jira/browse/SPARK-25647 Project: Spark

[jira] [Resolved] (SPARK-25521) Job id showing null when insert into command Job is finished.

2018-10-05 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25521. - Resolution: Fixed Assignee: Sujith Fix Version/s: 2.4.0 > Job id showing null wh

[jira] [Assigned] (SPARK-25647) Add spark streaming compatibility suite for kubernetes.

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25647: Assignee: Apache Spark > Add spark streaming compatibility suite for kubernetes. > --

[jira] [Assigned] (SPARK-25647) Add spark streaming compatibility suite for kubernetes.

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25647: Assignee: (was: Apache Spark) > Add spark streaming compatibility suite for kubernete

[jira] [Commented] (SPARK-25647) Add spark streaming compatibility suite for kubernetes.

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639526#comment-16639526 ] Apache Spark commented on SPARK-25647: -- User 'ScrapCodes' has created a pull reques

[jira] [Commented] (SPARK-25647) Add spark streaming compatibility suite for kubernetes.

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639527#comment-16639527 ] Apache Spark commented on SPARK-25647: -- User 'ScrapCodes' has created a pull reques

[jira] [Commented] (SPARK-25611) CompressionCodecSuite: both table-level and session-level compression are set 2 min 20 sec

2018-10-05 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639541#comment-16639541 ] Dilip Biswal commented on SPARK-25611: -- I would like to work on this one. > Compre

[jira] [Updated] (SPARK-25647) Add spark streaming compatibility suite for kubernetes.

2018-10-05 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25647: Affects Version/s: (was: 2.5.0) 3.0.0 > Add spark streaming com

[jira] [Resolved] (SPARK-17952) SparkSession createDataFrame method throws exception for nested JavaBeans

2018-10-05 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-17952. --- Issue resolved by pull request 22527 https://github.com/apache/spark/pull/22527 > SparkSession

[jira] [Created] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

2018-10-05 Thread Jun Zheng (JIRA)
Jun Zheng created SPARK-25648: - Summary: Spark 2.3.1 reads orc format files with native and hive, and return different results Key: SPARK-25648 URL: https://issues.apache.org/jira/browse/SPARK-25648 Proj

[jira] [Commented] (SPARK-25622) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables with bucket pruning filters - 42 seconds

2018-10-05 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639577#comment-16639577 ] Gengliang Wang commented on SPARK-25622: Created https://github.com/apache/spark

[jira] [Assigned] (SPARK-25621) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables having composite filters 45 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25621: Assignee: Apache Spark > BucketedReadWithHiveSupportSuite: read partitioning bucketed tab

[jira] [Assigned] (SPARK-25621) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables having composite filters 45 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25621: Assignee: (was: Apache Spark) > BucketedReadWithHiveSupportSuite: read partitioning b

[jira] [Commented] (SPARK-25621) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables having composite filters 45 sec

2018-10-05 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639574#comment-16639574 ] Gengliang Wang commented on SPARK-25621: created https://github.com/apache/spark

[jira] [Assigned] (SPARK-25622) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables with bucket pruning filters - 42 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25622: Assignee: (was: Apache Spark) > BucketedReadWithHiveSupportSuite: read partitioning b

[jira] [Commented] (SPARK-25622) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables with bucket pruning filters - 42 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639581#comment-16639581 ] Apache Spark commented on SPARK-25622: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-25621) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables having composite filters 45 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639579#comment-16639579 ] Apache Spark commented on SPARK-25621: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-25621) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables having composite filters 45 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639575#comment-16639575 ] Apache Spark commented on SPARK-25621: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-25622) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables with bucket pruning filters - 42 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25622: Assignee: Apache Spark > BucketedReadWithHiveSupportSuite: read partitioning bucketed tab

[jira] [Assigned] (SPARK-25622) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables with bucket pruning filters - 42 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25622: Assignee: Apache Spark > BucketedReadWithHiveSupportSuite: read partitioning bucketed tab

[jira] [Commented] (SPARK-25622) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables with bucket pruning filters - 42 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639580#comment-16639580 ] Apache Spark commented on SPARK-25622: -- User 'gengliangwang' has created a pull req

[jira] [Issue Comment Deleted] (SPARK-19498) Discussion: Making MLlib APIs extensible for 3rd party libraries

2018-10-05 Thread Peter Knight (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Knight updated SPARK-19498: - Comment: was deleted (was: Thank you for your e-mail. I am on holiday until Wednesday 25th July.

[jira] [Commented] (SPARK-25612) CompressionCodecSuite: table-level compression is not set but session-level compressions 47 seconds

2018-10-05 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639543#comment-16639543 ] Dilip Biswal commented on SPARK-25612: -- Most likely the fix would be same as 25611.

[jira] [Commented] (SPARK-25611) CompressionCodecSuite: both table-level and session-level compression are set 2 min 20 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639616#comment-16639616 ] Apache Spark commented on SPARK-25611: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-25611) CompressionCodecSuite: both table-level and session-level compression are set 2 min 20 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25611: Assignee: Apache Spark > CompressionCodecSuite: both table-level and session-level compre

[jira] [Commented] (SPARK-25622) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables with bucket pruning filters - 42 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639618#comment-16639618 ] Apache Spark commented on SPARK-25622: -- User 'dilipbiswal' has created a pull reque

[jira] [Commented] (SPARK-25622) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables with bucket pruning filters - 42 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639619#comment-16639619 ] Apache Spark commented on SPARK-25622: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-25612) CompressionCodecSuite: table-level compression is not set but session-level compressions 47 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25612: Assignee: (was: Apache Spark) > CompressionCodecSuite: table-level compression is not

[jira] [Commented] (SPARK-25612) CompressionCodecSuite: table-level compression is not set but session-level compressions 47 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639627#comment-16639627 ] Apache Spark commented on SPARK-25612: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-25612) CompressionCodecSuite: table-level compression is not set but session-level compressions 47 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25612: Assignee: Apache Spark > CompressionCodecSuite: table-level compression is not set but se

[jira] [Assigned] (SPARK-25611) CompressionCodecSuite: both table-level and session-level compression are set 2 min 20 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25611: Assignee: (was: Apache Spark) > CompressionCodecSuite: both table-level and session-l

[jira] [Commented] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

2018-10-05 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639723#comment-16639723 ] Marco Gaido commented on SPARK-25648: - cc [~dongjoon] > Spark 2.3.1 reads orc forma

[jira] [Created] (SPARK-25649) CatalystTypeConverter throws exception for ScalaesRow type when converting from ArrayConverter

2018-10-05 Thread Maulik Soneji (JIRA)
Maulik Soneji created SPARK-25649: - Summary: CatalystTypeConverter throws exception for ScalaesRow type when converting from ArrayConverter Key: SPARK-25649 URL: https://issues.apache.org/jira/browse/SPARK-25649

[jira] [Updated] (SPARK-25649) CatalystTypeConverter throws exception for ScalaesRow type when converting from ArrayConverter

2018-10-05 Thread Maulik Soneji (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maulik Soneji updated SPARK-25649: -- Description: Hi, I am trying running pyspark to convert elastic search data using `elasticse

[jira] [Updated] (SPARK-25649) CatalystTypeConverter throws exception for ScalaesRow type when converting from ArrayConverter

2018-10-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25649: - Priority: Major (was: Blocker) > CatalystTypeConverter throws exception for ScalaesRow type whe

[jira] [Commented] (SPARK-25649) CatalystTypeConverter throws exception for ScalaesRow type when converting from ArrayConverter

2018-10-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639821#comment-16639821 ] Hyukjin Kwon commented on SPARK-25649: -- Please avoid to set Critical+ which is usua

[jira] [Commented] (SPARK-25633) Performance Improvement for Drools Spark Jobs.

2018-10-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639826#comment-16639826 ] Hyukjin Kwon commented on SPARK-25633: -- Please avoid to set target version which is

[jira] [Updated] (SPARK-25633) Performance Improvement for Drools Spark Jobs.

2018-10-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25633: - Fix Version/s: (was: 2.2.0) > Performance Improvement for Drools Spark Jobs. > -

[jira] [Updated] (SPARK-25633) Performance Improvement for Drools Spark Jobs.

2018-10-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25633: - Target Version/s: (was: 2.2.0) > Performance Improvement for Drools Spark Jobs. >

[jira] [Commented] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

2018-10-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639824#comment-16639824 ] Hyukjin Kwon commented on SPARK-25648: -- [~justinnju] What results were different? H

[jira] [Updated] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

2018-10-05 Thread Jun Zheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Zheng updated SPARK-25648: -- Description: Hi All I am testing TPCx-BB[link title|www.tpc.org/tpcx-bb/default.asp] with the code f

[jira] [Commented] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

2018-10-05 Thread Jun Zheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639881#comment-16639881 ] Jun Zheng commented on SPARK-25648: --- Hi [~hyukjin.kwon]  Here is brief steps: # Use

[jira] [Commented] (SPARK-25613) HiveSparkSubmitSuite: dir 1 min 3 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639927#comment-16639927 ] Apache Spark commented on SPARK-25613: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-25613) HiveSparkSubmitSuite: dir 1 min 3 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25613: Assignee: Apache Spark > HiveSparkSubmitSuite: dir 1 min 3 seconds >

[jira] [Commented] (SPARK-25614) HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail with format class not found 38 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639929#comment-16639929 ] Apache Spark commented on SPARK-25614: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-25614) HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail with format class not found 38 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25614: Assignee: Apache Spark > HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail wi

[jira] [Assigned] (SPARK-25613) HiveSparkSubmitSuite: dir 1 min 3 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25613: Assignee: (was: Apache Spark) > HiveSparkSubmitSuite: dir 1 min 3 seconds > -

[jira] [Assigned] (SPARK-25614) HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail with format class not found 38 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25614: Assignee: (was: Apache Spark) > HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should

[jira] [Commented] (SPARK-25613) HiveSparkSubmitSuite: dir 1 min 3 seconds

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639931#comment-16639931 ] Apache Spark commented on SPARK-25613: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

2018-10-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639998#comment-16639998 ] Dongjoon Hyun commented on SPARK-25648: --- Thank you for reporting, [~justinnju]. H

[jira] [Assigned] (SPARK-25630) HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name collision while writing files 21 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25630: Assignee: (was: Apache Spark) > HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name

[jira] [Assigned] (SPARK-25630) HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name collision while writing files 21 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25630: Assignee: Apache Spark > HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name collision

[jira] [Comment Edited] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

2018-10-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639998#comment-16639998 ] Dongjoon Hyun edited comment on SPARK-25648 at 10/5/18 4:04 PM: --

[jira] [Commented] (SPARK-25630) HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name collision while writing files 21 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639997#comment-16639997 ] Apache Spark commented on SPARK-25630: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-25626) HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25626: Assignee: Apache Spark > HiveClientSuites: getPartitionsByFilter returns all partitions w

[jira] [Commented] (SPARK-25626) HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640018#comment-16640018 ] Apache Spark commented on SPARK-25626: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-25626) HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25626: Assignee: (was: Apache Spark) > HiveClientSuites: getPartitionsByFilter returns all p

[jira] [Commented] (SPARK-25626) HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640023#comment-16640023 ] Apache Spark commented on SPARK-25626: -- User 'dilipbiswal' has created a pull reque

[jira] [Commented] (SPARK-25164) Parquet reader builds entire list of columns once for each column

2018-10-05 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640045#comment-16640045 ] Ruslan Dautkhanov commented on SPARK-25164: --- Thank you [~bersprockets] - SPARK

[jira] [Created] (SPARK-25650) Make analyzer rules used in once-policy idempotent

2018-10-05 Thread Maryann Xue (JIRA)
Maryann Xue created SPARK-25650: --- Summary: Make analyzer rules used in once-policy idempotent Key: SPARK-25650 URL: https://issues.apache.org/jira/browse/SPARK-25650 Project: Spark Issue Type:

[jira] [Created] (SPARK-25651) spark-shell gets wrong version of spark on windows

2018-10-05 Thread Nick Sutcliffe (JIRA)
Nick Sutcliffe created SPARK-25651: -- Summary: spark-shell gets wrong version of spark on windows Key: SPARK-25651 URL: https://issues.apache.org/jira/browse/SPARK-25651 Project: Spark Issue

[jira] [Updated] (SPARK-25650) Make analyzer rules used in once-policy idempotent

2018-10-05 Thread Maryann Xue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maryann Xue updated SPARK-25650: Description: Rules like {{HandleNullInputsForUDF}}  (https://issues.apache.org/jira/browse/SPARK-2

[jira] [Updated] (SPARK-25650) Make analyzer rules used in once-policy idempotent

2018-10-05 Thread Maryann Xue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maryann Xue updated SPARK-25650: Issue Type: Task (was: Bug) > Make analyzer rules used in once-policy idempotent > --

[jira] [Created] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-05 Thread JIRA
Maciej Bryński created SPARK-25652: -- Summary: Wrong datetime conversion between Java and Python Key: SPARK-25652 URL: https://issues.apache.org/jira/browse/SPARK-25652 Project: Spark Issue

[jira] [Commented] (SPARK-23153) Support application dependencies in submission client's local file system

2018-10-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos commented on SPARK-23153: - The question is what can you

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2018-10-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:10 PM:

[jira] [Updated] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-25652: --- Description: Hi, I found strange behaviour of Spark when using datetime from night of changi

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2018-10-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:14 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2018-10-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:16 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2018-10-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:07 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2018-10-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:18 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2018-10-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:08 PM:

[jira] [Updated] (SPARK-25651) spark-shell gets wrong version of spark on windows

2018-10-05 Thread Nick Sutcliffe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Sutcliffe updated SPARK-25651: --- Description: I have multiple versions of spark on my computer, and in particular SPARK_HOME

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2018-10-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:13 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2018-10-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:10 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2018-10-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:12 PM:

[jira] [Commented] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640132#comment-16640132 ] Apache Spark commented on SPARK-25566: -- User 'shahidki31' has created a pull reques

[jira] [Commented] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640133#comment-16640133 ] Apache Spark commented on SPARK-25566: -- User 'shahidki31' has created a pull reques

[jira] [Assigned] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25566: Assignee: (was: Apache Spark) > [Spark Job History] SQL UI Page does not support Pagi

[jira] [Assigned] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25566: Assignee: Apache Spark > [Spark Job History] SQL UI Page does not support Pagination > --

[jira] [Commented] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640136#comment-16640136 ] Apache Spark commented on SPARK-25567: -- User 'shahidki31' has created a pull reques

[jira] [Assigned] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25567: Assignee: Apache Spark > [Spark Job History] Table listing in SQL Tab not display Sort Ic

[jira] [Commented] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640134#comment-16640134 ] Apache Spark commented on SPARK-25567: -- User 'shahidki31' has created a pull reques

[jira] [Assigned] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25567: Assignee: (was: Apache Spark) > [Spark Job History] Table listing in SQL Tab not disp

[jira] [Commented] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640137#comment-16640137 ] Apache Spark commented on SPARK-25567: -- User 'shahidki31' has created a pull reques

[jira] [Assigned] (SPARK-25653) Add tag ExtendedHiveTest for HiveSparkSubmitSuite

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25653: Assignee: Apache Spark > Add tag ExtendedHiveTest for HiveSparkSubmitSuite >

[jira] [Commented] (SPARK-25653) Add tag ExtendedHiveTest for HiveSparkSubmitSuite

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640139#comment-16640139 ] Apache Spark commented on SPARK-25653: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-25653) Add tag ExtendedHiveTest for HiveSparkSubmitSuite

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25653: Assignee: (was: Apache Spark) > Add tag ExtendedHiveTest for HiveSparkSubmitSuite > -

[jira] [Commented] (SPARK-25653) Add tag ExtendedHiveTest for HiveSparkSubmitSuite

2018-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640141#comment-16640141 ] Apache Spark commented on SPARK-25653: -- User 'gengliangwang' has created a pull req

[jira] [Resolved] (SPARK-25644) Fix java foreachBatch API

2018-10-05 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-25644. -- Resolution: Fixed Fix Version/s: 2.4.0 > Fix java foreachBatch API > --

[jira] [Created] (SPARK-25653) Add tag ExtendedHiveTest for HiveSparkSubmitSuite

2018-10-05 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-25653: -- Summary: Add tag ExtendedHiveTest for HiveSparkSubmitSuite Key: SPARK-25653 URL: https://issues.apache.org/jira/browse/SPARK-25653 Project: Spark Issue T

[jira] [Updated] (SPARK-25652) Wrong datetime conversion between Java and Python

2018-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-25652: --- Description: Hi, I found strange behaviour of Spark when using datetime from night of changi

[jira] [Updated] (SPARK-25649) CatalystTypeConverter throws exception for ScalaesRow type when converting from ArrayConverter

2018-10-05 Thread Maulik Soneji (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maulik Soneji updated SPARK-25649: -- Priority: Minor (was: Major) > CatalystTypeConverter throws exception for ScalaesRow type whe

[jira] [Commented] (SPARK-25649) CatalystTypeConverter throws exception for ScalaesRow type when converting from ArrayConverter

2018-10-05 Thread sravan kumar korumilli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640220#comment-16640220 ] sravan kumar korumilli commented on SPARK-25649: Hi Maulik, The right o

  1   2   >