[jira] [Updated] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25566: --- Description: 1. configure spark.sql.ui.retainedExecutions = 5 ( In Job History Spark-default.conf ) 2.

[jira] [Updated] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25566: --- Attachment: Screenshot from 2018-10-06 09-46-11.png > [Spark Job History] SQL UI Page does not support Pagin

[jira] [Resolved] (SPARK-25622) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables with bucket pruning filters - 42 seconds

[ https://issues.apache.org/jira/browse/SPARK-25622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25622. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22640 [https://gi

[jira] [Assigned] (SPARK-25621) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables having composite filters 45 sec

[ https://issues.apache.org/jira/browse/SPARK-25621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25621: Assignee: Gengliang Wang > BucketedReadWithHiveSupportSuite: read partitioning bucketed t

[jira] [Resolved] (SPARK-25621) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables having composite filters 45 sec

[ https://issues.apache.org/jira/browse/SPARK-25621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25621. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22640 [https://gi

[jira] [Resolved] (SPARK-25600) Make use of TypeCoercion.findTightestCommonType while inferring CSV schema

[ https://issues.apache.org/jira/browse/SPARK-25600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25600. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22619 [https://gi

[jira] [Assigned] (SPARK-25600) Make use of TypeCoercion.findTightestCommonType while inferring CSV schema

[ https://issues.apache.org/jira/browse/SPARK-25600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25600: Assignee: Dilip Biswal > Make use of TypeCoercion.findTightestCommonType while inferring

[jira] [Assigned] (SPARK-25202) SQL Function Split Should Respect Limit Argument

[ https://issues.apache.org/jira/browse/SPARK-25202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25202: Assignee: Parker Hegstrom > SQL Function Split Should Respect Limit Argument > --

[jira] [Resolved] (SPARK-25202) SQL Function Split Should Respect Limit Argument

[ https://issues.apache.org/jira/browse/SPARK-25202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25202. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 7 [https://gi

[jira] [Created] (SPARK-25658) Refactor HashByteArrayBenchmark to use main method

Yuming Wang created SPARK-25658: --- Summary: Refactor HashByteArrayBenchmark to use main method Key: SPARK-25658 URL: https://issues.apache.org/jira/browse/SPARK-25658 Project: Spark Issue Type:

[jira] [Created] (SPARK-25657) Refactor HashBenchmark to use main method

Yuming Wang created SPARK-25657: --- Summary: Refactor HashBenchmark to use main method Key: SPARK-25657 URL: https://issues.apache.org/jira/browse/SPARK-25657 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

[ https://issues.apache.org/jira/browse/SPARK-25655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25655. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22647 [https://gi

[jira] [Commented] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640559#comment-16640559 ] Apache Spark commented on SPARK-25575: -- User 'shahidki31' has created a pull reques

[jira] [Commented] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640558#comment-16640558 ] Apache Spark commented on SPARK-25575: -- User 'shahidki31' has created a pull reques

[jira] [Resolved] (SPARK-25646) docker-image-tool.sh doesn't work on developer build

[ https://issues.apache.org/jira/browse/SPARK-25646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25646. --- Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.4.0 This is reso

[jira] [Commented] (SPARK-25644) Fix java foreachBatch API

[ https://issues.apache.org/jira/browse/SPARK-25644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640548#comment-16640548 ] Apache Spark commented on SPARK-25644: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-20780) Spark Kafka10 Consumer Hangs

[ https://issues.apache.org/jira/browse/SPARK-20780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640534#comment-16640534 ] Kevin commented on SPARK-20780: --- Hello jayadeepj: I am facing the same problem, have you f

[jira] [Resolved] (SPARK-25610) DatasetCacheSuite: cache UDF result correctly 25 seconds

[ https://issues.apache.org/jira/browse/SPARK-25610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25610. - Resolution: Fixed Fix Version/s: 3.0.0 > DatasetCacheSuite: cache UDF result correctly 25 seconds

[jira] [Assigned] (SPARK-25610) DatasetCacheSuite: cache UDF result correctly 25 seconds

[ https://issues.apache.org/jira/browse/SPARK-25610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25610: --- Assignee: Dilip Biswal > DatasetCacheSuite: cache UDF result correctly 25 seconds > ---

[jira] [Resolved] (SPARK-20536) Extend ColumnName to create StructFields with explicit nullable

[ https://issues.apache.org/jira/browse/SPARK-20536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20536. - Resolution: Won't Fix > Extend ColumnName to create StructFields with explicit nullable > --

[jira] [Resolved] (SPARK-25653) Add tag ExtendedHiveTest for HiveSparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-25653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25653. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 3.0.0 > Add tag ExtendedHiveTe

[jira] [Resolved] (SPARK-25635) Support selective direct encoding in native ORC write

[ https://issues.apache.org/jira/browse/SPARK-25635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25635. - Resolution: Fixed Fix Version/s: 3.0.0 > Support selective direct encoding in native ORC write >

[jira] [Commented] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640460#comment-16640460 ] Dongjoon Hyun commented on SPARK-25648: --- Could you try Apache Spark 2.3.2, too? >

[jira] [Updated] (SPARK-25656) Add an example section about how to use Parquet/ORC library options

[ https://issues.apache.org/jira/browse/SPARK-25656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25656: -- Summary: Add an example section about how to use Parquet/ORC library options (was: Add a exam

[jira] [Created] (SPARK-25656) Add a example section about how to use Parquet/ORC library options

Dongjoon Hyun created SPARK-25656: - Summary: Add a example section about how to use Parquet/ORC library options Key: SPARK-25656 URL: https://issues.apache.org/jira/browse/SPARK-25656 Project: Spark

[jira] [Resolved] (SPARK-25626) HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec

[ https://issues.apache.org/jira/browse/SPARK-25626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25626. - Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 3.0.0 > HiveClientSuites: getPar

[jira] [Updated] (SPARK-20845) Support specification of column names in INSERT INTO

[ https://issues.apache.org/jira/browse/SPARK-20845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20845: Target Version/s: 3.0.0 > Support specification of column names in INSERT INTO > -

[jira] [Commented] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

[ https://issues.apache.org/jira/browse/SPARK-25655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640328#comment-16640328 ] Apache Spark commented on SPARK-25655: -- User 'gatorsmile' has created a pull reques

[jira] [Assigned] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

[ https://issues.apache.org/jira/browse/SPARK-25655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25655: Assignee: Apache Spark (was: Xiao Li) > Add Pspark-ganglia-lgpl to the scala style check

[jira] [Assigned] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

[ https://issues.apache.org/jira/browse/SPARK-25655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25655: Assignee: Xiao Li (was: Apache Spark) > Add Pspark-ganglia-lgpl to the scala style check

[jira] [Commented] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

[ https://issues.apache.org/jira/browse/SPARK-25655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640327#comment-16640327 ] Apache Spark commented on SPARK-25655: -- User 'gatorsmile' has created a pull reques

[jira] [Created] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

Xiao Li created SPARK-25655: --- Summary: Add Pspark-ganglia-lgpl to the scala style check Key: SPARK-25655 URL: https://issues.apache.org/jira/browse/SPARK-25655 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-22505) toDF() / createDataFrame() type inference doesn't work as expected

[ https://issues.apache.org/jira/browse/SPARK-22505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16263733#comment-16263733 ] Ruslan Dautkhanov edited comment on SPARK-22505 at 10/5/18 8:26 PM: --

[jira] [Commented] (SPARK-17952) SparkSession createDataFrame method throws exception for nested JavaBeans

[ https://issues.apache.org/jira/browse/SPARK-17952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640283#comment-16640283 ] Michal Šenkýř commented on SPARK-17952: --- Created a new issue and PR for arrays, li

[jira] [Commented] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640278#comment-16640278 ] Apache Spark commented on SPARK-25654: -- User 'michalsenkyr' has created a pull requ

[jira] [Assigned] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25654: Assignee: Apache Spark > createDataFrame does not support nested JavaBeans inside arrays

[jira] [Assigned] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25654: Assignee: (was: Apache Spark) > createDataFrame does not support nested JavaBeans ins

[jira] [Commented] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640277#comment-16640277 ] Apache Spark commented on SPARK-25654: -- User 'michalsenkyr' has created a pull requ

[jira] [Commented] (SPARK-25461) PySpark Pandas UDF outputs incorrect results when input columns contain None

[ https://issues.apache.org/jira/browse/SPARK-25461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640247#comment-16640247 ] Bryan Cutler commented on SPARK-25461: -- Thanks [~xiangcy]! Converting from bool to

[jira] [Issue Comment Deleted] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Šenkýř updated SPARK-25654: -- Comment: was deleted (was: Nested JavaBean support) > createDataFrame does not support nested

[jira] [Commented] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640239#comment-16640239 ] Michal Šenkýř commented on SPARK-25654: --- Nested JavaBean support > createDataFram

[jira] [Created] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

Michal Šenkýř created SPARK-25654: - Summary: createDataFrame does not support nested JavaBeans inside arrays and collections Key: SPARK-25654 URL: https://issues.apache.org/jira/browse/SPARK-25654 Pro

[jira] [Commented] (SPARK-25649) CatalystTypeConverter throws exception for ScalaesRow type when converting from ArrayConverter

[ https://issues.apache.org/jira/browse/SPARK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640220#comment-16640220 ] sravan kumar korumilli commented on SPARK-25649: Hi Maulik, The right o

[jira] [Updated] (SPARK-25649) CatalystTypeConverter throws exception for ScalaesRow type when converting from ArrayConverter

[ https://issues.apache.org/jira/browse/SPARK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maulik Soneji updated SPARK-25649: -- Priority: Minor (was: Major) > CatalystTypeConverter throws exception for ScalaesRow type whe

[jira] [Updated] (SPARK-25652) Wrong datetime conversion between Java and Python

[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-25652: --- Description: Hi, I found strange behaviour of Spark when using datetime from night of changi

[jira] [Created] (SPARK-25653) Add tag ExtendedHiveTest for HiveSparkSubmitSuite

Gengliang Wang created SPARK-25653: -- Summary: Add tag ExtendedHiveTest for HiveSparkSubmitSuite Key: SPARK-25653 URL: https://issues.apache.org/jira/browse/SPARK-25653 Project: Spark Issue T

[jira] [Resolved] (SPARK-25644) Fix java foreachBatch API

[ https://issues.apache.org/jira/browse/SPARK-25644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-25644. -- Resolution: Fixed Fix Version/s: 2.4.0 > Fix java foreachBatch API > --

[jira] [Commented] (SPARK-25653) Add tag ExtendedHiveTest for HiveSparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-25653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640141#comment-16640141 ] Apache Spark commented on SPARK-25653: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-25653) Add tag ExtendedHiveTest for HiveSparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-25653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640139#comment-16640139 ] Apache Spark commented on SPARK-25653: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-25653) Add tag ExtendedHiveTest for HiveSparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-25653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25653: Assignee: (was: Apache Spark) > Add tag ExtendedHiveTest for HiveSparkSubmitSuite > -

[jira] [Assigned] (SPARK-25653) Add tag ExtendedHiveTest for HiveSparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-25653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25653: Assignee: Apache Spark > Add tag ExtendedHiveTest for HiveSparkSubmitSuite >

[jira] [Commented] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640137#comment-16640137 ] Apache Spark commented on SPARK-25567: -- User 'shahidki31' has created a pull reques

[jira] [Commented] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640134#comment-16640134 ] Apache Spark commented on SPARK-25567: -- User 'shahidki31' has created a pull reques

[jira] [Assigned] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25567: Assignee: (was: Apache Spark) > [Spark Job History] Table listing in SQL Tab not disp

[jira] [Assigned] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25567: Assignee: Apache Spark > [Spark Job History] Table listing in SQL Tab not display Sort Ic

[jira] [Commented] (SPARK-25567) [Spark Job History] Table listing in SQL Tab not display Sort Icon

[ https://issues.apache.org/jira/browse/SPARK-25567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640136#comment-16640136 ] Apache Spark commented on SPARK-25567: -- User 'shahidki31' has created a pull reques

[jira] [Assigned] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25566: Assignee: Apache Spark > [Spark Job History] SQL UI Page does not support Pagination > --

[jira] [Assigned] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25566: Assignee: (was: Apache Spark) > [Spark Job History] SQL UI Page does not support Pagi

[jira] [Commented] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640132#comment-16640132 ] Apache Spark commented on SPARK-25566: -- User 'shahidki31' has created a pull reques

[jira] [Commented] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640133#comment-16640133 ] Apache Spark commented on SPARK-25566: -- User 'shahidki31' has created a pull reques

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:12 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:10 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:13 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:08 PM:

[jira] [Updated] (SPARK-25651) spark-shell gets wrong version of spark on windows

[ https://issues.apache.org/jira/browse/SPARK-25651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Sutcliffe updated SPARK-25651: --- Description: I have multiple versions of spark on my computer, and in particular SPARK_HOME

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:18 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:07 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:16 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:14 PM:

[jira] [Updated] (SPARK-25652) Wrong datetime conversion between Java and Python

[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-25652: --- Description: Hi, I found strange behaviour of Spark when using datetime from night of changi

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos edited comment on SPARK-23153 at 10/5/18 5:10 PM:

[jira] [Commented] (SPARK-23153) Support application dependencies in submission client's local file system

[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640086#comment-16640086 ] Stavros Kontopoulos commented on SPARK-23153: - The question is what can you

[jira] [Created] (SPARK-25652) Wrong datetime conversion between Java and Python

Maciej Bryński created SPARK-25652: -- Summary: Wrong datetime conversion between Java and Python Key: SPARK-25652 URL: https://issues.apache.org/jira/browse/SPARK-25652 Project: Spark Issue

[jira] [Updated] (SPARK-25650) Make analyzer rules used in once-policy idempotent

[ https://issues.apache.org/jira/browse/SPARK-25650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maryann Xue updated SPARK-25650: Issue Type: Task (was: Bug) > Make analyzer rules used in once-policy idempotent > --

[jira] [Updated] (SPARK-25650) Make analyzer rules used in once-policy idempotent

[ https://issues.apache.org/jira/browse/SPARK-25650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maryann Xue updated SPARK-25650: Description: Rules like {{HandleNullInputsForUDF}}  (https://issues.apache.org/jira/browse/SPARK-2

[jira] [Created] (SPARK-25651) spark-shell gets wrong version of spark on windows

Nick Sutcliffe created SPARK-25651: -- Summary: spark-shell gets wrong version of spark on windows Key: SPARK-25651 URL: https://issues.apache.org/jira/browse/SPARK-25651 Project: Spark Issue

[jira] [Created] (SPARK-25650) Make analyzer rules used in once-policy idempotent

Maryann Xue created SPARK-25650: --- Summary: Make analyzer rules used in once-policy idempotent Key: SPARK-25650 URL: https://issues.apache.org/jira/browse/SPARK-25650 Project: Spark Issue Type:

[jira] [Commented] (SPARK-25164) Parquet reader builds entire list of columns once for each column

[ https://issues.apache.org/jira/browse/SPARK-25164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640045#comment-16640045 ] Ruslan Dautkhanov commented on SPARK-25164: --- Thank you [~bersprockets] - SPARK

[jira] [Commented] (SPARK-25626) HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec

[ https://issues.apache.org/jira/browse/SPARK-25626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640023#comment-16640023 ] Apache Spark commented on SPARK-25626: -- User 'dilipbiswal' has created a pull reque

[jira] [Commented] (SPARK-25626) HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec

[ https://issues.apache.org/jira/browse/SPARK-25626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640018#comment-16640018 ] Apache Spark commented on SPARK-25626: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-25626) HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec

[ https://issues.apache.org/jira/browse/SPARK-25626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25626: Assignee: (was: Apache Spark) > HiveClientSuites: getPartitionsByFilter returns all p

[jira] [Assigned] (SPARK-25626) HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec

[ https://issues.apache.org/jira/browse/SPARK-25626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25626: Assignee: Apache Spark > HiveClientSuites: getPartitionsByFilter returns all partitions w

[jira] [Commented] (SPARK-25630) HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name collision while writing files 21 sec

[ https://issues.apache.org/jira/browse/SPARK-25630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639997#comment-16639997 ] Apache Spark commented on SPARK-25630: -- User 'gengliangwang' has created a pull req

[jira] [Comment Edited] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639998#comment-16639998 ] Dongjoon Hyun edited comment on SPARK-25648 at 10/5/18 4:04 PM: --

[jira] [Assigned] (SPARK-25630) HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name collision while writing files 21 sec

[ https://issues.apache.org/jira/browse/SPARK-25630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25630: Assignee: Apache Spark > HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name collision

[jira] [Commented] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639998#comment-16639998 ] Dongjoon Hyun commented on SPARK-25648: --- Thank you for reporting, [~justinnju]. H

[jira] [Assigned] (SPARK-25630) HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name collision while writing files 21 sec

[ https://issues.apache.org/jira/browse/SPARK-25630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25630: Assignee: (was: Apache Spark) > HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name

[jira] [Commented] (SPARK-25613) HiveSparkSubmitSuite: dir 1 min 3 seconds

[ https://issues.apache.org/jira/browse/SPARK-25613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639931#comment-16639931 ] Apache Spark commented on SPARK-25613: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-25614) HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail with format class not found 38 seconds

[ https://issues.apache.org/jira/browse/SPARK-25614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25614: Assignee: Apache Spark > HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail wi

[jira] [Assigned] (SPARK-25613) HiveSparkSubmitSuite: dir 1 min 3 seconds

[ https://issues.apache.org/jira/browse/SPARK-25613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25613: Assignee: (was: Apache Spark) > HiveSparkSubmitSuite: dir 1 min 3 seconds > -

[jira] [Assigned] (SPARK-25614) HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail with format class not found 38 seconds

[ https://issues.apache.org/jira/browse/SPARK-25614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25614: Assignee: (was: Apache Spark) > HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should

[jira] [Commented] (SPARK-25613) HiveSparkSubmitSuite: dir 1 min 3 seconds

[ https://issues.apache.org/jira/browse/SPARK-25613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639927#comment-16639927 ] Apache Spark commented on SPARK-25613: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-25613) HiveSparkSubmitSuite: dir 1 min 3 seconds

[ https://issues.apache.org/jira/browse/SPARK-25613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25613: Assignee: Apache Spark > HiveSparkSubmitSuite: dir 1 min 3 seconds >

[jira] [Commented] (SPARK-25614) HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail with format class not found 38 seconds

[ https://issues.apache.org/jira/browse/SPARK-25614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639929#comment-16639929 ] Apache Spark commented on SPARK-25614: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639881#comment-16639881 ] Jun Zheng commented on SPARK-25648: --- Hi [~hyukjin.kwon]  Here is brief steps: # Use

[jira] [Updated] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Zheng updated SPARK-25648: -- Description: Hi All I am testing TPCx-BB[link title|www.tpc.org/tpcx-bb/default.asp] with the code f

[jira] [Commented] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639824#comment-16639824 ] Hyukjin Kwon commented on SPARK-25648: -- [~justinnju] What results were different? H

[jira] [Updated] (SPARK-25633) Performance Improvement for Drools Spark Jobs.

[ https://issues.apache.org/jira/browse/SPARK-25633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25633: - Target Version/s: (was: 2.2.0) > Performance Improvement for Drools Spark Jobs. >

[jira] [Commented] (SPARK-25633) Performance Improvement for Drools Spark Jobs.

[ https://issues.apache.org/jira/browse/SPARK-25633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639826#comment-16639826 ] Hyukjin Kwon commented on SPARK-25633: -- Please avoid to set target version which is

[jira] [Updated] (SPARK-25633) Performance Improvement for Drools Spark Jobs.

[ https://issues.apache.org/jira/browse/SPARK-25633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25633: - Fix Version/s: (was: 2.2.0) > Performance Improvement for Drools Spark Jobs. > -

  1   2   >