[jira] [Created] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

Michal Šenkýř created SPARK-25654: - Summary: createDataFrame does not support nested JavaBeans inside arrays and collections Key: SPARK-25654 URL: https://issues.apache.org/jira/browse/SPARK-25654 Pro

[jira] [Commented] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640239#comment-16640239 ] Michal Šenkýř commented on SPARK-25654: --- Nested JavaBean support > createDataFram

[jira] [Issue Comment Deleted] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Šenkýř updated SPARK-25654: -- Comment: was deleted (was: Nested JavaBean support) > createDataFrame does not support nested

[jira] [Commented] (SPARK-25461) PySpark Pandas UDF outputs incorrect results when input columns contain None

[ https://issues.apache.org/jira/browse/SPARK-25461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640247#comment-16640247 ] Bryan Cutler commented on SPARK-25461: -- Thanks [~xiangcy]! Converting from bool to

[jira] [Assigned] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25654: Assignee: (was: Apache Spark) > createDataFrame does not support nested JavaBeans ins

[jira] [Commented] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640277#comment-16640277 ] Apache Spark commented on SPARK-25654: -- User 'michalsenkyr' has created a pull requ

[jira] [Commented] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640278#comment-16640278 ] Apache Spark commented on SPARK-25654: -- User 'michalsenkyr' has created a pull requ

[jira] [Assigned] (SPARK-25654) createDataFrame does not support nested JavaBeans inside arrays and collections

[ https://issues.apache.org/jira/browse/SPARK-25654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25654: Assignee: Apache Spark > createDataFrame does not support nested JavaBeans inside arrays

[jira] [Commented] (SPARK-17952) SparkSession createDataFrame method throws exception for nested JavaBeans

[ https://issues.apache.org/jira/browse/SPARK-17952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640283#comment-16640283 ] Michal Šenkýř commented on SPARK-17952: --- Created a new issue and PR for arrays, li

[jira] [Comment Edited] (SPARK-22505) toDF() / createDataFrame() type inference doesn't work as expected

[ https://issues.apache.org/jira/browse/SPARK-22505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16263733#comment-16263733 ] Ruslan Dautkhanov edited comment on SPARK-22505 at 10/5/18 8:26 PM: --

[jira] [Created] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

Xiao Li created SPARK-25655: --- Summary: Add Pspark-ganglia-lgpl to the scala style check Key: SPARK-25655 URL: https://issues.apache.org/jira/browse/SPARK-25655 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

[ https://issues.apache.org/jira/browse/SPARK-25655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25655: Assignee: Xiao Li (was: Apache Spark) > Add Pspark-ganglia-lgpl to the scala style check

[jira] [Commented] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

[ https://issues.apache.org/jira/browse/SPARK-25655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640327#comment-16640327 ] Apache Spark commented on SPARK-25655: -- User 'gatorsmile' has created a pull reques

[jira] [Assigned] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

[ https://issues.apache.org/jira/browse/SPARK-25655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25655: Assignee: Apache Spark (was: Xiao Li) > Add Pspark-ganglia-lgpl to the scala style check

[jira] [Commented] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

[ https://issues.apache.org/jira/browse/SPARK-25655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640328#comment-16640328 ] Apache Spark commented on SPARK-25655: -- User 'gatorsmile' has created a pull reques

[jira] [Updated] (SPARK-20845) Support specification of column names in INSERT INTO

[ https://issues.apache.org/jira/browse/SPARK-20845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20845: Target Version/s: 3.0.0 > Support specification of column names in INSERT INTO > -

[jira] [Resolved] (SPARK-25626) HiveClientSuites: getPartitionsByFilter returns all partitions when hive.metastore.try.direct.sql=false 46 sec

[ https://issues.apache.org/jira/browse/SPARK-25626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25626. - Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 3.0.0 > HiveClientSuites: getPar

[jira] [Created] (SPARK-25656) Add a example section about how to use Parquet/ORC library options

Dongjoon Hyun created SPARK-25656: - Summary: Add a example section about how to use Parquet/ORC library options Key: SPARK-25656 URL: https://issues.apache.org/jira/browse/SPARK-25656 Project: Spark

[jira] [Updated] (SPARK-25656) Add an example section about how to use Parquet/ORC library options

[ https://issues.apache.org/jira/browse/SPARK-25656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25656: -- Summary: Add an example section about how to use Parquet/ORC library options (was: Add a exam

[jira] [Commented] (SPARK-25648) Spark 2.3.1 reads orc format files with native and hive, and return different results

[ https://issues.apache.org/jira/browse/SPARK-25648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640460#comment-16640460 ] Dongjoon Hyun commented on SPARK-25648: --- Could you try Apache Spark 2.3.2, too? >

[jira] [Resolved] (SPARK-25635) Support selective direct encoding in native ORC write

[ https://issues.apache.org/jira/browse/SPARK-25635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25635. - Resolution: Fixed Fix Version/s: 3.0.0 > Support selective direct encoding in native ORC write >

[jira] [Resolved] (SPARK-25653) Add tag ExtendedHiveTest for HiveSparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-25653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25653. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 3.0.0 > Add tag ExtendedHiveTe

[jira] [Resolved] (SPARK-20536) Extend ColumnName to create StructFields with explicit nullable

[ https://issues.apache.org/jira/browse/SPARK-20536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20536. - Resolution: Won't Fix > Extend ColumnName to create StructFields with explicit nullable > --

[jira] [Assigned] (SPARK-25610) DatasetCacheSuite: cache UDF result correctly 25 seconds

[ https://issues.apache.org/jira/browse/SPARK-25610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25610: --- Assignee: Dilip Biswal > DatasetCacheSuite: cache UDF result correctly 25 seconds > ---

[jira] [Resolved] (SPARK-25610) DatasetCacheSuite: cache UDF result correctly 25 seconds

[ https://issues.apache.org/jira/browse/SPARK-25610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25610. - Resolution: Fixed Fix Version/s: 3.0.0 > DatasetCacheSuite: cache UDF result correctly 25 seconds

[jira] [Commented] (SPARK-20780) Spark Kafka10 Consumer Hangs

[ https://issues.apache.org/jira/browse/SPARK-20780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640534#comment-16640534 ] Kevin commented on SPARK-20780: --- Hello jayadeepj: I am facing the same problem, have you f

[jira] [Commented] (SPARK-25644) Fix java foreachBatch API

[ https://issues.apache.org/jira/browse/SPARK-25644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640548#comment-16640548 ] Apache Spark commented on SPARK-25644: -- User 'dongjoon-hyun' has created a pull req

[jira] [Resolved] (SPARK-25646) docker-image-tool.sh doesn't work on developer build

[ https://issues.apache.org/jira/browse/SPARK-25646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25646. --- Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.4.0 This is reso

[jira] [Commented] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640558#comment-16640558 ] Apache Spark commented on SPARK-25575: -- User 'shahidki31' has created a pull reques

[jira] [Commented] (SPARK-25575) SQL tab in the spark UI doesn't have option of hiding tables, eventhough other UI tabs has.

[ https://issues.apache.org/jira/browse/SPARK-25575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640559#comment-16640559 ] Apache Spark commented on SPARK-25575: -- User 'shahidki31' has created a pull reques

[jira] [Resolved] (SPARK-25655) Add Pspark-ganglia-lgpl to the scala style check

[ https://issues.apache.org/jira/browse/SPARK-25655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25655. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22647 [https://gi

[jira] [Created] (SPARK-25657) Refactor HashBenchmark to use main method

Yuming Wang created SPARK-25657: --- Summary: Refactor HashBenchmark to use main method Key: SPARK-25657 URL: https://issues.apache.org/jira/browse/SPARK-25657 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-25658) Refactor HashByteArrayBenchmark to use main method

Yuming Wang created SPARK-25658: --- Summary: Refactor HashByteArrayBenchmark to use main method Key: SPARK-25658 URL: https://issues.apache.org/jira/browse/SPARK-25658 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-25202) SQL Function Split Should Respect Limit Argument

[ https://issues.apache.org/jira/browse/SPARK-25202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25202: Assignee: Parker Hegstrom > SQL Function Split Should Respect Limit Argument > --

[jira] [Resolved] (SPARK-25202) SQL Function Split Should Respect Limit Argument

[ https://issues.apache.org/jira/browse/SPARK-25202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25202. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 7 [https://gi

[jira] [Assigned] (SPARK-25600) Make use of TypeCoercion.findTightestCommonType while inferring CSV schema

[ https://issues.apache.org/jira/browse/SPARK-25600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25600: Assignee: Dilip Biswal > Make use of TypeCoercion.findTightestCommonType while inferring

[jira] [Resolved] (SPARK-25600) Make use of TypeCoercion.findTightestCommonType while inferring CSV schema

[ https://issues.apache.org/jira/browse/SPARK-25600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25600. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22619 [https://gi

[jira] [Resolved] (SPARK-25621) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables having composite filters 45 sec

[ https://issues.apache.org/jira/browse/SPARK-25621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25621. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22640 [https://gi

[jira] [Assigned] (SPARK-25621) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables having composite filters 45 sec

[ https://issues.apache.org/jira/browse/SPARK-25621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25621: Assignee: Gengliang Wang > BucketedReadWithHiveSupportSuite: read partitioning bucketed t

[jira] [Resolved] (SPARK-25622) BucketedReadWithHiveSupportSuite: read partitioning bucketed tables with bucket pruning filters - 42 seconds

[ https://issues.apache.org/jira/browse/SPARK-25622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25622. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22640 [https://gi

[jira] [Updated] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25566: --- Attachment: Screenshot from 2018-10-06 09-46-11.png > [Spark Job History] SQL UI Page does not support Pagin

[jira] [Updated] (SPARK-25566) [Spark Job History] SQL UI Page does not support Pagination

[ https://issues.apache.org/jira/browse/SPARK-25566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25566: --- Description: 1. configure spark.sql.ui.retainedExecutions = 5 ( In Job History Spark-default.conf ) 2.

<    1   2