[jira] [Commented] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility)

[ https://issues.apache.org/jira/browse/SPARK-25923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674216#comment-16674216 ] Felix Cheung commented on SPARK-25923: -- thanks - what's the exchange required with CRAN admin? >

[jira] [Commented] (SPARK-25934) Mesos: SPARK_CONF_DIR should not be propogated by spark submit

[ https://issues.apache.org/jira/browse/SPARK-25934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674191#comment-16674191 ] Apache Spark commented on SPARK-25934: -- User 'mpmolek' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25934) Mesos: SPARK_CONF_DIR should not be propogated by spark submit

[ https://issues.apache.org/jira/browse/SPARK-25934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25934: Assignee: (was: Apache Spark) > Mesos: SPARK_CONF_DIR should not be propogated by

[jira] [Assigned] (SPARK-25934) Mesos: SPARK_CONF_DIR should not be propogated by spark submit

[ https://issues.apache.org/jira/browse/SPARK-25934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25934: Assignee: Apache Spark > Mesos: SPARK_CONF_DIR should not be propogated by spark submit

[jira] [Commented] (SPARK-25934) Mesos: SPARK_CONF_DIR should not be propogated by spark submit

[ https://issues.apache.org/jira/browse/SPARK-25934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674189#comment-16674189 ] Apache Spark commented on SPARK-25934: -- User 'mpmolek' has created a pull request for this issue:

[jira] [Created] (SPARK-25934) Mesos: SPARK_CONF_DIR should not be propogated by spark submit

Matt Molek created SPARK-25934: -- Summary: Mesos: SPARK_CONF_DIR should not be propogated by spark submit Key: SPARK-25934 URL: https://issues.apache.org/jira/browse/SPARK-25934 Project: Spark

[jira] [Updated] (SPARK-25931) Benchmarking creation of Jackson parser

[ https://issues.apache.org/jira/browse/SPARK-25931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25931: -- Component/s: Tests > Benchmarking creation of Jackson parser >

[jira] [Resolved] (SPARK-25933) Fix pstats reference for spark.python.profile.dump in configuration.md

[ https://issues.apache.org/jira/browse/SPARK-25933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25933. --- Resolution: Fixed Fix Version/s: 2.4.1 3.0.0 2.3.3

[jira] [Assigned] (SPARK-25933) Fix pstats reference for spark.python.profile.dump in configuration.md

[ https://issues.apache.org/jira/browse/SPARK-25933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25933: - Assignee: Alex Hagerman > Fix pstats reference for spark.python.profile.dump in

[jira] [Updated] (SPARK-25933) Fix pstats reference for spark.python.profile.dump in configuration.md

[ https://issues.apache.org/jira/browse/SPARK-25933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25933: -- Target Version/s: (was: 2.3.2) Labels: documentation (was: documentation

[jira] [Commented] (SPARK-25890) Null rows are ignored with Ctrl-A as a delimiter when reading a CSV file.

[ https://issues.apache.org/jira/browse/SPARK-25890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674112#comment-16674112 ] Maxim Gekk commented on SPARK-25890: I haven't reproduced the issue on the master branch. > Null

[jira] [Commented] (SPARK-19799) Support WITH clause in subqueries

[ https://issues.apache.org/jira/browse/SPARK-19799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674095#comment-16674095 ] Apache Spark commented on SPARK-19799: -- User 'gbloisi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19799) Support WITH clause in subqueries

[ https://issues.apache.org/jira/browse/SPARK-19799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19799: Assignee: (was: Apache Spark) > Support WITH clause in subqueries >

[jira] [Assigned] (SPARK-19799) Support WITH clause in subqueries

[ https://issues.apache.org/jira/browse/SPARK-19799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19799: Assignee: Apache Spark > Support WITH clause in subqueries >

[jira] [Assigned] (SPARK-25931) Benchmarking creation of Jackson parser

[ https://issues.apache.org/jira/browse/SPARK-25931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25931: - Assignee: Maxim Gekk > Benchmarking creation of Jackson parser >

[jira] [Resolved] (SPARK-25931) Benchmarking creation of Jackson parser

[ https://issues.apache.org/jira/browse/SPARK-25931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25931. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22920

[jira] [Updated] (SPARK-25931) Benchmarking creation of Jackson parser

[ https://issues.apache.org/jira/browse/SPARK-25931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25931: -- Affects Version/s: (was: 2.4.0) 3.0.0 > Benchmarking creation of

[jira] [Commented] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674066#comment-16674066 ] antonkulaga commented on SPARK-25588: - Any updates on this? This bug blocks ADAM library and hence

[jira] [Commented] (SPARK-25933) Fix pstats reference for spark.python.profile.dump in configuration.md

[ https://issues.apache.org/jira/browse/SPARK-25933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674044#comment-16674044 ] Apache Spark commented on SPARK-25933: -- User 'AlexHagerman' has created a pull request for this

[jira] [Assigned] (SPARK-25933) Fix pstats reference for spark.python.profile.dump in configuration.md

[ https://issues.apache.org/jira/browse/SPARK-25933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25933: Assignee: (was: Apache Spark) > Fix pstats reference for spark.python.profile.dump

[jira] [Assigned] (SPARK-25933) Fix pstats reference for spark.python.profile.dump in configuration.md

[ https://issues.apache.org/jira/browse/SPARK-25933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25933: Assignee: Apache Spark > Fix pstats reference for spark.python.profile.dump in

[jira] [Commented] (SPARK-25933) Fix pstats reference for spark.python.profile.dump in configuration.md

[ https://issues.apache.org/jira/browse/SPARK-25933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674043#comment-16674043 ] Alex Hagerman commented on SPARK-25933: --- https://github.com/apache/spark/pull/22933 > Fix pstats

[jira] [Updated] (SPARK-25933) Fix pstats reference for spark.python.profile.dump in configuration.md

[ https://issues.apache.org/jira/browse/SPARK-25933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Hagerman updated SPARK-25933: -- Labels: documentation pull-request-available (was: documentation) > Fix pstats reference for

[jira] [Created] (SPARK-25933) Fix pstats reference for spark.python.profile.dump in configuration.md

Alex Hagerman created SPARK-25933: - Summary: Fix pstats reference for spark.python.profile.dump in configuration.md Key: SPARK-25933 URL: https://issues.apache.org/jira/browse/SPARK-25933 Project:

[jira] [Updated] (SPARK-25906) spark-shell cannot handle `-i` option correctly

[ https://issues.apache.org/jira/browse/SPARK-25906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25906: - Target Version/s: 2.4.1, 3.0.0 (was: 2.4.1) > spark-shell cannot handle `-i` option correctly

[jira] [Updated] (SPARK-25906) spark-shell cannot handle `-i` option correctly

[ https://issues.apache.org/jira/browse/SPARK-25906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25906: - Target Version/s: 2.4.1 > spark-shell cannot handle `-i` option correctly >

[jira] [Updated] (SPARK-25932) why GraphX vertexId should be Long ?

[ https://issues.apache.org/jira/browse/SPARK-25932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Zadedehbalaei updated SPARK-25932: -- Target Version/s: (was: 2.3.2) Fix Version/s: (was: 2.3.2) > why GraphX

[jira] [Created] (SPARK-25932) why GraphX vertexId should be Long ?

Ali Zadedehbalaei created SPARK-25932: - Summary: why GraphX vertexId should be Long ? Key: SPARK-25932 URL: https://issues.apache.org/jira/browse/SPARK-25932 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17967) Support for list or other types as an option for datasources

[ https://issues.apache.org/jira/browse/SPARK-17967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674007#comment-16674007 ] Maxim Gekk commented on SPARK-17967: What about to preserve existing API as is, and pass multiple

[jira] [Assigned] (SPARK-25931) Benchmarking creation of Jackson parser

[ https://issues.apache.org/jira/browse/SPARK-25931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25931: Assignee: Apache Spark > Benchmarking creation of Jackson parser >

[jira] [Commented] (SPARK-25931) Benchmarking creation of Jackson parser

[ https://issues.apache.org/jira/browse/SPARK-25931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673980#comment-16673980 ] Apache Spark commented on SPARK-25931: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25931) Benchmarking creation of Jackson parser

[ https://issues.apache.org/jira/browse/SPARK-25931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25931: Assignee: (was: Apache Spark) > Benchmarking creation of Jackson parser >

[jira] [Created] (SPARK-25931) Benchmarking creation of Jackson parser

Maxim Gekk created SPARK-25931: -- Summary: Benchmarking creation of Jackson parser Key: SPARK-25931 URL: https://issues.apache.org/jira/browse/SPARK-25931 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-25548) In the PruneFileSourcePartitions optimizer, replace the nonPartitionOps field with true in the And(partitionOps, nonPartitionOps) to make the partition can be pruned

[ https://issues.apache.org/jira/browse/SPARK-25548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673957#comment-16673957 ] Eyal Farago commented on SPARK-25548: - [~eaton], I think there are two possible approaches to handle

[jira] [Commented] (SPARK-24437) Memory leak in UnsafeHashedRelation

[ https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673949#comment-16673949 ] Eyal Farago commented on SPARK-24437: - [~dvogelbacher], haven't looked to deep into this, but

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673948#comment-16673948 ] Apache Spark commented on SPARK-25102: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25102: -- Description: Currently, Spark writes Spark version number into Hive Table properties with

[jira] [Updated] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25102: -- Description: Currently, Spark writes Spark version number into Hive Table properties with

[jira] [Updated] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25102: -- Description: Currently, Spark writes Spark version number into Hive Table properties with

[jira] [Updated] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25102: -- Description: Currently, Spark writes Spark version number into Hive Table properties with

[jira] [Updated] (SPARK-25102) Write Spark version to Parquet/ORC file metadata

[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25102: -- Description: Currently, Spark writes Spark version number into Hive Table properties with

[jira] [Updated] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25102: -- Summary: Write Spark version to ORC/Parquet file metadata (was: Write Spark version to

[jira] [Updated] (SPARK-25102) Write Spark version to Parquet/ORC file metadata

[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25102: -- Summary: Write Spark version to Parquet/ORC file metadata (was: Write Spark version

[jira] [Updated] (SPARK-25102) Write Spark version to Parquet/ORC file metadata

[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25102: -- Priority: Major (was: Minor) > Write Spark version to Parquet/ORC file metadata >

[jira] [Updated] (SPARK-25102) Write Spark version to Parquet/ORC file metadata

[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25102: -- Affects Version/s: (was: 2.3.1) 3.0.0 > Write Spark version to

[jira] [Resolved] (SPARK-25901) Barrier mode spawns a bunch of threads that get collected on gc

[ https://issues.apache.org/jira/browse/SPARK-25901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-25901. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22912

[jira] [Commented] (SPARK-24758) Create table wants to use /user/hive/warehouse in clean clone

[ https://issues.apache.org/jira/browse/SPARK-24758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673939#comment-16673939 ] Yuming Wang commented on SPARK-24758: - cc [~Qin Yao] > Create table wants to use