[jira] [Commented] (SPARK-26330) Duplicate query execution events generated for SQL commands

[ https://issues.apache.org/jira/browse/SPARK-26330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790227#comment-16790227 ] Sandeep Katta commented on SPARK-26330: --- looks same as 

[jira] [Resolved] (SPARK-27011) reset command fails after cache table

[ https://issues.apache.org/jira/browse/SPARK-27011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27011. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23918

[jira] [Assigned] (SPARK-27011) reset command fails after cache table

[ https://issues.apache.org/jira/browse/SPARK-27011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27011: --- Assignee: Ajith S > reset command fails after cache table >

[jira] [Commented] (SPARK-27011) reset command fails after cache table

[ https://issues.apache.org/jira/browse/SPARK-27011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790220#comment-16790220 ] Ajith S commented on SPARK-27011: - @ [~cloud_fan] As [https://github.com/apache/spark/pull/23918] is

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790208#comment-16790208 ] Ajith S commented on SPARK-26961: - [~srowen] Yes. I too have same opinion of fixing it via 

[jira] [Resolved] (SPARK-27117) current_date/current_timestamp should not refer to columns with ansi parser mode

[ https://issues.apache.org/jira/browse/SPARK-27117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27117. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24039

[jira] [Commented] (SPARK-27114) SQL Tab shows duplicate executions for some commands

[ https://issues.apache.org/jira/browse/SPARK-27114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790136#comment-16790136 ] Ajith S commented on SPARK-27114: - [~srowen] as *LocalRelation* is eagerly evaluated hence can skip

[jira] [Commented] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790119#comment-16790119 ] Xianyin Xin commented on SPARK-21067: - Yep, [~Moriarty279] , nice analysis. > Thrift Server - CTAS

[jira] [Commented] (SPARK-27124) Expose org.apache.spark.sql.avro.SchemaConverters as developer API

[ https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790083#comment-16790083 ] Hyukjin Kwon commented on SPARK-27124: -- {{SchemaConverters}} isn't an API as you said. I think it's

[jira] [Resolved] (SPARK-27109) Refactoring of TimestampFormatter and DateFormatter

[ https://issues.apache.org/jira/browse/SPARK-27109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27109. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24030

[jira] [Assigned] (SPARK-27109) Refactoring of TimestampFormatter and DateFormatter

[ https://issues.apache.org/jira/browse/SPARK-27109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27109: - Assignee: Maxim Gekk > Refactoring of TimestampFormatter and DateFormatter >

[jira] [Updated] (SPARK-26921) Fix CRAN hack as soon as Arrow is available on CRAN

[ https://issues.apache.org/jira/browse/SPARK-26921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26921: - Description: Arrow optimization was added but Arrow is not available on CRAN. So, it had to

[jira] [Resolved] (SPARK-26923) Refactor ArrowRRunner and RRunner to share the same base

[ https://issues.apache.org/jira/browse/SPARK-26923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26923. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23977

[jira] [Assigned] (SPARK-26923) Refactor ArrowRRunner and RRunner to share the same base

[ https://issues.apache.org/jira/browse/SPARK-26923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26923: Assignee: Hyukjin Kwon > Refactor ArrowRRunner and RRunner to share the same base >

[jira] [Assigned] (SPARK-26594) DataSourceOptions.asMap should return CaseInsensitiveMap

[ https://issues.apache.org/jira/browse/SPARK-26594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26594: Assignee: (was: Apache Spark) > DataSourceOptions.asMap should return

[jira] [Assigned] (SPARK-26594) DataSourceOptions.asMap should return CaseInsensitiveMap

[ https://issues.apache.org/jira/browse/SPARK-26594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26594: Assignee: Apache Spark > DataSourceOptions.asMap should return CaseInsensitiveMap >

[jira] [Assigned] (SPARK-27123) Improve CollapseProject to handle projects cross limit/repartition/sample

[ https://issues.apache.org/jira/browse/SPARK-27123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-27123: - Assignee: Dongjoon Hyun > Improve CollapseProject to handle projects cross

[jira] [Assigned] (SPARK-26958) Add NestedSchemaPruningBenchmark

[ https://issues.apache.org/jira/browse/SPARK-26958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-26958: - Assignee: Dongjoon Hyun > Add NestedSchemaPruningBenchmark >

[jira] [Updated] (SPARK-27123) Improve CollapseProject to handle projects cross limit/repartition/sample

[ https://issues.apache.org/jira/browse/SPARK-27123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27123: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-25603 > Improve

[jira] [Commented] (SPARK-26822) Upgrade the deprecated module 'optparse'

[ https://issues.apache.org/jira/browse/SPARK-26822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790018#comment-16790018 ] Thincrs commented on SPARK-26822: - A user of thincrs has selected this issue. Deadline: Mon, Mar 18,

[jira] [Resolved] (SPARK-27073) Fix a race condition when handling of IdleStateEvent

[ https://issues.apache.org/jira/browse/SPARK-27073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27073. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23989

[jira] [Resolved] (SPARK-27004) Code for https uri authentication in Spark Submit needs to be removed

[ https://issues.apache.org/jira/browse/SPARK-27004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27004. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24033

[jira] [Assigned] (SPARK-27004) Code for https uri authentication in Spark Submit needs to be removed

[ https://issues.apache.org/jira/browse/SPARK-27004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27004: -- Assignee: Marcelo Vanzin > Code for https uri authentication in Spark Submit needs

[jira] [Commented] (SPARK-23160) Add more window sql tests

[ https://issues.apache.org/jira/browse/SPARK-23160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789877#comment-16789877 ] Dylan Guedes commented on SPARK-23160: -- Hi, I would like to work on this one, but to be fair I

[jira] [Assigned] (SPARK-27129) Add JSON event serialization methods in JSONUtils for blacklisted events

[ https://issues.apache.org/jira/browse/SPARK-27129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27129: Assignee: (was: Apache Spark) > Add JSON event serialization methods in JSONUtils

[jira] [Resolved] (SPARK-27129) Add JSON event serialization methods in JSONUtils for blacklisted events

[ https://issues.apache.org/jira/browse/SPARK-27129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27129. Resolution: Invalid Unless you can show why this (or in this case the lack of this) is a

[jira] [Assigned] (SPARK-27129) Add JSON event serialization methods in JSONUtils for blacklisted events

[ https://issues.apache.org/jira/browse/SPARK-27129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27129: Assignee: Apache Spark > Add JSON event serialization methods in JSONUtils for

[jira] [Created] (SPARK-27129) Add JSON event serialization methods in JSONUtils for blacklisted events

Shahid K I created SPARK-27129: -- Summary: Add JSON event serialization methods in JSONUtils for blacklisted events Key: SPARK-27129 URL: https://issues.apache.org/jira/browse/SPARK-27129 Project: Spark

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789829#comment-16789829 ] Mi Zi commented on SPARK-26961: --- I think the problem could be fixed from a more general prospect if there

[jira] [Commented] (SPARK-27093) Honor ParseMode in AvroFileFormat

[ https://issues.apache.org/jira/browse/SPARK-27093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789816#comment-16789816 ] Tim Cerexhe commented on SPARK-27093: - We have three distinct failure modes that we need to not

[jira] [Assigned] (SPARK-27061) Expose Driver UI port on driver service to access UI using service

[ https://issues.apache.org/jira/browse/SPARK-27061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27061: -- Assignee: Chandu Kavar > Expose Driver UI port on driver service to access UI using

[jira] [Resolved] (SPARK-27061) Expose Driver UI port on driver service to access UI using service

[ https://issues.apache.org/jira/browse/SPARK-27061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27061. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23990

[jira] [Commented] (SPARK-26998) spark.ssl.keyStorePassword in plaintext on 'ps -ef' output of executor processes in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789786#comment-16789786 ] Gabor Somogyi commented on SPARK-26998: --- Same understanding, chosen the file approach. >

[jira] [Resolved] (SPARK-26990) Difference in handling of mixed-case partition column names after SPARK-26188

[ https://issues.apache.org/jira/browse/SPARK-26990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-26990. --- Resolution: Fixed > Difference in handling of mixed-case partition column names after

[jira] [Updated] (SPARK-26990) Difference in handling of mixed-case partition column names after SPARK-26188

[ https://issues.apache.org/jira/browse/SPARK-26990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-26990: -- Fix Version/s: 2.4.1 > Difference in handling of mixed-case partition column names after

[jira] [Commented] (SPARK-26998) spark.ssl.keyStorePassword in plaintext on 'ps -ef' output of executor processes in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789766#comment-16789766 ] Marcelo Vanzin commented on SPARK-26998: There are 3 ways to solve this: pipe, file, or env

[jira] [Assigned] (SPARK-27128) Migrate JSON to File Data Source V2

[ https://issues.apache.org/jira/browse/SPARK-27128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27128: Assignee: (was: Apache Spark) > Migrate JSON to File Data Source V2 >

[jira] [Resolved] (SPARK-27119) Do not infer schema when reading Hive serde table with native data source

[ https://issues.apache.org/jira/browse/SPARK-27119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27119. - Resolution: Fixed Fix Version/s: 3.0.0 > Do not infer schema when reading Hive serde table with

[jira] [Assigned] (SPARK-27128) Migrate JSON to File Data Source V2

[ https://issues.apache.org/jira/browse/SPARK-27128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27128: Assignee: Apache Spark > Migrate JSON to File Data Source V2 >

[jira] [Created] (SPARK-27128) Migrate JSON to File Data Source V2

Gengliang Wang created SPARK-27128: -- Summary: Migrate JSON to File Data Source V2 Key: SPARK-27128 URL: https://issues.apache.org/jira/browse/SPARK-27128 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-26839) on JDK11, IsolatedClientLoader must be able to load java.sql classes

[ https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26839: Assignee: Apache Spark > on JDK11, IsolatedClientLoader must be able to load java.sql

[jira] [Assigned] (SPARK-26839) on JDK11, IsolatedClientLoader must be able to load java.sql classes

[ https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26839: Assignee: (was: Apache Spark) > on JDK11, IsolatedClientLoader must be able to load

[jira] [Commented] (SPARK-26860) Improve RangeBetween docs in Pyspark, SparkR

[ https://issues.apache.org/jira/browse/SPARK-26860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789703#comment-16789703 ] Jagadesh Kiran N commented on SPARK-26860: -- Thanks [~srowen] for committing the same >

[jira] [Commented] (SPARK-26839) on JDK11, IsolatedClientLoader must be able to load java.sql classes

[ https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789706#comment-16789706 ] Sean Owen commented on SPARK-26839: --- I'll open my WIP PR on this. I am not sure datanucleus is the

[jira] [Updated] (SPARK-27107) Spark SQL Job failing because of Kryo buffer overflow with ORC

[ https://issues.apache.org/jira/browse/SPARK-27107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dhruve Ashar updated SPARK-27107: - Description: The issue occurs while trying to read ORC data and setting the SearchArgument.

[jira] [Commented] (SPARK-27107) Spark SQL Job failing because of Kryo buffer overflow with ORC

[ https://issues.apache.org/jira/browse/SPARK-27107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789668#comment-16789668 ] Dhruve Ashar commented on SPARK-27107: -- This is something we can consistently reproduce every

[jira] [Comment Edited] (SPARK-26998) spark.ssl.keyStorePassword in plaintext on 'ps -ef' output of executor processes in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789653#comment-16789653 ] Gabor Somogyi edited comment on SPARK-26998 at 3/11/19 2:47 PM: Since

[jira] [Commented] (SPARK-26998) spark.ssl.keyStorePassword in plaintext on 'ps -ef' output of executor processes in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789653#comment-16789653 ] Gabor Somogyi commented on SPARK-26998: --- Since the first part of the PR solved (http URLs in case

[jira] [Updated] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominic Ricard updated SPARK-21067: --- Affects Version/s: 2.4.0 > Thrift Server - CTAS fail with Unable to move source >

[jira] [Comment Edited] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789589#comment-16789589 ] Mori[A]rty edited comment on SPARK-21067 at 3/11/19 2:04 PM: - Spark 2.4.0

[jira] [Commented] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789589#comment-16789589 ] Mori[A]rty commented on SPARK-21067: Spark 2.4.0 still has the same problem. And I want to elaborate

[jira] [Comment Edited] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789589#comment-16789589 ] Mori[A]rty edited comment on SPARK-21067 at 3/11/19 1:57 PM: - Spark 2.4.0

[jira] [Updated] (SPARK-26860) Improve RangeBetween docs in Pyspark, SparkR

[ https://issues.apache.org/jira/browse/SPARK-26860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26860: -- Labels: (was: docs easyfix python) Priority: Minor (was: Major) Component/s:

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789598#comment-16789598 ] Sean Owen commented on SPARK-26961: --- I think registerAsParallelCapable() sounds like it could resolve

[jira] [Commented] (SPARK-27124) Expose org.apache.spark.sql.avro.SchemaConverters as developer API

[ https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789591#comment-16789591 ] Gabor Somogyi commented on SPARK-27124: --- I would mention "SchemaConverters can be used to make

[jira] [Resolved] (SPARK-26860) Improve RangeBetween docs in Pyspark, SparkR

[ https://issues.apache.org/jira/browse/SPARK-26860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26860. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23946

[jira] [Assigned] (SPARK-26860) Improve RangeBetween docs in Pyspark, SparkR

[ https://issues.apache.org/jira/browse/SPARK-26860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26860: - Assignee: Jagadesh Kiran N > Improve RangeBetween docs in Pyspark, SparkR >

[jira] [Assigned] (SPARK-27116) Environment tab must sort Hadoop Configuration by default

[ https://issues.apache.org/jira/browse/SPARK-27116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27116: - Assignee: Ajith S > Environment tab must sort Hadoop Configuration by default >

[jira] [Reopened] (SPARK-26860) RangeBetween docs appear to be wrong

[ https://issues.apache.org/jira/browse/SPARK-26860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-26860: --- > RangeBetween docs appear to be wrong > - > >

[jira] [Resolved] (SPARK-27116) Environment tab must sort Hadoop Configuration by default

[ https://issues.apache.org/jira/browse/SPARK-27116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27116. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24038

[jira] [Assigned] (SPARK-26152) Flaky test: BroadcastSuite

[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26152: Assignee: (was: Apache Spark) > Flaky test: BroadcastSuite >

[jira] [Comment Edited] (SPARK-27124) Expose org.apache.spark.sql.avro.SchemaConverters as developer API

[ https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789562#comment-16789562 ] Hyukjin Kwon edited comment on SPARK-27124 at 3/11/19 1:32 PM: --- I think we

[jira] [Commented] (SPARK-27124) Expose org.apache.spark.sql.avro.SchemaConverters as developer API

[ https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789562#comment-16789562 ] Hyukjin Kwon commented on SPARK-27124: -- I think we can mention that generally somewhere, say, Py4J

[jira] [Assigned] (SPARK-26152) Flaky test: BroadcastSuite

[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26152: Assignee: Apache Spark > Flaky test: BroadcastSuite > -- > >

[jira] [Assigned] (SPARK-26820) Issue Error/Warning when Hint is not applicable

[ https://issues.apache.org/jira/browse/SPARK-26820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26820: Assignee: (was: Apache Spark) > Issue Error/Warning when Hint is not applicable >

[jira] [Assigned] (SPARK-26820) Issue Error/Warning when Hint is not applicable

[ https://issues.apache.org/jira/browse/SPARK-26820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26820: Assignee: Apache Spark > Issue Error/Warning when Hint is not applicable >

[jira] [Commented] (SPARK-27124) Expose org.apache.spark.sql.avro.SchemaConverters as developer API

[ https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789494#comment-16789494 ] Gabor Somogyi commented on SPARK-27124: --- Yeah, the python implementation would use the same what

[jira] [Updated] (SPARK-26152) Flaky test: BroadcastSuite

[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-26152: Attachment: Screenshot from 2019-03-11 17-03-40.png > Flaky test: BroadcastSuite >

[jira] [Assigned] (SPARK-27127) Deduplicate codes reading from/writing to unsafe object

[ https://issues.apache.org/jira/browse/SPARK-27127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27127: Assignee: (was: Apache Spark) > Deduplicate codes reading from/writing to unsafe

[jira] [Assigned] (SPARK-27127) Deduplicate codes reading from/writing to unsafe object

[ https://issues.apache.org/jira/browse/SPARK-27127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27127: Assignee: Apache Spark > Deduplicate codes reading from/writing to unsafe object >

[jira] [Created] (SPARK-27127) Deduplicate codes reading from/writing to unsafe object

Jungtaek Lim created SPARK-27127: Summary: Deduplicate codes reading from/writing to unsafe object Key: SPARK-27127 URL: https://issues.apache.org/jira/browse/SPARK-27127 Project: Spark

[jira] [Comment Edited] (SPARK-26152) Flaky test: BroadcastSuite

[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789462#comment-16789462 ] Ajith S edited comment on SPARK-26152 at 3/11/19 12:07 PM: --- I encountered this

[jira] [Comment Edited] (SPARK-26152) Flaky test: BroadcastSuite

[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789462#comment-16789462 ] Ajith S edited comment on SPARK-26152 at 3/11/19 12:07 PM: --- I encountered this

[jira] [Commented] (SPARK-26152) Flaky test: BroadcastSuite

[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789462#comment-16789462 ] Ajith S commented on SPARK-26152: - I encountered this issue and see that its the race between

[jira] [Assigned] (SPARK-27126) Consolidate Scala and Java type deserializerFor

[ https://issues.apache.org/jira/browse/SPARK-27126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27126: Assignee: (was: Apache Spark) > Consolidate Scala and Java type deserializerFor >

[jira] [Created] (SPARK-27126) Consolidate Scala and Java type deserializerFor

Liang-Chi Hsieh created SPARK-27126: --- Summary: Consolidate Scala and Java type deserializerFor Key: SPARK-27126 URL: https://issues.apache.org/jira/browse/SPARK-27126 Project: Spark Issue

[jira] [Assigned] (SPARK-27126) Consolidate Scala and Java type deserializerFor

[ https://issues.apache.org/jira/browse/SPARK-27126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27126: Assignee: Apache Spark > Consolidate Scala and Java type deserializerFor >

[jira] [Commented] (SPARK-27124) Expose org.apache.spark.sql.avro.SchemaConverters as developer API

[ https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789388#comment-16789388 ] Hyukjin Kwon commented on SPARK-27124: -- The way of reaching it will be same as the Python

[jira] [Reopened] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anuja Jakhade reopened SPARK-26985: --- I did tried with OpenJDK. However same behavior is observed.  The test fails with the same

[jira] [Commented] (SPARK-26940) Observed greater deviation on big endian platform for SingletonReplSuite test case

[ https://issues.apache.org/jira/browse/SPARK-26940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789393#comment-16789393 ] Anuja Jakhade commented on SPARK-26940: --- I did tried with OpenJDK. However same behavior is

[jira] [Reopened] (SPARK-26940) Observed greater deviation on big endian platform for SingletonReplSuite test case

[ https://issues.apache.org/jira/browse/SPARK-26940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anuja Jakhade reopened SPARK-26940: --- I did tried with OpenJDK. However same behavior is observed.  The test fails with the same

[jira] [Commented] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789392#comment-16789392 ] Anuja Jakhade commented on SPARK-26985: --- I did tried with OpenJDK. However same behavior is

[jira] [Commented] (SPARK-27124) Expose org.apache.spark.sql.avro.SchemaConverters as developer API

[ https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789391#comment-16789391 ] Hyukjin Kwon commented on SPARK-27124: -- I think we have workarounds, and looks difficult to match

[jira] [Comment Edited] (SPARK-27124) Expose org.apache.spark.sql.avro.SchemaConverters as developer API

[ https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789388#comment-16789388 ] Hyukjin Kwon edited comment on SPARK-27124 at 3/11/19 10:39 AM: The way

[jira] [Commented] (SPARK-27124) Expose org.apache.spark.sql.avro.SchemaConverters as developer API

[ https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789366#comment-16789366 ] Hyukjin Kwon commented on SPARK-27124: -- To me, I am not sure. How would you map Avro schema in

[jira] [Assigned] (SPARK-27125) Add test suite for sql execution page

[ https://issues.apache.org/jira/browse/SPARK-27125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27125: Assignee: Apache Spark > Add test suite for sql execution page >

[jira] [Commented] (SPARK-27124) Expose org.apache.spark.sql.avro.SchemaConverters as developer API

[ https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789376#comment-16789376 ] Gabor Somogyi commented on SPARK-27124: --- {quote}This is reachable via Py4J FWIW{quote} How

[jira] [Assigned] (SPARK-27125) Add test suite for sql execution page

[ https://issues.apache.org/jira/browse/SPARK-27125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27125: Assignee: (was: Apache Spark) > Add test suite for sql execution page >

[jira] [Assigned] (SPARK-26879) Inconsistency in default column names for functions like inline and stack

[ https://issues.apache.org/jira/browse/SPARK-26879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26879: Assignee: (was: Apache Spark) > Inconsistency in default column names for functions

[jira] [Assigned] (SPARK-26879) Inconsistency in default column names for functions like inline and stack

[ https://issues.apache.org/jira/browse/SPARK-26879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26879: Assignee: Apache Spark > Inconsistency in default column names for functions like inline

[jira] [Created] (SPARK-27125) Add test suite for sql execution page

Shahid K I created SPARK-27125: -- Summary: Add test suite for sql execution page Key: SPARK-27125 URL: https://issues.apache.org/jira/browse/SPARK-27125 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-27125) Add test suite for sql execution page

[ https://issues.apache.org/jira/browse/SPARK-27125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789367#comment-16789367 ] Shahid K I commented on SPARK-27125: I will raise a PR > Add test suite for sql execution page >

[jira] [Commented] (SPARK-27124) Expose org.apache.spark.sql.avro.SchemaConverters as developer API

[ https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789356#comment-16789356 ] Gabor Somogyi commented on SPARK-27124: --- I've already put together a POC but interested in what do

[jira] [Created] (SPARK-27124) Expose org.apache.spark.sql.avro.SchemaConverters as developer API

Gabor Somogyi created SPARK-27124: - Summary: Expose org.apache.spark.sql.avro.SchemaConverters as developer API Key: SPARK-27124 URL: https://issues.apache.org/jira/browse/SPARK-27124 Project: Spark

[jira] [Commented] (SPARK-20075) Support classifier, packaging in Maven coordinates

[ https://issues.apache.org/jira/browse/SPARK-20075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789341#comment-16789341 ] Gabor Somogyi commented on SPARK-20075: --- [~kabhwan] cool. I think we both can give a try and share

[jira] [Commented] (SPARK-20075) Support classifier, packaging in Maven coordinates

[ https://issues.apache.org/jira/browse/SPARK-20075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789338#comment-16789338 ] Jungtaek Lim commented on SPARK-20075: -- [~gsomogyi] Yeah, I have experience with Aether and it

[jira] [Commented] (SPARK-20075) Support classifier, packaging in Maven coordinates

[ https://issues.apache.org/jira/browse/SPARK-20075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789329#comment-16789329 ] Gabor Somogyi commented on SPARK-20075: --- [~kabhwan] To continue the discussion started on

[jira] [Resolved] (SPARK-27096) Reconcile the join type support between data frame and sql interface

[ https://issues.apache.org/jira/browse/SPARK-27096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27096. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23982

[jira] [Assigned] (SPARK-27096) Reconcile the join type support between data frame and sql interface

[ https://issues.apache.org/jira/browse/SPARK-27096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27096: --- Assignee: Dilip Biswal > Reconcile the join type support between data frame and sql

[jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data

[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789189#comment-16789189 ] Hu Ziqian commented on SPARK-25299: --- Hi [~yifeih], your google doc posted at 25/Feb/19 is mainly

  1   2   >