[jira] [Resolved] (SPARK-27265) Provide convenience accessors for values by Column Name

[ https://issues.apache.org/jira/browse/SPARK-27265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27265. -- Resolution: Won't Fix > Provide convenience accessors for values by Column Name >

[jira] [Resolved] (SPARK-27218) spark-sql-kafka-0-10 startingOffset=earliest not working as expected with streaming

[ https://issues.apache.org/jira/browse/SPARK-27218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emanuele Sabellico resolved SPARK-27218. Resolution: Not A Problem > spark-sql-kafka-0-10 startingOffset=earliest not worki

[jira] [Commented] (SPARK-27218) spark-sql-kafka-0-10 startingOffset=earliest not working as expected with streaming

[ https://issues.apache.org/jira/browse/SPARK-27218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16800465#comment-16800465 ] Emanuele Sabellico commented on SPARK-27218: Sorry, it's that I'm new to Spa

[jira] [Commented] (SPARK-27218) spark-sql-kafka-0-10 startingOffset=earliest not working as expected with streaming

[ https://issues.apache.org/jira/browse/SPARK-27218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16800505#comment-16800505 ] Gabor Somogyi commented on SPARK-27218: --- [~emasab] no problem, the good thing that

[jira] [Created] (SPARK-27267) spark 2.4 use 1.1.7.x snappy-java, but its behavior is different from 1.1.2.x

Max Xie created SPARK-27267: Summary: spark 2.4 use 1.1.7.x snappy-java, but its behavior is different from 1.1.2.x Key: SPARK-27267 URL: https://issues.apache.org/jira/browse/SPARK-27267 Project: Spa

[jira] [Commented] (SPARK-27228) Spark long delay on close, possible problem with killing executors

[ https://issues.apache.org/jira/browse/SPARK-27228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16800621#comment-16800621 ] Lukas Waldmann commented on SPARK-27228: That's a good question :) What code do

[jira] [Created] (SPARK-27268) Add map_keys and map_values support in nested schema pruning

Liang-Chi Hsieh created SPARK-27268: --- Summary: Add map_keys and map_values support in nested schema pruning Key: SPARK-27268 URL: https://issues.apache.org/jira/browse/SPARK-27268 Project: Spark

[jira] [Created] (SPARK-27269) File source v2 should validate data schema only

Gengliang Wang created SPARK-27269: -- Summary: File source v2 should validate data schema only Key: SPARK-27269 URL: https://issues.apache.org/jira/browse/SPARK-27269 Project: Spark Issue Typ

[jira] [Created] (SPARK-27270) Add Kafka dynamic JAAS authentication debug possibility

Gabor Somogyi created SPARK-27270: - Summary: Add Kafka dynamic JAAS authentication debug possibility Key: SPARK-27270 URL: https://issues.apache.org/jira/browse/SPARK-27270 Project: Spark Iss

[jira] [Updated] (SPARK-27234) Continuous Streaming does not support python UDFs

[ https://issues.apache.org/jira/browse/SPARK-27234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamilton updated SPARK-27234: -- Description: Heres a repro: {code:java} from pyspark.sql.functions import col, udf fooUDF = ud

[jira] [Resolved] (SPARK-26132) Remove support for Scala 2.11 in Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-26132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26132. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23098 [https://github.c

[jira] [Commented] (SPARK-27234) Continuous Streaming does not support python UDFs

[ https://issues.apache.org/jira/browse/SPARK-27234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16800817#comment-16800817 ] Mark Hamilton commented on SPARK-27234: --- Thank you for the quick reply [~hyukjin.k

[jira] [Updated] (SPARK-21708) use sbt 1.x

[ https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darcy Shen updated SPARK-21708: --- Affects Version/s: 2.4.0 > use sbt 1.x > --- > > Key: SPARK-21708 >

[jira] [Resolved] (SPARK-27263) Hide `Hadoop Properties` table in Environment page if it's empty

[ https://issues.apache.org/jira/browse/SPARK-27263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27263. --- Resolution: Won't Fix > Hide `Hadoop Properties` table in Environment page if it's empty > -

[jira] [Created] (SPARK-27271) Migrate Text to File Data Source V2

Gengliang Wang created SPARK-27271: -- Summary: Migrate Text to File Data Source V2 Key: SPARK-27271 URL: https://issues.apache.org/jira/browse/SPARK-27271 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-27177) Update jenkins locale to en_US.UTF-8

[ https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16800947#comment-16800947 ] shane knapp commented on SPARK-27177: - SBT builds to be updated in the next day or s

[jira] [Created] (SPARK-27272) Enable blacklisting of node/executor on fetch failures by default

Ankur Gupta created SPARK-27272: --- Summary: Enable blacklisting of node/executor on fetch failures by default Key: SPARK-27272 URL: https://issues.apache.org/jira/browse/SPARK-27272 Project: Spark

[jira] [Resolved] (SPARK-27240) Use pandas DataFrame for struct type argument in Scalar Pandas UDF.

[ https://issues.apache.org/jira/browse/SPARK-27240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-27240. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24177 https://git

[jira] [Commented] (SPARK-27255) Aggregate functions should not be allowed in WHERE

[ https://issues.apache.org/jira/browse/SPARK-27255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16800972#comment-16800972 ] Chakravarthi commented on SPARK-27255: -- Hi [~dkbiswal] , sorry for the delay...I ju

[jira] [Assigned] (SPARK-27240) Use pandas DataFrame for struct type argument in Scalar Pandas UDF.

[ https://issues.apache.org/jira/browse/SPARK-27240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-27240: Assignee: Takuya Ueshin > Use pandas DataFrame for struct type argument in Scalar Pandas

[jira] [Updated] (SPARK-27094) Thread interrupt being swallowed while launching executors in YarnAllocator

[ https://issues.apache.org/jira/browse/SPARK-27094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-27094: Fix Version/s: 2.4.1 > Thread interrupt being swallowed while launching executors in YarnAllocator > -

[jira] [Commented] (SPARK-27255) Aggregate functions should not be allowed in WHERE

[ https://issues.apache.org/jira/browse/SPARK-27255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16800984#comment-16800984 ] Dilip Biswal commented on SPARK-27255: -- [~chakravarthi] Not a problem. Thank you fo

[jira] [Commented] (SPARK-27255) Aggregate functions should not be allowed in WHERE

[ https://issues.apache.org/jira/browse/SPARK-27255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801000#comment-16801000 ] Dilip Biswal commented on SPARK-27255: -- cc [~chakravarthi] fyi - raised the pr. >

[jira] [Created] (SPARK-27273) Compile break for UserDefinedType (DataType) subclasses with javac 8

Robert Kruszewski created SPARK-27273: - Summary: Compile break for UserDefinedType (DataType) subclasses with javac 8 Key: SPARK-27273 URL: https://issues.apache.org/jira/browse/SPARK-27273 Projec

[jira] [Commented] (SPARK-26325) Interpret timestamp fields in Spark while reading json (timestampFormat)

[ https://issues.apache.org/jira/browse/SPARK-26325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801011#comment-16801011 ] Maxim Gekk commented on SPARK-26325: Can you try Z instead of 'Z'? > Interpret time

[jira] [Resolved] (SPARK-27155) Docker Oracle XE image docker image has been removed by DockerHub

[ https://issues.apache.org/jira/browse/SPARK-27155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27155. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24086 [https://github.c

[jira] [Assigned] (SPARK-27155) Docker Oracle XE image docker image has been removed by DockerHub

[ https://issues.apache.org/jira/browse/SPARK-27155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27155: - Assignee: Zhu, Lipeng > Docker Oracle XE image docker image has been removed by DockerHub > --

[jira] [Assigned] (SPARK-27198) Heartbeat interval mismatch in driver and executor

[ https://issues.apache.org/jira/browse/SPARK-27198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27198: - Assignee: Ajith S > Heartbeat interval mismatch in driver and executor > --

[jira] [Resolved] (SPARK-27198) Heartbeat interval mismatch in driver and executor

[ https://issues.apache.org/jira/browse/SPARK-27198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27198. --- Resolution: Fixed Fix Version/s: 2.4.2 Issue resolved by pull request 24140 [https://github.c

[jira] [Updated] (SPARK-21708) use sbt 1.x

[ https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21708: -- Affects Version/s: (was: 2.4.0) (was: 2.3.0)

[jira] [Commented] (SPARK-27260) Upgrade to Kafka 2.2.0

[ https://issues.apache.org/jira/browse/SPARK-27260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801148#comment-16801148 ] Dongjoon Hyun commented on SPARK-27260: --- Thank you so much, [~hyukjin.kwon]! > Up

[jira] [Resolved] (SPARK-27256) If the configuration is used to set the number of bytes, we'd better use `bytesConf`'.

[ https://issues.apache.org/jira/browse/SPARK-27256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27256. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24187 [https://gith

[jira] [Assigned] (SPARK-27256) If the configuration is used to set the number of bytes, we'd better use `bytesConf`'.

[ https://issues.apache.org/jira/browse/SPARK-27256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27256: --- Assignee: liuxian > If the configuration is used to set the number of bytes, we'd better us

[jira] [Created] (SPARK-27274) Refer to Scala 2.12 in docs; deprecate Scala 2.11 support in 2.4.x

Sean Owen created SPARK-27274: - Summary: Refer to Scala 2.12 in docs; deprecate Scala 2.11 support in 2.4.x Key: SPARK-27274 URL: https://issues.apache.org/jira/browse/SPARK-27274 Project: Spark

[jira] [Updated] (SPARK-27274) Refer to Scala 2.12 in docs; deprecate Scala 2.11 support in 2.4.1

[ https://issues.apache.org/jira/browse/SPARK-27274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27274: -- Summary: Refer to Scala 2.12 in docs; deprecate Scala 2.11 support in 2.4.1 (was: Refer to Sc

[jira] [Updated] (SPARK-27275) Potential corruption in EncryptedMessage.transferTo

[ https://issues.apache.org/jira/browse/SPARK-27275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-27275: - Labels: correctness (was: ) > Potential corruption in EncryptedMessage.transferTo > ---

[jira] [Created] (SPARK-27275) Potential corruption in EncryptedMessage.transferTo

Shixiong Zhu created SPARK-27275: Summary: Potential corruption in EncryptedMessage.transferTo Key: SPARK-27275 URL: https://issues.apache.org/jira/browse/SPARK-27275 Project: Spark Issue Typ

[jira] [Updated] (SPARK-27268) Add map_keys and map_values support in nested schema pruning

[ https://issues.apache.org/jira/browse/SPARK-27268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27268: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-25603 > Add map_keys and map_va

[jira] [Resolved] (SPARK-27268) Add map_keys and map_values support in nested schema pruning

[ https://issues.apache.org/jira/browse/SPARK-27268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27268. --- This is resolved via https://github.com/apache/spark/pull/24202 > Add map_keys and map_values s

[jira] [Updated] (SPARK-26847) Pruning nested serializers from object serializers: MapType support

[ https://issues.apache.org/jira/browse/SPARK-26847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26847: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-25603 > Pruning nested serializ

[jira] [Resolved] (SPARK-26847) Pruning nested serializers from object serializers: MapType support

[ https://issues.apache.org/jira/browse/SPARK-26847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26847. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 3.0.0 This is res

[jira] [Commented] (SPARK-27260) Upgrade to Kafka 2.2.0

[ https://issues.apache.org/jira/browse/SPARK-27260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801245#comment-16801245 ] Hyukjin Kwon commented on SPARK-27260: -- Nope :D > Upgrade to Kafka 2.2.0 > ---

[jira] [Commented] (SPARK-27234) Continuous Streaming does not support python UDFs

[ https://issues.apache.org/jira/browse/SPARK-27234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801248#comment-16801248 ] Hyukjin Kwon commented on SPARK-27234: -- Cool, thanks :D > Continuous Streaming doe

[jira] [Created] (SPARK-27276) Increase the minimum pyarrow version to 0.12.0

Bryan Cutler created SPARK-27276: Summary: Increase the minimum pyarrow version to 0.12.0 Key: SPARK-27276 URL: https://issues.apache.org/jira/browse/SPARK-27276 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-27276) Increase the minimum pyarrow version to 0.12.0

[ https://issues.apache.org/jira/browse/SPARK-27276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801250#comment-16801250 ] Bryan Cutler commented on SPARK-27276: -- [~shaneknapp] this will need an upgrade on

[jira] [Resolved] (SPARK-27274) Refer to Scala 2.12 in docs; deprecate Scala 2.11 support in 2.4.1

[ https://issues.apache.org/jira/browse/SPARK-27274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27274. --- Resolution: Fixed Fix Version/s: 2.4.1 Resolved by https://github.com/apache/spark/pull/24210

[jira] [Assigned] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26961: - Assignee: Ajith S > Found Java-level deadlock in Spark Driver > ---

[jira] [Resolved] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26961. --- Resolution: Fixed Fix Version/s: 2.3.4 2.4.2 3.0.0 Issu

[jira] [Assigned] (SPARK-27246) scalar subquery with no columns throws exception in spark.shell

[ https://issues.apache.org/jira/browse/SPARK-27246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-27246: Assignee: Chakravarthi > scalar subquery with no columns throws exception in spark.shell

[jira] [Resolved] (SPARK-27246) scalar subquery with no columns throws exception in spark.shell

[ https://issues.apache.org/jira/browse/SPARK-27246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27246. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/24182 > scalar subquery with

[jira] [Updated] (SPARK-27246) scalar subquery with no columns throws exception in spark.shell

[ https://issues.apache.org/jira/browse/SPARK-27246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27246: - Fix Version/s: 3.0.0 > scalar subquery with no columns throws exception in spark.shell > --

[jira] [Assigned] (SPARK-27226) Reduce the code duplicate when upgrading built-in Hive

[ https://issues.apache.org/jira/browse/SPARK-27226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27226: - Assignee: Yuming Wang > Reduce the code duplicate when upgrading built-in Hive > --

[jira] [Resolved] (SPARK-27226) Reduce the code duplicate when upgrading built-in Hive

[ https://issues.apache.org/jira/browse/SPARK-27226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27226. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24166 [https://github.c

[jira] [Resolved] (SPARK-27209) Split parsing of SELECT and INSERT into two top-level rules in the grammar file.

[ https://issues.apache.org/jira/browse/SPARK-27209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27209. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24150 [https://gith

[jira] [Assigned] (SPARK-27209) Split parsing of SELECT and INSERT into two top-level rules in the grammar file.

[ https://issues.apache.org/jira/browse/SPARK-27209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27209: --- Assignee: Dilip Biswal > Split parsing of SELECT and INSERT into two top-level rules in the

[jira] [Commented] (SPARK-24388) EventLoop's run method don't handle fatal error, causes driver hang forever

[ https://issues.apache.org/jira/browse/SPARK-24388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801273#comment-16801273 ] Shivu Sondur commented on SPARK-24388: -- [~advancedxy] are you still checking this i

[jira] [Updated] (SPARK-27276) Increase the minimum pyarrow version to 0.12.0

[ https://issues.apache.org/jira/browse/SPARK-27276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27276: - Target Version/s: 3.0.0 > Increase the minimum pyarrow version to 0.12.0 > -

[jira] [Commented] (SPARK-27276) Increase the minimum pyarrow version to 0.12.0

[ https://issues.apache.org/jira/browse/SPARK-27276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801281#comment-16801281 ] Hyukjin Kwon commented on SPARK-27276: -- Yes, we really need to upgrade the minimal

[jira] [Commented] (SPARK-27267) spark 2.4 use 1.1.7.x snappy-java, but its behavior is different from 1.1.2.x

[ https://issues.apache.org/jira/browse/SPARK-27267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801311#comment-16801311 ] Max Xie commented on SPARK-27267: -- I has committed this fix to snappy-java ([https://

[jira] [Resolved] (SPARK-27140) The feature is 'insert overwrite local directory' has an inconsistent behavior in different environment.

[ https://issues.apache.org/jira/browse/SPARK-27140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27140. --- Resolution: Duplicate > The feature is 'insert overwrite local directory' has an inconsistent > beh

[jira] [Commented] (SPARK-27267) spark 2.4 use 1.1.7.x snappy-java, but its behavior is different from 1.1.2.x

[ https://issues.apache.org/jira/browse/SPARK-27267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801316#comment-16801316 ] Yuming Wang commented on SPARK-27267: - [~max2049] (y) > spark 2.4 use 1.1.7.x sna

[jira] [Created] (SPARK-27277) Recover from setting fix version failure in merge script

Hyukjin Kwon created SPARK-27277: Summary: Recover from setting fix version failure in merge script Key: SPARK-27277 URL: https://issues.apache.org/jira/browse/SPARK-27277 Project: Spark Issu

[jira] [Resolved] (SPARK-27238) In the same APP, maybe some hive Parquet(ORC) tables can't use the built-in Parquet(ORC) reader and writer

[ https://issues.apache.org/jira/browse/SPARK-27238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27238. -- Resolution: Won't Fix > In the same APP, maybe some hive Parquet(ORC) tables can't use the bui

[jira] [Created] (SPARK-27278) SimplifyExtractValueOps doesn't optimise Literal map access to CASE WHEN ... END

Huon Wilson created SPARK-27278: --- Summary: SimplifyExtractValueOps doesn't optimise Literal map access to CASE WHEN ... END Key: SPARK-27278 URL: https://issues.apache.org/jira/browse/SPARK-27278 Projec

[jira] [Updated] (SPARK-27278) SimplifyExtractValueOps doesn't optimise Literal map access to CASE WHEN ... END

[ https://issues.apache.org/jira/browse/SPARK-27278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huon Wilson updated SPARK-27278: Labels: Optimization (was: ) > SimplifyExtractValueOps doesn't optimise Literal map access to CAS

[jira] [Created] (SPARK-27279) Reuse subquery should compare child node only

Adrian Wang created SPARK-27279: --- Summary: Reuse subquery should compare child node only Key: SPARK-27279 URL: https://issues.apache.org/jira/browse/SPARK-27279 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-27246) scalar subquery with no columns throws exception in spark.shell

[ https://issues.apache.org/jira/browse/SPARK-27246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801356#comment-16801356 ] Sandeep Katta commented on SPARK-27246: --- [~hyukjin.kwon]I think by mistake assigne

[jira] [Assigned] (SPARK-27246) scalar subquery with no columns throws exception in spark.shell

[ https://issues.apache.org/jira/browse/SPARK-27246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-27246: Assignee: Sandeep Katta (was: Chakravarthi) > scalar subquery with no columns throws ex

[jira] [Commented] (SPARK-27246) scalar subquery with no columns throws exception in spark.shell

[ https://issues.apache.org/jira/browse/SPARK-27246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801357#comment-16801357 ] Hyukjin Kwon commented on SPARK-27246: -- Thanks. > scalar subquery with no columns

[jira] [Updated] (SPARK-27266) Support ANALYZE TABLE to collect tables stats for cached catalog views

[ https://issues.apache.org/jira/browse/SPARK-27266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27266: -- Affects Version/s: (was: 2.4.0) 3.0.0 > Support ANALYZE TABLE to co

[jira] [Updated] (SPARK-25196) Extends the analyze column command for cached tables

[ https://issues.apache.org/jira/browse/SPARK-25196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25196: -- Affects Version/s: (was: 2.3.1) 3.0.0 > Extends the analyze column

[jira] [Commented] (SPARK-27267) spark 2.4 use 1.1.7.x snappy-java, but its behavior is different from 1.1.2.x

[ https://issues.apache.org/jira/browse/SPARK-27267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801366#comment-16801366 ] Taro L. Saito commented on SPARK-27267: --- Just released snappy-java 1.1.7.3 with th

[jira] [Commented] (SPARK-27269) File source v2 should validate data schema only

[ https://issues.apache.org/jira/browse/SPARK-27269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801393#comment-16801393 ] Dongjoon Hyun commented on SPARK-27269: --- Hi, [~Gengliang.Wang]. - If this is a re

[jira] [Commented] (SPARK-27267) spark 2.4 use 1.1.7.x snappy-java, but its behavior is different from 1.1.2.x

[ https://issues.apache.org/jira/browse/SPARK-27267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801396#comment-16801396 ] Yuming Wang commented on SPARK-27267: - Thank you [~taroleo]. @[~max2049] Could you 

[jira] [Reopened] (SPARK-27239) Processing Compressed HDFS files with spark failing with error: "java.lang.IllegalArgumentException: requirement failed: length (-1) cannot be negative" from spark 2.2.

[ https://issues.apache.org/jira/browse/SPARK-27239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Kumar K reopened SPARK-27239: Reopening this Jira, since Jira : SPARK-27259 is duplicate and it exactly cloned from this Ji

[jira] [Updated] (SPARK-27239) Processing Compressed HDFS files with spark failing with error: "java.lang.IllegalArgumentException: requirement failed: length (-1) cannot be negative" from spark 2.2.X

[ https://issues.apache.org/jira/browse/SPARK-27239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Kumar K updated SPARK-27239: --- Priority: Major (was: Blocker) > Processing Compressed HDFS files with spark failing with e

[jira] [Commented] (SPARK-27264) spark sql released all executor but the job is not done

[ https://issues.apache.org/jira/browse/SPARK-27264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801437#comment-16801437 ] Mike Chan commented on SPARK-27264: --- I have repartition the data before transformation

[jira] [Resolved] (SPARK-27264) spark sql released all executor but the job is not done

[ https://issues.apache.org/jira/browse/SPARK-27264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Chan resolved SPARK-27264. --- Resolution: Invalid Before making further attempt, I want to ensure broadcast join is enabled on th