[jira] [Commented] (SPARK-33133) History server fails when loading invalid rolling event logs

[ https://issues.apache.org/jira/browse/SPARK-33133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213689#comment-17213689 ] Jungtaek Lim commented on SPARK-33133: -- [~Kimahriman] Thanks for the report! Let's

[jira] [Commented] (SPARK-33113) [SparkR] gapply works with arrow disabled, fails with arrow enabled stringsAsFactors=TRUE

[ https://issues.apache.org/jira/browse/SPARK-33113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213709#comment-17213709 ] Jacek Pliszka commented on SPARK-33113: --- sessionInfo()   R version 3.6.3 (2020-0

[jira] [Created] (SPARK-33143) Make SocketAuthServer socket timeout configurable

Miklos Szurap created SPARK-33143: - Summary: Make SocketAuthServer socket timeout configurable Key: SPARK-33143 URL: https://issues.apache.org/jira/browse/SPARK-33143 Project: Spark Issue Typ

[jira] [Created] (SPARK-33144) Connot insert overwite multiple partition, get exception "get partition: Value for key name is null or empty"

CHC created SPARK-33144: --- Summary: Connot insert overwite multiple partition, get exception "get partition: Value for key name is null or empty" Key: SPARK-33144 URL: https://issues.apache.org/jira/browse/SPARK-33144

[jira] [Commented] (SPARK-33111) aft transform optimization

[ https://issues.apache.org/jira/browse/SPARK-33111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213789#comment-17213789 ] Apache Spark commented on SPARK-33111: -- User 'zhengruifeng' has created a pull requ

[jira] [Created] (SPARK-33145) In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page.

akiyamaneko created SPARK-33145: --- Summary: In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page. Key: SPARK-33145 URL: https://issues.apache.org/jira/br

[jira] [Updated] (SPARK-33145) In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page.

[ https://issues.apache.org/jira/browse/SPARK-33145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] akiyamaneko updated SPARK-33145: Attachment: Screenshot.png > In Execution web page, when `Succeeded Job` has many child url elemen

[jira] [Updated] (SPARK-33145) In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page.

[ https://issues.apache.org/jira/browse/SPARK-33145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] akiyamaneko updated SPARK-33145: Attachment: Screenshot1.png > In Execution web page, when `Succeeded Job` has many child url eleme

[jira] [Assigned] (SPARK-33145) In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page.

[ https://issues.apache.org/jira/browse/SPARK-33145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33145: Assignee: (was: Apache Spark) > In Execution web page, when `Succeeded Job` has many

[jira] [Commented] (SPARK-33145) In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page.

[ https://issues.apache.org/jira/browse/SPARK-33145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213810#comment-17213810 ] Apache Spark commented on SPARK-33145: -- User 'akiyamaneko' has created a pull reque

[jira] [Commented] (SPARK-33145) In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page.

[ https://issues.apache.org/jira/browse/SPARK-33145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213811#comment-17213811 ] Apache Spark commented on SPARK-33145: -- User 'akiyamaneko' has created a pull reque

[jira] [Assigned] (SPARK-33145) In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page.

[ https://issues.apache.org/jira/browse/SPARK-33145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33145: Assignee: Apache Spark > In Execution web page, when `Succeeded Job` has many child url e

[jira] [Commented] (SPARK-33085) "Master removed our application" error leads to FAILED driver status instead of KILLED driver status

[ https://issues.apache.org/jira/browse/SPARK-33085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213815#comment-17213815 ] t oo commented on SPARK-33085: -- # start long running spark job in cluster mode # terminate

[jira] [Commented] (SPARK-33138) unify temp view and permanent view behaviors

[ https://issues.apache.org/jira/browse/SPARK-33138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213824#comment-17213824 ] Leanken.Lin commented on SPARK-33138: - Thanks for your consideration, but me and my 

[jira] [Created] (SPARK-33146) Encountering an invalid rolling event log folder prevents loading other applications in SHS

Adam Binford created SPARK-33146: Summary: Encountering an invalid rolling event log folder prevents loading other applications in SHS Key: SPARK-33146 URL: https://issues.apache.org/jira/browse/SPARK-33146

[jira] [Commented] (SPARK-33133) History server fails when loading invalid rolling event logs

[ https://issues.apache.org/jira/browse/SPARK-33133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213832#comment-17213832 ] Adam Binford commented on SPARK-33133: -- I created [https://issues.apache.org/jira/p

[jira] [Created] (SPARK-33147) Avoid distribute user jar from driver in yarn client mode

dzcxzl created SPARK-33147: -- Summary: Avoid distribute user jar from driver in yarn client mode Key: SPARK-33147 URL: https://issues.apache.org/jira/browse/SPARK-33147 Project: Spark Issue Type: Imp

[jira] [Commented] (SPARK-33147) Avoid distribute user jar from driver in yarn client mode

[ https://issues.apache.org/jira/browse/SPARK-33147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213843#comment-17213843 ] Apache Spark commented on SPARK-33147: -- User 'cxzl25' has created a pull request fo

[jira] [Assigned] (SPARK-33147) Avoid distribute user jar from driver in yarn client mode

[ https://issues.apache.org/jira/browse/SPARK-33147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33147: Assignee: (was: Apache Spark) > Avoid distribute user jar from driver in yarn client

[jira] [Assigned] (SPARK-33147) Avoid distribute user jar from driver in yarn client mode

[ https://issues.apache.org/jira/browse/SPARK-33147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33147: Assignee: Apache Spark > Avoid distribute user jar from driver in yarn client mode >

[jira] [Created] (SPARK-33148) SQLConf inconsistency between SharedState and SessionState

Kent Yao created SPARK-33148: Summary: SQLConf inconsistency between SharedState and SessionState Key: SPARK-33148 URL: https://issues.apache.org/jira/browse/SPARK-33148 Project: Spark Issue Type

[jira] [Assigned] (SPARK-33146) Encountering an invalid rolling event log folder prevents loading other applications in SHS

[ https://issues.apache.org/jira/browse/SPARK-33146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33146: Assignee: (was: Apache Spark) > Encountering an invalid rolling event log folder prev

[jira] [Commented] (SPARK-33146) Encountering an invalid rolling event log folder prevents loading other applications in SHS

[ https://issues.apache.org/jira/browse/SPARK-33146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213850#comment-17213850 ] Apache Spark commented on SPARK-33146: -- User 'Kimahriman' has created a pull reques

[jira] [Assigned] (SPARK-33146) Encountering an invalid rolling event log folder prevents loading other applications in SHS

[ https://issues.apache.org/jira/browse/SPARK-33146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33146: Assignee: Apache Spark > Encountering an invalid rolling event log folder prevents loadin

[jira] [Commented] (SPARK-33144) Connot insert overwite multiple partition, get exception "get partition: Value for key name is null or empty"

[ https://issues.apache.org/jira/browse/SPARK-33144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213853#comment-17213853 ] CHC commented on SPARK-33144: - set spark.sql.hive.convertInsertingPartitionedTable=false; le

[jira] [Commented] (SPARK-33144) Connot insert overwite multiple partition, get exception "get partition: Value for key name is null or empty"

[ https://issues.apache.org/jira/browse/SPARK-33144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213854#comment-17213854 ] CHC commented on SPARK-33144: - {code:sql} set spark.sql.hive.convertInsertingPartitionedTabl

[jira] [Issue Comment Deleted] (SPARK-33144) Connot insert overwite multiple partition, get exception "get partition: Value for key name is null or empty"

[ https://issues.apache.org/jira/browse/SPARK-33144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CHC updated SPARK-33144: Comment: was deleted (was: set spark.sql.hive.convertInsertingPartitionedTable=false; lead this problem) > Connot

[jira] [Comment Edited] (SPARK-33144) Connot insert overwite multiple partition, get exception "get partition: Value for key name is null or empty"

[ https://issues.apache.org/jira/browse/SPARK-33144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213854#comment-17213854 ] CHC edited comment on SPARK-33144 at 10/14/20, 12:04 PM: - I met

[jira] [Assigned] (SPARK-33130) Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MsSqlServer dialect)

[ https://issues.apache.org/jira/browse/SPARK-33130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33130: Assignee: Apache Spark > Support ALTER TABLE in JDBC v2 Table Catalog: add, update type a

[jira] [Assigned] (SPARK-33130) Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MsSqlServer dialect)

[ https://issues.apache.org/jira/browse/SPARK-33130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33130: Assignee: (was: Apache Spark) > Support ALTER TABLE in JDBC v2 Table Catalog: add, up

[jira] [Commented] (SPARK-33130) Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MsSqlServer dialect)

[ https://issues.apache.org/jira/browse/SPARK-33130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213885#comment-17213885 ] Apache Spark commented on SPARK-33130: -- User 'ScrapCodes' has created a pull reques

[jira] [Commented] (SPARK-32342) Kafka events are missing magic byte

[ https://issues.apache.org/jira/browse/SPARK-32342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213886#comment-17213886 ] Jakub Waller commented on SPARK-32342: -- Here are the details about the confluent fo

[jira] [Resolved] (SPARK-25547) Pluggable jdbc connection factory

[ https://issues.apache.org/jira/browse/SPARK-25547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-25547. -- Resolution: Duplicate > Pluggable jdbc connection factory > --

[jira] [Updated] (SPARK-25547) Pluggable jdbc connection factory

[ https://issues.apache.org/jira/browse/SPARK-25547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25547: - Target Version/s: (was: 3.0.0) > Pluggable jdbc connection factory > -

[jira] [Updated] (SPARK-25547) Pluggable jdbc connection factory

[ https://issues.apache.org/jira/browse/SPARK-25547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25547: - Component/s: (was: Spark Core) SQL > Pluggable jdbc connection fact

[jira] [Created] (SPARK-33149) Why does ArrayType schema change between read/write for parquet files?

Juha Iso-Sipilä created SPARK-33149: --- Summary: Why does ArrayType schema change between read/write for parquet files? Key: SPARK-33149 URL: https://issues.apache.org/jira/browse/SPARK-33149 Project:

[jira] [Commented] (SPARK-32342) Kafka events are missing magic byte

[ https://issues.apache.org/jira/browse/SPARK-32342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213900#comment-17213900 ] Jungtaek Lim commented on SPARK-32342: -- I'm not sure we want to support Confluent S

[jira] [Commented] (SPARK-33026) Add numRows to metric of BroadcastExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-33026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213906#comment-17213906 ] Apache Spark commented on SPARK-33026: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-33061) Expose inverse hyperbolic functions through sql.functions API

[ https://issues.apache.org/jira/browse/SPARK-33061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-33061: Assignee: Richard Penney > Expose inverse hyperbolic functions through sql.functions API

[jira] [Resolved] (SPARK-33061) Expose inverse hyperbolic functions through sql.functions API

[ https://issues.apache.org/jira/browse/SPARK-33061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-33061. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29938 [https://gi

[jira] [Created] (SPARK-33150) Groupby key may not be unique when using window

Dieter De Paepe created SPARK-33150: --- Summary: Groupby key may not be unique when using window Key: SPARK-33150 URL: https://issues.apache.org/jira/browse/SPARK-33150 Project: Spark Issue T

[jira] [Resolved] (SPARK-33136) Handling nullability for complex types is broken during resolution of V2 write command

[ https://issues.apache.org/jira/browse/SPARK-33136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33136. --- Fix Version/s: 3.1.0 3.0.2 Assignee: Jungtaek Lim Resoluti

[jira] [Commented] (SPARK-33138) unify temp view and permanent view behaviors

[ https://issues.apache.org/jira/browse/SPARK-33138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214011#comment-17214011 ] Erik Krogen commented on SPARK-33138: - Hi [~leanken], thanks for starting this effor

[jira] [Commented] (SPARK-33124) Adds a group tag in all the expressions for built-in functions

[ https://issues.apache.org/jira/browse/SPARK-33124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214071#comment-17214071 ] Apache Spark commented on SPARK-33124: -- User 'tanelk' has created a pull request fo

[jira] [Assigned] (SPARK-33124) Adds a group tag in all the expressions for built-in functions

[ https://issues.apache.org/jira/browse/SPARK-33124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33124: Assignee: Apache Spark > Adds a group tag in all the expressions for built-in functions >

[jira] [Assigned] (SPARK-33124) Adds a group tag in all the expressions for built-in functions

[ https://issues.apache.org/jira/browse/SPARK-33124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33124: Assignee: (was: Apache Spark) > Adds a group tag in all the expressions for built-in

[jira] [Updated] (SPARK-33134) Incorrect nested complex JSON fields raise an exception

[ https://issues.apache.org/jira/browse/SPARK-33134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-33134: Issue Type: Bug (was: Improvement) > Incorrect nested complex JSON fields raise an exception > --

[jira] [Created] (SPARK-33151) Jenkins PRB is not responding

Holden Karau created SPARK-33151: Summary: Jenkins PRB is not responding Key: SPARK-33151 URL: https://issues.apache.org/jira/browse/SPARK-33151 Project: Spark Issue Type: Bug Compo

[jira] [Commented] (SPARK-32402) Implement ALTER TABLE in JDBC Table Catalog

[ https://issues.apache.org/jira/browse/SPARK-32402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214191#comment-17214191 ] Apache Spark commented on SPARK-32402: -- User 'huaxingao' has created a pull request

[jira] [Created] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

Asif created SPARK-33152: Summary: Constraint Propagation code causes OOM issues or increasing compilation time to hours Key: SPARK-33152 URL: https://issues.apache.org/jira/browse/SPARK-33152 Project: Spark

[jira] [Commented] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214298#comment-17214298 ] Asif commented on SPARK-33152: -- I will be generating a PR for the same.. > Constraint Prop

[jira] [Resolved] (SPARK-33151) Jenkins PRB is not responding

[ https://issues.apache.org/jira/browse/SPARK-33151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-33151. -- Resolution: Fixed > Jenkins PRB is not responding > - > >

[jira] [Updated] (SPARK-33139) protect setActiveSession and clearActiveSession

[ https://issues.apache.org/jira/browse/SPARK-33139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin updated SPARK-33139: Description: This PR is a sub-task of [SPARK-33138](https://issues.apache.org/jira/browse/SPARK-3

[jira] [Commented] (SPARK-33139) protect setActiveSession and clearActiveSession

[ https://issues.apache.org/jira/browse/SPARK-33139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214366#comment-17214366 ] Apache Spark commented on SPARK-33139: -- User 'leanken' has created a pull request f

[jira] [Assigned] (SPARK-33139) protect setActiveSession and clearActiveSession

[ https://issues.apache.org/jira/browse/SPARK-33139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33139: Assignee: Apache Spark > protect setActiveSession and clearActiveSession > --

[jira] [Assigned] (SPARK-33139) protect setActiveSession and clearActiveSession

[ https://issues.apache.org/jira/browse/SPARK-33139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33139: Assignee: (was: Apache Spark) > protect setActiveSession and clearActiveSession > ---

[jira] [Commented] (SPARK-32691) Test org.apache.spark.DistributedSuite failed on arm64 jenkins

[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214368#comment-17214368 ] huangtianhua commented on SPARK-32691: -- [~podongfeng] Seems the tests failed after

[jira] [Commented] (SPARK-33139) protect setActiveSession and clearActiveSession

[ https://issues.apache.org/jira/browse/SPARK-33139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214367#comment-17214367 ] Apache Spark commented on SPARK-33139: -- User 'leanken' has created a pull request f

[jira] [Commented] (SPARK-33136) Handling nullability for complex types is broken during resolution of V2 write command

[ https://issues.apache.org/jira/browse/SPARK-33136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214369#comment-17214369 ] Apache Spark commented on SPARK-33136: -- User 'HeartSaVioR' has created a pull reque

[jira] [Updated] (SPARK-33140) make Analyzer rules using SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-33140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin updated SPARK-33140: Summary: make Analyzer rules using SQLConf.get (was: make Analyzer and Optimizer rules using SQLC

[jira] [Created] (SPARK-33153) HiveExternalCatalogVersionsSuite fails at Python 3.8

Dongjoon Hyun created SPARK-33153: - Summary: HiveExternalCatalogVersionsSuite fails at Python 3.8 Key: SPARK-33153 URL: https://issues.apache.org/jira/browse/SPARK-33153 Project: Spark Issue

[jira] [Updated] (SPARK-33153) HiveExternalCatalogVersionsSuite fails on Ubuntu 20.04 due to Python 3.8

[ https://issues.apache.org/jira/browse/SPARK-33153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33153: -- Summary: HiveExternalCatalogVersionsSuite fails on Ubuntu 20.04 due to Python 3.8 (was: HiveE

[jira] [Updated] (SPARK-33153) HiveExternalCatalogVersionsSuite fails on Ubuntu 20.04

[ https://issues.apache.org/jira/browse/SPARK-33153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33153: -- Summary: HiveExternalCatalogVersionsSuite fails on Ubuntu 20.04 (was: HiveExternalCatalogVers

[jira] [Assigned] (SPARK-33153) HiveExternalCatalogVersionsSuite fails on Ubuntu 20.04

[ https://issues.apache.org/jira/browse/SPARK-33153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33153: Assignee: (was: Apache Spark) > HiveExternalCatalogVersionsSuite fails on Ubuntu 20.0

[jira] [Assigned] (SPARK-33153) HiveExternalCatalogVersionsSuite fails on Ubuntu 20.04

[ https://issues.apache.org/jira/browse/SPARK-33153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33153: Assignee: Apache Spark > HiveExternalCatalogVersionsSuite fails on Ubuntu 20.04 > ---

[jira] [Commented] (SPARK-33153) HiveExternalCatalogVersionsSuite fails on Ubuntu 20.04

[ https://issues.apache.org/jira/browse/SPARK-33153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214380#comment-17214380 ] Apache Spark commented on SPARK-33153: -- User 'dongjoon-hyun' has created a pull req

[jira] [Resolved] (SPARK-33146) Encountering an invalid rolling event log folder prevents loading other applications in SHS

[ https://issues.apache.org/jira/browse/SPARK-33146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-33146. -- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-33146) Encountering an invalid rolling event log folder prevents loading other applications in SHS

[ https://issues.apache.org/jira/browse/SPARK-33146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-33146: Assignee: Adam Binford > Encountering an invalid rolling event log folder prevents loadin

[jira] [Updated] (SPARK-33136) Handling nullability for complex types is broken during resolution of V2 write command

[ https://issues.apache.org/jira/browse/SPARK-33136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33136: -- Fix Version/s: 2.4.8 > Handling nullability for complex types is broken during resolution of V

[jira] [Commented] (SPARK-32691) Test org.apache.spark.DistributedSuite failed on arm64 jenkins

[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214384#comment-17214384 ] Dongjoon Hyun commented on SPARK-32691: --- [~huangtianhua] As I posted at the initia

[jira] [Updated] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13860: -- Labels: correctness (was: bulk-closed tpcds-result-mismatch) > TPCDS query 39 returns wrong r

[jira] [Updated] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13860: -- Affects Version/s: 2.3.4 2.4.7 3.0.1 > TPCDS que

[jira] [Commented] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214389#comment-17214389 ] Dongjoon Hyun commented on SPARK-13860: --- I updated the affected versions and added

[jira] [Resolved] (SPARK-33153) HiveExternalCatalogVersionsSuite fails on Ubuntu 20.04

[ https://issues.apache.org/jira/browse/SPARK-33153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33153. --- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-33153) HiveExternalCatalogVersionsSuite fails on Ubuntu 20.04

[ https://issues.apache.org/jira/browse/SPARK-33153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33153: - Assignee: Dongjoon Hyun > HiveExternalCatalogVersionsSuite fails on Ubuntu 20.04 >

[jira] [Comment Edited] (SPARK-33128) mismatched input since Spark 3.0

[ https://issues.apache.org/jira/browse/SPARK-33128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213137#comment-17213137 ] Yang Jie edited comment on SPARK-33128 at 10/15/20, 4:06 AM: -

[jira] [Created] (SPARK-33154) Handle shuffle blocks being removed during decommissioning

Holden Karau created SPARK-33154: Summary: Handle shuffle blocks being removed during decommissioning Key: SPARK-33154 URL: https://issues.apache.org/jira/browse/SPARK-33154 Project: Spark Is

[jira] [Assigned] (SPARK-32991) RESET can clear StaticSQLConfs

[ https://issues.apache.org/jira/browse/SPARK-32991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32991: Assignee: Apache Spark > RESET can clear StaticSQLConfs > --

[jira] [Commented] (SPARK-32991) RESET can clear StaticSQLConfs

[ https://issues.apache.org/jira/browse/SPARK-32991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214419#comment-17214419 ] Apache Spark commented on SPARK-32991: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-33154) Handle shuffle blocks being removed during decommissioning

[ https://issues.apache.org/jira/browse/SPARK-33154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33154: Assignee: Holden Karau (was: Apache Spark) > Handle shuffle blocks being removed during

[jira] [Commented] (SPARK-33154) Handle shuffle blocks being removed during decommissioning

[ https://issues.apache.org/jira/browse/SPARK-33154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214420#comment-17214420 ] Apache Spark commented on SPARK-33154: -- User 'holdenk' has created a pull request f

[jira] [Assigned] (SPARK-33154) Handle shuffle blocks being removed during decommissioning

[ https://issues.apache.org/jira/browse/SPARK-33154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33154: Assignee: Apache Spark (was: Holden Karau) > Handle shuffle blocks being removed during

[jira] [Assigned] (SPARK-32991) RESET can clear StaticSQLConfs

[ https://issues.apache.org/jira/browse/SPARK-32991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32991: Assignee: (was: Apache Spark) > RESET can clear StaticSQLConfs >

[jira] [Assigned] (SPARK-33078) Add SQL config to control Json expression optimization

[ https://issues.apache.org/jira/browse/SPARK-33078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33078: Assignee: L. C. Hsieh (was: Apache Spark) > Add SQL config to control Json expression op

[jira] [Assigned] (SPARK-33078) Add SQL config to control Json expression optimization

[ https://issues.apache.org/jira/browse/SPARK-33078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33078: Assignee: Apache Spark (was: L. C. Hsieh) > Add SQL config to control Json expression op

[jira] [Commented] (SPARK-33078) Add SQL config to control Json expression optimization

[ https://issues.apache.org/jira/browse/SPARK-33078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214422#comment-17214422 ] Apache Spark commented on SPARK-33078: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-30893) Expressions should not change its data type/nullability after it's created

[ https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214423#comment-17214423 ] Dongjoon Hyun commented on SPARK-30893: --- Thank you for investigation, [~anuragmant

[jira] [Commented] (SPARK-30894) The nullability of Size function should not depend on SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-30894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214424#comment-17214424 ] Dongjoon Hyun commented on SPARK-30894: --- Thank you, [~anuragmantri]. In this case,

[jira] [Comment Edited] (SPARK-30894) The nullability of Size function should not depend on SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-30894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214424#comment-17214424 ] Dongjoon Hyun edited comment on SPARK-30894 at 10/15/20, 4:19 AM:

[jira] [Updated] (SPARK-32399) Support full outer join in shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-32399: -- Attachment: Screen Shot 2020-10-14 at 12.30.07 PM.png > Support full outer join in shu

[jira] [Commented] (SPARK-32399) Support full outer join in shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214426#comment-17214426 ] Ruslan Dautkhanov commented on SPARK-32399: --- [~chengsu] thank you for all the

[jira] [Commented] (SPARK-33146) Encountering an invalid rolling event log folder prevents loading other applications in SHS

[ https://issues.apache.org/jira/browse/SPARK-33146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214433#comment-17214433 ] Apache Spark commented on SPARK-33146: -- User 'dongjoon-hyun' has created a pull req

[jira] [Issue Comment Deleted] (SPARK-33146) Encountering an invalid rolling event log folder prevents loading other applications in SHS

[ https://issues.apache.org/jira/browse/SPARK-33146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33146: -- Comment: was deleted (was: User 'dongjoon-hyun' has created a pull request for this issue: htt

[jira] [Updated] (SPARK-33146) Encountering an invalid rolling event log folder prevents loading other applications in SHS

[ https://issues.apache.org/jira/browse/SPARK-33146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33146: -- Fix Version/s: (was: 3.0.2) > Encountering an invalid rolling event log folder prevents lo

[jira] [Updated] (SPARK-32399) Support full outer join in shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-32399: -- Attachment: Screen Shot 2020-10-14 at 11.08.37 PM.png > Support full outer join in shu

[jira] [Commented] (SPARK-32399) Support full outer join in shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214440#comment-17214440 ] Ruslan Dautkhanov commented on SPARK-32399: --- Here's another view if that's hel

[jira] [Created] (SPARK-33155) Make spark.kubernetes.pyspark.pythonVersion allow `Python 3` only

Dongjoon Hyun created SPARK-33155: - Summary: Make spark.kubernetes.pyspark.pythonVersion allow `Python 3` only Key: SPARK-33155 URL: https://issues.apache.org/jira/browse/SPARK-33155 Project: Spark

[jira] [Assigned] (SPARK-33155) Make spark.kubernetes.pyspark.pythonVersion allow `Python 3` only

[ https://issues.apache.org/jira/browse/SPARK-33155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33155: - Assignee: Dongjoon Hyun > Make spark.kubernetes.pyspark.pythonVersion allow `Python 3`

[jira] [Commented] (SPARK-33155) Make spark.kubernetes.pyspark.pythonVersion allow `Python 3` only

[ https://issues.apache.org/jira/browse/SPARK-33155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214443#comment-17214443 ] Apache Spark commented on SPARK-33155: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-33154) Handle shuffle blocks being removed during decommissioning

[ https://issues.apache.org/jira/browse/SPARK-33154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33154: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Handle shuffle blocks b

  1   2   >