[jira] [Commented] (SPARK-27196) Beginning offset 115204574 is after the ending offset 115204516 for topic

[ https://issues.apache.org/jira/browse/SPARK-27196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224470#comment-17224470 ] Yu Wang commented on SPARK-27196: - https://issues.apache.org/jira/browse/KAFKA-8124 > Beginning offset

[jira] [Commented] (SPARK-33315) simplify CaseWhen with EqualTo

[ https://issues.apache.org/jira/browse/SPARK-33315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224453#comment-17224453 ] Apache Spark commented on SPARK-33315: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33315) simplify CaseWhen with EqualTo

[ https://issues.apache.org/jira/browse/SPARK-33315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33315: Assignee: (was: Apache Spark) > simplify CaseWhen with EqualTo >

[jira] [Commented] (SPARK-33315) simplify CaseWhen with EqualTo

[ https://issues.apache.org/jira/browse/SPARK-33315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224452#comment-17224452 ] Apache Spark commented on SPARK-33315: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33315) simplify CaseWhen with EqualTo

[ https://issues.apache.org/jira/browse/SPARK-33315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33315: Assignee: Apache Spark > simplify CaseWhen with EqualTo > --

[jira] [Created] (SPARK-33315) simplify CaseWhen with EqualTo

Yuming Wang created SPARK-33315: --- Summary: simplify CaseWhen with EqualTo Key: SPARK-33315 URL: https://issues.apache.org/jira/browse/SPARK-33315 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-33259) Joining 3 streams results in incorrect output

[ https://issues.apache.org/jira/browse/SPARK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224446#comment-17224446 ] Jungtaek Lim commented on SPARK-33259: -- I'll also link to the first JIRA issue which the problem

[jira] [Commented] (SPARK-12567) Add aes_encrypt and aes_decrypt UDFs

[ https://issues.apache.org/jira/browse/SPARK-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224445#comment-17224445 ] Saheb Kanodia commented on SPARK-12567: --- [~wuhao] [~vectorijk] This seems like a very common

[jira] [Assigned] (SPARK-33027) Add DisableUnnecessaryBucketedScan rule to AQE queryStagePreparationRules

[ https://issues.apache.org/jira/browse/SPARK-33027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33027: --- Assignee: Cheng Su > Add DisableUnnecessaryBucketedScan rule to AQE

[jira] [Resolved] (SPARK-33027) Add DisableUnnecessaryBucketedScan rule to AQE queryStagePreparationRules

[ https://issues.apache.org/jira/browse/SPARK-33027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33027. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30200

[jira] [Commented] (SPARK-33279) Spark 3.0 failure due to lack of Arrow dependency

[ https://issues.apache.org/jira/browse/SPARK-33279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224435#comment-17224435 ] Liya Fan commented on SPARK-33279: -- [~bryanc] Thanks a lot for your effort.  > Spark 3.0 failure due

[jira] [Comment Edited] (SPARK-33279) Spark 3.0 failure due to lack of Arrow dependency

[ https://issues.apache.org/jira/browse/SPARK-33279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224420#comment-17224420 ] Bryan Cutler edited comment on SPARK-33279 at 11/2/20, 5:21 AM:

[jira] [Commented] (SPARK-33279) Spark 3.0 failure due to lack of Arrow dependency

[ https://issues.apache.org/jira/browse/SPARK-33279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224420#comment-17224420 ] Bryan Cutler commented on SPARK-33279: -- [~fan_li_ya] we should change the Arrow-Spark integration

[jira] [Updated] (SPARK-33314) Avro reader drops rows

[ https://issues.apache.org/jira/browse/SPARK-33314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-33314: - Priority: Blocker (was: Major) > Avro reader drops rows > -- > >

[jira] [Updated] (SPARK-33313) R/run-tests.sh is not compatible with testthat >= 3.0

[ https://issues.apache.org/jira/browse/SPARK-33313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33313: - Fix Version/s: 3.0.2 2.4.8 > R/run-tests.sh is not compatible with testthat

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224379#comment-17224379 ] Arya Ketan commented on SPARK-24432: With acceptance of

[jira] [Commented] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224377#comment-17224377 ] Hyukjin Kwon commented on SPARK-33273: -- cc [~yumwang] do you have any clue? > Fix Flaky Test:

[jira] [Assigned] (SPARK-33314) Avro reader drops rows

[ https://issues.apache.org/jira/browse/SPARK-33314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33314: Assignee: (was: Apache Spark) > Avro reader drops rows > -- > >

[jira] [Assigned] (SPARK-33314) Avro reader drops rows

[ https://issues.apache.org/jira/browse/SPARK-33314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33314: Assignee: Apache Spark > Avro reader drops rows > -- > >

[jira] [Commented] (SPARK-33314) Avro reader drops rows

[ https://issues.apache.org/jira/browse/SPARK-33314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224367#comment-17224367 ] Apache Spark commented on SPARK-33314: -- User 'bersprockets' has created a pull request for this

[jira] [Commented] (SPARK-33282) Replace Probot Autolabeler with Github Action

[ https://issues.apache.org/jira/browse/SPARK-33282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224366#comment-17224366 ] Hyukjin Kwon commented on SPARK-33282: -- Yeah, I noticed this but couldn't have time to take a look.

[jira] [Resolved] (SPARK-33289) Error executing `SHOW VIEWS in {database}` using JDBC

[ https://issues.apache.org/jira/browse/SPARK-33289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33289. -- Resolution: Invalid > Error executing `SHOW VIEWS in {database}` using JDBC >

[jira] [Commented] (SPARK-33289) Error executing `SHOW VIEWS in {database}` using JDBC

[ https://issues.apache.org/jira/browse/SPARK-33289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224365#comment-17224365 ] Hyukjin Kwon commented on SPARK-33289: -- This seems an issue in Tableau that creates a query wrong.

[jira] [Commented] (SPARK-33312) Provide latest Spark 2.4.7 runnable distribution

[ https://issues.apache.org/jira/browse/SPARK-33312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224364#comment-17224364 ] Hyukjin Kwon commented on SPARK-33312: -- Providing that option is pretty much an overhead to update

[jira] [Updated] (SPARK-33309) Replace origin GROUPING SETS with new expression

[ https://issues.apache.org/jira/browse/SPARK-33309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33309: - Description: Replace current GroupingSets just using expression {code} case class

[jira] [Commented] (SPARK-33312) Provide latest Spark 2.4.7 runnable distribution

[ https://issues.apache.org/jira/browse/SPARK-33312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224363#comment-17224363 ] Hyukjin Kwon commented on SPARK-33312: -- Providing that option is pretty much an overhead to update

[jira] [Updated] (SPARK-33314) Avro reader drops rows

[ https://issues.apache.org/jira/browse/SPARK-33314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-33314: -- Labels: correctness (was: ) > Avro reader drops rows > -- > >

[jira] [Created] (SPARK-33314) Avro reader drops rows

Bruce Robbins created SPARK-33314: - Summary: Avro reader drops rows Key: SPARK-33314 URL: https://issues.apache.org/jira/browse/SPARK-33314 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-33277) Python/Pandas UDF right after off-heap vectorized reader could cause executor crash.

[ https://issues.apache.org/jira/browse/SPARK-33277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33277: - Fix Version/s: 3.0.2 2.4.8 > Python/Pandas UDF right after off-heap

[jira] [Assigned] (SPARK-33277) Python/Pandas UDF right after off-heap vectorized reader could cause executor crash.

[ https://issues.apache.org/jira/browse/SPARK-33277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33277: Assignee: Takuya Ueshin > Python/Pandas UDF right after off-heap vectorized reader could

[jira] [Commented] (SPARK-33313) R/run-tests.sh is not compatible with testthat >= 3.0

[ https://issues.apache.org/jira/browse/SPARK-33313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224362#comment-17224362 ] Apache Spark commented on SPARK-33313: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-33313) R/run-tests.sh is not compatible with testthat >= 3.0

[ https://issues.apache.org/jira/browse/SPARK-33313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224361#comment-17224361 ] Apache Spark commented on SPARK-33313: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-33313) R/run-tests.sh is not compatible with testthat >= 3.0

[ https://issues.apache.org/jira/browse/SPARK-33313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33313. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30219

[jira] [Assigned] (SPARK-33313) R/run-tests.sh is not compatible with testthat >= 3.0

[ https://issues.apache.org/jira/browse/SPARK-33313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33313: Assignee: Maciej Szymkiewicz > R/run-tests.sh is not compatible with testthat >= 3.0 >

[jira] [Assigned] (SPARK-30663) Remove 1.x testthat switch once Jenkins version is updated to 2.x

[ https://issues.apache.org/jira/browse/SPARK-30663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30663: Assignee: Maciej Szymkiewicz > Remove 1.x testthat switch once Jenkins version is

[jira] [Resolved] (SPARK-30663) Remove 1.x testthat switch once Jenkins version is updated to 2.x

[ https://issues.apache.org/jira/browse/SPARK-30663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30663. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30219

[jira] [Commented] (SPARK-33313) R/run-tests.sh is not compatible with testthat >= 3.0

[ https://issues.apache.org/jira/browse/SPARK-33313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224349#comment-17224349 ] Apache Spark commented on SPARK-33313: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33313) R/run-tests.sh is not compatible with testthat >= 3.0

[ https://issues.apache.org/jira/browse/SPARK-33313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33313: Assignee: Apache Spark > R/run-tests.sh is not compatible with testthat >= 3.0 >

[jira] [Assigned] (SPARK-30663) Remove 1.x testthat switch once Jenkins version is updated to 2.x

[ https://issues.apache.org/jira/browse/SPARK-30663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30663: Assignee: (was: Apache Spark) > Remove 1.x testthat switch once Jenkins version is

[jira] [Commented] (SPARK-33313) R/run-tests.sh is not compatible with testthat >= 3.0

[ https://issues.apache.org/jira/browse/SPARK-33313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224348#comment-17224348 ] Apache Spark commented on SPARK-33313: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33313) R/run-tests.sh is not compatible with testthat >= 3.0

[ https://issues.apache.org/jira/browse/SPARK-33313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33313: Assignee: (was: Apache Spark) > R/run-tests.sh is not compatible with testthat >=

[jira] [Commented] (SPARK-30663) Remove 1.x testthat switch once Jenkins version is updated to 2.x

[ https://issues.apache.org/jira/browse/SPARK-30663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224347#comment-17224347 ] Apache Spark commented on SPARK-30663: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-30663) Remove 1.x testthat switch once Jenkins version is updated to 2.x

[ https://issues.apache.org/jira/browse/SPARK-30663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30663: Assignee: Apache Spark > Remove 1.x testthat switch once Jenkins version is updated to

[jira] [Created] (SPARK-33313) R/run-tests.sh is not compatible with testthat >= 3.0

Maciej Szymkiewicz created SPARK-33313: -- Summary: R/run-tests.sh is not compatible with testthat >= 3.0 Key: SPARK-33313 URL: https://issues.apache.org/jira/browse/SPARK-33313 Project: Spark

[jira] [Commented] (SPARK-33277) Python/Pandas UDF right after off-heap vectorized reader could cause executor crash.

[ https://issues.apache.org/jira/browse/SPARK-33277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224339#comment-17224339 ] Apache Spark commented on SPARK-33277: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-33277) Python/Pandas UDF right after off-heap vectorized reader could cause executor crash.

[ https://issues.apache.org/jira/browse/SPARK-33277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224338#comment-17224338 ] Apache Spark commented on SPARK-33277: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-33277) Python/Pandas UDF right after off-heap vectorized reader could cause executor crash.

[ https://issues.apache.org/jira/browse/SPARK-33277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224329#comment-17224329 ] Apache Spark commented on SPARK-33277: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-33277) Python/Pandas UDF right after off-heap vectorized reader could cause executor crash.

[ https://issues.apache.org/jira/browse/SPARK-33277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224328#comment-17224328 ] Apache Spark commented on SPARK-33277: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-33304) Add from_avro and to_avro functions to SparkR

[ https://issues.apache.org/jira/browse/SPARK-33304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224301#comment-17224301 ] Apache Spark commented on SPARK-33304: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33304) Add from_avro and to_avro functions to SparkR

[ https://issues.apache.org/jira/browse/SPARK-33304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33304: Assignee: (was: Apache Spark) > Add from_avro and to_avro functions to SparkR >

[jira] [Assigned] (SPARK-33304) Add from_avro and to_avro functions to SparkR

[ https://issues.apache.org/jira/browse/SPARK-33304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33304: Assignee: Apache Spark > Add from_avro and to_avro functions to SparkR >

[jira] [Commented] (SPARK-33304) Add from_avro and to_avro functions to SparkR

[ https://issues.apache.org/jira/browse/SPARK-33304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224299#comment-17224299 ] Apache Spark commented on SPARK-33304: -- User 'zero323' has created a pull request for this issue:

[jira] [Resolved] (SPARK-20044) Support Spark UI behind front-end reverse proxy using a path prefix

[ https://issues.apache.org/jira/browse/SPARK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-20044. Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29820

[jira] [Resolved] (SPARK-33277) Python/Pandas UDF right after off-heap vectorized reader could cause executor crash.

[ https://issues.apache.org/jira/browse/SPARK-33277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33277. -- Fix Version/s: 3.1.0 Resolution: Fixed Fixed in

[jira] [Assigned] (SPARK-33310) Relax pyspark typing for sql str functions

[ https://issues.apache.org/jira/browse/SPARK-33310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33310: Assignee: Daniel Himmelstein > Relax pyspark typing for sql str functions >

[jira] [Resolved] (SPARK-33310) Relax pyspark typing for sql str functions

[ https://issues.apache.org/jira/browse/SPARK-33310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33310. -- Resolution: Fixed Issue resolved by pull request 30209

[jira] [Created] (SPARK-33312) Provide latest Spark 2.4.7 runnable distribution

Prateek Dubey created SPARK-33312: - Summary: Provide latest Spark 2.4.7 runnable distribution Key: SPARK-33312 URL: https://issues.apache.org/jira/browse/SPARK-33312 Project: Spark Issue