[jira] [Commented] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeachBatch in PySpark

[ https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168423#comment-17168423 ] Abhishek Dixit commented on SPARK-32500: [~rohitmishr1484] I used the following

[jira] [Updated] (SPARK-32505) Only codegen build side separately for shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-32505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-32505: - Parent: SPARK-32461 Issue Type: Sub-task (was: Improvement) > Only codegen build side separatel

[jira] [Created] (SPARK-32505) Only codegen build side separately for shuffled hash join

Cheng Su created SPARK-32505: Summary: Only codegen build side separately for shuffled hash join Key: SPARK-32505 URL: https://issues.apache.org/jira/browse/SPARK-32505 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-32468) Fix timeout config issue in Kafka connector tests

[ https://issues.apache.org/jira/browse/SPARK-32468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-32468: Assignee: Gabor Somogyi > Fix timeout config issue in Kafka connector tests > ---

[jira] [Resolved] (SPARK-32468) Fix timeout config issue in Kafka connector tests

[ https://issues.apache.org/jira/browse/SPARK-32468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-32468. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29272 [https://gi

[jira] [Assigned] (SPARK-32421) Add code-gen for shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-32421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32421: --- Assignee: Cheng Su > Add code-gen for shuffled hash join >

[jira] [Resolved] (SPARK-32421) Add code-gen for shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-32421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32421. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29277 [https://gith

[jira] [Commented] (SPARK-27589) Spark file source V2

[ https://issues.apache.org/jira/browse/SPARK-27589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168414#comment-17168414 ] Gengliang Wang commented on SPARK-27589: [~tgraves] we still need: 1. Make the F

[jira] [Closed] (SPARK-32503) Add Scala 2.13 `core` and related module test in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-32503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-32503. - > Add Scala 2.13 `core` and related module test in GitHub Action > -

[jira] [Updated] (SPARK-32503) Add Scala 2.13 `core` and related module test in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-32503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32503: -- Parent: (was: SPARK-25075) Issue Type: Test (was: Sub-task) > Add Scala 2.13 `cor

[jira] [Resolved] (SPARK-32503) Add Scala 2.13 `core` and related module test in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-32503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32503. --- Resolution: Won't Do > Add Scala 2.13 `core` and related module test in GitHub Action >

[jira] [Resolved] (SPARK-32482) Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

[ https://issues.apache.org/jira/browse/SPARK-32482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-32482. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29289 [https://gi

[jira] [Assigned] (SPARK-32482) Eliminate deprecated poll(long) API calls to avoid infinite wait in tests

[ https://issues.apache.org/jira/browse/SPARK-32482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-32482: Assignee: Gabor Somogyi > Eliminate deprecated poll(long) API calls to avoid infinite wai

[jira] [Commented] (SPARK-32175) Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

[ https://issues.apache.org/jira/browse/SPARK-32175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168328#comment-17168328 ] Apache Spark commented on SPARK-32175: -- User 'sarutak' has created a pull request f

[jira] [Created] (SPARK-32504) Shuffle Storage API: Dynamic updates of shuffle metadata

Matt Cheah created SPARK-32504: -- Summary: Shuffle Storage API: Dynamic updates of shuffle metadata Key: SPARK-32504 URL: https://issues.apache.org/jira/browse/SPARK-32504 Project: Spark Issue Ty

[jira] [Commented] (SPARK-32402) Implement ALTER TABLE in JDBC Table Catalog

[ https://issues.apache.org/jira/browse/SPARK-32402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168310#comment-17168310 ] Huaxin Gao commented on SPARK-32402: I am working on this. Thanks! > Implement ALTE

[jira] [Commented] (SPARK-28210) Shuffle Storage API: Reads

[ https://issues.apache.org/jira/browse/SPARK-28210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168287#comment-17168287 ] Matt Cheah commented on SPARK-28210: [~devaraj]  [~tianczha] Thanks for expressing i

[jira] [Commented] (SPARK-32175) Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

[ https://issues.apache.org/jira/browse/SPARK-32175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168253#comment-17168253 ] Apache Spark commented on SPARK-32175: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-32503) Add Scala 2.13 `core` and related module test in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-32503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32503: Assignee: (was: Apache Spark) > Add Scala 2.13 `core` and related module test in GitH

[jira] [Commented] (SPARK-32503) Add Scala 2.13 `core` and related module test in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-32503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168186#comment-17168186 ] Apache Spark commented on SPARK-32503: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-32503) Add Scala 2.13 `core` and related module test in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-32503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32503: Assignee: Apache Spark > Add Scala 2.13 `core` and related module test in GitHub Action >

[jira] [Created] (SPARK-32503) Add Scala 2.13 `core` and related module test in GitHub Action

Dongjoon Hyun created SPARK-32503: - Summary: Add Scala 2.13 `core` and related module test in GitHub Action Key: SPARK-32503 URL: https://issues.apache.org/jira/browse/SPARK-32503 Project: Spark

[jira] [Reopened] (SPARK-32486) Issue with deserialization and persist api in latest spark java versions

[ https://issues.apache.org/jira/browse/SPARK-32486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Kumar reopened SPARK-32486: -- This issue is happening in all higher version, please fix it > Issue with deserialization and per

[jira] [Created] (SPARK-32502) Please fix CVE related to Guava 14.0.1

Rodney Aaron Stainback created SPARK-32502: -- Summary: Please fix CVE related to Guava 14.0.1 Key: SPARK-32502 URL: https://issues.apache.org/jira/browse/SPARK-32502 Project: Spark Is

[jira] [Resolved] (SPARK-32417) Flaky test: BlockManagerDecommissionIntegrationSuite.verify that an already running task which is going to cache data succeeds on a decommissioned executor

[ https://issues.apache.org/jira/browse/SPARK-32417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32417. -- Fix Version/s: 3.1.0 Assignee: Devesh Agrawal Resolution: Fixed > Flaky test:

[jira] [Resolved] (SPARK-32199) Clear shuffle state when decommissioned nodes/executors are finally lost

[ https://issues.apache.org/jira/browse/SPARK-32199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32199. -- Fix Version/s: 3.1.0 Assignee: Devesh Agrawal Resolution: Fixed > Clear shuffl

[jira] [Assigned] (SPARK-32198) Don't fail running jobs when decommissioned executors finally go away

[ https://issues.apache.org/jira/browse/SPARK-32198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-32198: Assignee: Devesh Agrawal > Don't fail running jobs when decommissioned executors finally

[jira] [Resolved] (SPARK-32198) Don't fail running jobs when decommissioned executors finally go away

[ https://issues.apache.org/jira/browse/SPARK-32198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32198. -- Fix Version/s: 3.1.0 Target Version/s: 3.1.0 Resolution: Fixed > Don't fail r

[jira] [Commented] (SPARK-27589) Spark file source V2

[ https://issues.apache.org/jira/browse/SPARK-27589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168133#comment-17168133 ] Thomas Graves commented on SPARK-27589: --- Hey, I see most of the sources are still

[jira] [Assigned] (SPARK-32501) Inconsistent NULL conversions to strings

[ https://issues.apache.org/jira/browse/SPARK-32501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32501: Assignee: Apache Spark > Inconsistent NULL conversions to strings >

[jira] [Commented] (SPARK-32501) Inconsistent NULL conversions to strings

[ https://issues.apache.org/jira/browse/SPARK-32501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168129#comment-17168129 ] Apache Spark commented on SPARK-32501: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-32501) Inconsistent NULL conversions to strings

[ https://issues.apache.org/jira/browse/SPARK-32501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32501: Assignee: (was: Apache Spark) > Inconsistent NULL conversions to strings > -

[jira] [Created] (SPARK-32501) Inconsistent NULL conversions to strings

Maxim Gekk created SPARK-32501: -- Summary: Inconsistent NULL conversions to strings Key: SPARK-32501 URL: https://issues.apache.org/jira/browse/SPARK-32501 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-32489) Pass all `core` module UTs in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-32489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32489: - Assignee: Dongjoon Hyun > Pass all `core` module UTs in Scala 2.13 > --

[jira] [Resolved] (SPARK-32489) Pass all `core` module UTs in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-32489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32489. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29298 [https://

[jira] [Commented] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeachBatch in PySpark

[ https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168115#comment-17168115 ] Rohit Mishra commented on SPARK-32500: -- [~abhishekd0907], It will be helpful if you

[jira] [Commented] (SPARK-32332) AQE doesn't adequately allow for Columnar Processing extension

[ https://issues.apache.org/jira/browse/SPARK-32332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168031#comment-17168031 ] Apache Spark commented on SPARK-32332: -- User 'andygrove' has created a pull request

[jira] [Commented] (SPARK-29886) Add support for Spark style HashDistribution and Partitioning to V2 Datasource

[ https://issues.apache.org/jira/browse/SPARK-29886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168030#comment-17168030 ] Apache Spark commented on SPARK-29886: -- User 'rahij' has created a pull request for

[jira] [Resolved] (SPARK-32497) Installs qpdf package for CRAN check in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32497. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29306 [https://gi

[jira] [Assigned] (SPARK-32497) Installs qpdf package for CRAN check in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32497: Assignee: Hyukjin Kwon > Installs qpdf package for CRAN check in GitHub Actions > ---

[jira] [Updated] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeacgBatch in Pyspark

[ https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Dixit updated SPARK-32500: --- Description: Query Id and Batch Id information is not available for jobs started by structu

[jira] [Updated] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeachBatch in PySpark

[ https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Dixit updated SPARK-32500: --- Summary: Query and Batch Id not set for Structured Streaming Jobs in case of ForeachBatch in

[jira] [Updated] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeacgBatch in Pyspark

[ https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Dixit updated SPARK-32500: --- Description: Query Id and Batch Id information is not available for jobs started by structu

[jira] [Commented] (SPARK-32499) Use {} for structs and maps in show()

[ https://issues.apache.org/jira/browse/SPARK-32499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168007#comment-17168007 ] Apache Spark commented on SPARK-32499: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-32499) Use {} for structs and maps in show()

[ https://issues.apache.org/jira/browse/SPARK-32499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32499: Assignee: Apache Spark > Use {} for structs and maps in show() >

[jira] [Assigned] (SPARK-32499) Use {} for structs and maps in show()

[ https://issues.apache.org/jira/browse/SPARK-32499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32499: Assignee: (was: Apache Spark) > Use {} for structs and maps in show() > -

[jira] [Updated] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeacgBatch in Pyspark

[ https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Dixit updated SPARK-32500: --- Description: Query Id and Batch Id information is not available for jobs started by structu

[jira] [Updated] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeacgBatch in Pyspark

[ https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Dixit updated SPARK-32500: --- Attachment: Screen Shot 2020-07-30 at 9.04.21 PM.png > Query and Batch Id not set for Struct

[jira] [Created] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeacgBatch in Pyspark

Abhishek Dixit created SPARK-32500: -- Summary: Query and Batch Id not set for Structured Streaming Jobs in case of ForeacgBatch in Pyspark Key: SPARK-32500 URL: https://issues.apache.org/jira/browse/SPARK-32500

[jira] [Commented] (SPARK-32083) Unnecessary tasks are launched when input is empty with AQE

[ https://issues.apache.org/jira/browse/SPARK-32083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168003#comment-17168003 ] Apache Spark commented on SPARK-32083: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-32499) Use {} for structs and maps in show()

Maxim Gekk created SPARK-32499: -- Summary: Use {} for structs and maps in show() Key: SPARK-32499 URL: https://issues.apache.org/jira/browse/SPARK-32499 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-29886) Add support for Spark style HashDistribution and Partitioning to V2 Datasource

[ https://issues.apache.org/jira/browse/SPARK-29886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29886: Assignee: (was: Apache Spark) > Add support for Spark style HashDistribution and Part

[jira] [Assigned] (SPARK-29886) Add support for Spark style HashDistribution and Partitioning to V2 Datasource

[ https://issues.apache.org/jira/browse/SPARK-29886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29886: Assignee: Apache Spark > Add support for Spark style HashDistribution and Partitioning to

[jira] [Commented] (SPARK-32481) Support truncate table to move the data to trash

[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167976#comment-17167976 ] Udbhav Agrawal commented on SPARK-32481: [~LuciferYang] yes i have the patch re

[jira] [Created] (SPARK-32498) Support grant/revoke access privileges like postgresql

jobit mathew created SPARK-32498: Summary: Support grant/revoke access privileges like postgresql Key: SPARK-32498 URL: https://issues.apache.org/jira/browse/SPARK-32498 Project: Spark Issue

[jira] [Resolved] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32227. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Fixed in https://github

[jira] [Assigned] (SPARK-32227) Bug in load-spark-env.cmd with Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-32227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32227: Assignee: Ihor Bobak > Bug in load-spark-env.cmd with Spark 3.0.0 >

[jira] [Commented] (SPARK-32485) RecordBinaryComparatorSuite test failures on big-endian systems

[ https://issues.apache.org/jira/browse/SPARK-32485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167881#comment-17167881 ] Michael Munday commented on SPARK-32485: This is for Linux running on the IBM Z

[jira] [Commented] (SPARK-32497) Installs qpdf package for CRAN check in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167870#comment-17167870 ] Apache Spark commented on SPARK-32497: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-32481) Support truncate table to move the data to trash

[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167869#comment-17167869 ] Yang Jie commented on SPARK-32481: -- [~Udbhav Agrawal] Maybe Trash#moveToAppropriateTras

[jira] [Assigned] (SPARK-32497) Installs qpdf package for CRAN check in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32497: Assignee: (was: Apache Spark) > Installs qpdf package for CRAN check in GitHub Action

[jira] [Assigned] (SPARK-32497) Installs qpdf package for CRAN check in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32497: Assignee: Apache Spark > Installs qpdf package for CRAN check in GitHub Actions > ---

[jira] [Commented] (SPARK-32497) Installs qpdf package for CRAN check in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167868#comment-17167868 ] Apache Spark commented on SPARK-32497: -- User 'HyukjinKwon' has created a pull reque

[jira] [Resolved] (SPARK-32496) Include GitHub Action file as the changes in testing

[ https://issues.apache.org/jira/browse/SPARK-32496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32496. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29305 [https://gi

[jira] [Assigned] (SPARK-32496) Include GitHub Action file as the changes in testing

[ https://issues.apache.org/jira/browse/SPARK-32496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32496: Assignee: Hyukjin Kwon > Include GitHub Action file as the changes in testing > -

[jira] [Updated] (SPARK-32497) Installs qpdf package for CRAN check in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32497: - Parent: SPARK-32244 Issue Type: Sub-task (was: Bug) > Installs qpdf package for CRAN ch

[jira] [Created] (SPARK-32497) Installs qpdf package for CRAN check in GitHub Actions

Hyukjin Kwon created SPARK-32497: Summary: Installs qpdf package for CRAN check in GitHub Actions Key: SPARK-32497 URL: https://issues.apache.org/jira/browse/SPARK-32497 Project: Spark Issue

[jira] [Updated] (SPARK-32497) Installs qpdf package for CRAN check in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32497: - Affects Version/s: (was: 3.0.0) 3.1.0 > Installs qpdf package for CRA

[jira] [Commented] (SPARK-32496) Include GitHub Action file as the changes in testing

[ https://issues.apache.org/jira/browse/SPARK-32496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167826#comment-17167826 ] Apache Spark commented on SPARK-32496: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32496) Include GitHub Action file as the changes in testing

[ https://issues.apache.org/jira/browse/SPARK-32496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32496: Assignee: (was: Apache Spark) > Include GitHub Action file as the changes in testing

[jira] [Commented] (SPARK-32496) Include GitHub Action file as the changes in testing

[ https://issues.apache.org/jira/browse/SPARK-32496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167823#comment-17167823 ] Apache Spark commented on SPARK-32496: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32496) Include GitHub Action file as the changes in testing

[ https://issues.apache.org/jira/browse/SPARK-32496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32496: Assignee: Apache Spark > Include GitHub Action file as the changes in testing > -

[jira] [Resolved] (SPARK-32493) Manually install R instead of using setup-r in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32493. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29302 [https://gi

[jira] [Assigned] (SPARK-32493) Manually install R instead of using setup-r in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32493: Assignee: Hyukjin Kwon > Manually install R instead of using setup-r in GitHub Actions >

[jira] [Created] (SPARK-32496) Include GitHub Action file as the changes in testing

Hyukjin Kwon created SPARK-32496: Summary: Include GitHub Action file as the changes in testing Key: SPARK-32496 URL: https://issues.apache.org/jira/browse/SPARK-32496 Project: Spark Issue Ty

[jira] [Created] (SPARK-32495) Update jackson versions from 2.4.6 and so on(2.4.x)

SHOBHIT SHUKLA created SPARK-32495: -- Summary: Update jackson versions from 2.4.6 and so on(2.4.x) Key: SPARK-32495 URL: https://issues.apache.org/jira/browse/SPARK-32495 Project: Spark Issue

[jira] [Resolved] (SPARK-32491) Do not install SparkR in test-only mode in testing script

[ https://issues.apache.org/jira/browse/SPARK-32491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32491. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29300 [https://gi

[jira] [Assigned] (SPARK-32491) Do not install SparkR in test-only mode in testing script

[ https://issues.apache.org/jira/browse/SPARK-32491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32491: Assignee: Hyukjin Kwon > Do not install SparkR in test-only mode in testing script >

[jira] [Assigned] (SPARK-32494) Null Aware Anti Join Optimize Support Multi-Column

[ https://issues.apache.org/jira/browse/SPARK-32494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32494: Assignee: (was: Apache Spark) > Null Aware Anti Join Optimize Support Multi-Column >

[jira] [Commented] (SPARK-32494) Null Aware Anti Join Optimize Support Multi-Column

[ https://issues.apache.org/jira/browse/SPARK-32494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167800#comment-17167800 ] Apache Spark commented on SPARK-32494: -- User 'leanken' has created a pull request f

[jira] [Assigned] (SPARK-32494) Null Aware Anti Join Optimize Support Multi-Column

[ https://issues.apache.org/jira/browse/SPARK-32494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32494: Assignee: Apache Spark > Null Aware Anti Join Optimize Support Multi-Column > ---

[jira] [Commented] (SPARK-32492) Fulfill missing column meta information for thrift server client tools

[ https://issues.apache.org/jira/browse/SPARK-32492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167797#comment-17167797 ] Apache Spark commented on SPARK-32492: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-32492) Fulfill missing column meta information for thrift server client tools

[ https://issues.apache.org/jira/browse/SPARK-32492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32492: Assignee: (was: Apache Spark) > Fulfill missing column meta information for thrift se

[jira] [Assigned] (SPARK-32492) Fulfill missing column meta information for thrift server client tools

[ https://issues.apache.org/jira/browse/SPARK-32492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32492: Assignee: Apache Spark > Fulfill missing column meta information for thrift server client

[jira] [Updated] (SPARK-32494) Null Aware Anti Join Optimize Support Multi-Column

[ https://issues.apache.org/jira/browse/SPARK-32494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin updated SPARK-32494: Description: In Issue SPARK-32290, we managed to optimize BroadcastNestedLoopJoin into  BroadcastH

[jira] [Commented] (SPARK-32492) Fulfill missing column meta information for thrift server client tools

[ https://issues.apache.org/jira/browse/SPARK-32492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167795#comment-17167795 ] Apache Spark commented on SPARK-32492: -- User 'yaooqinn' has created a pull request

[jira] [Created] (SPARK-32494) Null Aware Anti Join Optimize Support Multi-Column

Leanken.Lin created SPARK-32494: --- Summary: Null Aware Anti Join Optimize Support Multi-Column Key: SPARK-32494 URL: https://issues.apache.org/jira/browse/SPARK-32494 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32493) Manually install R instead of using setup-r in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167787#comment-17167787 ] Apache Spark commented on SPARK-32493: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32493) Manually install R instead of using setup-r in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32493: Assignee: (was: Apache Spark) > Manually install R instead of using setup-r in GitHub

[jira] [Commented] (SPARK-32493) Manually install R instead of using setup-r in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167785#comment-17167785 ] Apache Spark commented on SPARK-32493: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32493) Manually install R instead of using setup-r in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-32493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32493: Assignee: Apache Spark > Manually install R instead of using setup-r in GitHub Actions >

[jira] [Created] (SPARK-32493) Manually install R instead of using setup-r in GitHub Actions

Hyukjin Kwon created SPARK-32493: Summary: Manually install R instead of using setup-r in GitHub Actions Key: SPARK-32493 URL: https://issues.apache.org/jira/browse/SPARK-32493 Project: Spark

[jira] [Updated] (SPARK-32492) Fulfill missing column meta information for thrift server client tools

[ https://issues.apache.org/jira/browse/SPARK-32492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-32492: - Attachment: wx20200730-175...@2x.png > Fulfill missing column meta information for thrift server client

[jira] [Updated] (SPARK-32492) Fulfill missing column meta information for thrift server client tools

[ https://issues.apache.org/jira/browse/SPARK-32492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-32492: - Description: Most fields of a column are missing， e.g. position, column-size   was: Most fields of a

[jira] [Created] (SPARK-32492) Fulfill missing column meta information for thrift server client tools

Kent Yao created SPARK-32492: Summary: Fulfill missing column meta information for thrift server client tools Key: SPARK-32492 URL: https://issues.apache.org/jira/browse/SPARK-32492 Project: Spark

[jira] [Resolved] (SPARK-32474) NullAwareAntiJoin multi-column support

[ https://issues.apache.org/jira/browse/SPARK-32474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin resolved SPARK-32474. - Resolution: Duplicate > NullAwareAntiJoin multi-column support > ---

[jira] [Resolved] (SPARK-32479) Fix the slicing logic in createDataFrame when converting pandas dataframe to arrow table

[ https://issues.apache.org/jira/browse/SPARK-32479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-32479. Resolution: Not A Bug > Fix the slicing logic in createDataFrame when converting pandas dataframe

[jira] [Commented] (SPARK-32479) Fix the slicing logic in createDataFrame when converting pandas dataframe to arrow table

[ https://issues.apache.org/jira/browse/SPARK-32479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167759#comment-17167759 ] Liang Zhang commented on SPARK-32479: - This is not a bug. Spark will always create `

[jira] [Commented] (SPARK-32475) java.lang.NoSuchMethodError: java.nio.ByteBuffer.flip()Ljava/nio/ByteBuffer;

[ https://issues.apache.org/jira/browse/SPARK-32475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167736#comment-17167736 ] Hyukjin Kwon commented on SPARK-32475: -- Looks like you're Java paths are mixed up.

[jira] [Commented] (SPARK-32475) java.lang.NoSuchMethodError: java.nio.ByteBuffer.flip()Ljava/nio/ByteBuffer;

[ https://issues.apache.org/jira/browse/SPARK-32475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167737#comment-17167737 ] Hyukjin Kwon commented on SPARK-32475: -- Oh right. > java.lang.NoSuchMethodError: j

  1   2   >