[jira] [Commented] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973985#comment-16973985 ] sandeshyapuram commented on SPARK-29682: Thanks! > Failure when resolving conflicting

[jira] [Updated] (SPARK-29888) New interval string parser parse '.111 seconds' to null

[ https://issues.apache.org/jira/browse/SPARK-29888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-29888: - Issue Type: Bug (was: Improvement) > New interval string parser parse '.111 seconds' to null >

[jira] [Created] (SPARK-29888) New interval string parser parse '.111 seconds' to null

Kent Yao created SPARK-29888: Summary: New interval string parser parse '.111 seconds' to null Key: SPARK-29888 URL: https://issues.apache.org/jira/browse/SPARK-29888 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29682. --- Fix Version/s: 3.0.0 2.4.5 Assignee: Terry Kim

[jira] [Resolved] (SPARK-29873) Support `--import` directive to load queries from another test case in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-29873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29873. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26497

[jira] [Assigned] (SPARK-29873) Support `--import` directive to load queries from another test case in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-29873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29873: --- Assignee: Takeshi Yamamuro > Support `--import` directive to load queries from another

[jira] [Updated] (SPARK-29885) Improve the exception message when reading the daemon port

[ https://issues.apache.org/jira/browse/SPARK-29885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29885: Fix Version/s: (was: 3.0.0) > Improve the exception message when reading the daemon port >

[jira] [Commented] (SPARK-29887) PostgreSQL dialect: cast to smallint

[ https://issues.apache.org/jira/browse/SPARK-29887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973942#comment-16973942 ] jobit mathew commented on SPARK-29887: -- I will work on this > PostgreSQL dialect: cast to

[jira] [Created] (SPARK-29887) PostgreSQL dialect: cast to smallint

jobit mathew created SPARK-29887: Summary: PostgreSQL dialect: cast to smallint Key: SPARK-29887 URL: https://issues.apache.org/jira/browse/SPARK-29887 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29886) Add support for Spark style HashDistribution and Partitioning to V2 Datasource

Andrew K Long created SPARK-29886: - Summary: Add support for Spark style HashDistribution and Partitioning to V2 Datasource Key: SPARK-29886 URL: https://issues.apache.org/jira/browse/SPARK-29886

[jira] [Assigned] (SPARK-29837) PostgreSQL dialect: cast to boolean

[ https://issues.apache.org/jira/browse/SPARK-29837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29837: --- Assignee: wuyi > PostgreSQL dialect: cast to boolean > ---

[jira] [Resolved] (SPARK-29837) PostgreSQL dialect: cast to boolean

[ https://issues.apache.org/jira/browse/SPARK-29837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29837. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26463

[jira] [Updated] (SPARK-29619) Add retry times when reading the daemon port.

[ https://issues.apache.org/jira/browse/SPARK-29619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-29619: --- Description: This ticket is related to  https://issues.apache.org/jira/browse/SPARK-29885 and add

[jira] [Updated] (SPARK-29619) Add retry times when reading the daemon port.

[ https://issues.apache.org/jira/browse/SPARK-29619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-29619: --- Summary: Add retry times when reading the daemon port. (was: Improve the exception message when

[jira] [Updated] (SPARK-29619) Add retry times when reading the daemon port.

[ https://issues.apache.org/jira/browse/SPARK-29619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-29619: --- Description: (was: In production environment, my pyspark application occurs an exception and

[jira] [Updated] (SPARK-29885) Improve the exception message when reading the daemon port

[ https://issues.apache.org/jira/browse/SPARK-29885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-29885: --- Description: In production environment, my pyspark application occurs an exception and it's

[jira] [Created] (SPARK-29885) Improve the exception message when reading the daemon port

jiaan.geng created SPARK-29885: -- Summary: Improve the exception message when reading the daemon port Key: SPARK-29885 URL: https://issues.apache.org/jira/browse/SPARK-29885 Project: Spark Issue

[jira] [Resolved] (SPARK-29649) Stop task set if FileAlreadyExistsException was thrown when writing to output file

[ https://issues.apache.org/jira/browse/SPARK-29649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29649. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26312

[jira] [Resolved] (SPARK-29644) ShortType is wrongly set as Int in JDBCUtils.scala

[ https://issues.apache.org/jira/browse/SPARK-29644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29644. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26301

[jira] [Updated] (SPARK-29644) Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

[ https://issues.apache.org/jira/browse/SPARK-29644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29644: -- Summary: Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils (was:

[jira] [Assigned] (SPARK-29644) ShortType is wrongly set as Int in JDBCUtils.scala

[ https://issues.apache.org/jira/browse/SPARK-29644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29644: - Assignee: Shiv Prashant Sood > ShortType is wrongly set as Int in JDBCUtils.scala >

[jira] [Resolved] (SPARK-29287) Executors should not receive any offers before they are actually constructed

[ https://issues.apache.org/jira/browse/SPARK-29287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-29287. -- Fix Version/s: 3.0.0 Assignee: Kent Yao Resolution: Done Fixed by

[jira] [Resolved] (SPARK-29778) saveAsTable append mode is not passing writer options

[ https://issues.apache.org/jira/browse/SPARK-29778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29778. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26474

[jira] [Assigned] (SPARK-29778) saveAsTable append mode is not passing writer options

[ https://issues.apache.org/jira/browse/SPARK-29778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29778: - Assignee: Wesley Hoffman > saveAsTable append mode is not passing writer options >

[jira] [Resolved] (SPARK-24203) Make executor's bindAddress configurable

[ https://issues.apache.org/jira/browse/SPARK-24203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-24203. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26331

[jira] [Commented] (SPARK-28945) Allow concurrent writes to different partitions with dynamic partition overwrite

[ https://issues.apache.org/jira/browse/SPARK-28945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973715#comment-16973715 ] koert kuipers commented on SPARK-28945: --- i understand there is a great deal of complexity in the

[jira] [Comment Edited] (SPARK-29748) Remove sorting of fields in PySpark SQL Row creation

[ https://issues.apache.org/jira/browse/SPARK-29748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973695#comment-16973695 ] Maciej Szymkiewicz edited comment on SPARK-29748 at 11/13/19 9:13 PM:

[jira] [Comment Edited] (SPARK-29748) Remove sorting of fields in PySpark SQL Row creation

[ https://issues.apache.org/jira/browse/SPARK-29748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973695#comment-16973695 ] Maciej Szymkiewicz edited comment on SPARK-29748 at 11/13/19 9:11 PM:

[jira] [Commented] (SPARK-29748) Remove sorting of fields in PySpark SQL Row creation

[ https://issues.apache.org/jira/browse/SPARK-29748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973695#comment-16973695 ] Maciej Szymkiewicz commented on SPARK-29748: While this is a step in the right direction I

[jira] [Updated] (SPARK-29884) spark-submit to kuberentes can not parse valid ca certificate

[ https://issues.apache.org/jira/browse/SPARK-29884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy updated SPARK-29884: --- Summary: spark-submit to kuberentes can not parse valid ca certificate (was: spark-Submit to kuberentes

[jira] [Updated] (SPARK-29884) spark-Submit to kuberentes can not parse valid ca certificate

[ https://issues.apache.org/jira/browse/SPARK-29884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy updated SPARK-29884: --- Description: spark submit can not be used to to schedule to kuberentes with oauth token and cacert

[jira] [Updated] (SPARK-29884) spark-Submit to kuberentes can not parse valid ca certificate

[ https://issues.apache.org/jira/browse/SPARK-29884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy updated SPARK-29884: --- Description: spark submit can not be used to to schedule to kuberentes with oauth token and cacert

[jira] [Created] (SPARK-29884) spark-Submit to kuberentes can not parse valid ca certificate

Jeremy created SPARK-29884: -- Summary: spark-Submit to kuberentes can not parse valid ca certificate Key: SPARK-29884 URL: https://issues.apache.org/jira/browse/SPARK-29884 Project: Spark Issue

[jira] [Updated] (SPARK-29152) Spark Executor Plugin API shutdown is not proper when dynamic allocation enabled

[ https://issues.apache.org/jira/browse/SPARK-29152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29152: -- Summary: Spark Executor Plugin API shutdown is not proper when dynamic allocation enabled

[jira] [Updated] (SPARK-29152) Spark Executor Plugin API shutdown is not proper when dynamic allocation enabled

[ https://issues.apache.org/jira/browse/SPARK-29152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29152: -- Affects Version/s: 2.4.0 2.4.1 2.4.2

[jira] [Commented] (SPARK-29878) Improper cache strategies in GraphX

[ https://issues.apache.org/jira/browse/SPARK-29878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973637#comment-16973637 ] Aman Omer commented on SPARK-29878: --- [https://github.com/apache/spark/pull/7469] this PR had

[jira] [Commented] (SPARK-29883) Improve error messages when function name is an alias

[ https://issues.apache.org/jira/browse/SPARK-29883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973633#comment-16973633 ] Aman Omer commented on SPARK-29883: --- Working on this. > Improve error messages when function name is

[jira] [Created] (SPARK-29883) Improve error messages when function name is an alias

Xiao Li created SPARK-29883: --- Summary: Improve error messages when function name is an alias Key: SPARK-29883 URL: https://issues.apache.org/jira/browse/SPARK-29883 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-29882) SPARK on Kubernetes is Broken for SPARK with no Hadoop release

[ https://issues.apache.org/jira/browse/SPARK-29882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-29882. Fix Version/s: (was: 2.4.4) Target Version/s: (was: 2.4.4)

[jira] [Assigned] (SPARK-29875) Avoid to use deprecated pyarrow.open_stream API in Spark 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-29875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29875: - Assignee: Hyukjin Kwon > Avoid to use deprecated pyarrow.open_stream API in Spark

[jira] [Resolved] (SPARK-29875) Avoid to use deprecated pyarrow.open_stream API in Spark 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-29875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29875. --- Fix Version/s: 2.4.5 Resolution: Fixed Issue resolved by pull request 26501

[jira] [Resolved] (SPARK-23151) Provide a distribution of Spark with Hadoop 3.0

[ https://issues.apache.org/jira/browse/SPARK-23151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-23151. --- Resolution: Duplicate > Provide a distribution of Spark with Hadoop 3.0 >

[jira] [Commented] (SPARK-23151) Provide a distribution of Spark with Hadoop 3.0

[ https://issues.apache.org/jira/browse/SPARK-23151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973546#comment-16973546 ] Dongjoon Hyun commented on SPARK-23151: --- Yes. We did as we shipped in 3.0-preview release. >

[jira] [Assigned] (SPARK-29149) Update YARN cluster manager For Stage Level Scheduling

[ https://issues.apache.org/jira/browse/SPARK-29149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-29149: - Assignee: Thomas Graves > Update YARN cluster manager For Stage Level Scheduling >

[jira] [Created] (SPARK-29882) SPARK on Kubernetes is Broken for SPARK with no Hadoop release

Shahin Shakeri created SPARK-29882: -- Summary: SPARK on Kubernetes is Broken for SPARK with no Hadoop release Key: SPARK-29882 URL: https://issues.apache.org/jira/browse/SPARK-29882 Project: Spark

[jira] [Resolved] (SPARK-29872) Improper cache strategy in examples

[ https://issues.apache.org/jira/browse/SPARK-29872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29872. -- Resolution: Won't Fix > Improper cache strategy in examples >

[jira] [Comment Edited] (SPARK-24353) Add support for pod affinity/anti-affinity

[ https://issues.apache.org/jira/browse/SPARK-24353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973392#comment-16973392 ] Rafael Felix Correa edited comment on SPARK-24353 at 11/13/19 2:35 PM:

[jira] [Commented] (SPARK-24353) Add support for pod affinity/anti-affinity

[ https://issues.apache.org/jira/browse/SPARK-24353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973392#comment-16973392 ] Rafael Felix Correa commented on SPARK-24353: - Hi all, I gave this problem a shot in my PR 

[jira] [Resolved] (SPARK-29808) StopWordsRemover should support multi-cols

[ https://issues.apache.org/jira/browse/SPARK-29808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29808. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26480

[jira] [Resolved] (SPARK-29823) Improper persist strategy in mllib.clustering.KMeans.run()

[ https://issues.apache.org/jira/browse/SPARK-29823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29823. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26483

[jira] [Assigned] (SPARK-29823) Improper persist strategy in mllib.clustering.KMeans.run()

[ https://issues.apache.org/jira/browse/SPARK-29823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29823: Assignee: Aman Omer > Improper persist strategy in mllib.clustering.KMeans.run() >

[jira] [Updated] (SPARK-29823) Improper persist strategy in mllib.clustering.KMeans.run()

[ https://issues.apache.org/jira/browse/SPARK-29823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29823: - Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) These aren't bugs. >

[jira] [Resolved] (SPARK-28168) release-build.sh for Hadoop-3.2

[ https://issues.apache.org/jira/browse/SPARK-28168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-28168. - Resolution: Duplicate The issue fixed by SPARK-29608. > release-build.sh for Hadoop-3.2 >

[jira] [Commented] (SPARK-23151) Provide a distribution of Spark with Hadoop 3.0

[ https://issues.apache.org/jira/browse/SPARK-23151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973372#comment-16973372 ] Yuming Wang commented on SPARK-23151: - [~dongjoon] Is this issue fixed by SPARK-29608? > Provide a

[jira] [Updated] (SPARK-29881) Introduce API for manually breaking up dataset plan

[ https://issues.apache.org/jira/browse/SPARK-29881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devyn Cairns updated SPARK-29881: - Description: I have an interesting situation where I'm calling functions that are relatively

[jira] [Created] (SPARK-29881) Introduce API for manually breaking up dataset plan

Devyn Cairns created SPARK-29881: Summary: Introduce API for manually breaking up dataset plan Key: SPARK-29881 URL: https://issues.apache.org/jira/browse/SPARK-29881 Project: Spark Issue

[jira] [Resolved] (SPARK-29863) rename EveryAgg/AnyAgg to BoolAnd/BoolOr

[ https://issues.apache.org/jira/browse/SPARK-29863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29863. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26486

[jira] [Resolved] (SPARK-29753) refine the default catalog config

[ https://issues.apache.org/jira/browse/SPARK-29753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29753. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26395

[jira] [Updated] (SPARK-29877) static PageRank allow checkPoint from previous computations

[ https://issues.apache.org/jira/browse/SPARK-29877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joan Fontanals updated SPARK-29877: --- Priority: Major (was: Minor) > static PageRank allow checkPoint from previous computations

[jira] [Created] (SPARK-29880) Handle submit exception when target hadoop cluster is Federation

zhoukang created SPARK-29880: Summary: Handle submit exception when target hadoop cluster is Federation Key: SPARK-29880 URL: https://issues.apache.org/jira/browse/SPARK-29880 Project: Spark

[jira] [Created] (SPARK-29879) Support unbounded waiting for RPC reply

wenxuanguan created SPARK-29879: --- Summary: Support unbounded waiting for RPC reply Key: SPARK-29879 URL: https://issues.apache.org/jira/browse/SPARK-29879 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-29835) Remove the unnecessary conversion from Statement to LogicalPlan for DELETE/UPDATE

[ https://issues.apache.org/jira/browse/SPARK-29835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29835. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26464

[jira] [Assigned] (SPARK-29835) Remove the unnecessary conversion from Statement to LogicalPlan for DELETE/UPDATE

[ https://issues.apache.org/jira/browse/SPARK-29835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29835: --- Assignee: Xianyin Xin > Remove the unnecessary conversion from Statement to LogicalPlan

[jira] [Resolved] (SPARK-29866) Upper case enum values

[ https://issues.apache.org/jira/browse/SPARK-29866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29866. -- Resolution: Won't Fix > Upper case enum values > -- > >

[jira] [Created] (SPARK-29878) Improper cache strategies in GraphX

Dong Wang created SPARK-29878: - Summary: Improper cache strategies in GraphX Key: SPARK-29878 URL: https://issues.apache.org/jira/browse/SPARK-29878 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-29851) V2 Catalog: Default behavior of dropping namespace is cascading

[ https://issues.apache.org/jira/browse/SPARK-29851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29851: --- Assignee: Terry Kim > V2 Catalog: Default behavior of dropping namespace is cascading >

[jira] [Resolved] (SPARK-29851) V2 Catalog: Default behavior of dropping namespace is cascading

[ https://issues.apache.org/jira/browse/SPARK-29851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29851. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26476

[jira] [Created] (SPARK-29877) static PageRank allow checkPoint from previous computations

Joan Fontanals created SPARK-29877: -- Summary: static PageRank allow checkPoint from previous computations Key: SPARK-29877 URL: https://issues.apache.org/jira/browse/SPARK-29877 Project: Spark

[jira] [Updated] (SPARK-29876) Delete/archive file source completed files in separate thread

[ https://issues.apache.org/jira/browse/SPARK-29876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-29876: -- Summary: Delete/archive file source completed files in separate thread (was: Delete/archive

[jira] [Commented] (SPARK-29876) Delete/archive file source data in separate thread

[ https://issues.apache.org/jira/browse/SPARK-29876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973216#comment-16973216 ] Gabor Somogyi commented on SPARK-29876: --- I'm working on this. > Delete/archive file source data

[jira] [Created] (SPARK-29876) Delete/archive file source data in separate thread

Gabor Somogyi created SPARK-29876: - Summary: Delete/archive file source data in separate thread Key: SPARK-29876 URL: https://issues.apache.org/jira/browse/SPARK-29876 Project: Spark Issue

[jira] [Created] (SPARK-29875) Avoid to use deprecated pyarrow.open_stream API in Spark 2.4.x

Hyukjin Kwon created SPARK-29875: Summary: Avoid to use deprecated pyarrow.open_stream API in Spark 2.4.x Key: SPARK-29875 URL: https://issues.apache.org/jira/browse/SPARK-29875 Project: Spark

[jira] [Resolved] (SPARK-29710) Seeing offsets not resetting even when reset policy is configured explicitly

[ https://issues.apache.org/jira/browse/SPARK-29710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi resolved SPARK-29710. --- Resolution: Incomplete Please attach logs or any further information and re-open it. I'm

[jira] [Created] (SPARK-29874) Optimize Dataset.isEmpty()

angerszhu created SPARK-29874: - Summary: Optimize Dataset.isEmpty() Key: SPARK-29874 URL: https://issues.apache.org/jira/browse/SPARK-29874 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-29873) Support `--import` directive to load queries from another test case in SQLQueryTestSuite

Takeshi Yamamuro created SPARK-29873: Summary: Support `--import` directive to load queries from another test case in SQLQueryTestSuite Key: SPARK-29873 URL: https://issues.apache.org/jira/browse/SPARK-29873