[jira] [Created] (SPARK-48196) Make lazy val plans in QueryExecution Trys to not re-execute on error

2024-05-08 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-48196: - Summary: Make lazy val plans in QueryExecution Trys to not re-execute on error Key: SPARK-48196 URL: https://issues.apache.org/jira/browse/SPARK-48196

[jira] [Created] (SPARK-48195) Keep and RDD created by SparkPlan doExecute

2024-05-08 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-48195: - Summary: Keep and RDD created by SparkPlan doExecute Key: SPARK-48195 URL: https://issues.apache.org/jira/browse/SPARK-48195 Project: Spark Issue

[jira] [Created] (SPARK-46186) Invalid Spark Connect execution state transition if interrupted before thread started

2023-11-30 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-46186: - Summary: Invalid Spark Connect execution state transition if interrupted before thread started Key: SPARK-46186 URL: https://issues.apache.org/jira/browse/SPARK-46186

[jira] [Updated] (SPARK-46011) Spark Connect session heartbeat / keepalive

2023-11-23 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-46011: -- Epic Link: SPARK-43754 > Spark Connect session heartbeat / keepalive >

[jira] [Resolved] (SPARK-46011) Spark Connect session heartbeat / keepalive

2023-11-23 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-46011. --- Resolution: Won't Fix Decided to not add this at this point. > Spark Connect

[jira] [Created] (SPARK-46075) Refactor SparkConnectSessionManager to not use guava cache

2023-11-23 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-46075: - Summary: Refactor SparkConnectSessionManager to not use guava cache Key: SPARK-46075 URL: https://issues.apache.org/jira/browse/SPARK-46075 Project: Spark

[jira] [Created] (SPARK-46011) Spark Connect session heartbeat / keepalive

2023-11-20 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-46011: - Summary: Spark Connect session heartbeat / keepalive Key: SPARK-46011 URL: https://issues.apache.org/jira/browse/SPARK-46011 Project: Spark Issue

[jira] [Created] (SPARK-45780) Propagate all Spark Connect client threadlocal in InheritableThread

2023-11-03 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45780: - Summary: Propagate all Spark Connect client threadlocal in InheritableThread Key: SPARK-45780 URL: https://issues.apache.org/jira/browse/SPARK-45780

[jira] [Updated] (SPARK-43754) Spark Connect Session & Query lifecycle

2023-10-26 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43754: -- Affects Version/s: 4.0.0 > Spark Connect Session & Query lifecycle >

[jira] [Created] (SPARK-45680) ReleaseSession to close Spark Connect session

2023-10-26 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45680: - Summary: ReleaseSession to close Spark Connect session Key: SPARK-45680 URL: https://issues.apache.org/jira/browse/SPARK-45680 Project: Spark

[jira] [Created] (SPARK-45647) Spark Connect API to propagate per request context

2023-10-24 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45647: - Summary: Spark Connect API to propagate per request context Key: SPARK-45647 URL: https://issues.apache.org/jira/browse/SPARK-45647 Project: Spark

[jira] [Updated] (SPARK-45435) Document that lazy checkpoint may not be a consistent

2023-10-06 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-45435: -- Summary: Document that lazy checkpoint may not be a consistent (was: Document that

[jira] [Created] (SPARK-45435) Document that lazy checkpoint may cause undeterministm

2023-10-06 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45435: - Summary: Document that lazy checkpoint may cause undeterministm Key: SPARK-45435 URL: https://issues.apache.org/jira/browse/SPARK-45435 Project: Spark

[jira] [Created] (SPARK-45416) Sanity check that Spark Connect returns arrow batches in order

2023-10-04 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45416: - Summary: Sanity check that Spark Connect returns arrow batches in order Key: SPARK-45416 URL: https://issues.apache.org/jira/browse/SPARK-45416 Project:

[jira] [Created] (SPARK-45206) Shutting down SparkConnectClient can have outstanding ReleaseExecute

2023-09-18 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45206: - Summary: Shutting down SparkConnectClient can have outstanding ReleaseExecute Key: SPARK-45206 URL: https://issues.apache.org/jira/browse/SPARK-45206

[jira] [Updated] (SPARK-45167) Python Spark Connect client does not call `releaseAll`

2023-09-14 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-45167: -- Epic Link: SPARK-43754 (was: SPARK-39375) > Python Spark Connect client does not

[jira] [Created] (SPARK-45133) Mark Spark Connect queries as finished when all result tasks are finished, not sent

2023-09-12 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45133: - Summary: Mark Spark Connect queries as finished when all result tasks are finished, not sent Key: SPARK-45133 URL: https://issues.apache.org/jira/browse/SPARK-45133

[jira] [Created] (SPARK-44872) Testing reattachable execute

2023-08-18 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44872: - Summary: Testing reattachable execute Key: SPARK-44872 URL: https://issues.apache.org/jira/browse/SPARK-44872 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-44855) Small tweaks to attaching ExecuteGrpcResponseSender to ExecuteResponseObserver

2023-08-17 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44855: - Summary: Small tweaks to attaching ExecuteGrpcResponseSender to ExecuteResponseObserver Key: SPARK-44855 URL: https://issues.apache.org/jira/browse/SPARK-44855

[jira] [Resolved] (SPARK-44730) Spark Connect: Cleaner thread not stopped when SparkSession stops

2023-08-17 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-44730. --- Resolution: Not A Problem > Spark Connect: Cleaner thread not stopped when

[jira] [Commented] (SPARK-44730) Spark Connect: Cleaner thread not stopped when SparkSession stops

2023-08-17 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755613#comment-17755613 ] Juliusz Sompolski commented on SPARK-44730: --- Silly me, Cleaner is already global and I looked

[jira] [Created] (SPARK-44849) Expose SparkConnectExecutionManager.listActiveExecutions

2023-08-17 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44849: - Summary: Expose SparkConnectExecutionManager.listActiveExecutions Key: SPARK-44849 URL: https://issues.apache.org/jira/browse/SPARK-44849 Project: Spark

[jira] [Created] (SPARK-44835) SparkConnect ReattachExecute could raise before ExecutePlan even attaches.

2023-08-16 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44835: - Summary: SparkConnect ReattachExecute could raise before ExecutePlan even attaches. Key: SPARK-44835 URL: https://issues.apache.org/jira/browse/SPARK-44835

[jira] [Created] (SPARK-44833) Spark Connect reattach when initial ExecutePlan didn't reach server doing too eager Reattach

2023-08-16 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44833: - Summary: Spark Connect reattach when initial ExecutePlan didn't reach server doing too eager Reattach Key: SPARK-44833 URL:

[jira] [Resolved] (SPARK-44765) Make ReleaseExecute retry in ExecutePlanResponseReattachableIterator reuse common mechanism

2023-08-16 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-44765. --- Fix Version/s: 3.5.0 Resolution: Fixed > Make ReleaseExecute retry in

[jira] [Commented] (SPARK-43754) Spark Connect Session & Query lifecycle

2023-08-14 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754182#comment-17754182 ] Juliusz Sompolski commented on SPARK-43754: --- Needed for testing of this:

[jira] [Created] (SPARK-44806) Separate connect-client-jvm-internal

2023-08-14 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44806: - Summary: Separate connect-client-jvm-internal Key: SPARK-44806 URL: https://issues.apache.org/jira/browse/SPARK-44806 Project: Spark Issue Type:

[jira] [Commented] (SPARK-44784) Failure in testing `SparkSessionE2ESuite` using Maven

2023-08-14 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753974#comment-17753974 ] Juliusz Sompolski commented on SPARK-44784: --- This is a classloader issue with the

[jira] [Created] (SPARK-44765) Make ReleaseExecute retry in ExecutePlanResponseReattachableIterator reuse common mechanism

2023-08-10 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44765: - Summary: Make ReleaseExecute retry in ExecutePlanResponseReattachableIterator reuse common mechanism Key: SPARK-44765 URL:

[jira] [Created] (SPARK-44762) Add more documentation and examples for using job tags for interrupt

2023-08-10 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44762: - Summary: Add more documentation and examples for using job tags for interrupt Key: SPARK-44762 URL: https://issues.apache.org/jira/browse/SPARK-44762

[jira] [Updated] (SPARK-44738) Spark Connect Reattach misses metadata propagation

2023-08-09 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-44738: -- Epic Link: SPARK-43754 > Spark Connect Reattach misses metadata propagation >

[jira] [Created] (SPARK-44730) Spark Connect: Cleaner thread not stopped when SparkSession stops

2023-08-08 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44730: - Summary: Spark Connect: Cleaner thread not stopped when SparkSession stops Key: SPARK-44730 URL: https://issues.apache.org/jira/browse/SPARK-44730 Project:

[jira] [Commented] (SPARK-43754) Spark Connect Session & Query lifecycle

2023-08-08 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752130#comment-17752130 ] Juliusz Sompolski commented on SPARK-43754: --- Not in epic, but nice-to-have refactoring:

[jira] [Updated] (SPARK-43756) Spark Connect - prefer to pass around SessionHolder / ExecuteHolder more

2023-08-08 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43756: -- Epic Link: (was: SPARK-43754) > Spark Connect - prefer to pass around SessionHolder

[jira] [Created] (SPARK-44722) reattach.py: AttributeError: 'NoneType' object has no attribute 'message'

2023-08-08 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44722: - Summary: reattach.py: AttributeError: 'NoneType' object has no attribute 'message' Key: SPARK-44722 URL: https://issues.apache.org/jira/browse/SPARK-44722

[jira] [Created] (SPARK-44709) Fix flow control in ExecuteGrpcResponseSender

2023-08-07 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44709: - Summary: Fix flow control in ExecuteGrpcResponseSender Key: SPARK-44709 URL: https://issues.apache.org/jira/browse/SPARK-44709 Project: Spark

[jira] [Created] (SPARK-44676) Ensure Spark Connect scala client CloseableIterator is closed in all cases where exception could be thrown

2023-08-04 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44676: - Summary: Ensure Spark Connect scala client CloseableIterator is closed in all cases where exception could be thrown Key: SPARK-44676 URL:

[jira] [Updated] (SPARK-44656) Close dangling iterators in SparkResult too (Spark Connect Scala)

2023-08-03 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-44656: -- Epic Link: SPARK-43754 > Close dangling iterators in SparkResult too (Spark Connect

[jira] [Updated] (SPARK-43754) Spark Connect Session & Query lifecycle

2023-08-02 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43754: -- Epic Name: connect-query-lifecycle (was: sc-query-lifecycle) > Spark Connect Session

[jira] [Updated] (SPARK-43754) Spark Connect Session & Query lifecycle

2023-08-02 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43754: -- Epic Name: sc-query-lifecycle (was: sc-session-lifecycle) > Spark Connect Session &

[jira] [Created] (SPARK-44642) ExecutePlanResponseReattachableIterator should release all after error

2023-08-02 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44642: - Summary: ExecutePlanResponseReattachableIterator should release all after error Key: SPARK-44642 URL: https://issues.apache.org/jira/browse/SPARK-44642

[jira] [Updated] (SPARK-44642) ExecutePlanResponseReattachableIterator should release all after error

2023-08-02 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-44642: -- Epic Link: SPARK-43754 > ExecutePlanResponseReattachableIterator should release all

[jira] [Updated] (SPARK-44636) Leave no dangling iterators in Spark Connect Scala

2023-08-02 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-44636: -- Epic Link: SPARK-43754 > Leave no dangling iterators in Spark Connect Scala >

[jira] [Updated] (SPARK-44637) ExecuteRelease needs to synchronize

2023-08-02 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-44637: -- Epic Link: SPARK-43754 > ExecuteRelease needs to synchronize >

[jira] [Created] (SPARK-44637) ExecuteRelease needs to synchronize

2023-08-02 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44637: - Summary: ExecuteRelease needs to synchronize Key: SPARK-44637 URL: https://issues.apache.org/jira/browse/SPARK-44637 Project: Spark Issue Type:

[jira] [Updated] (SPARK-44624) Spark Connect reattachable Execute when initial ExecutePlan didn't reach server

2023-08-01 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-44624: -- Epic Link: SPARK-43754 > Spark Connect reattachable Execute when initial ExecutePlan

[jira] [Updated] (SPARK-44624) Spark Connect reattachable Execute when initial ExecutePlan didn't reach server

2023-08-01 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-44624: -- Description: If the ExecutePlan never reached the server, a ReattachExecute will fail

[jira] [Updated] (SPARK-44624) Spark Connect reattachable Execute when initial ExecutePlan didn't reach server

2023-08-01 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-44624: -- Summary: Spark Connect reattachable Execute when initial ExecutePlan didn't reach

[jira] [Created] (SPARK-44625) Spark Connect clean up abandoned executions

2023-08-01 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44625: - Summary: Spark Connect clean up abandoned executions Key: SPARK-44625 URL: https://issues.apache.org/jira/browse/SPARK-44625 Project: Spark Issue

[jira] [Created] (SPARK-44624) Wrap retries around initial streaming GRPC call in connect

2023-08-01 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44624: - Summary: Wrap retries around initial streaming GRPC call in connect Key: SPARK-44624 URL: https://issues.apache.org/jira/browse/SPARK-44624 Project: Spark

[jira] [Commented] (SPARK-44599) Python client for reattaching to existing execute in Spark Connect (server mechanism)

2023-07-31 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749370#comment-17749370 ] Juliusz Sompolski commented on SPARK-44599: --- Duplicate of

[jira] [Updated] (SPARK-43923) [CONNECT] Post listenerBus events during ExecutePlanRequest

2023-07-14 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43923: -- Issue Type: New Feature (was: Bug) > [CONNECT] Post listenerBus events during

[jira] [Created] (SPARK-44425) Validate that session_id is an UUID

2023-07-14 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44425: - Summary: Validate that session_id is an UUID Key: SPARK-44425 URL: https://issues.apache.org/jira/browse/SPARK-44425 Project: Spark Issue Type:

[jira] [Created] (SPARK-44424) Reattach to existing execute in Spark Connect (python client)

2023-07-14 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44424: - Summary: Reattach to existing execute in Spark Connect (python client) Key: SPARK-44424 URL: https://issues.apache.org/jira/browse/SPARK-44424 Project:

[jira] [Created] (SPARK-44423) Reattach to existing execute in Spark Connect (scala client)

2023-07-14 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44423: - Summary: Reattach to existing execute in Spark Connect (scala client) Key: SPARK-44423 URL: https://issues.apache.org/jira/browse/SPARK-44423 Project:

[jira] [Created] (SPARK-44422) Fine grained interrupt in Spark Connect

2023-07-14 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44422: - Summary: Fine grained interrupt in Spark Connect Key: SPARK-44422 URL: https://issues.apache.org/jira/browse/SPARK-44422 Project: Spark Issue

[jira] [Updated] (SPARK-44421) Reattach to existing execute in Spark Connect (server mechanism)

2023-07-14 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-44421: -- Summary: Reattach to existing execute in Spark Connect (server mechanism) (was:

[jira] [Created] (SPARK-44421) Reattach to existing execute in Spark Connect

2023-07-14 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44421: - Summary: Reattach to existing execute in Spark Connect Key: SPARK-44421 URL: https://issues.apache.org/jira/browse/SPARK-44421 Project: Spark

[jira] [Created] (SPARK-44195) Add JobTag APIs to SparkR SparkContext

2023-06-26 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44195: - Summary: Add JobTag APIs to SparkR SparkContext Key: SPARK-44195 URL: https://issues.apache.org/jira/browse/SPARK-44195 Project: Spark Issue Type:

[jira] [Created] (SPARK-44194) Add JobTag APIs to Pyspark SparkContext

2023-06-26 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44194: - Summary: Add JobTag APIs to Pyspark SparkContext Key: SPARK-44194 URL: https://issues.apache.org/jira/browse/SPARK-44194 Project: Spark Issue

[jira] [Updated] (SPARK-43744) Spark Connect scala UDF serialization pulling in unrelated classes not available on server

2023-06-12 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43744: -- Summary: Spark Connect scala UDF serialization pulling in unrelated classes not

[jira] [Updated] (SPARK-43744) Maven test failure when "interrupt all" tests are moved to ClientE2ETestSuite

2023-06-12 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43744: -- Description: [https://github.com/apache/spark/pull/41487] moved "interrupt all -

[jira] [Reopened] (SPARK-43744) Maven test failure of ClientE2ETestSuite "interrupt all" tests

2023-06-12 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski reopened SPARK-43744: --- [https://github.com/apache/spark/pull/41487] has swept the issue under the rug by

[jira] [Updated] (SPARK-43744) Maven test failure when "interrupt all" tests are moved to ClientE2ETestSuite

2023-06-12 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43744: -- Summary: Maven test failure when "interrupt all" tests are moved to

[jira] [Commented] (SPARK-43952) Cancel Spark jobs not only by a single "jobgroup", but allow multiple "job tags"

2023-06-02 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17728791#comment-17728791 ] Juliusz Sompolski commented on SPARK-43952: --- Indirectly related with

[jira] [Commented] (SPARK-43754) Spark Connect Session & Query lifecycle

2023-06-02 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17728790#comment-17728790 ] Juliusz Sompolski commented on SPARK-43754: --- Indirectly related to

[jira] [Created] (SPARK-43952) Cancel Spark jobs not only by a single "jobgroup", but allow multiple "job tags"

2023-06-02 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-43952: - Summary: Cancel Spark jobs not only by a single "jobgroup", but allow multiple "job tags" Key: SPARK-43952 URL: https://issues.apache.org/jira/browse/SPARK-43952

[jira] [Created] (SPARK-43756) Spark Connect - prefer to pass around SessionHolder / ExecuteHolder more

2023-05-23 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-43756: - Summary: Spark Connect - prefer to pass around SessionHolder / ExecuteHolder more Key: SPARK-43756 URL: https://issues.apache.org/jira/browse/SPARK-43756

[jira] [Created] (SPARK-43755) Spark Connect - decouple query execution from RPC handler

2023-05-23 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-43755: - Summary: Spark Connect - decouple query execution from RPC handler Key: SPARK-43755 URL: https://issues.apache.org/jira/browse/SPARK-43755 Project: Spark

[jira] [Updated] (SPARK-43331) Spark Connect - SparkSession interruptAll

2023-05-23 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43331: -- Epic Link: SPARK-43754 > Spark Connect - SparkSession interruptAll >

[jira] [Created] (SPARK-43754) Spark Connect Session & Query lifecycle

2023-05-23 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-43754: - Summary: Spark Connect Session & Query lifecycle Key: SPARK-43754 URL: https://issues.apache.org/jira/browse/SPARK-43754 Project: Spark Issue

[jira] [Resolved] (SPARK-43744) Maven test failure of ClientE2ETestSuite "interrupt all" tests

2023-05-23 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-43744. --- Resolution: Duplicate > Maven test failure of ClientE2ETestSuite "interrupt all"

[jira] [Commented] (SPARK-43648) Maven test failed: `interrupt all - background queries, foreground interrupt` and `interrupt all - foreground queries, background interrupt`

2023-05-23 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725320#comment-17725320 ] Juliusz Sompolski commented on SPARK-43648: --- Duplicated by

[jira] [Updated] (SPARK-43744) Maven test failure of ClientE2ETestSuite "interrupt all" tests

2023-05-23 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43744: -- Description: When testing with {code:java} build/mvn clean install -DskipTests -Phive

[jira] [Commented] (SPARK-43227) Fix deserialisation issue when UDFs contain a lambda expression

2023-05-23 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725315#comment-17725315 ] Juliusz Sompolski commented on SPARK-43227: --- Possibly related to

[jira] [Created] (SPARK-43744) Maven test failure of ClientE2ETestSuite "interrupt all" tests

2023-05-23 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-43744: - Summary: Maven test failure of ClientE2ETestSuite "interrupt all" tests Key: SPARK-43744 URL: https://issues.apache.org/jira/browse/SPARK-43744 Project:

[jira] [Created] (SPARK-43331) Spark Connect - SparkSession interruptAll

2023-05-01 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-43331: - Summary: Spark Connect - SparkSession interruptAll Key: SPARK-43331 URL: https://issues.apache.org/jira/browse/SPARK-43331 Project: Spark Issue

[jira] [Comment Edited] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

2023-01-02 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653648#comment-17653648 ] Juliusz Sompolski edited comment on SPARK-41497 at 1/2/23 4:22 PM: ---

[jira] [Commented] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

2023-01-02 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653648#comment-17653648 ] Juliusz Sompolski commented on SPARK-41497: --- Note that this issue leads to a correctness issue

[jira] [Created] (SPARK-40918) Mismatch between ParquetFileFormat and FileSourceScanExec in # columns for WSCG.isTooManyFields when using _metadata

2022-10-26 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-40918: - Summary: Mismatch between ParquetFileFormat and FileSourceScanExec in # columns for WSCG.isTooManyFields when using _metadata Key: SPARK-40918 URL:

[jira] [Commented] (SPARK-20624) SPIP: Add better handling for node shutdown

2022-09-13 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603577#comment-17603577 ] Juliusz Sompolski commented on SPARK-20624: --- [~holden] Are these new APIs documented? I can't

[jira] [Resolved] (SPARK-37090) Upgrade libthrift to resolve security vulnerabilities

2021-10-21 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-37090. --- Resolution: Duplicate > Upgrade libthrift to resolve security vulnerabilities >

[jira] [Commented] (SPARK-37090) Upgrade libthrift to resolve security vulnerabilities

2021-10-21 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17432731#comment-17432731 ] Juliusz Sompolski commented on SPARK-37090: --- Duplicate of

[jira] [Created] (SPARK-37090) Upgrade libthrift to resolve security vulnerabilities

2021-10-21 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-37090: - Summary: Upgrade libthrift to resolve security vulnerabilities Key: SPARK-37090 URL: https://issues.apache.org/jira/browse/SPARK-37090 Project: Spark

[jira] [Commented] (SPARK-34152) CreateViewStatement.child should be a real child

2021-01-18 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267166#comment-17267166 ] Juliusz Sompolski commented on SPARK-34152: --- Same applies to AlterViewStatement. >

[jira] [Commented] (SPARK-32132) Thriftserver interval returns "4 weeks 2 days" in 2.4 and "30 days" in 3.0

2020-06-30 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148848#comment-17148848 ] Juliusz Sompolski commented on SPARK-32132: --- Also 2.4 adds "interval" at the start, while 3.0

[jira] [Commented] (SPARK-32132) Thriftserver interval returns "4 weeks 2 days" in 2.4 and "30 days" in 3.0

2020-06-29 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148086#comment-17148086 ] Juliusz Sompolski commented on SPARK-32132: --- cc [~hyukjin.kwon] [~cloud_fan] [~Qin Yao] >

[jira] [Created] (SPARK-32132) Thriftserver interval returns "4 weeks 2 days" in 2.4 and "30 days" in 3.0

2020-06-29 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-32132: - Summary: Thriftserver interval returns "4 weeks 2 days" in 2.4 and "30 days" in 3.0 Key: SPARK-32132 URL: https://issues.apache.org/jira/browse/SPARK-32132

[jira] [Updated] (SPARK-32021) make_interval does not accept seconds >100

2020-06-18 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-32021: -- Description: In make_interval(years, months, weeks, days, hours, mins, secs), secs

[jira] [Created] (SPARK-32021) make_interval does not accept seconds >100

2020-06-18 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-32021: - Summary: make_interval does not accept seconds >100 Key: SPARK-32021 URL: https://issues.apache.org/jira/browse/SPARK-32021 Project: Spark Issue

[jira] [Created] (SPARK-31863) Thriftserver not setting active SparkSession, SQLConf.get not getting session configs correctly

2020-05-28 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31863: - Summary: Thriftserver not setting active SparkSession, SQLConf.get not getting session configs correctly Key: SPARK-31863 URL:

[jira] [Commented] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119002#comment-17119002 ] Juliusz Sompolski commented on SPARK-31859: --- Actually, it's already in

[jira] [Created] (SPARK-31861) Thriftserver collecting timestamp not using spark.sql.session.timeZone

2020-05-28 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31861: - Summary: Thriftserver collecting timestamp not using spark.sql.session.timeZone Key: SPARK-31861 URL: https://issues.apache.org/jira/browse/SPARK-31861

[jira] [Updated] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-31859: -- Issue Type: Bug (was: Improvement) > Thriftserver with

[jira] [Created] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31859: - Summary: Thriftserver with spark.sql.datetime.java8API.enabled=true Key: SPARK-31859 URL: https://issues.apache.org/jira/browse/SPARK-31859 Project: Spark

[jira] [Created] (SPARK-31388) org.apache.spark.sql.hive.thriftserver.CliSuite result matching is flaky

2020-04-08 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31388: - Summary: org.apache.spark.sql.hive.thriftserver.CliSuite result matching is flaky Key: SPARK-31388 URL: https://issues.apache.org/jira/browse/SPARK-31388

[jira] [Created] (SPARK-31204) HiveResult compatibility for DatasourceV2 command

2020-03-20 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31204: - Summary: HiveResult compatibility for DatasourceV2 command Key: SPARK-31204 URL: https://issues.apache.org/jira/browse/SPARK-31204 Project: Spark

[jira] [Resolved] (SPARK-31051) Thriftserver operations other than SparkExecuteStatementOperation do not call onOperationClosed

2020-03-05 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-31051. --- Resolution: Not A Problem I'm just blind. They are there. > Thriftserver

[jira] [Created] (SPARK-31051) Thriftserver operations other than SparkExecuteStatementOperation do not call onOperationClosed

2020-03-05 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31051: - Summary: Thriftserver operations other than SparkExecuteStatementOperation do not call onOperationClosed Key: SPARK-31051 URL:

[jira] [Commented] (SPARK-29349) Support FETCH_PRIOR in Thriftserver query results fetching

2019-11-12 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972369#comment-16972369 ] Juliusz Sompolski commented on SPARK-29349: --- [~runzhiwang] it is used by Simba Spark ODBC

  1   2   >