[jira] [Created] (SPARK-47341) Replace commands with relations in a few tests in SparkConnectClientSuite

2024-03-11 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-47341: Summary: Replace commands with relations in a few tests in SparkConnectClientSuite Key: SPARK-47341 URL: https://issues.apache.org/jira/browse/SPARK-47341

[jira] [Created] (SPARK-46660) ReattachExecute requests do not refresh aliveness of SessionHolder

2024-01-10 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-46660: Summary: ReattachExecute requests do not refresh aliveness of SessionHolder Key: SPARK-46660 URL: https://issues.apache.org/jira/browse/SPARK-46660

[jira] [Created] (SPARK-46202) Expose new ArtifactManager API to support in-memory artifacts and sub-directory structure

2023-12-01 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-46202: Summary: Expose new ArtifactManager API to support in-memory artifacts and sub-directory structure Key: SPARK-46202 URL:

[jira] [Created] (SPARK-45155) Add API Docs

2023-09-13 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-45155: Summary: Add API Docs Key: SPARK-45155 URL: https://issues.apache.org/jira/browse/SPARK-45155 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-44851) Update SparkConnectClientParser usage() method to match implementation

2023-09-09 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17763343#comment-17763343 ] Venkata Sai Akhil Gudesa commented on SPARK-44851: -- [~harry] Go ahead :)  > Update

[jira] [Created] (SPARK-44867) Refactor Spark Connect Docs to incorporate Scala setup

2023-08-18 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44867: Summary: Refactor Spark Connect Docs to incorporate Scala setup Key: SPARK-44867 URL: https://issues.apache.org/jira/browse/SPARK-44867

[jira] [Updated] (SPARK-44851) Update SparkConnectClientParser usage() method to match implementation

2023-08-17 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-44851: - Epic Link: SPARK-42554 > Update SparkConnectClientParser usage() method

[jira] [Created] (SPARK-44851) Update SparkConnectClientParser usage() method to match implementation

2023-08-17 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44851: Summary: Update SparkConnectClientParser usage() method to match implementation Key: SPARK-44851 URL: https://issues.apache.org/jira/browse/SPARK-44851

[jira] [Created] (SPARK-44829) Expose uploadAllArtifactClasses in ArtifactManager to `sql` package

2023-08-16 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44829: Summary: Expose uploadAllArtifactClasses in ArtifactManager to `sql` package Key: SPARK-44829 URL: https://issues.apache.org/jira/browse/SPARK-44829

[jira] [Created] (SPARK-44657) Incorrect limit handling and config parsing in Arrow collect

2023-08-03 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44657: Summary: Incorrect limit handling and config parsing in Arrow collect Key: SPARK-44657 URL: https://issues.apache.org/jira/browse/SPARK-44657

[jira] [Created] (SPARK-44584) AddArtifactsRequest and ArtifactStatusesRequest do not set client_type information

2023-07-28 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44584: Summary: AddArtifactsRequest and ArtifactStatusesRequest do not set client_type information Key: SPARK-44584 URL:

[jira] [Created] (SPARK-44476) JobArtifactSet is populated with all artifacts if it is not associated with an artifact

2023-07-18 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44476: Summary: JobArtifactSet is populated with all artifacts if it is not associated with an artifact Key: SPARK-44476 URL:

[jira] [Updated] (SPARK-44388) Using an updated instance of ScalarUserDefinedFunction causes protobuf cast failures on server

2023-07-12 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-44388: - Epic Link: SPARK-42554 > Using an updated instance of

[jira] [Created] (SPARK-44388) Using an updated instance of ScalarUserDefinedFunction causes protobuf cast failures on server

2023-07-12 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44388: Summary: Using an updated instance of ScalarUserDefinedFunction causes protobuf cast failures on server Key: SPARK-44388 URL:

[jira] [Updated] (SPARK-44300) SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts

2023-07-04 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-44300: - Epic Link: SPARK-42554 > SparkConnectArtifactManager#cleanUpResources

[jira] [Created] (SPARK-44300) SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts

2023-07-04 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44300: Summary: SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts Key: SPARK-44300 URL:

[jira] [Created] (SPARK-44293) Task failures during custom JAR fetch in executors

2023-07-04 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44293: Summary: Task failures during custom JAR fetch in executors Key: SPARK-44293 URL: https://issues.apache.org/jira/browse/SPARK-44293 Project:

[jira] [Created] (SPARK-44246) Follow-ups for Jar/Classfile Isolation

2023-06-29 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44246: Summary: Follow-ups for Jar/Classfile Isolation Key: SPARK-44246 URL: https://issues.apache.org/jira/browse/SPARK-44246 Project: Spark

[jira] [Updated] (SPARK-44146) Isolate Spark Connect session/artifacts

2023-06-29 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-44146: - Epic Link: SPARK-42554 > Isolate Spark Connect session/artifacts >

[jira] [Created] (SPARK-44146) Isolate Spark Connect session/artifacts

2023-06-22 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44146: Summary: Isolate Spark Connect session/artifacts Key: SPARK-44146 URL: https://issues.apache.org/jira/browse/SPARK-44146 Project: Spark

[jira] [Created] (SPARK-44078) Add support for classloader/resource isolation

2023-06-16 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44078: Summary: Add support for classloader/resource isolation Key: SPARK-44078 URL: https://issues.apache.org/jira/browse/SPARK-44078 Project: Spark

[jira] [Created] (SPARK-44016) Artifacts with name as an absolute path may overwrite other files

2023-06-09 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44016: Summary: Artifacts with name as an absolute path may overwrite other files Key: SPARK-44016 URL: https://issues.apache.org/jira/browse/SPARK-44016

[jira] [Created] (SPARK-43998) Add support for UDAF

2023-06-07 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-43998: Summary: Add support for UDAF Key: SPARK-43998 URL: https://issues.apache.org/jira/browse/SPARK-43998 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-43995) Implement UDFRegistration

2023-06-07 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-43995: - Description: Reference file -

[jira] [Updated] (SPARK-43996) Implement call_udf function

2023-06-07 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-43996: - Description:

[jira] [Updated] (SPARK-43997) Add support for Java UDFs

2023-06-07 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-43997: - Description: API:  {code:java} def udf(f: UDF0[_], returnType:

[jira] [Created] (SPARK-43997) Add support for Java UDFs

2023-06-07 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-43997: Summary: Add support for Java UDFs Key: SPARK-43997 URL: https://issues.apache.org/jira/browse/SPARK-43997 Project: Spark Issue

[jira] [Created] (SPARK-43996) Implement call_udf function

2023-06-07 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-43996: Summary: Implement call_udf function Key: SPARK-43996 URL: https://issues.apache.org/jira/browse/SPARK-43996 Project: Spark Issue

[jira] [Created] (SPARK-43995) Implement UDFRegistration

2023-06-07 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-43995: Summary: Implement UDFRegistration Key: SPARK-43995 URL: https://issues.apache.org/jira/browse/SPARK-43995 Project: Spark Issue

[jira] [Updated] (SPARK-43285) ReplE2ESuite consistently fails with JDK 17

2023-04-25 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-43285: - Description:

[jira] [Created] (SPARK-43285) ReplE2ESuite consistently fails with JDK 17

2023-04-25 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-43285: Summary: ReplE2ESuite consistently fails with JDK 17 Key: SPARK-43285 URL: https://issues.apache.org/jira/browse/SPARK-43285 Project: Spark

[jira] [Created] (SPARK-43227) Fix deserialisation issue when UDFs contain a lambda expression

2023-04-20 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-43227: Summary: Fix deserialisation issue when UDFs contain a lambda expression Key: SPARK-43227 URL: https://issues.apache.org/jira/browse/SPARK-43227

[jira] [Updated] (SPARK-43198) Fix "Could not initialise class ammonite..." error when using filter

2023-04-19 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-43198: - Description: When {code:java} spark.range(10).filter(n => n % 2 ==

[jira] [Created] (SPARK-43198) Fix "Could not initialise class ammonite..." error when using filter

2023-04-19 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-43198: Summary: Fix "Could not initialise class ammonite..." error when using filter Key: SPARK-43198 URL: https://issues.apache.org/jira/browse/SPARK-43198

[jira] [Created] (SPARK-42812) client_type is missing from AddArtifactsRequest proto message

2023-03-15 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42812: Summary: client_type is missing from AddArtifactsRequest proto message Key: SPARK-42812 URL: https://issues.apache.org/jira/browse/SPARK-42812

[jira] [Created] (SPARK-42748) Server-side Artifact Management

2023-03-10 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42748: Summary: Server-side Artifact Management Key: SPARK-42748 URL: https://issues.apache.org/jira/browse/SPARK-42748 Project: Spark

[jira] [Updated] (SPARK-42658) Handle timeouts and CRC failures during artifact transfer

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-42658: - Description: We would need a retry mechanism on the client side to

[jira] [Updated] (SPARK-42658) Handle timeouts and CRC failures during artifact transfer

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-42658: - Summary: Handle timeouts and CRC failures during artifact transfer

[jira] [Created] (SPARK-42658) Handle CRC failures during artifact transfer

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42658: Summary: Handle CRC failures during artifact transfer Key: SPARK-42658 URL: https://issues.apache.org/jira/browse/SPARK-42658 Project: Spark

[jira] [Created] (SPARK-42657) Support to find and transfer client-side REPL classfiles to server as artifacts

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42657: Summary: Support to find and transfer client-side REPL classfiles to server as artifacts Key: SPARK-42657 URL:

[jira] [Updated] (SPARK-42657) Support to find and transfer client-side REPL classfiles to server as artifacts

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-42657: - Epic Link: SPARK-42554 > Support to find and transfer client-side REPL

[jira] [Updated] (SPARK-42653) Artifact transfer from Scala/JVM client to Server

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-42653: - Epic Link: SPARK-42554 > Artifact transfer from Scala/JVM client to

[jira] [Created] (SPARK-42653) Artifact transfer from Scala/JVM client to Server

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42653: Summary: Artifact transfer from Scala/JVM client to Server Key: SPARK-42653 URL: https://issues.apache.org/jira/browse/SPARK-42653 Project:

[jira] [Created] (SPARK-42543) Specify protocol for UDF artifact transfer in JVM/Scala client

2023-02-23 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42543: Summary: Specify protocol for UDF artifact transfer in JVM/Scala client Key: SPARK-42543 URL: https://issues.apache.org/jira/browse/SPARK-42543

[jira] [Updated] (SPARK-42283) Add Simple Scala UDFs to Scala/JVM Client

2023-02-01 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-42283: - Description: “Simple” here refers to UDFs that utilize no

[jira] [Created] (SPARK-42283) Add Simple Scala UDFs to Scala/JVM Client

2023-02-01 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42283: Summary: Add Simple Scala UDFs to Scala/JVM Client Key: SPARK-42283 URL: https://issues.apache.org/jira/browse/SPARK-42283 Project: Spark

[jira] [Created] (SPARK-42133) Add basic Dataset API methods to Spark Connect Scala Client

2023-01-20 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42133: Summary: Add basic Dataset API methods to Spark Connect Scala Client Key: SPARK-42133 URL: https://issues.apache.org/jira/browse/SPARK-42133

[jira] [Created] (SPARK-41967) SBT unable to resolve particular packages from the imported maven build

2023-01-10 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-41967: Summary: SBT unable to resolve particular packages from the imported maven build Key: SPARK-41967 URL: https://issues.apache.org/jira/browse/SPARK-41967

[jira] [Created] (SPARK-41917) Support SSL and Auth token in connection channel for JVM/Scala Client

2023-01-05 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-41917: Summary: Support SSL and Auth token in connection channel for JVM/Scala Client Key: SPARK-41917 URL: https://issues.apache.org/jira/browse/SPARK-41917

[jira] [Updated] (SPARK-41822) Setup Scala/JVM Client Connection

2023-01-02 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-41822: - Summary: Setup Scala/JVM Client Connection (was: Setup Scala Client

[jira] [Created] (SPARK-41822) Setup Scala Client Connection

2023-01-02 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-41822: Summary: Setup Scala Client Connection Key: SPARK-41822 URL: https://issues.apache.org/jira/browse/SPARK-41822 Project: Spark Issue

[jira] [Created] (SPARK-41534) Setup initial client module for Spark Connect

2022-12-15 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-41534: Summary: Setup initial client module for Spark Connect Key: SPARK-41534 URL: https://issues.apache.org/jira/browse/SPARK-41534 Project: Spark

[jira] [Created] (SPARK-41369) Refactor connect directory structure

2022-12-02 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-41369: Summary: Refactor connect directory structure Key: SPARK-41369 URL: https://issues.apache.org/jira/browse/SPARK-41369 Project: Spark

[jira] [Commented] (SPARK-36677) NestedColumnAliasing pushes down aggregate functions into projections

2021-09-06 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410734#comment-17410734 ] Venkata Sai Akhil Gudesa commented on SPARK-36677: -- I have a fix for this and have a PR

[jira] [Created] (SPARK-36677) NestedColumnAliasing pushes down aggregate functions into projections

2021-09-06 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-36677: Summary: NestedColumnAliasing pushes down aggregate functions into projections Key: SPARK-36677 URL: https://issues.apache.org/jira/browse/SPARK-36677