[jira] [Updated] (SPARK-47766) Extend spark 3.5.1 to support hadoop-client-api 3.4.0, hadoop-client-runtime-3.4.0

[ https://issues.apache.org/jira/browse/SPARK-47766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-47766: Description: We have some HIGH CVEs which are coming from hadoop-client-runtime 3.3.4 and hence

[jira] [Created] (SPARK-47766) Extend spark 3.5.1 to support hadoop-client-api 3.4.0, hadoop-client-runtime-3.4.0

Ramakrishna created SPARK-47766: --- Summary: Extend spark 3.5.1 to support hadoop-client-api 3.4.0, hadoop-client-runtime-3.4.0 Key: SPARK-47766 URL: https://issues.apache.org/jira/browse/SPARK-47766

[jira] [Commented] (SPARK-40782) Upgrade Jackson-databind to 2.13.4.1

[ https://issues.apache.org/jira/browse/SPARK-40782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834801#comment-17834801 ] Ramakrishna commented on SPARK-40782: - Hi this seems to be an issue still as transitive dependency

[jira] [Comment Edited] (SPARK-21595) introduction of spark.sql.windowExec.buffer.spill.threshold in spark 2.2 breaks existing workflow

[ https://issues.apache.org/jira/browse/SPARK-21595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819249#comment-17819249 ] Ramakrishna edited comment on SPARK-21595 at 2/21/24 1:34 PM: --

[jira] [Commented] (SPARK-21595) introduction of spark.sql.windowExec.buffer.spill.threshold in spark 2.2 breaks existing workflow

[ https://issues.apache.org/jira/browse/SPARK-21595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819249#comment-17819249 ] Ramakrishna commented on SPARK-21595: - [~Rakesh_Shah]  How did you manage to solve this ? I am

[jira] [Comment Edited] (SPARK-44152) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746516#comment-17746516 ] Ramakrishna edited comment on SPARK-44152 at 7/24/23 4:06 PM: -- Hello

[jira] [Commented] (SPARK-44152) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746516#comment-17746516 ] Ramakrishna commented on SPARK-44152: - Hello [~sdehaes]  It should work if you copy jar to   

[jira] [Commented] (SPARK-44152) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739627#comment-17739627 ] Ramakrishna commented on SPARK-44152: -  Hi [~iainm]  Yes, I spent probably bit longer to understand

[jira] [Commented] (SPARK-44152) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17736404#comment-17736404 ] Ramakrishna commented on SPARK-44152: - [~gurwls223]  Is this an issue spark 3.4.0 ? at least I am

[jira] [Updated] (SPARK-44135) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-44135: Description:   I have a spark application that is deployed using k8s and it is of version 3.3.2

[jira] [Updated] (SPARK-44135) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-44135: Priority: Blocker (was: Critical) > Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread

[jira] [Updated] (SPARK-44135) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-44135: Issue Type: Bug (was: Improvement) > Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread

[jira] [Updated] (SPARK-44135) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-44135: Description:   I have a spark application that is deployed using k8s and it is of version 3.3.2

[jira] [Updated] (SPARK-44135) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-44135: Description:   I have a spark application that is deployed using k8s and it is of version 3.3.2

[jira] [Updated] (SPARK-44135) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-44135: Component/s: Spark Core (was: Shuffle) > Upgrade to spark 3.4.0 from 3.3.2

[jira] [Updated] (SPARK-44135) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-44135: Affects Version/s: (was: 3.2.0) > Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread

[jira] [Updated] (SPARK-44135) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-44135: Description:   I have a spark application that is deployed using k8s and it is of version 3.3.2

[jira] [Updated] (SPARK-44135) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

[ https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-44135: Description: (was: In our production environment, _finalizeShuffleMerge_ processing took

[jira] [Created] (SPARK-44135) Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

Ramakrishna created SPARK-44135: --- Summary: Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location Key: SPARK-44135 URL:

[jira] [Commented] (SPARK-41298) Getting Count on data frame is giving the performance issue

[ https://issues.apache.org/jira/browse/SPARK-41298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644164#comment-17644164 ] Ramakrishna commented on SPARK-41298: - Can some one please check behavior and update me asap. >

[jira] [Updated] (SPARK-41298) Getting Count on data frame is giving the performance issue

[ https://issues.apache.org/jira/browse/SPARK-41298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-41298: Description: We are invoking  below query on Teradata  1) Dataframe df = spark.format("jdbc"). .

[jira] [Created] (SPARK-41298) Getting Count on data frame is giving the performance issue

Ramakrishna created SPARK-41298: --- Summary: Getting Count on data frame is giving the performance issue Key: SPARK-41298 URL: https://issues.apache.org/jira/browse/SPARK-41298 Project: Spark

[jira] [Resolved] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna resolved SPARK-41070. - Resolution: Done > Performance issue when Spark SQL connects with TeraData >

[jira] [Updated] (SPARK-41170) Performance issue when Spark SQL connects with TeraData

[ https://issues.apache.org/jira/browse/SPARK-41170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-41170: Summary: Performance issue when Spark SQL connects with TeraData (was: CLONE - Performance

[jira] [Created] (SPARK-41170) CLONE - Performance issue when Spark SQL connects with TeraData

Ramakrishna created SPARK-41170: --- Summary: CLONE - Performance issue when Spark SQL connects with TeraData Key: SPARK-41170 URL: https://issues.apache.org/jira/browse/SPARK-41170 Project: Spark

[jira] [Commented] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635223#comment-17635223 ] Ramakrishna commented on SPARK-41070: - I converted issue to a questions. > Performance issue when

[jira] [Reopened] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna reopened SPARK-41070: - > Performance issue when Spark SQL connects with TeraData >

[jira] [Updated] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-41070: Issue Type: Question (was: Bug) > Performance issue when Spark SQL connects with TeraData >

[jira] [Commented] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635083#comment-17635083 ] Ramakrishna commented on SPARK-41070: - Do I need to do raise any ticket for this. > Performance

[jira] [Updated] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-41070: Component/s: SQL > Performance issue when Spark SQL connects with TeraData >

[jira] [Updated] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-41070: Description: We are connecting Tera data from spark SQL with below API {color:#ff8b00}Dataset

[jira] [Updated] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

[ https://issues.apache.org/jira/browse/SPARK-41070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-41070: Description: We are connecting Tera data from spark SQL with below API {color:#ff8b00}Dataset

[jira] [Created] (SPARK-41070) Performance issue when Spark SQL connects with TeraData

Ramakrishna created SPARK-41070: --- Summary: Performance issue when Spark SQL connects with TeraData Key: SPARK-41070 URL: https://issues.apache.org/jira/browse/SPARK-41070 Project: Spark Issue

[jira] [Created] (SPARK-13585) addPyFile behavior change between 1.6 and before

Santhosh Gorantla Ramakrishna created SPARK-13585: - Summary: addPyFile behavior change between 1.6 and before Key: SPARK-13585 URL: https://issues.apache.org/jira/browse/SPARK-13585