[
https://issues.apache.org/jira/browse/SPARK-28575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kushal Mahajan updated SPARK-28575:
---
Description:
Steps to reproduce:
# Read a directory(consisting of txt files) using spark
[
https://issues.apache.org/jira/browse/SPARK-28575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kushal Mahajan updated SPARK-28575:
---
Summary: Time lag between two consecutive spark actions using Spark 2.3.1
(was: Spark job
[
https://issues.apache.org/jira/browse/SPARK-28575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kushal Mahajan reopened SPARK-28575:
> Spark job time increasing when upgrading Spark from 2.1.1 to 2.3.1
>
[
https://issues.apache.org/jira/browse/SPARK-28575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899848#comment-16899848
]
Kushal Mahajan commented on SPARK-28575:
Attached are the screenshot for Spark UI for 2.1 and
[
https://issues.apache.org/jira/browse/SPARK-28575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kushal Mahajan updated SPARK-28575:
---
Attachment: spark_2.3_screenshot.PNG
spark_2.1_screenshot.PNG
> Spark job
Kushal Mahajan created SPARK-28575:
--
Summary: Spark job time increasing when upgrading Spark from 2.1.1
to 2.3.1
Key: SPARK-28575
URL: https://issues.apache.org/jira/browse/SPARK-28575
Project: