[
https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626849#comment-16626849
]
Sujith edited comment on SPARK-25521 at 9/25/18 6:39 AM:
---------------------------------------------------------
[~Bjangir] I could see the jobcontext doesn't have jobID when the flow hits
FileFormatWriter.scala in the insert flow. Moreover this issue is happening in
insert flow. I will check into this issue more and raise a PR for handling the
same. Thanks for reporting.
was (Author: s71955):
[~Bjangir] I could see the jobcontext doesn't have jobID when the flow hits
FileFormatWriter.scala in the insert flow. I will check into this issue more
and raise a PR for handling the same. Thanks for reporting.
> Job id showing null when Job is finished.
> -----------------------------------------
>
> Key: SPARK-25521
> URL: https://issues.apache.org/jira/browse/SPARK-25521
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, SQL
> Affects Versions: 2.3.1
> Reporter: Babulal
> Priority: Minor
> Attachments: image-2018-09-25-12-01-31-871.png
>
>
> scala> spark.sql("create table x1(name string,age int) stored as parquet")
> scala> spark.sql("insert into x1 select 'a',29")
> check logs
> 2018-08-19 12:45:36 INFO TaskSetManager:54 - Finished task 0.0 in stage 0.0
> (TID 0) in 874 ms on localhost (executor
> driver) (1/1)
> 2018-08-19 12:45:36 INFO TaskSchedulerImpl:54 - Removed TaskSet 0.0, whose
> tasks have all completed, from pool
> 2018-08-19 12:45:36 INFO DAGScheduler:54 - ResultStage 0 (sql at
> <console>:24) finished in 1.131 s
> 2018-08-19 12:45:36 INFO DAGScheduler:54 - Job 0 finished: sql at
> <console>:24, took 1.233329 s
> 2018-08-19 12:45:36 INFO FileFormatWriter:54 - Job
> {color:#d04437}null{color} committed.
> 2018-08-19 12:45:36 INFO FileFormatWriter:54 - Finished processing stats for
> job null.
> res4: org.apache.spark.sql.DataFrame = []
>
> !image-2018-09-25-12-01-31-871.png!
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
