[ https://issues.apache.org/jira/browse/SPARK-18298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tao Wang updated SPARK-18298: ----------------------------- Description: When I started HistoryServer for reading event logs, the timestamp readed will be parsed using local timezone like "CST"(confirmed via debug). But the time related columns like "Started"/"Completed"/"Last Updated" in History Server UI using "GMT" time, which is 8 hours earlier than "CST". {quote} App ID App Name Started Completed Duration Spark User Last Updated Event Log local-1478225166651 Spark shell 2016-11-04 02:06:06 2016-11-07 01:33:30 71.5 h root 2016-11-07 01:33:30 {quote} I've checked the REST api and found the result like: {color:red} [ { "id" : "local-1478225166651", "name" : "Spark shell", "attempts" : [ { "startTime" : "2016-11-04T02:06:06.020GMT", "endTime" : "2016-11-07T01:33:30.265GMT", "lastUpdated" : "2016-11-07T01:33:30.000GMT", "duration" : 257244245, "sparkUser" : "root", "completed" : true, "lastUpdatedEpoch" : 1478482410000, "endTimeEpoch" : 1478482410265, "startTimeEpoch" : 1478225166020 } ] }, { "id" : "local-1478224925869", "name" : "Spark Pi", "attempts" : [ { "startTime" : "2016-11-04T02:02:02.133GMT", "endTime" : "2016-11-04T02:02:07.468GMT", "lastUpdated" : "2016-11-04T02:02:07.000GMT", "duration" : 5335, "sparkUser" : "root", "completed" : true, ... {color} So maybe the change happened in transferring between server and browser? I have no idea where to go from this point. Hope guys can offer some help, or just fix it if it's easy? :) was: When I started HistoryServer for reading event logs, the timestamp readed will be parsed using local timezone like "CST"(confirmed via debug). But the time related columns like "Started"/"Completed"/"Last Updated" in History Server UI using "GMT" time, which is 8 hours earlier than "CST". {quote} App ID App Name Started Completed Duration Spark User Last Updated Event Log local-1478225166651 Spark shell 2016-11-04 02:06:06 2016-11-07 01:33:30 71.5 h root 2016-11-07 01:33:30 {quote} I've checked the REST api and found the result like: {color:red} [ { "id" : "local-1478225166651", "name" : "Spark shell", "attempts" : [ { "startTime" : "2016-11-04T02:06:06.020GMT", "endTime" : "2016-11-07T01:33:30.265GMT", "lastUpdated" : "2016-11-07T01:33:30.000GMT", "duration" : 257244245, "sparkUser" : "root", "completed" : true, "lastUpdatedEpoch" : 1478482410000, "endTimeEpoch" : 1478482410265, "startTimeEpoch" : 1478225166020 } ] }, { "id" : "local-1478224925869", "name" : "Spark Pi", "attempts" : [ { "startTime" : "2016-11-04T02:02:02.133GMT", "endTime" : "2016-11-04T02:02:07.468GMT", "lastUpdated" : "2016-11-04T02:02:07.000GMT", "duration" : 5335, "sparkUser" : "root", ... {color} So maybe the change happened in transferring between server and browser? I have no idea where to go from this point. Hope guys can offer some help, or just fix it if it's easy? :) > HistoryServer use GMT time all time > ----------------------------------- > > Key: SPARK-18298 > URL: https://issues.apache.org/jira/browse/SPARK-18298 > Project: Spark > Issue Type: Bug > Components: Web UI > Affects Versions: 2.0.0, 2.0.1 > Environment: suse 11.3 with CST time > Reporter: Tao Wang > > When I started HistoryServer for reading event logs, the timestamp readed > will be parsed using local timezone like "CST"(confirmed via debug). > But the time related columns like "Started"/"Completed"/"Last Updated" in > History Server UI using "GMT" time, which is 8 hours earlier than "CST". > {quote} > App ID App Name Started Completed Duration Spark > User Last Updated Event Log > local-1478225166651 Spark shell 2016-11-04 02:06:06 2016-11-07 > 01:33:30 71.5 h root 2016-11-07 01:33:30 > {quote} > I've checked the REST api and found the result like: > {color:red} > [ { > "id" : "local-1478225166651", > "name" : "Spark shell", > "attempts" : [ { > "startTime" : "2016-11-04T02:06:06.020GMT", > "endTime" : "2016-11-07T01:33:30.265GMT", > "lastUpdated" : "2016-11-07T01:33:30.000GMT", > "duration" : 257244245, > "sparkUser" : "root", > "completed" : true, > "lastUpdatedEpoch" : 1478482410000, > "endTimeEpoch" : 1478482410265, > "startTimeEpoch" : 1478225166020 > } ] > }, { > "id" : "local-1478224925869", > "name" : "Spark Pi", > "attempts" : [ { > "startTime" : "2016-11-04T02:02:02.133GMT", > "endTime" : "2016-11-04T02:02:07.468GMT", > "lastUpdated" : "2016-11-04T02:02:07.000GMT", > "duration" : 5335, > "sparkUser" : "root", > "completed" : true, > ... > {color} > So maybe the change happened in transferring between server and browser? I > have no idea where to go from this point. > Hope guys can offer some help, or just fix it if it's easy? :) -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org