[
https://issues.apache.org/jira/browse/SPARK-14057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15216293#comment-15216293
]
Andrew Davidson commented on SPARK-14057:
-----------------------------------------
Hi Vijay
I am fairly new to this also. I think I would contact the Russel about his
analysis spark-connector
potentially making a change to the way dates are handled could break a lot of
existing apps. I think the key is to figure how to come up with a solution that
is backwards compatible.
I have filed several bugs in the past but only after discussion on the users
email group. I would suggest before you do a lot of work you see what the user
group thinks
many thanks for taking this on
Andy
> sql time stamps do not respect time zones
> -----------------------------------------
>
> Key: SPARK-14057
> URL: https://issues.apache.org/jira/browse/SPARK-14057
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.6.0
> Reporter: Andrew Davidson
> Priority: Minor
>
> we have time stamp data. The time stamp data is UTC how ever when we load the
> data into spark data frames, the system assume the time stamps are in the
> local time zone. This causes problems for our data scientists. Often they
> pull data from our data center into their local macs. The data centers run
> UTC. There computers are typically in PST or EST.
> It is possible to hack around this problem
> This cause a lot of errors in their analysis
> A complete description of this issue can be found in the following mail msg
> https://www.mail-archive.com/user@spark.apache.org/msg48121.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
