[
https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401081#comment-13401081
]
Russell Jurney commented on PIG-1314:
-------------------------------------
A couple comments:
1) Don't persist DateTimes as ints/longs unless you also persist a timezone
offset with it somehow (is this possible?). Persisting timezones is one of the
key benefits of a DateTime type in my opinion. At Hadoop scale you are often
dealing with events from different sites/locations. DateTime needs timezone, or
we can just use long/unix time.
2) Consider using jodatime/ISO8601 durations for date math, as a separate type.
i.e. If this extends scope too far, save it for later.
http://en.wikipedia.org/wiki/ISO_8601#Durations
Although it may be inefficient, I would encourage an ISO8601 string
representation during serialization.
> Add DateTime Support to Pig
> ---------------------------
>
> Key: PIG-1314
> URL: https://issues.apache.org/jira/browse/PIG-1314
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.7.0
> Reporter: Russell Jurney
> Assignee: Zhijie Shen
> Labels: gsoc2012
> Attachments: PIG-1314-1.patch, PIG-1314-2.patch, joda_vs_builtin.zip
>
> Original Estimate: 672h
> Remaining Estimate: 672h
>
> Hadoop/Pig are primarily used to parse log data, and most logs have a
> timestamp component. Therefore Pig should support dates as a primitive.
> Can someone familiar with adding types to pig comment on how hard this is?
> We're looking at doing this, rather than use UDFs. Is this a patch that
> would be accepted?
> This is a candidate project for Google summer of code 2012. More information
> about the program can be found at
> https://cwiki.apache.org/confluence/display/PIG/GSoc2012
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
