On 5/22/15, 1:26 PM, "Michael Howard" <mhow...@podiumdata.com> wrote:
>I would like to have a discussion about a number of issues/questions >related to support for the datetime datatype in pig. > >main topics: > > * ToDate(chararray) accepts ISO-8601 'T' timestamps, but not JDBC space ' >' timestamps ... thereby make it incompatible with hive, impala & JDBC >data >sources ... I am familiar with >https://issues.apache.org/jira/browse/PIG-1430 ToDate use org.joda.time.format.ISODateTimeFormat to parse date string. I am open to change as long as it does not break backward compatibility. Any suggestion? > >* casting: (datetime)timestampString fails, even though datetime is listed >as a primitive data type. This can be fixed, can you open a Jira? > >* ToDate(chararray) throws an exception (rather than returning null) when >given a mal-formed timestamp ... is this the desired behavior? Probably return a null is better, but we cannot break backward compatibility. We can create a new UDF to return null. > >It is unclear to me if this is the appropriate forum for a discussion of >these topics ... or if this should happen in the context of a JIRA ... or >if I should have a side-discussion with an experienced core pig developer. > >Please advise. > > >Michael