Hi Harish, On 20 Jul 2015, at 20:37, Harish Butani <rhbutani.sp...@gmail.com> wrote:
> Hey Jan, > > Can you provide more details on the serialization and cache issues. My symptom is that I have a Joda DateTime on which I can call toString and getMillis without problems, but when I call getYear I get a NPE out of the internal AbstractDateTime. Totally strange but seems to align with issues others have. I am now changing the app to work with millis internally, as that seems to be a performance improvement regarding serialization anyhow. Thanks, Jan > > If you are looking for datetime functionality with spark-sql please consider: > https://github.com/SparklineData/spark-datetime It provides a simple way to > combine joda datetime expressions with spark sql. > > regards, > Harish. > > On Mon, Jul 20, 2015 at 7:37 AM, algermissen1971 <algermissen1...@icloud.com> > wrote: > Hi, > > I am having trouble with Joda Time in a Spark application and saw by now that > I am not the only one (generally seems to have to do with serialization and > internal caches of the Joda Time objects). > > Is there a known best practice to work around these issues? > > Jan > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
