Re: Date / time stuff with spark.

2016-01-22 Thread Durgesh Verma
Option B is good too, have date as timestamp and format later. Thanks, -Durgesh > On Jan 22, 2016, at 9:50 AM, Spencer, Alex (Santander) > wrote: > > Hi Andy, > > Sorry this is in Scala but you may be able to do something similar? I use > Joda's

Re: Spark Cassandra clusters

2016-01-22 Thread Durgesh Verma
This may be useful, you can try connectors. https://academy.datastax.com/demos/getting-started-apache-spark-and-cassandra https://spark-summit.org/2015/events/cassandra-and-spark-optimizing-for-data-locality/ Thanks, -Durgesh > On Jan 22, 2016, at 8:37 PM, >

Re: NPE when using Joda DateTime

2016-01-14 Thread Durgesh Verma
Today is my day... Trying to go thru where I can pitch in. Let me know if below makes sense. I looked at joda Java Api source code (1.2.9) and traced that call in NPE. It looks like AssembledChronology class is being used, the iYears instance variable is defined as transient.