We only serialize things that are in the constructor. You would have
access to it in the typed API (df.map(_.day)). I'd suggest making a
factory method that fills these in and put them in the constructor if you
need to get to it from other dataframe operations.
On Tue, Feb 28, 2017 at 12:03 PM,
In the following example, the "day" value is in the case class, but I cannot
get that in the Spark dataset, which I would like to use at runtime? Any idea?
Do I have to force it to be present in the case class constructor? I like to
derive it out automatically and used in the dataset or
