This might be a hint. Maybe invalid data?
Caused by: java.lang.IllegalArgumentException: Missing required char
':' at 'struct>'
On Wed., 24 Jul. 2019, 2:15 pm Balakumar iyer S,
wrote:
> Hi Bobby Evans,
>
> I apologise for the delayed response , yes you are right I missed out to
> paste the
Hi Bobby Evans,
I apologise for the delayed response , yes you are right I missed out to
paste the complete stack trace exception. Here with I have attached the
complete yarn log for the same.
Thank you , It would be helpful if you guys could assist me on this error.
You are missing a lot of the stack trace that could explain the exception.
All it shows is that an exception happened while writing out the orc file,
not what that underlying exception is, there should be at least one more
caused by under the one you included.
Thanks,
Bobby
On Mon, Jul 22, 2019
Hi ,
I am trying to perform a group by followed by aggregate collect set
operation on a two column data-setschema (LeftData int , RightData
int).
code snippet
val wind_2 =
dframe.groupBy("LeftData").agg(collect_set(array("RightData")))
