Hi all, I have a parquet file, which I am loading in a shell. When I launch the shell with -driver-java-options ="-Dspark.serializer=...kryo", makes a couple fields look like:
03-?????? ??????-?? ??-??????? when calling > data.first I will confirm briefly, but I am utterly sure it happens only on StringType fields. Why could this be happening? perhaps when creating the parquet file from spark, Kryo wasn't set up? If I disable Kryo, data looks good. Any ideas? Saif