Hi all, I am writing to a parquet file using Impala version 3.4.0 and try to read same parquet file from Spark 3.3.0 to a DataFrame.
var df = spark.read.parquet(parquet_file_name) But when I show the DataFrame it has some encoded values for string data type as below. For string "TAX" it shows [54 41 58] For string "LAPTOP" it shows [4C 41 50 54 4F 50] But when read that same parquet file from impala it has no issues. Can anyone suggest me a method to overcome this problem? Thank you, Best regards, Nipuna Shantha