Hi all,

I am writing to a parquet file using Impala version 3.4.0 and try to read
same parquet file from Spark 3.3.0 to a DataFrame.

var df = spark.read.parquet(parquet_file_name)

But when I show the DataFrame it has some encoded values for string data
type as below.

For string "TAX" it shows [54 41 58]
For string "LAPTOP" it shows [4C 41 50 54 4F 50]

But when read that same parquet file from impala it has no issues.

Can anyone suggest me a method to overcome this problem?

Thank you,
Best regards,
Nipuna Shantha

Reply via email to