RE: Encoded data retrieved when reading Parquet file

2022-10-19 Thread Nipuna Shantha
Solved this issue. Thank You On 2022/10/19 05:26:51 Nipuna Shantha wrote:> Hi all,> > I am writing to a parquet file using Impala version 3.4.0 and try to read> same parquet file from Spark 3.3.0 to a DataFrame.> > var df = spark.read.parquet(parquet_file_name)> > But when I show the DataFrame it has some encoded values for string data> type as below.> > For string "TAX" it shows [54 41 58]> For string "LAPTOP" it shows [4C 41 50 54 4F 50]> > But when read that same parquet file from impala it has no issues.> > Can anyone suggest me a method to overcome this problem?> > Thank you,> Best regards,> Nipuna Shantha> Sent from Mail for Windows Virus-free.www.avast.com 

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org



Encoded data retrieved when reading Parquet file

2022-10-19 Thread Nipuna Shantha
Hi all,

I am writing to a parquet file using Impala version 3.4.0 and try to read
same parquet file from Spark 3.3.0 to a DataFrame.

var df = spark.read.parquet(parquet_file_name)

But when I show the DataFrame it has some encoded values for string data
type as below.

For string "TAX" it shows [54 41 58]
For string "LAPTOP" it shows [4C 41 50 54 4F 50]

But when read that same parquet file from impala it has no issues.

Can anyone suggest me a method to overcome this problem?

Thank you,
Best regards,
Nipuna Shantha