Support of CSV to AVRO Converter in DataStream FileSource

2023-04-14 Thread Kirti Dhar Upadhyay K via user
Hi Community,

I am reading CSV data using data stream file source connector and need to 
convert them into AVRO generated specific objects.
I am using CsvReaderFormat with CSVSchema but this supports only primitive 
types of AVRO (that also except null and bytes).


Is there any support provided for AVRO complex and Logical types as well? As I 
can see few classes like CsvToRowDataConverters and RowDataToAvroConverter

but seems they are specific to Table APIs.



Regards,

Kirti Dhar



Re: Support of CSV to AVRO Converter in DataStream FileSource

2023-04-14 Thread Hang Ruan
Hi, Kirti,
I think you need a custom convertor for your csv files. The convertors
provided by Flink only define how to translate the data into a Flink type.

Best,
Hang

Kirti Dhar Upadhyay K via user  于2023年4月14日周五
15:27写道:

> Hi Community,
>
>
>
> I am reading CSV data using data stream file source connector and need to
> convert them into AVRO generated specific objects.
>
> I am using CsvReaderFormat with CSVSchema but this supports only primitive
> types of AVRO (that also except null and bytes).
>
>
>
> Is there any support provided for AVRO complex and Logical types as well? As 
> I can see few classes like CsvToRowDataConverters and RowDataToAvroConverter
>
> but seems they are specific to Table APIs.
>
>
>
> Regards,
>
> Kirti Dhar
>
>
>