Hi Team,

I have to store data by department and region.
/dept=HR/region=AP
/dept=OPS/region=AP
/dept=HR/region=SA
/dept=OPS/region=SA

so partitioned table created will have multi-keys


I tried passing value as comma separated(dept,region)
.option(DataSourceWriteOptions.PARTITIONPATH_FIELD_OPT_KEY,"dept,region")

and dot separated,
.option(DataSourceWriteOptions.PARTITIONPATH_FIELD_OPT_KEY,"dept.region")

but the partitions were not created in hdfs.All the data added to default
partition.


Could you guide in format of passing the multi-partitions to spark write
hudi dataset.

regards
Satish S

Reply via email to