Hi All,

I tried to use Datasource Writer to read streaming data from Kafka topic and 
write to Hudi dataset on HDFS.  I used following codes:

val output = data
   .writeStream
   .trigger(Trigger.ProcessingTime("300 seconds"))
   .format("org.apache.hudi")
   .option("hoodie.table.name", "hudi_ro_table")
   .outputMode("append")
   .option("path", fileLocation)
   .option("checkpointLocation", s"${fileLocation}_chpk")
   .start()
However, when I run this spark job it cannot write anything onto HDFS. Can 
anyone tell me how to do that? Thanks.

Best,
Eric

Reply via email to