Hello! Is it possible to write pyspark UDF, generated data to streaming dataframe? I want to get some data from REST API requests in real time and consider to save this data to dataframe. And then put it to Kafka. I can't realise how to create streaming dataframe from generated data.
I am new in spark streaming. Could you give me some hints? Best regards, Stanislav Porotikov
