I have the same question with yours On Thu, Sep 5, 2019 at 9:18 PM Shyam P <shyamabigd...@gmail.com> wrote:
> Hi, > > I am using spark-sql-2.4.1v to streaming in my PoC. > > how to refresh the loaded dataframe from hdfs/cassandra table every time > new batch of stream processed ? What is the practice followed in general to > handle this kind of scenario? > > Below is the SOF link for more details . > > > https://stackoverflow.com/questions/57815645/how-to-refresh-the-contents-of-non-streaming-dataframe > > Thank you, > Shyam > >
