If you have space for a message log like, then you should try: MySQL -> Kafka (via CDC) -> Spark (Structured Streaming) -> HDFS/S3/ADLS -> Hive
On Wed, Aug 17, 2022 at 5:40 PM Akash Vellukai <akashvellukai...@gmail.com> wrote: > Dear sir > > I have tried a lot on this could you help me with this? > > Data ingestion from MySql to Hive with spark- streaming? > > Could you give me an overview. > > > Thanks and regards > Akash P >
