t; > > > >> > > tools for that out there.
> > > > > >> > > - the config management can get bit hard to understand,
> since
> > we
> > > > > >> overload
> > > > > >> > > ingest and reverse ETL into a single tool. So break it
gt;> > >
> > > > >> > > Thoughts?
> > > > >> > >
> > > > >> > > David: PMC does not have control over that. Please see
> > > unsubscribe
> > > > >> > > instructions he
gt; level?
> > > >> > >
> > > >> > > Thoughts?
> > > >> > >
> > > >> > > David: PMC does not have control over that. Please see
> > unsubscribe
> > > >> > > instru
avid: PMC does not have control over that. Please see
> unsubscribe
> > >> > > instructions here. https://hudi.apache.org/community/get-involved
> > >> > > Love to keep this thread about reverse streamer discussion. So
> > kindly
> > >> > fork
> > >> > >
discussion. So
> kindly
> >> > fork
> >> > > another thread if you want to discuss unsubscribing.
> >> > >
> >> > > On Fri, Mar 31, 2023 at 1:47 AM Davidiam
> >> > wrote:
> >> > >
> >> > > > Hell
31, 2023 at 1:47 AM Davidiam
>> > wrote:
>> > >
>> > > > Hello Vinoth,
>> > > >
>> > > > Can you please unsubscribe me? I have been trying to unsubscribe for
>> > > > months without success.
>>
you please unsubscribe me? I have been trying to unsubscribe for
> > > > months without success.
> > > >
> > > > Kind Regards,
> > > > David
> > > >
> > > > Sent from Outlook for Android<https://aka.ms/AAb9ysg>
> > > >
thout success.
> > >
> > > Kind Regards,
> > > David
> > >
> > > Sent from Outlook for Android<https://aka.ms/AAb9ysg>
> > >
> > > From: Vinoth Chandar
> > > Sent: Friday, March 31, 2023 5
cess.
> >
> > Kind Regards,
> > David
> >
> > Sent from Outlook for Android<https://aka.ms/AAb9ysg>
> > ________
> > From: Vinoth Chandar
> > Sent: Friday, March 31, 2023 5:09:52 AM
> > To: dev
>
without success.
>
> Kind Regards,
> David
>
> Sent from Outlook for Android<https://aka.ms/AAb9ysg>
>
> From: Vinoth Chandar
> Sent: Friday, March 31, 2023 5:09:52 AM
> To: dev
> Subject: [DISCUSS] Hudi Reverse Streamer
>
> Hi a
ubject: [DISCUSS] Hudi Reverse Streamer
Hi all,
Any interest in building a reverse streaming tool, that does the reverse of
what the DeltaStreamer tool does? It will read Hudi table incrementally
(only source) and write out the data to a variety of sinks - Kafka, JDBC
Databases, DFS.
This has c
+1 to this.
I can help drive some of this work.
On Fri, Mar 31, 2023 at 10:09 AM Prashant Wason
wrote:
> Could be useful. Also, may be useful for backup / replication scenario
> (keeping a copy of data in alternate/cloud DC).
>
> HoodieDeltaStreamer already has the concept of "sources". This
Could be useful. Also, may be useful for backup / replication scenario
(keeping a copy of data in alternate/cloud DC).
HoodieDeltaStreamer already has the concept of "sources". This can be
implemented as a "sink" concept.
On Thu, Mar 30, 2023 at 8:12 PM Vinoth Chandar wrote:
> Essentially.
>
>
Essentially.
Old architecture :(operational database) ==> some tool ==> (data
warehouse raw data) ==> SQL ETL ==> (data warehouse derived data)
New architecture : (operational database) ==> Hudi delta Streamer ==> (Hudi
raw data) ==> Spark/Flink Hudi ETL ==> (Hudi derived data) ==> Hudi
Hi all,
Any interest in building a reverse streaming tool, that does the reverse of
what the DeltaStreamer tool does? It will read Hudi table incrementally
(only source) and write out the data to a variety of sinks - Kafka, JDBC
Databases, DFS.
This has come up many times with data warehouse
15 matches
Mail list logo
