,
Wojciech Indyk
sob., 30 kwi 2022 o 12:35 Wojciech Indyk
napisał(a):
> Hi Gourav!
> I use stateless processing, no watermarking, no aggregations.
> I don't want any data loss, so changing checkpoint location is not an
> option to me.
>
> --
> Kind regards/ Pozdrawiam,
> Wojciech
Hi Gourav!
I use stateless processing, no watermarking, no aggregations.
I don't want any data loss, so changing checkpoint location is not an
option to me.
--
Kind regards/ Pozdrawiam,
Wojciech Indyk
pt., 29 kwi 2022 o 11:07 Gourav Sengupta
napisał(a):
> Hi,
>
> this may
Update for the scenario of deleting compact files: it recovers from the
recent (not compacted) checkpoint file, but when it comes to compaction of
checkpoint then it fails with missing recent compaction file. I use Spark
3.1.2
--
Kind regards/ Pozdrawiam,
Wojciech Indyk
pt., 29 kwi 2022 o 07:00
s like possible
workaround of my problem, but this scenario with manual delete of
checkpoint files looks ugly, so I would prefer something managed by Spark.
--
Kind regards/ Pozdrawiam,
Wojciech Indyk
opinion at first. The same
for quickstart:
http://spark.apache.org/docs/latest/quick-start.html#self-contained-applications
--
Kind regards/ Pozdrawiam,
Wojciech Indyk
tiating session
> 16/02/29 23:09:34 INFO ClientCnxn: Session establishment complete on
> server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x3532fb70ba20035,
Maybe there is a problem with using RPC call to regions using IPv6
(but I just guess).
--
Kind regards/ Pozdrawiam,
Wojciech Indyk
