structured streaming- checkpoint metadata growing indefinetely

2022-04-28 Thread Wojciech Indyk
Hello! I use spark struture streaming. I need to use s3 for storing checkpoint metadata (I know, it's not optimal storage for checkpoint metadata). Compaction interval is 10 (default) and I set "spark.sql.streaming.minBatchesToRetain"=5. When the job was running for a few weeks then checkpointing

Unsubscribe

2022-04-28 Thread Sahil Bali
Unsubscribe

Re: Unsubscribe

2022-04-28 Thread wilson
please send the message to user-unsubscr...@spark.apache.org to unsubscribe. Ajay Thompson wrote: Unsubscribe - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

2022-04-28 Thread Ajay Thompson
Unsubscribe

Re: Reg: CVE-2020-9480

2022-04-28 Thread Sean Owen
It is not a real dependency, so should not be any issue. I am not sure why your tool flags it at all. On Thu, Apr 28, 2022 at 10:04 PM Sundar Sabapathi Meenakshi < sun...@mcruncher.com> wrote: > Hi all, > > I am using spark-sql_2.12 dependency version 3.2.1 in my > project. My

Reg: CVE-2020-9480

2022-04-28 Thread Sundar Sabapathi Meenakshi
Hi all, I am using spark-sql_2.12 dependency version 3.2.1 in my project. My dependency tracker highlights the transitive dependency "unused" from spark-sql_2.12 as vulnerable. I check there is no update for these artifacts since 2014. Is the artifact used anywhere in spark ? To

unsubscribe

2022-04-28 Thread Deepak Gajare
unsubscribe