Re: Contributions and help needed in SPARK-40005

2022-08-30 Thread Khalid Mammadov
Will do, thanks! On Wed, 31 Aug 2022, 01:14 Hyukjin Kwon, wrote: > Oh, that's a mistake. please just go ahead and reuse that JIRA :-). > You can just create a PR with reusing the same JIRA ID for functions.py > > On Wed, 31 Aug 2022 at 01:18, Khalid Mammadov > wrote: > >> Hi @Hyukjin Kwon >>

Re: Contributions and help needed in SPARK-40005

2022-08-30 Thread Hyukjin Kwon
Oh, that's a mistake. please just go ahead and reuse that JIRA :-). You can just create a PR with reusing the same JIRA ID for functions.py On Wed, 31 Aug 2022 at 01:18, Khalid Mammadov wrote: > Hi @Hyukjin Kwon > > I see you have resolved the JIRA and I got some more things to do in >

Re: Contributions and help needed in SPARK-40005

2022-08-30 Thread Khalid Mammadov
Hi @Hyukjin Kwon I see you have resolved the JIRA and I got some more things to do in functions.py (only done 50%). So shall I create a new JIRA for each new PR or ok to reuse this one? On Fri, 19 Aug 2022, 09:29 Khalid Mammadov, wrote: > Will do, thanks! > > On Fri, 19 Aug 2022, 09:11

[Structured Streaming + Kafka] Reduced support for alternative offset management

2022-08-30 Thread Martin Andersson
I was looking around for some documentation regarding how checkpointing (or rather, delivery semantics) is done when consuming from kafka with structured streaming and I stumbled across this old documentation (that still somehow exists in latest versions) at