Re: SPIP architecture diagrams

2023-03-04 Thread Mich Talebzadeh
ok I decided to bite the bullet and use a Visio diagram for my SPIP "Shutting down spark structured streaming when the streaming process completed the current process". Details from here https://issues.apache.org/jira/browse/SPARK-42485 This is not meant to be complete. In this an indication. I

Re: SPIP architecture diagrams

2023-02-24 Thread Mich Talebzadeh
Sounds like I have to decide for myself what to use. A correction Vision should read* Visio * ideally the SPIP guide https://spark.apache.org/improvement-proposals.html should include this topic. Additionally there should be a repository for the original diagrams as well. From the said guide: