Alexey, Thank you for sharing the summary!
Small question. How are you going to integrations with different Spark versions? чт, 17 окт. 2019 г. в 22:30, Denis Magda <dma...@apache.org>: > > > > > 1. We are going to release Apache Ignite 2.8 with limited support of > > Spark 2.4.4 (known issues are listed here > > https://issues.apache.org/jira/browse/IGNITE-12054) > > > What does limited support mean? Is it about regressions (something that > worked before but will fail) or capabilities unsupported even for the > presently released version of the integration? > > - > Denis > > > On Thu, Oct 17, 2019 at 7:55 AM Alexey Zinoviev <zaleslaw....@gmail.com> > wrote: > > > The meeting notes and results of discussion are next: > > > > 1. We are going to release Apache Ignite 2.8 with limited support of > > Spark 2.4.4 (known issues are listed here > > https://issues.apache.org/jira/browse/IGNITE-12054) > > 2. The AI 2.8 will support both, Spark 2.3 and Spark 2.4.4 with known > > fixed bugs > > 3. We will create the developer-profiles spark_2_3 and spark_2_4 > > separately from current scala profile > > 4. We are ready to move the Ignite-Spark integration to the separate > > module after release 2.8 with support of most actual Spark versions and > > with independent release cycle > > 5. We will work together on the next release roadmap with Nikolay and > > all interested igniters to improve the current solution (add new > > features > > as thin client support, working with caches via binary object and so on) > > 6. Nikolay is ready to help with the review of tickets as an author of > > this component > > > > Thanks > > > > > > > > пн, 14 окт. 2019 г. в 14:36, Alexey Zinoviev <zaleslaw....@gmail.com>: > > > > > Yes, let's use the Russian for short discussion, the meeting notes will > > be > > > presented in English > > > > > > пн, 14 окт. 2019 г. в 14:08, Nikolay Izhikov <nizhi...@apache.org>: > > > > > >> Hello, Alexey. > > >> > > >> I'm ready to take part in the meeting. > > >> It will be in Russian, isn't it? > > >> > > >> В Пн, 14/10/2019 в 14:00 +0300, Alexey Zinoviev пишет: > > >> > Hi, Igniters, and especially Nikolay Izhikov > > >> > > > >> > I suggest to arrange the meeting via ASF-slack in > > >> #ignite-spark-integration > > >> > channel at 17 October, in 16 MSK Time. > > >> > The language of the meeting: Russian > > >> > > > >> > *The topics to discuss:* > > >> > > > >> > - Review of next tickets > > >> > > > >> > > > >> > 1. [Spark][Bug] IgniteSpark integration forget to close the > > >> > IgniteContext and stops the client node in case if error during > > >> > PairFunction logic > > >> > <https://issues.apache.org/jira/browse/IGNITE-11724> > > >> > 2. [Spark] Add initial support of Spark 2.4 > > >> > <https://issues.apache.org/jira/browse/IGNITE-12247> > > >> > 3. [Spark] Add joins to Spark Dataframe examples > > >> > <https://issues.apache.org/jira/browse/IGNITE-9732> > > >> > > > >> > > > >> > - Known issues of migration to 2.4 version > > >> > - Organization of multiple version support for Apache Spark > > >> > > > >> > P.S. meeting notes will be shared with the community > > >> > P.P.S Nikolay, if you have any objections about the time or topics, > > >> please > > >> > let me know > > >> > > > > > -- Best regards, Ivan Pavlukhin
