Hello, Alexey.

> But the
> compatibility with Spark 2.3 will be broken, isn't it?

Yes.

> Do you have any
> plans to support the different version of Spark without loosing your unique
> expertise in Spark-Ignite integration?

What do you mean by "my unique expertise"? :)

How do you see support of several Spark version?


В Ср, 28/08/2019 в 14:29 +0300, Alexey Zinoviev пишет:
> Dear Nikolay Izhikov
> Are you going to update the Ignite-Spark integration for Spark 2.4. But the
> compatibility with Spark 2.3 will be broken, isn't it? Do you have any
> plans to support the different version of Spark without loosing your unique
> expertise in Spark-Ignite integration?
> 
> чт, 15 авг. 2019 г. в 14:54, Nikolay Izhikov <nizhi...@apache.org>:
> 
> > Hello, Igniters.
> > 
> > I try to upgrade Spark version but failed.
> > 
> > Seems, internal Spark API(External Catalog, SQL planner) that we use
> > changed a lot.
> > So it will take some time to upgrade version.
> > 
> > For now, I work hard to complete the second phase of IEP-35 so I postpone
> > upgrade Spark version to Ignite 2.8.
> > 
> > В Чт, 15/08/2019 в 14:51 +0300, Dmitriy Pavlov пишет:
> > > Hi Denis,
> > > 
> > > Sure, since code freeze is planned for today, I don't mind to include
> > 
> > this
> > > bug.
> > > 
> > > Ivan, could you complete this issue by 20 August?
> > > 
> > > BTW #1, Dmitriy Govoruchnin, please reply about commit for
> > > https://issues.apache.org/jira/browse/IGNITE-11953?src=confmacro
> > > 
> > > BTW #2, FYI, release page is now available here
> > > https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.7.6
> > > 
> > > BTW #3, FYI, release related test PR is here
> > > https://github.com/apache/ignite/pull/6775 and it's TC Bot report is
> > 
> > here:
> > > 
> > 
> > https://mtcga.gridgain.com/pr.html?serverId=apache&suiteId=IgniteTests24Java8_RunAll&branchForTc=ignite-2.7.6&action=Latest&baseBranchForTc=ignite-2.7.6
> > > 
> > > 
> > > чт, 15 авг. 2019 г. в 13:55, Denis Magda <dma...@apache.org>:
> > > 
> > > > An Ignite user just reported a silly issue that needs to be fixed in
> > 
> > 2.7.6:
> > > > https://issues.apache.org/jira/browse/IGNITE-12068
> > > > 
> > > > More details and context:
> > > > 
> > > > 
> > 
> > https://stackoverflow.com/questions/57479636/simple-select-query-missing-rows-in-ignite
> > > > 
> > > > Ivan, please help us to make it to the release.
> > > > 
> > > > -
> > > > Denis
> > > > 
> > > > 
> > > > On Tue, Aug 13, 2019 at 6:47 AM Denis Magda <dma...@apache.org> wrote:
> > > > 
> > > > > IGNITE-12507 (Persistence files are stored to temp dir) has
> > 
> > definitely be
> > > > > added the scope and treated one of the main release drivers.
> > > > > 
> > > > > Dmitry, please let us know once the release wiki page is ready so
> > 
> > that we
> > > > > can finalize the timelines based on chosen scope.
> > > > > 
> > > > > -
> > > > > Denis
> > > > > 
> > > > > 
> > > > > On Mon, Aug 12, 2019 at 7:12 PM Dmitriy Pavlov <dpav...@apache.org>
> > > > 
> > > > wrote:
> > > > > 
> > > > > > Hi,
> > > > > > 
> > > > > > Thanks to everyone, who participated in the discussion.
> > > > > > 
> > > > > > I would like to wait also fix for
> > > > > > https://issues.apache.org/jira/browse/IGNITE-12057
> > > > > > 
> > > > > > and discussion results for that issue:
> > > > > > 
> > > > > > 
> > > > 
> > > > 
> > 
> > https://lists.apache.org/thread.html/498a14b3971950a45ef57f45cc23d2438ce1afba000b586e230927bf@%3Cdev.ignite.apache.org%3E
> > > > > > 
> > > > > > 
> > > > > > Since some issues are still open, we'll probably move some dates
> > > > 
> > > > forward,
> > > > > > but it seems we managed to discuss scope before scope freeze.
> > > > > > 
> > > > > > I consider now the scope is frozen - no new feature can be added
> > 
> > to the
> > > > > > scope of 2.7.6. We're entering the rampdown phase.
> > > > > > 
> > > > > > Sincerely,
> > > > > > Dmitriy Pavlov
> > > > > > 
> > > > > > See
> > 
> > https://cwiki.apache.org/confluence/display/IGNITE/Release+Process
> > > > > > for
> > > > > > more details.
> > > > > > 
> > > > > > пн, 12 авг. 2019 г. в 16:37, Zhenya Stanilovsky
> > > > > > <arzamas...@mail.ru.invalid
> > > > > > > :
> > > > > > > Hi al,, i also suggest to append [1], cause it could produce
> > > > > > > CorruptedTreeException in some scenario.
> > > > > > > 
> > > > > > > 
> > > > > > > [1] https://issues.apache.org/jira/browse/IGNITE-12061
> > > > > > > 
> > > > > > > > 
> > > > > > > > 
> > > > > > > > Hi all,
> > > > > > > > Can we include
> > 
> > https://issues.apache.org/jira/browse/IGNITE-12060 ?
> > > > > > > 
> > > > > > > This is
> > > > > > > > a  https://issues.apache.org/jira/browse/IGNITE-11953
> > > > > > > > 
> > > > > > > > On Fri, Aug 9, 2019 at 10:04 AM Nikolay Izhikov <
> > > > 
> > > > nizhi...@apache.org
> > > > > > > 
> > > > > > > wrote:
> > > > > > > > 
> > > > > > > > > Hello, Deni.
> > > > > > > > > 
> > > > > > > > > > Nickolay, could you check if that's a quick upgrade?
> > > > > > > > > 
> > > > > > > > > Yes, I will take a look.
> > > > > > > > > 
> > > > > > > > > 
> > > > > > > > > В Чт, 08/08/2019 в 11:08 -0700, Denis Magda пишет:
> > > > > > > > > > Dmitry,
> > > > > > > > > > 
> > > > > > > > > > Please add this BTree corruption fix to the scope:
> > > > > > > > > >  https://issues.apache.org/jira/browse/IGNITE-11953
> > > > > > > > > > 
> > > > > > > > > > Plus, I would upgrade our Spark integration to version 2.4
> > 
> > as
> > > > 
> > > > long
> > > > > > as
> > > > > > > 2.3
> > > > > > > > > > goes with limitations reported by our users:
> > > > > > > > > >  https://issues.apache.org/jira/browse/IGNITE-12054
> > > > > > > > > > 
> > > > > > > > > > Nickolay, could you check if that's a quick upgrade?
> > > > > > > > > > 
> > > > > > > > > > -
> > > > > > > > > > Denis
> > > > > > > > > > 
> > > > > > > > > > 
> > > > > > > > > > On Thu, Aug 8, 2019 at 10:40 AM Dmitriy Pavlov <
> > > > > > 
> > > > > > dpav...@apache.org >
> > > > > > > > > wrote:
> > > > > > > > > > 
> > > > > > > > > > > Hi Ivan, Ilya, Igniters,
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > I would like this release would be as minimal as
> > 
> > possible.
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > According to dates proposed we could freeze scope at
> > 
> > 12.08, 4
> > > > > > 
> > > > > > days
> > > > > > > is
> > > > > > > > > more
> > > > > > > > > > > than enough to stand up and say, ‘Hey, I have an urgent
> > 
> > fix’.
> > > > 
> > > > But
> > > > > > > it is
> > > > > > > > > > > also ok for me if we decide to have more relaxed dates.
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > For now, I suppose the following fixed should be
> > 
> > cherry-picked:
> > > > > > > > > > > 
> > > > > > > > > > >  https://issues.apache.org/jira/browse/IGNITE-11767
> > 
> > (Blocker)
> > > > > > > > > > > GridDhtPartitionsFullMessage retains huge maps on heap in
> > > > > > 
> > > > > > exchange
> > > > > > > > > history
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > >  https://issues.apache.org/jira/browse/IGNITE-10451
> > 
> > (Major
> > > > 
> > > > Bug)
> > > > > > > .NET:
> > > > > > > > > > > Persistence does not work with custom affinity function
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > >  https://issues.apache.org/jira/browse/IGNITE-9562
> > 
> > (Critical
> > > > > > 
> > > > > > Bug)
> > > > > > > > > Destroyed
> > > > > > > > > > > cache that resurrected on an old offline node breaks PME
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > But I will continue to research JIRA.
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > Sincerely,
> > > > > > > > > > > 
> > > > > > > > > > > Dmitriy Pavlov
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > чт, 8 авг. 2019 г. в 17:30, Павлухин Иван <
> > > > 
> > > > vololo...@gmail.com
> > > > > > > :
> > > > > > > > > > > 
> > > > > > > > > > > > > What's the scope for this release?
> > > > > > > > > > > > 
> > > > > > > > > > > > Same question.
> > > > > > > > > > > > 
> > > > > > > > > > > > On the other hand an idea of 2.7.6 release attracts me
> > > > 
> > > > because
> > > > > > > having
> > > > > > > > > > > > a practice of doing frequent minor releases can help
> > 
> > us to
> > > > > > 
> > > > > > build
> > > > > > > > > > > > reliable and predictable release rails.
> > > > > > > > > > > > 
> > > > > > > > > > > > чт, 8 авг. 2019 г. в 15:09, Ilya Kasnacheev <
> > > > > > > > > 
> > > > > > > > >  ilya.kasnach...@gmail.com >:
> > > > > > > > > > > > > 
> > > > > > > > > > > > > Hello!
> > > > > > > > > > > > > 
> > > > > > > > > > > > > What's the scope for this release?
> > > > > > > > > > > > > 
> > > > > > > > > > > > > Regards,
> > > > > > > > > > > > > --
> > > > > > > > > > > > > Ilya Kasnacheev
> > > > > > > > > > > > > 
> > > > > > > > > > > > > 
> > > > > > > > > > > > > чт, 8 авг. 2019 г. в 15:07, Dmitriy Pavlov <
> > > > > > 
> > > > > > dpav...@apache.org
> > > > > > > > :
> > > > > > > > > > > > > 
> > > > > > > > > > > > > > Hi Apache Ignite Developers,
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > We seem to be on the same page about 2.8 release,
> > 
> > but
> > > > 
> > > > we’ve
> > > > > > > > > started
> > > > > > > > > > > 
> > > > > > > > > > > new
> > > > > > > > > > > > > > practice - minor releases, the first release was
> > 
> > 2.7.5.
> > > > > > > > > > > 
> > > > > > > > > > > Unfortunately,
> > > > > > > > > > > > > > there is a couple of issues still not fixed in that
> > > > > > 
> > > > > > release,
> > > > > > > so I
> > > > > > > > > > > 
> > > > > > > > > > > would
> > > > > > > > > > > > > > like to propose to prepare one more minor release
> > 
> > for
> > > > > > 
> > > > > > Apache
> > > > > > > > > Ignite.
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > I propose my candidacy to be release manager once
> > 
> > again.
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > I could (of course with help from Peter Ivanov) do
> > 
> > some
> > > > > > > > > 
> > > > > > > > > additional
> > > > > > > > > > > > 
> > > > > > > > > > > > efforts
> > > > > > > > > > > > > > to complete and improve process doc
> > > > > > > > > > > > > > 
> > > > 
> > > > https://cwiki.apache.org/confluence/display/IGNITE/Release+Process
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > I propose (most optimistic) dates for release
> > 
> > stages:
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > Scope Freeze: August 12, 2019
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > Code Freeze: August 15, 2019
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > Voting Date: August 22, 2019
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > Release Date: August 27, 2019
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > WDYT?
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > If nobody minds, I will create branch 2.7.6 based
> > 
> > on
> > > > 
> > > > 2.7.5
> > > > > > and
> > > > > > > > > set up
> > > > > > > > > > > > 
> > > > > > > > > > > > in
> > > > > > > > > > > > > > the TC Bot during the weekend.
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > Sincerely,
> > > > > > > > > > > > > > 
> > > > > > > > > > > > > > Dmitriy Pavlov
> > > > > > > > > > > > > > 
> > > > > > > > > > > > 
> > > > > > > > > > > > 
> > > > > > > > > > > > 
> > > > > > > > > > > > --
> > > > > > > > > > > > Best regards,
> > > > > > > > > > > > Ivan Pavlukhin
> > > > > > > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > > --
> > > > > > > Zhenya Stanilovsky
> > > > > > > 

Attachment: signature.asc
Description: This is a digitally signed message part

Reply via email to