Re: [DISCUSS] Pub/Sub Streamer Implementation

2019-11-30 Thread Emmanouil Gkatziouras
Hi Saikat!

Thank you for your assistance on that!

Kind regards

*Emmanouil Gkatziouras*
https://egkatzioura.com/ | https://www.linkedin.com/in/gkatziourasemmanouil/
https://github.com/gkatzioura


On Sat, 30 Nov 2019 at 23:51, Saikat Maitra  wrote:

> Hi Emmanouil,
>
> I looked into the build logs and I observed that since I added artifacts
> dependencies to "Build apache Ignite"[1] it was able to pull the required
> dependencies and was able to run the existing tests. It is however not
> identifying new modules like I changed from flink to flink-ext or pub-sub.
>
> [1]
>
> https://ci.ignite.apache.org/admin/editDependencies.html?id=buildType:IgniteExtensions_Build
>
> I will look into the issue and debug further.
>
> Regards,
> Saikat
>
>
> On Sat, Nov 30, 2019 at 5:35 PM Emmanouil Gkatziouras <
> gkatzio...@gmail.com>
> wrote:
>
> > Hi Saikat!
> >
> > From the logs[1] it seems that TC cannot find the project. However I did
> > include the project on the parent pom (modules sections) [2]
> > I tried to reproduce locally unfortunately I am not aware of the full
> > context on TC. It seems as if a different parent pom is being picked up.
> >
> > Kind regards
> >
> > [1]
> >
> >
> https://ci.ignite.apache.org/viewLog.html?buildId=4804893&buildTypeId=IgniteExtensions_Build&tab=buildLog&branch_IgniteExtensions=pull%2F2%2Fhead&_focus=1704
> > [2]
> >
> >
> https://github.com/gkatzioura/ignite-extensions/blob/d6a8beee7feff28f59d9a12be692016305564d25/pom.xml#L46
> >
> > *Emmanouil Gkatziouras*
> > https://egkatzioura.com/ |
> > https://www.linkedin.com/in/gkatziourasemmanouil/
> > https://github.com/gkatzioura
> >
> >
> > On Sat, 30 Nov 2019 at 22:20, Saikat Maitra 
> > wrote:
> >
> > > Hello,
> > >
> > > I have made changes in Ignite Extensions build configurations.
> > >
> > > It is now running the tests as expected.
> > >
> > >
> > >
> >
> https://ci.ignite.apache.org/viewLog.html?buildId=4804480&buildTypeId=IgniteExtensions_Build&tab=buildResultsDiv&branch_IgniteExtensions=pull%2F1%2Fhead
> > >
> > > Regards,
> > > Saikat
> > >
> > > On Thu, Nov 28, 2019 at 1:29 PM Saikat Maitra  >
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > We do run build with -DskipTests and then configure selective test
> > suites
> > > > to run.
> > > >
> > > > I will check why these test suites are not getting executed.
> > > >
> > > > Regards
> > > > Saikat
> > > >
> > > > On Wed, 27 Nov 2019 at 3:05 PM, Emmanouil Gkatziouras <
> > > > gkatzio...@gmail.com> wrote:
> > > >
> > > >> Hi all,
> > > >>
> > > >> I did add a test suite and run the build with the corresponding
> > > arguments,
> > > >> however the tests did not run [1].
> > > >> I checked the Flink's build logs and the same message is displayed
> > there
> > > >> too `No tests to run` [2].
> > > >>
> > > >> [1]
> > > >>
> > > >>
> > >
> >
> https://ci.ignite.apache.org/viewLog.html?buildId=4798203&buildTypeId=IgniteExtensions_Build&tab=buildLog&branch_IgniteExtensions=pull%2F2%2Fhead&_focus=248
> > > >> [2]
> > > >>
> > > >>
> > >
> >
> https://ci.ignite.apache.org/viewLog.html?buildTypeId=IgniteExtensions_Build&buildId=4789199&tab=buildLog&logTab=tree&filter=debug&expand=all&_focus=1256
> > > >>
> > > >> Kind regards
> > > >> *Emmanouil Gkatziouras*
> > > >> https://egkatzioura.com/ |
> > > >> https://www.linkedin.com/in/gkatziourasemmanouil/
> > > >> https://github.com/gkatzioura
> > > >>
> > > >>
> > > >> On Wed, 27 Nov 2019 at 18:58, Saikat Maitra <
> saikat.mai...@gmail.com>
> > > >> wrote:
> > > >>
> > > >> > Hi,
> > > >> >
> > > >> > We will need to add test suites for tests to be executed in build.
> > We
> > > >> pass
> > > >> > them as TestSuites param. I had added Flink sink and source
> > > testsuites.
> > > >> >
> > > >> > Can you please review and confirm.
> > > >> >
> > > >> > Regards
> > > >> > Saikat
> > > >> >
> > > >> > On Wed, 27 Nov 2019 at 6:00 AM, Emmanouil Gkatziouras <
> > > >> > gkatzio...@gmail.com>
> > > >> > wrote:
> > > >> >
> > > >> > > Hi all!
> > > >> > >
> > > >> > > I was successful building and running my pull requests. It seems
> > > that
> > > >> the
> > > >> > > tests do not run both for Flink and Pub/Sub [1]
> > > >> > > If there is something I cannot do to make them discoverable
> please
> > > >> let me
> > > >> > > know.
> > > >> > >
> > > >> > > [1]
> > > >> > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> https://ci.ignite.apache.org/viewLog.html?buildTypeId=IgniteExtensions_Build&buildId=4796722&tab=buildLog&logTab=tree&filter=debug&expand=all&_focus=283
> > > >> > >
> > > >> > > *Emmanouil Gkatziouras*
> > > >> > > https://egkatzioura.com/ |
> > > >> > > https://www.linkedin.com/in/gkatziourasemmanouil/
> > > >> > > https://github.com/gkatzioura
> > > >> > >
> > > >> > >
> > > >> > > On Wed, 27 Nov 2019 at 04:57, Saikat Maitra <
> > > saikat.mai...@gmail.com>
> > > >> > > wrote:
> > > >> > >
> > > >> > > > Hi Emmanouil,
> > > >> > > >
> > > >> > > > I have added you as contributor in Ignite Extensions project.
> > Can
> > > >>

Re: [DISCUSS] Pub/Sub Streamer Implementation

2019-11-30 Thread Saikat Maitra
Hi Emmanouil,

I looked into the build logs and I observed that since I added artifacts
dependencies to "Build apache Ignite"[1] it was able to pull the required
dependencies and was able to run the existing tests. It is however not
identifying new modules like I changed from flink to flink-ext or pub-sub.

[1]
https://ci.ignite.apache.org/admin/editDependencies.html?id=buildType:IgniteExtensions_Build

I will look into the issue and debug further.

Regards,
Saikat


On Sat, Nov 30, 2019 at 5:35 PM Emmanouil Gkatziouras 
wrote:

> Hi Saikat!
>
> From the logs[1] it seems that TC cannot find the project. However I did
> include the project on the parent pom (modules sections) [2]
> I tried to reproduce locally unfortunately I am not aware of the full
> context on TC. It seems as if a different parent pom is being picked up.
>
> Kind regards
>
> [1]
>
> https://ci.ignite.apache.org/viewLog.html?buildId=4804893&buildTypeId=IgniteExtensions_Build&tab=buildLog&branch_IgniteExtensions=pull%2F2%2Fhead&_focus=1704
> [2]
>
> https://github.com/gkatzioura/ignite-extensions/blob/d6a8beee7feff28f59d9a12be692016305564d25/pom.xml#L46
>
> *Emmanouil Gkatziouras*
> https://egkatzioura.com/ |
> https://www.linkedin.com/in/gkatziourasemmanouil/
> https://github.com/gkatzioura
>
>
> On Sat, 30 Nov 2019 at 22:20, Saikat Maitra 
> wrote:
>
> > Hello,
> >
> > I have made changes in Ignite Extensions build configurations.
> >
> > It is now running the tests as expected.
> >
> >
> >
> https://ci.ignite.apache.org/viewLog.html?buildId=4804480&buildTypeId=IgniteExtensions_Build&tab=buildResultsDiv&branch_IgniteExtensions=pull%2F1%2Fhead
> >
> > Regards,
> > Saikat
> >
> > On Thu, Nov 28, 2019 at 1:29 PM Saikat Maitra 
> > wrote:
> >
> > > Hi,
> > >
> > > We do run build with -DskipTests and then configure selective test
> suites
> > > to run.
> > >
> > > I will check why these test suites are not getting executed.
> > >
> > > Regards
> > > Saikat
> > >
> > > On Wed, 27 Nov 2019 at 3:05 PM, Emmanouil Gkatziouras <
> > > gkatzio...@gmail.com> wrote:
> > >
> > >> Hi all,
> > >>
> > >> I did add a test suite and run the build with the corresponding
> > arguments,
> > >> however the tests did not run [1].
> > >> I checked the Flink's build logs and the same message is displayed
> there
> > >> too `No tests to run` [2].
> > >>
> > >> [1]
> > >>
> > >>
> >
> https://ci.ignite.apache.org/viewLog.html?buildId=4798203&buildTypeId=IgniteExtensions_Build&tab=buildLog&branch_IgniteExtensions=pull%2F2%2Fhead&_focus=248
> > >> [2]
> > >>
> > >>
> >
> https://ci.ignite.apache.org/viewLog.html?buildTypeId=IgniteExtensions_Build&buildId=4789199&tab=buildLog&logTab=tree&filter=debug&expand=all&_focus=1256
> > >>
> > >> Kind regards
> > >> *Emmanouil Gkatziouras*
> > >> https://egkatzioura.com/ |
> > >> https://www.linkedin.com/in/gkatziourasemmanouil/
> > >> https://github.com/gkatzioura
> > >>
> > >>
> > >> On Wed, 27 Nov 2019 at 18:58, Saikat Maitra 
> > >> wrote:
> > >>
> > >> > Hi,
> > >> >
> > >> > We will need to add test suites for tests to be executed in build.
> We
> > >> pass
> > >> > them as TestSuites param. I had added Flink sink and source
> > testsuites.
> > >> >
> > >> > Can you please review and confirm.
> > >> >
> > >> > Regards
> > >> > Saikat
> > >> >
> > >> > On Wed, 27 Nov 2019 at 6:00 AM, Emmanouil Gkatziouras <
> > >> > gkatzio...@gmail.com>
> > >> > wrote:
> > >> >
> > >> > > Hi all!
> > >> > >
> > >> > > I was successful building and running my pull requests. It seems
> > that
> > >> the
> > >> > > tests do not run both for Flink and Pub/Sub [1]
> > >> > > If there is something I cannot do to make them discoverable please
> > >> let me
> > >> > > know.
> > >> > >
> > >> > > [1]
> > >> > >
> > >> > >
> > >> >
> > >>
> >
> https://ci.ignite.apache.org/viewLog.html?buildTypeId=IgniteExtensions_Build&buildId=4796722&tab=buildLog&logTab=tree&filter=debug&expand=all&_focus=283
> > >> > >
> > >> > > *Emmanouil Gkatziouras*
> > >> > > https://egkatzioura.com/ |
> > >> > > https://www.linkedin.com/in/gkatziourasemmanouil/
> > >> > > https://github.com/gkatzioura
> > >> > >
> > >> > >
> > >> > > On Wed, 27 Nov 2019 at 04:57, Saikat Maitra <
> > saikat.mai...@gmail.com>
> > >> > > wrote:
> > >> > >
> > >> > > > Hi Emmanouil,
> > >> > > >
> > >> > > > I have added you as contributor in Ignite Extensions project.
> Can
> > >> you
> > >> > > > please check and confirm if you are able to see the project and
> > >> execute
> > >> > > > build on your pull request.
> > >> > > >
> > >> > > > Regards,
> > >> > > > Saikat
> > >> > > >
> > >> > > > On Tue, Nov 26, 2019 at 12:49 PM Emmanouil Gkatziouras <
> > >> > > > gkatzio...@gmail.com>
> > >> > > > wrote:
> > >> > > >
> > >> > > > > Hi all!
> > >> > > > >
> > >> > > > > If someone could give me read access to the Job of Ignite
> > >> Extensions
> > >> > on
> > >> > > > > Team City will greatly help me (username gkatzioura).
> > >> > > > > I suppose the builds get triggered automatically on a p

Re: [DISCUSS] Pub/Sub Streamer Implementation

2019-11-30 Thread Emmanouil Gkatziouras
Hi Saikat!

>From the logs[1] it seems that TC cannot find the project. However I did
include the project on the parent pom (modules sections) [2]
I tried to reproduce locally unfortunately I am not aware of the full
context on TC. It seems as if a different parent pom is being picked up.

Kind regards

[1]
https://ci.ignite.apache.org/viewLog.html?buildId=4804893&buildTypeId=IgniteExtensions_Build&tab=buildLog&branch_IgniteExtensions=pull%2F2%2Fhead&_focus=1704
[2]
https://github.com/gkatzioura/ignite-extensions/blob/d6a8beee7feff28f59d9a12be692016305564d25/pom.xml#L46

*Emmanouil Gkatziouras*
https://egkatzioura.com/ | https://www.linkedin.com/in/gkatziourasemmanouil/
https://github.com/gkatzioura


On Sat, 30 Nov 2019 at 22:20, Saikat Maitra  wrote:

> Hello,
>
> I have made changes in Ignite Extensions build configurations.
>
> It is now running the tests as expected.
>
>
> https://ci.ignite.apache.org/viewLog.html?buildId=4804480&buildTypeId=IgniteExtensions_Build&tab=buildResultsDiv&branch_IgniteExtensions=pull%2F1%2Fhead
>
> Regards,
> Saikat
>
> On Thu, Nov 28, 2019 at 1:29 PM Saikat Maitra 
> wrote:
>
> > Hi,
> >
> > We do run build with -DskipTests and then configure selective test suites
> > to run.
> >
> > I will check why these test suites are not getting executed.
> >
> > Regards
> > Saikat
> >
> > On Wed, 27 Nov 2019 at 3:05 PM, Emmanouil Gkatziouras <
> > gkatzio...@gmail.com> wrote:
> >
> >> Hi all,
> >>
> >> I did add a test suite and run the build with the corresponding
> arguments,
> >> however the tests did not run [1].
> >> I checked the Flink's build logs and the same message is displayed there
> >> too `No tests to run` [2].
> >>
> >> [1]
> >>
> >>
> https://ci.ignite.apache.org/viewLog.html?buildId=4798203&buildTypeId=IgniteExtensions_Build&tab=buildLog&branch_IgniteExtensions=pull%2F2%2Fhead&_focus=248
> >> [2]
> >>
> >>
> https://ci.ignite.apache.org/viewLog.html?buildTypeId=IgniteExtensions_Build&buildId=4789199&tab=buildLog&logTab=tree&filter=debug&expand=all&_focus=1256
> >>
> >> Kind regards
> >> *Emmanouil Gkatziouras*
> >> https://egkatzioura.com/ |
> >> https://www.linkedin.com/in/gkatziourasemmanouil/
> >> https://github.com/gkatzioura
> >>
> >>
> >> On Wed, 27 Nov 2019 at 18:58, Saikat Maitra 
> >> wrote:
> >>
> >> > Hi,
> >> >
> >> > We will need to add test suites for tests to be executed in build. We
> >> pass
> >> > them as TestSuites param. I had added Flink sink and source
> testsuites.
> >> >
> >> > Can you please review and confirm.
> >> >
> >> > Regards
> >> > Saikat
> >> >
> >> > On Wed, 27 Nov 2019 at 6:00 AM, Emmanouil Gkatziouras <
> >> > gkatzio...@gmail.com>
> >> > wrote:
> >> >
> >> > > Hi all!
> >> > >
> >> > > I was successful building and running my pull requests. It seems
> that
> >> the
> >> > > tests do not run both for Flink and Pub/Sub [1]
> >> > > If there is something I cannot do to make them discoverable please
> >> let me
> >> > > know.
> >> > >
> >> > > [1]
> >> > >
> >> > >
> >> >
> >>
> https://ci.ignite.apache.org/viewLog.html?buildTypeId=IgniteExtensions_Build&buildId=4796722&tab=buildLog&logTab=tree&filter=debug&expand=all&_focus=283
> >> > >
> >> > > *Emmanouil Gkatziouras*
> >> > > https://egkatzioura.com/ |
> >> > > https://www.linkedin.com/in/gkatziourasemmanouil/
> >> > > https://github.com/gkatzioura
> >> > >
> >> > >
> >> > > On Wed, 27 Nov 2019 at 04:57, Saikat Maitra <
> saikat.mai...@gmail.com>
> >> > > wrote:
> >> > >
> >> > > > Hi Emmanouil,
> >> > > >
> >> > > > I have added you as contributor in Ignite Extensions project. Can
> >> you
> >> > > > please check and confirm if you are able to see the project and
> >> execute
> >> > > > build on your pull request.
> >> > > >
> >> > > > Regards,
> >> > > > Saikat
> >> > > >
> >> > > > On Tue, Nov 26, 2019 at 12:49 PM Emmanouil Gkatziouras <
> >> > > > gkatzio...@gmail.com>
> >> > > > wrote:
> >> > > >
> >> > > > > Hi all!
> >> > > > >
> >> > > > > If someone could give me read access to the Job of Ignite
> >> Extensions
> >> > on
> >> > > > > Team City will greatly help me (username gkatzioura).
> >> > > > > I suppose the builds get triggered automatically on a pull
> >> request.
> >> > > > >
> >> > > > > Kind regards,
> >> > > > > Emmanouil
> >> > > > >
> >> > > > > *Emmanouil Gkatziouras*
> >> > > > > https://egkatzioura.com/ |
> >> > > > > https://www.linkedin.com/in/gkatziourasemmanouil/
> >> > > > > https://github.com/gkatzioura
> >> > > > >
> >> > > > >
> >> > > > > On Sun, 24 Nov 2019 at 21:11, Emmanouil Gkatziouras <
> >> > > > gkatzio...@gmail.com>
> >> > > > > wrote:
> >> > > > >
> >> > > > > > Hi Saikat!
> >> > > > > >
> >> > > > > > I just rebased with the flink branch. Unfortunately I do not
> >> have
> >> > > read
> >> > > > > > access to the team city link you provided and thus evaluate
> the
> >> > tests
> >> > > > for
> >> > > > > > my pull request.
> >> > > > > > I guess it has to do with ignite extensions being new.
> >> > > > > > My username is gkatzioura and 

Re: [DISCUSS] Pub/Sub Streamer Implementation

2019-11-30 Thread Saikat Maitra
Hello,

I have made changes in Ignite Extensions build configurations.

It is now running the tests as expected.

https://ci.ignite.apache.org/viewLog.html?buildId=4804480&buildTypeId=IgniteExtensions_Build&tab=buildResultsDiv&branch_IgniteExtensions=pull%2F1%2Fhead

Regards,
Saikat

On Thu, Nov 28, 2019 at 1:29 PM Saikat Maitra 
wrote:

> Hi,
>
> We do run build with -DskipTests and then configure selective test suites
> to run.
>
> I will check why these test suites are not getting executed.
>
> Regards
> Saikat
>
> On Wed, 27 Nov 2019 at 3:05 PM, Emmanouil Gkatziouras <
> gkatzio...@gmail.com> wrote:
>
>> Hi all,
>>
>> I did add a test suite and run the build with the corresponding arguments,
>> however the tests did not run [1].
>> I checked the Flink's build logs and the same message is displayed there
>> too `No tests to run` [2].
>>
>> [1]
>>
>> https://ci.ignite.apache.org/viewLog.html?buildId=4798203&buildTypeId=IgniteExtensions_Build&tab=buildLog&branch_IgniteExtensions=pull%2F2%2Fhead&_focus=248
>> [2]
>>
>> https://ci.ignite.apache.org/viewLog.html?buildTypeId=IgniteExtensions_Build&buildId=4789199&tab=buildLog&logTab=tree&filter=debug&expand=all&_focus=1256
>>
>> Kind regards
>> *Emmanouil Gkatziouras*
>> https://egkatzioura.com/ |
>> https://www.linkedin.com/in/gkatziourasemmanouil/
>> https://github.com/gkatzioura
>>
>>
>> On Wed, 27 Nov 2019 at 18:58, Saikat Maitra 
>> wrote:
>>
>> > Hi,
>> >
>> > We will need to add test suites for tests to be executed in build. We
>> pass
>> > them as TestSuites param. I had added Flink sink and source testsuites.
>> >
>> > Can you please review and confirm.
>> >
>> > Regards
>> > Saikat
>> >
>> > On Wed, 27 Nov 2019 at 6:00 AM, Emmanouil Gkatziouras <
>> > gkatzio...@gmail.com>
>> > wrote:
>> >
>> > > Hi all!
>> > >
>> > > I was successful building and running my pull requests. It seems that
>> the
>> > > tests do not run both for Flink and Pub/Sub [1]
>> > > If there is something I cannot do to make them discoverable please
>> let me
>> > > know.
>> > >
>> > > [1]
>> > >
>> > >
>> >
>> https://ci.ignite.apache.org/viewLog.html?buildTypeId=IgniteExtensions_Build&buildId=4796722&tab=buildLog&logTab=tree&filter=debug&expand=all&_focus=283
>> > >
>> > > *Emmanouil Gkatziouras*
>> > > https://egkatzioura.com/ |
>> > > https://www.linkedin.com/in/gkatziourasemmanouil/
>> > > https://github.com/gkatzioura
>> > >
>> > >
>> > > On Wed, 27 Nov 2019 at 04:57, Saikat Maitra 
>> > > wrote:
>> > >
>> > > > Hi Emmanouil,
>> > > >
>> > > > I have added you as contributor in Ignite Extensions project. Can
>> you
>> > > > please check and confirm if you are able to see the project and
>> execute
>> > > > build on your pull request.
>> > > >
>> > > > Regards,
>> > > > Saikat
>> > > >
>> > > > On Tue, Nov 26, 2019 at 12:49 PM Emmanouil Gkatziouras <
>> > > > gkatzio...@gmail.com>
>> > > > wrote:
>> > > >
>> > > > > Hi all!
>> > > > >
>> > > > > If someone could give me read access to the Job of Ignite
>> Extensions
>> > on
>> > > > > Team City will greatly help me (username gkatzioura).
>> > > > > I suppose the builds get triggered automatically on a pull
>> request.
>> > > > >
>> > > > > Kind regards,
>> > > > > Emmanouil
>> > > > >
>> > > > > *Emmanouil Gkatziouras*
>> > > > > https://egkatzioura.com/ |
>> > > > > https://www.linkedin.com/in/gkatziourasemmanouil/
>> > > > > https://github.com/gkatzioura
>> > > > >
>> > > > >
>> > > > > On Sun, 24 Nov 2019 at 21:11, Emmanouil Gkatziouras <
>> > > > gkatzio...@gmail.com>
>> > > > > wrote:
>> > > > >
>> > > > > > Hi Saikat!
>> > > > > >
>> > > > > > I just rebased with the flink branch. Unfortunately I do not
>> have
>> > > read
>> > > > > > access to the team city link you provided and thus evaluate the
>> > tests
>> > > > for
>> > > > > > my pull request.
>> > > > > > I guess it has to do with ignite extensions being new.
>> > > > > > My username is gkatzioura and email the one I am using on this
>> > email
>> > > > > >
>> > > > > > Thank you for your time.
>> > > > > >
>> > > > > >
>> > > > > > *Emmanouil Gkatziouras*
>> > > > > > https://egkatzioura.com/ |
>> > > > > > https://www.linkedin.com/in/gkatziourasemmanouil/
>> > > > > > https://github.com/gkatzioura
>> > > > > >
>> > > > > >
>> > > > > > On Sun, 24 Nov 2019 at 18:03, Saikat Maitra <
>> > saikat.mai...@gmail.com
>> > > >
>> > > > > > wrote:
>> > > > > >
>> > > > > >> Hi Emmanouil,
>> > > > > >>
>> > > > > >> The latest build on teamcity has passed on Flink pull request.
>> > > > > >>
>> > > > > >>
>> > > > > >>
>> > > > >
>> > > >
>> > >
>> >
>> https://ci.ignite.apache.org/viewLog.html?buildId=4788928&buildTypeId=IgniteExtensions_Build&tab=buildResultsDiv&branch_IgniteExtensions=pull%2F1%2Fhead
>> > > > > >>
>> > > > > >> you should be able to take the changes I made in my PR and run
>> > build
>> > > > on
>> > > > > >> your pull request.
>> > > > > >>
>> > > > > >> Please let me know if you have any questions.
>> > > > > >>
>> > > > > >> Regards,
>> > > > > 

Re: [DISCUSS] dependencies and release process for Ignite Extensions

2019-11-30 Thread Saikat Maitra
Hello Denis,

Thank you for your email and sharing your thoughts on the release process.
I will update the artifact id and dependencies for ignite-extensions
accordingly.

I had created Ignite-Extensions project as a root level project and in
teamcity I was facing issues pulling dependencies for 2.8.0-SNAPSHOT
whereas I was able to pull dependencies for ignite-core 2.7.6 from maven
central. I will look into it further why teamcity build was not able to
pull snapshot dependencies.

I will also create "ignite-core-2.9+" branch for the upcoming release
process.

Thank you,
Saikat




On Wed, Nov 27, 2019 at 1:05 PM Denis Magda  wrote:

> Hi Saikat,
>
> Thanks for driving this activity forward and raising the question. Let me
> share my thoughts below and let's see what the broader community thinks.
>
> Each extension needs to have its own version unrelated to the core and
> Maven's groupId parameter for extension artifacts should be
> "org.apache.ignite.ext". For instance, the very first release of Flink in
> the form of extension should be pulled from Maven this way
>
> 
> org.apache.ignite.ext
> ignite-flink
> 1.0.0
> 
>
> When it comes to the releases, all the extensions need to be verified for
> an upcoming release and updated if needed (with the version increase only
> for those updated). Thus, looks like the extensions master needs to be
> linked to the latest Ignite core snapshot. Whenever the core will be being
> prepared and any extensions need to be modified we can take this approach:
>
>- Create a branch of extensions for the upcoming core release. For
>instance, "ignite-core-2.9+" branch. That's just the branch name (and
> not
>any Maven artifact name) with "+" sign implying that the updated
> extensions
>will work for Ignite 2.9 and later until we need to update them again
>creating a release branch like "ignite-core-2.14+"
>- If only a subset of the extensions was updated then we need to release
>those extensions to Maven. The goal is to avoid the practice of
> publishing
>Flink or any other extension to Maven for every core release if there
> are
>no changes.
>- As for a ZIP archive, we should prepare the archive for a download
>with the name like "ignite-core-2.9+"
>
>
> -
> Denis
>
>
> On Tue, Nov 26, 2019 at 9:03 PM Saikat Maitra 
> wrote:
>
> > Hello,
> >
> > I wanted to connect and discuss on the release process for
> > ignite-extensions. As of today all our integrations since released
> together
> > were able to run build based on latest snapshot for example the current
> > build depends on 2.8.0-SNAPSHOT. If we are making ignite-extensions as
> > separate project with different release cycle then it make sense to have
> > dependencies on core modules based on released artifact for example the
> > dependency for ignite-core would be 2.7.6
> >
> > Please review and share your thoughts.
> >
> > PR https://github.com/apache/ignite-extensions/pull/1
> >
> > Regards
> > Saikat
> >
>


Re: Data consistency essentials explained

2019-11-30 Thread Ivan Pavlukhin
Alexei,

> Ivan, the link is intentional.

Could you please elaborate why is it fine to have a such link? The
referred document is out of community control. Do not we have a
similar one in Ignite documentation? Should we discuss it in another
mail thread?

сб, 30 нояб. 2019 г. в 15:48, Alexei Scherbakov :
>
> Ivan, the link is intentional.
>
> Nikolai, the formatting looks ok to me. Feel free to change it however you
> like.
>
> чт, 28 нояб. 2019 г. в 09:53, Николай Ижиков :
>
> > Hello, Alex.
> >
> > I think we should improve article formatting - code highlight, fonts, etc.
> >
> > For now, it’s very hard to read it.
> >
> > Can you, please, do it?
> >
> > > 28 нояб. 2019 г., в 09:25, Ivan Pavlukhin 
> > написал(а):
> > >
> > > Alexei,
> > >
> > > Many thanks for that article! Really nice that now we have a document
> > > describing Ignite approach for data consistency. I think it is super
> > > important because it is not trivial and very Ignite specific. I
> > > believe lots of Ignite developers will learn something new from this
> > > document.
> > >
> > > By the way, I noticed a link to GridGain documentation [1]. Is it fine?
> > >
> > > [1]
> > https://www.gridgain.com/docs/latest/developers-guide/key-value-api/transactions#pessimistic-transactions
> > >
> > > чт, 28 нояб. 2019 г. в 02:49, Denis Magda :
> > >>
> > >> Alex,
> > >>
> > >> Thanks a lot for putting your knowledge on paper. That's an invaluable
> > contribution!
> > >>
> > >> Looping in the user community (will be interesting for those who use
> > native persistence) and has just spread the word via Ignite twitter handle:
> > >> https://twitter.com/ApacheIgnite/status/1199837055007612928
> > >>
> > >> -
> > >> Denis
> > >>
> > >>
> > >> On Wed, Nov 27, 2019 at 12:29 AM Alexei Scherbakov <
> > alexey.scherbak...@gmail.com> wrote:
> > >>>
> > >>> Igniters,
> > >>>
> > >>> As a final action in my almost year long effort in repairing data
> > >>> consistency related issues for transactional persistent caches I've
> > >>> prepared an article explaining the principles of achieving the
> > consistency
> > >>> between partition copies for these scenarios [1]
> > >>> Comments and suggestions are welcome.
> > >>> I plan to keep the article in actual state if something will change in
> > this
> > >>> area in the future.
> > >>> Fixes were mostly done under IGNITE-10780 and several follow-up fixes.
> > >>>
> > >>> There is still work to be done. Currently I'm working on similar issue
> > for
> > >>> atomic persistent caches [2]. I hope to give an update on that soon.
> > >>>
> > >>> [1]
> > https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
> > >>> [2] https://issues.apache.org/jira/browse/IGNITE-11797
> > >>> --
> > >>>
> > >>> Best regards,
> > >>> Alexei Scherbakov
> > >
> > >
> > >
> > > --
> > > Best regards,
> > > Ivan Pavlukhin
> >
> >
>
> --
>
> Best regards,
> Alexei Scherbakov



-- 
Best regards,
Ivan Pavlukhin


Re: Data consistency essentials explained

2019-11-30 Thread Alexei Scherbakov
Ivan, the link is intentional.

Nikolai, the formatting looks ok to me. Feel free to change it however you
like.

чт, 28 нояб. 2019 г. в 09:53, Николай Ижиков :

> Hello, Alex.
>
> I think we should improve article formatting - code highlight, fonts, etc.
>
> For now, it’s very hard to read it.
>
> Can you, please, do it?
>
> > 28 нояб. 2019 г., в 09:25, Ivan Pavlukhin 
> написал(а):
> >
> > Alexei,
> >
> > Many thanks for that article! Really nice that now we have a document
> > describing Ignite approach for data consistency. I think it is super
> > important because it is not trivial and very Ignite specific. I
> > believe lots of Ignite developers will learn something new from this
> > document.
> >
> > By the way, I noticed a link to GridGain documentation [1]. Is it fine?
> >
> > [1]
> https://www.gridgain.com/docs/latest/developers-guide/key-value-api/transactions#pessimistic-transactions
> >
> > чт, 28 нояб. 2019 г. в 02:49, Denis Magda :
> >>
> >> Alex,
> >>
> >> Thanks a lot for putting your knowledge on paper. That's an invaluable
> contribution!
> >>
> >> Looping in the user community (will be interesting for those who use
> native persistence) and has just spread the word via Ignite twitter handle:
> >> https://twitter.com/ApacheIgnite/status/1199837055007612928
> >>
> >> -
> >> Denis
> >>
> >>
> >> On Wed, Nov 27, 2019 at 12:29 AM Alexei Scherbakov <
> alexey.scherbak...@gmail.com> wrote:
> >>>
> >>> Igniters,
> >>>
> >>> As a final action in my almost year long effort in repairing data
> >>> consistency related issues for transactional persistent caches I've
> >>> prepared an article explaining the principles of achieving the
> consistency
> >>> between partition copies for these scenarios [1]
> >>> Comments and suggestions are welcome.
> >>> I plan to keep the article in actual state if something will change in
> this
> >>> area in the future.
> >>> Fixes were mostly done under IGNITE-10780 and several follow-up fixes.
> >>>
> >>> There is still work to be done. Currently I'm working on similar issue
> for
> >>> atomic persistent caches [2]. I hope to give an update on that soon.
> >>>
> >>> [1]
> https://cwiki.apache.org/confluence/display/IGNITE/Data+consistency
> >>> [2] https://issues.apache.org/jira/browse/IGNITE-11797
> >>> --
> >>>
> >>> Best regards,
> >>> Alexei Scherbakov
> >
> >
> >
> > --
> > Best regards,
> > Ivan Pavlukhin
>
>

-- 

Best regards,
Alexei Scherbakov