Re: Suggestion for new Direction for Gora

2018-12-08 Thread lewis john mcgibbney
Hi Kevin,
Responses inline

On Tue, Dec 4, 2018 at 5:56 PM  wrote:

> From: Kevin Ratnasekera 
> To: Gora Dev 
> Cc:
> Bcc:
> Date: Wed, 5 Dec 2018 02:35:14 +0530
> Subject: Re: Suggestion for new Direction for Gora
> Hi Lewis,
>
> Thank you for all the suggestions given. I went through the pointers you
> given and found out that,
>
> 1. Camel is at gora 0.8 ( Already upgraded to latest )
>

cool


> 2. Giraph is at gora 0.5 ( Upgrade needed )
>

Yes and this upgrade will be pretty trivial.


> 3. Chukwa is at gora 0.6 ( Upgrade needed )
>

Yes and this upgrade will be pretty trivial.


>
> I logged two jira tickets [1] which I will be taking over. ( If anyone like
> to join please talk to me  )


Nice.


> I am not sure about nutch gora integration,
> current status and whether we can do anything from our end. I have seen
> several times dev@gora people raised their concerns over improvements to
> nutch-gora Eg:- Last time when we had discussion on GSoC ideas, there was a
> proposal from Renato on fixing gora-nutch integration in Nutch 2.x possible
> cases where we have neglected as community. [3]


We are proposing to retire Nutch 2.x due to long periods of inactivity...
which is a shame but it is also fragmenting the Nutch community so I think
it is probably best fr the project at this stage. If you are interested in
maintaining then please let us know on dev@nutch. Our plans are to release
once more then retire it.


> Also recently I noticed
> some people requesting mavenized build for 2.x branch as well. [4] Do we
> have ideas to take things forward?
>

I don't think at this stage that it is worth it. We are going to finish off
the Maven build for 1.x instead and focus on that branch for development
moving forward.


Re: Suggestion for new Direction for Gora

2018-12-04 Thread Kevin Ratnasekera
Hi Lewis,

Thank you for all the suggestions given. I went through the pointers you
given and found out that,

1. Camel is at gora 0.8 ( Already upgraded to latest )
2. Giraph is at gora 0.5 ( Upgrade needed )
3. Chukwa is at gora 0.6 ( Upgrade needed )

I logged two jira tickets [1] which I will be taking over. ( If anyone like
to join please talk to me  ) I am not sure about nutch gora integration,
current status and whether we can do anything from our end. I have seen
several times dev@gora people raised their concerns over improvements to
nutch-gora Eg:- Last time when we had discussion on GSoC ideas, there was a
proposal from Renato on fixing gora-nutch integration in Nutch 2.x possible
cases where we have neglected as community. [3] Also recently I noticed
some people requesting mavenized build for 2.x branch as well. [4] Do we
have ideas to take things forward?

[1] https://issues.apache.org/jira/browse/CHUKWA-823
[2] https://issues.apache.org/jira/browse/GIRAPH-1214
[3]
https://lists.apache.org/thread.html/e365623c62e3f43e9e4ac79d0069d981f1096d8bdac52b353a412ef5@%3Cuser.gora.apache.org%3E
[4] https://issues.apache.org/jira/browse/NUTCH-2292

Regards
Kevin

On Fri, Nov 30, 2018 at 2:03 PM Kevin Ratnasekera 
wrote:

> Hi Lewis,
>
> I came across this, is this something we could work to integrate with
> Apache OODT?
>
> [1] https://issues.apache.org/jira/browse/OODT-658
>
> Regards
> Kevin
>
> On Fri, Nov 30, 2018 at 1:10 AM lewis john mcgibbney 
> wrote:
>
>> Hi Folks,
>> As our RESOLUTION is now agreed upon within the community and submitted to
>> the Board for approval. I wanted to drop a few ideas which will hopefully
>> kickstart some new project activity and usage.
>> We've been building a rich suite of modules which not only enable flexible
>> object-to-datastore mapping solutions but also data analysis (Hadoop,
>> Spark, Flink) and data warehouse query execution (Pig).
>> I wanted however for us to consider where Gora could be used around the
>> rich spectrum of projects at the ASF.
>> So far we've built Gora into Nutch 2.X branch (which will soon be
>> retired),
>> Camel (which needs updated), Giraph (which needs updated) and Chukwa
>> (which
>> needs updated).
>> The above is a pretty nice roster of Apache projects which consume Gora
>> but
>> I think we should engage those communities again and update everywhere we
>> can.
>> It would also be my intention for this thread to act as a bulletin board
>> for ideas of where Gora could be embedded in other projects.
>> I'll leave it there for now.
>> Lewis
>>
>> --
>> http://home.apache.org/~lewismc/
>> http://people.apache.org/keys/committer/lewismc
>>
>


Re: Suggestion for new Direction for Gora

2018-11-30 Thread Kevin Ratnasekera
Hi Lewis,

I came across this, is this something we could work to integrate with
Apache OODT?

[1] https://issues.apache.org/jira/browse/OODT-658

Regards
Kevin

On Fri, Nov 30, 2018 at 1:10 AM lewis john mcgibbney 
wrote:

> Hi Folks,
> As our RESOLUTION is now agreed upon within the community and submitted to
> the Board for approval. I wanted to drop a few ideas which will hopefully
> kickstart some new project activity and usage.
> We've been building a rich suite of modules which not only enable flexible
> object-to-datastore mapping solutions but also data analysis (Hadoop,
> Spark, Flink) and data warehouse query execution (Pig).
> I wanted however for us to consider where Gora could be used around the
> rich spectrum of projects at the ASF.
> So far we've built Gora into Nutch 2.X branch (which will soon be retired),
> Camel (which needs updated), Giraph (which needs updated) and Chukwa (which
> needs updated).
> The above is a pretty nice roster of Apache projects which consume Gora but
> I think we should engage those communities again and update everywhere we
> can.
> It would also be my intention for this thread to act as a bulletin board
> for ideas of where Gora could be embedded in other projects.
> I'll leave it there for now.
> Lewis
>
> --
> http://home.apache.org/~lewismc/
> http://people.apache.org/keys/committer/lewismc
>


Suggestion for new Direction for Gora

2018-11-29 Thread lewis john mcgibbney
Hi Folks,
As our RESOLUTION is now agreed upon within the community and submitted to
the Board for approval. I wanted to drop a few ideas which will hopefully
kickstart some new project activity and usage.
We've been building a rich suite of modules which not only enable flexible
object-to-datastore mapping solutions but also data analysis (Hadoop,
Spark, Flink) and data warehouse query execution (Pig).
I wanted however for us to consider where Gora could be used around the
rich spectrum of projects at the ASF.
So far we've built Gora into Nutch 2.X branch (which will soon be retired),
Camel (which needs updated), Giraph (which needs updated) and Chukwa (which
needs updated).
The above is a pretty nice roster of Apache projects which consume Gora but
I think we should engage those communities again and update everywhere we
can.
It would also be my intention for this thread to act as a bulletin board
for ideas of where Gora could be embedded in other projects.
I'll leave it there for now.
Lewis

-- 
http://home.apache.org/~lewismc/
http://people.apache.org/keys/committer/lewismc