[REPORT] Apache OODT - December 2019

2019-12-11 Thread Imesha Sudasingha
## Description:
Apache OODT is a software framework as well as an architectural style for
the
rapid construction of scientific data systems. It provides components for
data
capture, curation, metadata extraction, workflow management, resource
management, and data processing.

## Issues:
There are no issues requiring board attention

## Membership Data:
Apache OODT was founded 2010-11-17 (9 years ago) There are currently 46
committers and 45 PMC members in this project. The Committer-to-PMC ratio is
roughly 1:1.

Community changes, past quarter:
- No new PMC members. Last addition was Imesha Sudasingha on 2017-08-28.
- No new committers. Last addition was Imesha Sudasingha on 2017-08-29.

## Project Activity:
2 Google Summer of Code projects were completed in this quarter. With them a
new UI was introduced for OODT and main OODT components were dockerized to
support k8s deployment. These features are being further enhanced under 2.x
developments which are yet to be released.

After around one year silence, OODT 1.9 was released in this October which
included the major update of making Avro RPC the default. We are working on
a
maintenance release, 1.9.x to address a backward compatibility issue
introduced with 1.9 release due to avro being default over XML RPC.

## Community Health:
Mailing list activity was high due to recent release and completion of GSoC
projects. Jira and PR activity were lower compared to last quarter since
GSoC
projects finished at the beginning of this quarter.

We are planning to submit projects for 2020 GSoC program as well.


[Report] Apache OODT - September 2019

2019-09-11 Thread Imesha Sudasingha
## Description:
 Apache OODT is a software framework as well as an architectural style for
the
 rapid construction of scientific data systems. It provides components for
 data capture, curation, metadata extraction, workflow management, resource
 management, and data processing.

## Issues:
There are no issues requiring board attention

## Membership Data:
Apache OODT was founded 2010-11-17 (9 years ago) There are currently 46
committers and 45 PMC members in this project. The Committer-to-PMC ratio is
roughly 1:1.

Community changes, past quarter:
- No new PMC members. Last addition was Imesha Sudasingha on 2017-08-28.
- No new committers. Last addition was Imesha Sudasingha on 2017-08-29.

## Project Activity:
We have just completed 2 GSoC projects. One to improve OODT deployment with
docker and the other one was to implement a new UI for OODT OPSUI. Both were
completed successfully. However, there are few PRs still required to be
merged
and some minor improvements requires to be made on top of GSoC contributions
for the new features to be usable. Those students will help us get through
this.

With those additions we are planning to release OODT 2.0. We have 1.9
release
on the backlog which is dev completed, but not yet properly tested. We
intend
to finalize that as well.

- Last release was 1.2.5 on 2018-09-13.

## Community Health:
- 16 issues opened in JIRA, past quarter (300% increase)
- 9 issues closed in JIRA, past quarter (800% increase)
- 19 commits in the past quarter (216% increase)
- 7 code contributors in the past quarter (250% increase)
- 19 PRs opened on GitHub, past quarter (375% increase)

Overall development activity was very high compared to past quarters due to
the GSoC projects. We hope that we will be able to keep this momentum.


[Report] Apache OODT - June 2019

2019-06-12 Thread Imesha Sudasingha
## Description:
 -  Apache OODT is a software framework as well as an architectural style
for
the rapid construction of scientific data systems.  It provides
components
for data capture, curation, metadata extraction, workflow management,
resource management, and data processing.

## Issues:
 - There are no issues requiring board attention at this time.

## Activity:
 - 2 GSoC projects are ongoing as of now. One to improve the OPSUI, which is
   the web interface of OODT and the other one to simplify the OODT
deployment
   to support kubernetes. Progress on both projects seems good and we think
   these improvements will help us gain more activity in the future.
 - Last release was 1.2.5 released on Thu Sep 13 2018

## Health report:
 - Due to GSoC activity, mailing list activity has increased considerably.
Few
   PRs were merged during this period which were received from the GSoC
   applicants.
 - No PMC additions since OODT did not get significant contributions from
   newcomers throughout the last year
 - 1.9 release is yet to be made. We are in the final phase of
   testing/validating as of now. We hope that we will be able to release it
in
   the next reporting period.

## PMC changes:

 - Currently 45 PMC members.
 - No new PMC members added in the last 3 months
 - Last PMC addition was Imesha Sudasingha on Mon Aug 28 2017

## Committer base changes:

 - Currently 46 committers.
 - No new committers added in the last 3 months
 - Last committer addition was Imesha Sudasingha at Tue Aug 29 2017

## Releases:

 - Last release was 1.2.5 on Thu Sep 13 2018

## Mailing list activity:

 - As mentioned earlier, 2 GSoC projects have resulted in more discussion on
   mailing lists.

 - dev@oodt.apache.org:
- 96 subscribers (down -1 in the last 3 months):
- 93 emails sent to list (43 in previous quarter)

## JIRA activity:

 - 4 JIRA tickets created in the last 3 months
 - 1 JIRA tickets closed/resolved in the last 3 months


[Report] Apache OODT - March 2019

2019-03-13 Thread Imesha Sudasingha
## Description:
 - Apache OODT is a software framework as well as an architectural style for
   the rapid construction of scientific data systems.  It provides
components
   for data capture, curation, metadata extraction, workflow management,
   resource management, and data processing.

## Issues:
 - There are no issues requiring board attention at this time.

## Activity:
 - Last release was 1.2.5 released on Thu Sep 13 2018
 - This has been a very quiet period since no major developments were
carried
   out. The 1.9 release is yet to be made, but is on hold due to committers
   being busy to verify the changes made.

## Health report:
 - 1.9 release is yet to be made (though it is 100% ready from dev point of
   view, not verified yet). We hope we will be able to release this in the
   coming period with the new found energy due to GSoC 2019.
 - We are planning to offer 2/3 GSoC projects to attract new contributors to
   the community. These projects are focused on improving OODT UI (named
   OPSUI) and making OODT deployment easy.
 - We believe that OODT will be more active with GSoC students applying for
   projects and the introduction of above mentioned features from users'
point
   of view.

## PMC changes:

 - Currently 45 PMC members.
 - No new PMC members added in the last 3 months
 - Last PMC addition was Imesha Sudasingha on Mon Aug 28 2017

## Committer base changes:

 - Currently 46 committers.
 - No new committers added in the last 3 months
 - Last committer addition was Imesha Sudasingha at Tue Aug 29 2017

## Releases:

 - Last release was 1.2.5 on Thu Sep 13 2018

## Mailing list activity:

 - As mentioned earlier, this has been a quiet period and no reasonable
   development activity took place.

 - dev@oodt.apache.org:
- 96 subscribers (up 1 in the last 3 months):
- 57 emails sent to list (135 in previous quarter)

## JIRA activity:

 - 5 JIRA tickets created in the last 3 months
 - 2 JIRA tickets closed/resolved in the last 3 months


[Report] Apache OODT - December 2018

2018-12-10 Thread Imesha Sudasingha
## Description:

Apache OODT is a software framework as well as an architectural style for
the
rapid construction of scientific data systems.  It provides components for
data capture, curation, metadata extraction, workflow management, resource
management, and data processing.

## Issues:

There are no issues requiring board attention at this time.

## Activity:
 - Last release was 1.2.5 on September 18th 2018
 - A discussion is ongoing on plan to containerize OODT
 - 1.9 release is yet to be made even though the required developments are
   almost complete.

## Health report:

During this reporting period, there has been an increased activity due to
contributions from a new community member and active usage of OODT in user
projects. We plan to release 1.9 (which was delayed) in the coming reporting
period. Furthermore, we plan to containerize OODT components along with a
docker build. In addition to that, we are planning on what GSoC project
ideas
to make available for GSoC 2019 and possible mentors.

Overall this period can be considered as an active period where new
contributions and active users were involved.

## PMC changes:

 - Currently 45 PMC members.
 - No new PMC members added in the last 3 months
 - Last PMC addition was Imesha Sudasingha on Mon Aug 28 2017

## Committer base changes:

 - Currently 46 committers.
 - No new committers added in the last 3 months
 - Last committer addition was Imesha Sudasingha at Tue Aug 29 2017

## Releases:

 - 1.2.5 was released on Thu Sep 13 2018

## Mailing list activity:

There was increased activity in this period due an ongoing discussion on
containerization, a new contributor fixing some bugs and some users actively
using OODT in their projects.

 - dev@oodt.apache.org:
- 95 subscribers (up 3 in the last 3 months):
- 139 emails sent to list (118 in previous quarter)

## JIRA activity:

 - 10 JIRA tickets created in the last 3 months
 - 4 JIRA tickets closed/resolved in the last 3 months


[REPORT] Apache OODT - September 2018

2018-09-13 Thread Imesha Sudasingha
## Description:
 - Apache OODT is a software framework as well as an architectural style for
   the rapid construction of scientific data systems.  It provides
components
   for data capture, curation, metadata extraction, workflow management,
   resource management, and data processing.

## Issues:
 - There are no issues requiring board attention at this time.

## Activity:
 -  Last release was 1.2.5 released on Thu Sep 13 2018
 -  Couple of issues were fixed and released (3 releases) related to OODT
1.2
within the reporting period including support for JDK 8.
 -  On the other hand, 1.9 is almost ready to be released after switching to
Avro RPC for communications. This will be released within the coming
month.
 -  We are also working on supporting OODT to be built under JDK 10.

## Health report:
 - Project activity has been quiet except for the 3 1.2.x releases.
 - Due to Apache DRAT GSoC project, OODT could identify bottlenecks of using
   XML RPC and could expedite the Avro RPC migration. As a result, Avro RPC
   support has been made stable along with better logging support.
 - Despite the number of mails in the lists are lower compared to the last
   term, contributor involvement has increased within the period where more
   contributors worked actively within the period.
 - OODT 1.9 is ready to be released and will be released in the coming
month.
 - After 1.9, we will be moving to the 2.0 development cycle which will be a
   major step forward.

## PMC changes:

 - Currently 45 PMC members.
 - No new PMC members added in the last 3 months
 - Last PMC addition was Imesha Sudasingha on Mon Aug 28 2017

## Committer base changes:

 - Currently 46 committers.
 - No new committers added in the last 3 months
 - Last committer addition was Imesha Sudasingha at Tue Aug 29 2017

## Releases:

 - 1.2.3 was released on Mon Aug 06 2018
 - 1.2.4 was released on Sun Aug 19 2018
 - 1.2.5 was released on Thu Sep 13 2018

## Mailing list activity:

 - Mailing list activity has increased with increased user queries,
developer
   discussions and releases. The numbers are lower because the auto
generated
   mails (Jenkins/Jira) have decreased within the period.

 - dev@oodt.apache.org:
- 92 subscribers (up 2 in the last 3 months):
- 125 emails sent to list (152 in previous quarter)


## JIRA activity:

 - 7 JIRA tickets created in the last 3 months
 - 8 JIRA tickets closed/resolved in the last 3 months


[REPORT] Apache OODT - June 2018

2018-06-09 Thread Imesha Sudasingha
## Description:

Apache OODT is a software framework as well as an architectural style for
the
rapid construction of scientific data systems.  It provides components for
data capture, curation, metadata extraction, workflow management, resource
management, and data processing.

## Issues:

There are no issues requiring board attention at this time.

## Activity:

- Last release was 1.2.2 on March 5th 2018
- A new PMC chair (Imesha Sudasingha) was elected in April, 2018. (Previous
  chair - Tom Barber)

Improved activity compared to last reporting periods with improvements being
made on stabilizing Avro RPC implementations of OODT components and
improving
logging support for OODT. Furthermore, Apache DRAT GSoC student is making
improvements to OODT APIs in order to use OODT functionalities though REST
APIs.

All these new additions will affect towards OODT being an easy to use
platform
for scientific data systems in near future.

## Health report:

We are currently working on 1.9 release which will be the last in line
before
completely removing XML RPC code from the project. As per now, once the
above
mentioned logging improvements are done and workflow manager and resource
manager are stabilized, we are ready to release 1.9. Hopefully within the
next
reporting period.

So, project activity is below average with few contributors making constant
contributions throughout the period.

## PMC changes:

 - Currently 45 PMC members.
 - No new PMC members added in the last 3 months
 - Last PMC addition was Imesha Sudasingha on Mon Aug 28 2017

## Committer base changes:

 - Currently 46 committers.
 - No new committers added in the last 3 months
 - Last committer addition was Imesha Sudasingha at Tue Aug 29 2017

## Releases:

 - Last release was 1.2.2 on Mon Mar 05 2018

## Mailing list activity:

Most of the mailing list activities are related to improvements that being
done for 1.9 release.

 - dev@oodt.apache.org:
- 91 subscribers (down -1 in the last 3 months):
- 156 emails sent to list (74 in previous quarter)

## JIRA activity:

 - 11 JIRA tickets created in the last 3 months
 - 3 JIRA tickets closed/resolved in the last 3 months


Re: [REPORT] Apache OODT - Sept 2017

2017-09-14 Thread lewis john mcgibbney
Very good

On Thu, Sep 14, 2017 at 8:01 PM, Tom Barber  wrote:

> DESCRIPTION
>
> Apache OODT is a software framework as well as an architectural style for
> the
> rapid construction of scientific data systems.  It provides components for
> data capture, curation, metadata extraction, workflow management, resource
> management, and data processing.
>
> RELEASES/DEVELOPMENT
>
> - Last release was 1.1 on Wed Jul 27 2017
> - Last release was 1.2 on Wed Aug 28 2017
>
> We resolved 21 issues for these releases.
>
> Improved activity this reporting period, with 2 releases, a number of fixed
> bugs, cleaned up Jira and a great new set of features from the GSOC
> project.
>
> We have new features coming into the code base for the 2.0 development
> drive
> and a positive outlook for the future.
>
> COMMUNITY
>
> Latest committers and PMC members
> Imesha Sudasingha(imesha) on 28th Aug 2017 as committer and PMC member
>
> ISSUES
>
> There are no issues requiring board attention at this time.
>
> HEALTH REPORT
>
> The project activity is pretty quiet, but there has been a positive uplift
> this quarter with
> the GSOC project and 2 new releases.
>



-- 
http://home.apache.org/~lewismc/
@hectorMcSpector
http://www.linkedin.com/in/lmcgibbney


[REPORT] Apache OODT - Sept 2017

2017-09-14 Thread Tom Barber
DESCRIPTION

Apache OODT is a software framework as well as an architectural style for
the
rapid construction of scientific data systems.  It provides components for
data capture, curation, metadata extraction, workflow management, resource
management, and data processing.

RELEASES/DEVELOPMENT

- Last release was 1.1 on Wed Jul 27 2017
- Last release was 1.2 on Wed Aug 28 2017

We resolved 21 issues for these releases.

Improved activity this reporting period, with 2 releases, a number of fixed
bugs, cleaned up Jira and a great new set of features from the GSOC project.

We have new features coming into the code base for the 2.0 development
drive
and a positive outlook for the future.

COMMUNITY

Latest committers and PMC members
Imesha Sudasingha(imesha) on 28th Aug 2017 as committer and PMC member

ISSUES

There are no issues requiring board attention at this time.

HEALTH REPORT

The project activity is pretty quiet, but there has been a positive uplift
this quarter with
the GSOC project and 2 new releases.


[REPORT] Apache OODT - March 2017

2017-03-09 Thread Tom Barber
DESCRIPTION

Apache OODT is a software framework as well as an architectural style for
the
rapid construction of scientific data systems.  It provides components for
data capture, curation, metadata extraction, workflow management, resource
management, and data processing.

RELEASES/DEVELOPMENT

- Last release was 1.0 on Wed Jun 29 2016

We resolved 0 issues for this release.

Development on Apache OODT has been pretty quiet over the last 9 months,
but we have recently accepted a large new feature into our code base and
are currently working at incorporating that into the mainline branch so
that we can run a release with the new features in place.

On top of that there has been renewed discussion over the last week or so
over the state of Apache OODT development and what we need to do to move
forward with the 2.0 roadmap. This has been organised and we should be
seeing increased development activity over the coming quarter.

COMMUNITY

Latest committers and PMC members
Radu Maonle(radumanole) on 11th Oct 2015 as committer and PMC member

Last committer and PMC member added on 11th October 2015.

No new users have spoken up on the mailing list recently, but there
has been some interest and patches committed by a volunteer via Jira so we
will be working at bringing them into the project.

ISSUES

There are no issues requiring board attention at this time.

HEALTH REPORT

The project activity is pretty quiet, but there are still on going efforts
in place to help drive wider adoption.


[REPORT] Apache OODT - December 2016

2016-12-13 Thread Tom Barber
DESCRIPTION

Apache OODT is a software framework as well as an architectural style for
the
rapid construction of scientific data systems.  It provides components for
data capture, curation, metadata extraction, workflow management, resource
management, and data processing.

RELEASES/DEVELOPMENT

- Last release was 1.0 on Wed Jun 29 2016

We resolved 0 issues for this release.

We finally reached a point in the platform lifecycle which made sense to
release Apache OODT as 1.0. This was done both to signify the stability of
what we had but also allow us to prepare for major changes coming in the
next major release cycle to modernise the platform and extend what was
already in place. These changes will be API breaking and as such we wanted
to signify this in the release versioning.

It was asked in last months meeting to keep the board updated with regards
to driving adoption. To this end this month we have switched our website
from Apache CMS to gitsubpub and Jekyll to ease the updating process. Along
the website has tried to reduce the science centric focus and add more
business use case type content. This will be an ongoing process as we get
time to add more content to aid potential users in understanding how OODT
can help them. Tom also gave an OODT related talk at Apachecon Europe that
had decent attendance and further feedback afterwards. Having spoken to a
number of PMC members we feel that reducing the size of the code base and
integrating with a number of the other ASF data projects will help bring
people on board and as such the roadmap for OODT 2.0 has this aim in mind.

COMMUNITY

Latest committers and PMC members
Radu Maonle(radumanole) on 11th Oct 2015 as committer and PMC member

Last committer and PMC member added on 6th October 2015.

Mailing list activity has been pretty much static in terms of
period on period volume and Jira has been quiet.

ISSUES

There are no issues requiring board attention at this time.

HEALTH REPORT

The project activity is pretty quiet, but there are still on going efforts
in place to help drive wider adoption.


[REPORT] Apache OODT - Sept 2016

2016-09-12 Thread Tom Barber
DESCRIPTION

Apache OODT is a software framework as well as an architectural style for
the
rapid construction of scientific data systems.  It provides components for
data capture, curation, metadata extraction, workflow management, resource
management, and data processing.

RELEASES/DEVELOPMENT

- Last release was 1.0 on Wed Jun 29 2016

We resolved 0 issues for this release.

We finally reached a point in the platform lifecycle which made sense to
release Apache OODT as 1.0. This was done both to signify the stability of
what we had but also allow us to prepare for major changes coming in the
next major release cycle to modernise the platform and extend what was
already in place. These changes will be API breaking and as such we wanted
to signify this in the release versioning.

COMMUNITY

Latest committers and PMC members
Radu Maonle(radumanole) on 11th Oct 2015 as committer and PMC member

Last committer and PMC member added on 6th October 2015.

Mailing list activity has been pretty much static in terms of
period on period volume and Jira has been quiet.

ISSUES

There are no issues requiring board attention at this time.

HEALTH REPORT

The project activity is pretty quiet, but there are still on going efforts
in place to help drive wider adoption. This includes a new website, greater
connectivity with other data platforms and adding some much desired
features to the core platform. As mentioned above, now that we have
released 1.0 we will be turning our attention to the new features. Although
development is quiet, we have a fully functioning and responsive PMC and
community.


[REPORT] Apache OODT - June 2016

2016-06-12 Thread Tom Barber
DESCRIPTION

Apache OODT is a software framework as well as an architectural style for
the
rapid construction of scientific data systems.  It provides components for
data capture, curation, metadata extraction, workflow management, resource
management, and data processing.

RELEASES/DEVELOPMENT

- Last release was 0.12 on Feb 19th 2016

We resolved 4 issues for this release.

The last few months have been quiet in development but there has been
movement to start merging some pretty large changes that were developed in
the last GSOC into our main development branch.

COMMUNITY

Latest committers and PMC members
Radu Maonle(radumanole) on 28 Oct 2015 as committer and PMC member

Last committer and PMC member added on 28th October 2015.

Mailing list activity has been pretty much static in terms of
period on period volume and Jira has been quiet.

ISSUES

There are no issues requiring board attention at this time.

HEALTH REPORT

The project activity is pretty quiet, but there are still on going efforts
in place to help drive wider adoption. This includes a new website, greater
connectivity with other data platforms and adding some much desired
features to the core platform.


[REPORT] Apache OODT - March 2016

2016-03-13 Thread Tom Barber
DESCRIPTION

Apache OODT is a software framework as well as an architectural style for
the
rapid construction of scientific data systems.  It provides components for
data capture, curation, metadata extraction, workflow management, resource
management, and data processing.

RELEASES/DEVELOPMENT

- Last release was 0.12 on Feb 19th 2016

We resolved 4 issues for this release.

0.12 was a out of band release for OODT initially the scope was an
emergency patch
for an API issue, but in preparing for the release we also addressed 3
major issues
relating to the the Solr integration for OODT.

We have decided to switch to a rough quarterly release schedule to help
keep the
code active and make sure that commits that get pushed to the project get
released
in a timely manner, which will give contributors more confidence about when
their
patches will end up in the stable codebase.

February was a busy month on the mailing list with a number of new users
showing up
and triggering the Solr patches and general questions about OODT usage.

The project is specific in its design but we have been working on
advertising
to a larger crowd for less scientific based data management to draw a
larger
audience and userbase.

At ApacheCon we have 1 presentation and 2 tutorials scheduled for Apache
OODT which
we hope will drive awareness to wider audiences.

As ever it would be nice to see fresh blood on the project helping to
increase the
development effort on the platform, but the software itself is stable and
well used.

COMMUNITY

Latest committers and PMC members
Radu Maonle(radumanole) on 28 Oct 2015 as committer and PMC member

Last committer and PMC member added on 28th October 2015.


[REPORT] Apache OODT

2013-03-05 Thread Sean Kelly
DESCRIPTION

Apache OODT is a software framework as well as an architectural style for the
rapid construction of scientific data systems.  It provides components for
data capture, curation, metadata extraction, workflow management, resource
management, and data processing.

RELEASES/DEVELOPMENT

For our Christmas-day gift of 2012, we released version 0.5 of OODT [1], which
closed out 61 issues in JIRA [2] and provided improvements to:

* OODT File Manager, and Lucene- and Solr-based catalog indexing
* Curator JAX-RS web application
* PushPull remote file retrieval
* WEngine workflow system

Future work in the next quarter will focus on cross-fertilization projects
with Apache Airavata and Apache Tika, as well as fleshing out our Python APIs.

OODT Jenkins jobs are now prominently featured from our project home page [3].

Our development mailing lists remain quite popular, while the user list shows
less activity.  The table below lists the number of postings by list, by
month, in 2013:

List Jan Feb Mar
 --- --- ---
dev   57  75  12
user  12  16   0

COMMUNITY

The North American ApacheCon 2013 conspicuously featured Apache OODT.  Seven
speakers gave eight presentations about OODT in the "Apache in Science" track at
the conference [4].

We established a third social media base at Google Plus [5], complementing our
existing Facebook [6] and Twitter [7] presence.  We also created a read-only
mirror of OODT at Github [8], enabling a wider base of code contributions and
future participants.

BRANDING

There are no outstanding branding issues since our last report. All's good.

PRESS

Apache OODT received noteworthy attention in two articles penned by our
eminent member Chris A. Mattmann:

* Nature published "Computing: A Vision for Data Science" [9] in volume 493
  (p. 474) featuring Apache OODT, Hadoop, and Tika in the face of "big data".

* Software Development Times published "Apache Does Science" [10], discussing
  OODT's and Apache Airavata's places in scientific endeavors.

ISSUES

There are no issues requiring board attention at this time.

[1] http://s.apache.org/gm
[2] http://issues.apache.org/jira/browse/OODT
[3] http://oodt.apache.org/
[4] http://s.apache.org/c8C
[5] http://s.apache.org/8vM
[6] http://s.apache.org/M5x
[7] http://s.apache.org/PYt
[8] http://s.apache.org/cNy
[9] http://s.apache.org/eS
[10] http://s.apache.org/Yeg