Re: Questions regarding CI, PR and documentation

2016-10-30 Thread Suneel Marthi
On Sun, Oct 30, 2016 at 7:00 PM, Ran Ziv  wrote:

> Thanks Suneel.
> Actually I believe it was the wrong Tal, so I removed his permissions.
>
> Unless I'm missing something, everyone needs to register to confluence
> separately from jira / apache-id etc., here
> .
>

Correct. All need to register separately on Confluence (and its separate
from Jira).

>
> Guys please send your ID once you do that so we could grant you permissions
>
> On Sun, Oct 30, 2016 at 6:07 PM, Suneel Marthi 
> wrote:
>
> > Done - added Tal, John D. Jakob. Ran <- all these users have admin
> > privs, please feel free to add others.
> >
> > On Sun, Oct 30, 2016 at 11:56 AM, John D. Ament 
> > wrote:
> >
> > > Could you add me as well?
> > >
> > > On Sun, Oct 30, 2016 at 11:50 AM Suneel Marthi <
> suneel.mar...@gmail.com>
> > > wrote:
> > >
> > > > Heh Sorry, Ran I added u to confluence - ur ApacheId 'ran' would be
> ur
> > > > login.
> > > >
> > > > You have permissions to add users, please feel free to add others.
> > > >
> > > > On Sun, Oct 30, 2016 at 11:40 AM, Ran Ziv 
> wrote:
> > > >
> > > > > Suneel, could you please provide me (and possibly the rest of us as
> > > well)
> > > > > permissions for creating pages on our Confluence? I don't seem to
> > have
> > > > > these permissions at the moment.
> > > > > Thank you :)
> > > > >
> > > > > On Tue, Oct 25, 2016 at 6:05 PM, Suneel Marthi  >
> > > > wrote:
> > > > >
> > > > > > On Tue, Oct 25, 2016 at 10:55 AM, Ran Ziv 
> > > wrote:
> > > > > >
> > > > > > > Done.
> > > > > > > I'll update the project's .travis file now.
> > > > > > >
> > > > > > > What is the process of setting up a Jenkins job?
> > > > > > >
> > > > > >
> > > > > > Needs an Infra ticket.
> > > > > >
> > > > > > >
> > > > > > > -
> > > > > > >
> > > > > > > Regarding shared documents, is Confluence the Apache standard?
> > What
> > > > > about
> > > > > > > using github markup files and have the documents as a part of
> the
> > > > repo?
> > > > > > > Does anyone have any specific preference or other ideas on this
> > > > matter?
> > > > > > >
> > > > > >
> > > > > > Its again up to the project. Projects like Flink, Pirk, Beam have
> > > > markup
> > > > > > files in github and use Jekyll.
> > > > > >
> > > > > > They also use Confluence for few other things.
> > > > > >
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Tue, Oct 25, 2016 at 3:11 PM, Suneel Marthi <
> > smar...@apache.org
> > > >
> > > > > > wrote:
> > > > > > >
> > > > > > > > Never heard of CircleCI, and I don't think Infra is gonna
> > support
> > > > > that.
> > > > > > > >
> > > > > > > > Please go ahead and create an Infra ticket to enable Travis
> for
> > > > Aria.
> > > > > > > >
> > > > > > > > On Tue, Oct 25, 2016 at 5:24 AM, Ran Ziv  >
> > > > wrote:
> > > > > > > >
> > > > > > > > > Regarding CI - Does Apache also support CircleCI? I assume
> > less
> > > > > > > projects
> > > > > > > > > use it and if that's the case it could possibly be a better
> > > > option
> > > > > > for
> > > > > > > us
> > > > > > > > > if the purpose of using an additional CI environment
> (besides
> > > > > > jenkins)
> > > > > > > is
> > > > > > > > > to allow for quick feedback over PRs.
> > > > > > > > > If not I'll create an Infra JIRA to enable Travis for our
> > > > project.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, Oct 20, 2016 at 5:29 PM, Suneel Marthi <
> > > > smar...@apache.org
> > > > > >
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > On Thu, Oct 20, 2016 at 8:38 AM, Ran Ziv <
> > r...@gigaspaces.com
> > > >
> > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > Hi,
> > > > > > > > > > >
> > > > > > > > > > > I have some questions for our mentors:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > 1) CI - we've noticed some Apache projects use online
> > > > services
> > > > > > > rather
> > > > > > > > > > than
> > > > > > > > > > > the infra tools  offered by
> > > Apache.
> > > > > > We're
> > > > > > > > > > leaning
> > > > > > > > > > > towards using TravisCI, however we're somewhat worried
> > that
> > > > > since
> > > > > > > all
> > > > > > > > > > > apache projects are under a single github organization,
> > > > builds
> > > > > in
> > > > > > > > > Travis
> > > > > > > > > > > will take a very long time to start etc..
> > > > > > > > > > >
> > > > > > > > > > >  Are you aware of any such issues (or perhaps Travis
> > offers
> > > > > some
> > > > > > > > > special
> > > > > > > > > > > QoS to Apache projects or so)..?
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Most Apache projects use both Travis (unofficial) and
> > Jenkins
> > > > > > > (Official
> > > > > > > > > > Apache CI).
> > > > > > > > > >
> > > > > 

Re: Questions regarding CI, PR and documentation

2016-10-30 Thread Suneel Marthi
Done - added Tal, John D. Jakob. Ran <- all these users have admin
privs, please feel free to add others.

On Sun, Oct 30, 2016 at 11:56 AM, John D. Ament 
wrote:

> Could you add me as well?
>
> On Sun, Oct 30, 2016 at 11:50 AM Suneel Marthi 
> wrote:
>
> > Heh Sorry, Ran I added u to confluence - ur ApacheId 'ran' would be ur
> > login.
> >
> > You have permissions to add users, please feel free to add others.
> >
> > On Sun, Oct 30, 2016 at 11:40 AM, Ran Ziv  wrote:
> >
> > > Suneel, could you please provide me (and possibly the rest of us as
> well)
> > > permissions for creating pages on our Confluence? I don't seem to have
> > > these permissions at the moment.
> > > Thank you :)
> > >
> > > On Tue, Oct 25, 2016 at 6:05 PM, Suneel Marthi 
> > wrote:
> > >
> > > > On Tue, Oct 25, 2016 at 10:55 AM, Ran Ziv 
> wrote:
> > > >
> > > > > Done.
> > > > > I'll update the project's .travis file now.
> > > > >
> > > > > What is the process of setting up a Jenkins job?
> > > > >
> > > >
> > > > Needs an Infra ticket.
> > > >
> > > > >
> > > > > -
> > > > >
> > > > > Regarding shared documents, is Confluence the Apache standard? What
> > > about
> > > > > using github markup files and have the documents as a part of the
> > repo?
> > > > > Does anyone have any specific preference or other ideas on this
> > matter?
> > > > >
> > > >
> > > > Its again up to the project. Projects like Flink, Pirk, Beam have
> > markup
> > > > files in github and use Jekyll.
> > > >
> > > > They also use Confluence for few other things.
> > > >
> > > >
> > > > >
> > > > >
> > > > > On Tue, Oct 25, 2016 at 3:11 PM, Suneel Marthi  >
> > > > wrote:
> > > > >
> > > > > > Never heard of CircleCI, and I don't think Infra is gonna support
> > > that.
> > > > > >
> > > > > > Please go ahead and create an Infra ticket to enable Travis for
> > Aria.
> > > > > >
> > > > > > On Tue, Oct 25, 2016 at 5:24 AM, Ran Ziv 
> > wrote:
> > > > > >
> > > > > > > Regarding CI - Does Apache also support CircleCI? I assume less
> > > > > projects
> > > > > > > use it and if that's the case it could possibly be a better
> > option
> > > > for
> > > > > us
> > > > > > > if the purpose of using an additional CI environment (besides
> > > > jenkins)
> > > > > is
> > > > > > > to allow for quick feedback over PRs.
> > > > > > > If not I'll create an Infra JIRA to enable Travis for our
> > project.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Oct 20, 2016 at 5:29 PM, Suneel Marthi <
> > smar...@apache.org
> > > >
> > > > > > wrote:
> > > > > > >
> > > > > > > > On Thu, Oct 20, 2016 at 8:38 AM, Ran Ziv  >
> > > > wrote:
> > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > I have some questions for our mentors:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > 1) CI - we've noticed some Apache projects use online
> > services
> > > > > rather
> > > > > > > > than
> > > > > > > > > the infra tools  offered by
> Apache.
> > > > We're
> > > > > > > > leaning
> > > > > > > > > towards using TravisCI, however we're somewhat worried that
> > > since
> > > > > all
> > > > > > > > > apache projects are under a single github organization,
> > builds
> > > in
> > > > > > > Travis
> > > > > > > > > will take a very long time to start etc..
> > > > > > > > >
> > > > > > > > >  Are you aware of any such issues (or perhaps Travis offers
> > > some
> > > > > > > special
> > > > > > > > > QoS to Apache projects or so)..?
> > > > > > > > >
> > > > > > > >
> > > > > > > > Most Apache projects use both Travis (unofficial) and Jenkins
> > > > > (Official
> > > > > > > > Apache CI).
> > > > > > > >
> > > > > > > > Jenkins is the official CI for all Apache projects while u
> can
> > > also
> > > > > use
> > > > > > > > Travis to validate PRs.
> > > > > > > >
> > > > > > > > YEs, I do see that the Travis builds take forever to launch
> > > > sometimes
> > > > > > > given
> > > > > > > > the large number of Apache projects.
> > > > > > > >
> > > > > > > > For Aria, you can go wth Travis if you choose to (and we need
> > to
> > > > file
> > > > > > an
> > > > > > > > Infra ticket to enable Travis for the project), but Jenkins
> > would
> > > > be
> > > > > > the
> > > > > > > > authoritative CI - most projects now have both enabled.
> > > > > > > >
> > > > > > > >
> > > > > > > > > 2) Pull requests - we're used to reviewing code using PRs
> on
> > > > > github.
> > > > > > > > > However, since the github repo is merely a mirror, it's
> > > > impossible
> > > > > to
> > > > > > > > merge
> > > > > > > > > PRs directly on github, which means we have to rebase the
> PR
> > > into
> > > > > the
> > > > > > > > > master branch and close the PR manually.
> > > > > > > > >
> > > > > > > >
> > > > > > > > Pull Requests for Apache github projects work a 

JIRA Issue Scheme

2016-10-30 Thread John D. Ament
I just saw this ticket in the INFRA backlog -
https://issues.apache.org/jira/browse/INFRA-12733

Just wondering, was this discussed on the ML?  I didn't see it, and I would
recommend leaving in ticket types like documentation.


Re: Questions regarding CI, PR and documentation

2016-10-30 Thread John D. Ament
Could you add me as well?

On Sun, Oct 30, 2016 at 11:50 AM Suneel Marthi 
wrote:

> Heh Sorry, Ran I added u to confluence - ur ApacheId 'ran' would be ur
> login.
>
> You have permissions to add users, please feel free to add others.
>
> On Sun, Oct 30, 2016 at 11:40 AM, Ran Ziv  wrote:
>
> > Suneel, could you please provide me (and possibly the rest of us as well)
> > permissions for creating pages on our Confluence? I don't seem to have
> > these permissions at the moment.
> > Thank you :)
> >
> > On Tue, Oct 25, 2016 at 6:05 PM, Suneel Marthi 
> wrote:
> >
> > > On Tue, Oct 25, 2016 at 10:55 AM, Ran Ziv  wrote:
> > >
> > > > Done.
> > > > I'll update the project's .travis file now.
> > > >
> > > > What is the process of setting up a Jenkins job?
> > > >
> > >
> > > Needs an Infra ticket.
> > >
> > > >
> > > > -
> > > >
> > > > Regarding shared documents, is Confluence the Apache standard? What
> > about
> > > > using github markup files and have the documents as a part of the
> repo?
> > > > Does anyone have any specific preference or other ideas on this
> matter?
> > > >
> > >
> > > Its again up to the project. Projects like Flink, Pirk, Beam have
> markup
> > > files in github and use Jekyll.
> > >
> > > They also use Confluence for few other things.
> > >
> > >
> > > >
> > > >
> > > > On Tue, Oct 25, 2016 at 3:11 PM, Suneel Marthi 
> > > wrote:
> > > >
> > > > > Never heard of CircleCI, and I don't think Infra is gonna support
> > that.
> > > > >
> > > > > Please go ahead and create an Infra ticket to enable Travis for
> Aria.
> > > > >
> > > > > On Tue, Oct 25, 2016 at 5:24 AM, Ran Ziv 
> wrote:
> > > > >
> > > > > > Regarding CI - Does Apache also support CircleCI? I assume less
> > > > projects
> > > > > > use it and if that's the case it could possibly be a better
> option
> > > for
> > > > us
> > > > > > if the purpose of using an additional CI environment (besides
> > > jenkins)
> > > > is
> > > > > > to allow for quick feedback over PRs.
> > > > > > If not I'll create an Infra JIRA to enable Travis for our
> project.
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Thu, Oct 20, 2016 at 5:29 PM, Suneel Marthi <
> smar...@apache.org
> > >
> > > > > wrote:
> > > > > >
> > > > > > > On Thu, Oct 20, 2016 at 8:38 AM, Ran Ziv 
> > > wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > I have some questions for our mentors:
> > > > > > > >
> > > > > > > >
> > > > > > > > 1) CI - we've noticed some Apache projects use online
> services
> > > > rather
> > > > > > > than
> > > > > > > > the infra tools  offered by Apache.
> > > We're
> > > > > > > leaning
> > > > > > > > towards using TravisCI, however we're somewhat worried that
> > since
> > > > all
> > > > > > > > apache projects are under a single github organization,
> builds
> > in
> > > > > > Travis
> > > > > > > > will take a very long time to start etc..
> > > > > > > >
> > > > > > > >  Are you aware of any such issues (or perhaps Travis offers
> > some
> > > > > > special
> > > > > > > > QoS to Apache projects or so)..?
> > > > > > > >
> > > > > > >
> > > > > > > Most Apache projects use both Travis (unofficial) and Jenkins
> > > > (Official
> > > > > > > Apache CI).
> > > > > > >
> > > > > > > Jenkins is the official CI for all Apache projects while u can
> > also
> > > > use
> > > > > > > Travis to validate PRs.
> > > > > > >
> > > > > > > YEs, I do see that the Travis builds take forever to launch
> > > sometimes
> > > > > > given
> > > > > > > the large number of Apache projects.
> > > > > > >
> > > > > > > For Aria, you can go wth Travis if you choose to (and we need
> to
> > > file
> > > > > an
> > > > > > > Infra ticket to enable Travis for the project), but Jenkins
> would
> > > be
> > > > > the
> > > > > > > authoritative CI - most projects now have both enabled.
> > > > > > >
> > > > > > >
> > > > > > > > 2) Pull requests - we're used to reviewing code using PRs on
> > > > github.
> > > > > > > > However, since the github repo is merely a mirror, it's
> > > impossible
> > > > to
> > > > > > > merge
> > > > > > > > PRs directly on github, which means we have to rebase the PR
> > into
> > > > the
> > > > > > > > master branch and close the PR manually.
> > > > > > > >
> > > > > > >
> > > > > > > Pull Requests for Apache github projects work a little
> different
> > > > unlike
> > > > > > the
> > > > > > > regular github projects.
> > > > > > > See  http://mahout.apache.org/developers/github.html for how
> > other
> > > > > > > projects
> > > > > > > handle PRs.
> > > > > > >
> > > > > > > Feel free to use that to create a similar documentation for
> Aria.
> > > > > > >
> > > > > > >
> > > > > > > > Do you have any recommendation for a different workflow we
> > could
> > > > use
> > > > > > for
> > > > > > > > this purpose? Are there possibly 

incubator-ariatosca git commit: CFY-4 fixed py2.6-incompatible usages [Forced Update!]

2016-10-30 Thread ran
Repository: incubator-ariatosca
Updated Branches:
  refs/heads/ARIA-3-api-for-creating-workflows 9672e5f62 -> 3397e4a6c (forced 
update)


CFY-4 fixed py2.6-incompatible usages


Project: http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/commit/3397e4a6
Tree: http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/tree/3397e4a6
Diff: http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/diff/3397e4a6

Branch: refs/heads/ARIA-3-api-for-creating-workflows
Commit: 3397e4a6cd9c62994ac53da568dac86a5872947b
Parents: f493fe8
Author: Ran Ziv 
Authored: Sun Oct 30 13:51:52 2016 +0200
Committer: Ran Ziv 
Committed: Sun Oct 30 14:22:09 2016 +0200

--
 aria/logger.py  | 6 +++---
 aria/storage/drivers.py | 2 +-
 aria/workflows/core/executor.py | 2 +-
 requirements.txt| 1 +
 4 files changed, 6 insertions(+), 5 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/blob/3397e4a6/aria/logger.py
--
diff --git a/aria/logger.py b/aria/logger.py
index 4959126..65bd653 100644
--- a/aria/logger.py
+++ b/aria/logger.py
@@ -37,7 +37,7 @@ class LoggerMixin(object):
 
 def __init__(self, *args, **kwargs):
 self.logger_name = self.logger_name or self.__class__.__name__
-self.logger = _base_logger.getChild(self.logger_name)
+self.logger = logging.getLogger('{0}.{1}'.format(_base_logger.name, 
self.logger_name))
 self.logger.setLevel(self.logger_level)
 super(LoggerMixin, self).__init__(*args, **kwargs)
 
@@ -63,7 +63,7 @@ class LoggerMixin(object):
 
 def __setstate__(self, obj_dict):
 vars(self).update(
-logger=_base_logger.getChild(obj_dict['logger_name']),
+logger=logging.getLogger('{0}.{1}'.format(_base_logger.name, 
obj_dict['logger_name'])),
 **obj_dict)
 
 
@@ -112,7 +112,7 @@ class _DefaultConsoleFormat(logging.Formatter):
 self._fmt = '%(levelname)s: %(message)s'
 except AttributeError:
 return record.message
-return super(_DefaultConsoleFormat, self).format(record)
+return logging.Formatter.format(record)
 
 
 def create_file_log_handler(

http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/blob/3397e4a6/aria/storage/drivers.py
--
diff --git a/aria/storage/drivers.py b/aria/storage/drivers.py
index 0ad2f49..33b7c00 100644
--- a/aria/storage/drivers.py
+++ b/aria/storage/drivers.py
@@ -32,7 +32,7 @@ import shutil
 # pylint has an issue with distutils and virtualenvs: 
https://github.com/PyCQA/pylint/issues/73
 import distutils.dir_util  
 # pylint: disable=no-name-in-module, import-error
 from functools import partial
-from multiprocessing import RLock
+from billiard import RLock
 
 import jsonpickle
 

http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/blob/3397e4a6/aria/workflows/core/executor.py
--
diff --git a/aria/workflows/core/executor.py b/aria/workflows/core/executor.py
index ace445a..1abecac 100644
--- a/aria/workflows/core/executor.py
+++ b/aria/workflows/core/executor.py
@@ -18,7 +18,7 @@ Executors for workflow tasks
 """
 
 import threading
-import multiprocessing
+import billiard as multiprocessing
 import Queue
 
 import jsonpickle

http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/blob/3397e4a6/requirements.txt
--
diff --git a/requirements.txt b/requirements.txt
index 1240b72..b585039 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -11,6 +11,7 @@
 # limitations under the License.
 
 PyYAML==3.10
+billiard==3.3.0.20
 networkx==1.9
 requests==2.7.0
 retrying==1.3.3



[1/5] incubator-ariatosca git commit: ARIA-6 Add tox.ini and .travis files for CI [Forced Update!]

2016-10-30 Thread ran
Repository: incubator-ariatosca
Updated Branches:
  refs/heads/ARIA-3-api-for-creating-workflows 21c99ee66 -> e721ba61b (forced 
update)


ARIA-6 Add tox.ini and .travis files for CI

The files actually existed but were out of date.
Both are now up to date. Tox will take care of installing both
code requirements and tests requirements before running the tests.

Additional changes:

 - several setup.py changes (set version to 0.1.0; updated email)

 - minor changes to tests' requirements (removed tox, froze mock)

 - fixed typo in "test_base_model_members" unit test

 - modified networkx dependency version to 1.9 (for py2.6 support)

 - added missing license header to requirements.txt files


Project: http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/commit/e1c919df
Tree: http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/tree/e1c919df
Diff: http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/diff/e1c919df

Branch: refs/heads/ARIA-3-api-for-creating-workflows
Commit: e1c919df95cc4c49901f5e3b1a786e8e039ccfe3
Parents: f380043
Author: Ran Ziv 
Authored: Tue Oct 25 17:47:35 2016 +0300
Committer: Ran Ziv 
Committed: Fri Oct 28 19:14:19 2016 +0300

--
 .travis.yml  | 30 ++
 requirements.txt | 14 +-
 setup.py |  6 +++---
 tests/requirements.txt   | 15 +--
 tests/storage/test_models.py |  2 +-
 tox.ini  | 39 ---
 6 files changed, 84 insertions(+), 22 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/blob/e1c919df/.travis.yml
--
diff --git a/.travis.yml b/.travis.yml
index 381cf43..8a54504 100644
--- a/.travis.yml
+++ b/.travis.yml
@@ -1,14 +1,28 @@
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
 sudo: false
 language: python
 python:
-- "2.7"
+  - "2.7"
 env:
-- TOX_ENV=pylint_package
-- TOX_ENV=pylint_tests
-- TOX_ENV=py26
-- TOX_ENV=py27
+- TOX_ENV=pylint_code
+- TOX_ENV=pylint_tests
+- TOX_ENV=py27
+- TOX_ENV=py26
 install:
-- pip install tox==1.6.1
+  - pip install --upgrade pip
+  - pip install tox
 script:
-- tox -e $TOX_ENV
-
+  - pip --version
+  - tox --version
+  - tox -e $TOX_ENV

http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/blob/e1c919df/requirements.txt
--
diff --git a/requirements.txt b/requirements.txt
index c2b7663..1240b72 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -1,5 +1,17 @@
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
 PyYAML==3.10
-networkx==1.11
+networkx==1.9
 requests==2.7.0
 retrying==1.3.3
 blinker==1.4

http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/blob/e1c919df/setup.py
--
diff --git a/setup.py b/setup.py
index b7978fe..811810b 100644
--- a/setup.py
+++ b/setup.py
@@ -26,7 +26,7 @@ if (sys.version_info[0], sys.version_info[1]) not in 
_PYTHON_SUPPORTED_VERSIONS:
 '{0} Package support Python version 2.6 & 2.7 Only'.format(
 _PACKAGE_NAME))
 
-version = '0.0.1'
+version = '0.1.0'
 execfile(os.path.join('.', _PACKAGE_NAME, 'VERSION.py'))
 
 
@@ -45,10 +45,10 @@ setup(
 name=_PACKAGE_NAME,
 version=version,
 author='aria-core',
-author_email='cosmo-ad...@gigaspaces.com',
+author_email='dev@ariatosca.incubator.apache.org',
 packages=find_packages(exclude=('*tests*',)),
 license='LICENSE',
-description='Aria Project',
+description='ARIA Project',
 zip_safe=False,
 install_requires=install_requires,
 

[3/5] incubator-ariatosca git commit: ARIA-4 Create an API for creating workflows

2016-10-30 Thread ran
ARIA-4 Create an API for creating workflows

An API for creating workflows. Users can build graphs of tasks and
set depenedencies in between tasks to execute them in a specific
order.

This commit also includes minimal reorganization of a few test
modules, so they are now using the same file system hierarchy as
the modules which they test.


Project: http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/commit/107c9729
Tree: http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/tree/107c9729
Diff: http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/diff/107c9729

Branch: refs/heads/ARIA-3-api-for-creating-workflows
Commit: 107c972981dbd2ce0bbc3ea55e2801049031a581
Parents: e1c919d
Author: Ran Ziv 
Authored: Fri Oct 21 13:21:25 2016 +0300
Committer: Ran Ziv 
Committed: Sun Oct 30 08:51:19 2016 +0200

--
 aria/contexts.py|   2 +-
 aria/workflows/api/task_graph.py| 305 +
 aria/workflows/api/tasks_graph.py   | 203 --
 tests/workflows/api/__init__.py |   0
 tests/workflows/api/test_task_graph.py  | 658 +++
 tests/workflows/core/__init__.py|   0
 tests/workflows/core/test_executor.py   | 117 
 .../test_task_graph_into_exececution_graph.py   |  79 +++
 tests/workflows/test_executor.py| 117 
 .../test_task_graph_into_exececution_graph.py   |  79 ---
 10 files changed, 1160 insertions(+), 400 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/blob/107c9729/aria/contexts.py
--
diff --git a/aria/contexts.py b/aria/contexts.py
index ae7fc66..3bda9be 100644
--- a/aria/contexts.py
+++ b/aria/contexts.py
@@ -21,7 +21,7 @@ from uuid import uuid4
 
 from aria.logger import LoggerMixin
 from aria.tools.lru_cache import lru_cache
-from aria.workflows.api.tasks_graph import TaskGraph
+from aria.workflows.api.task_graph import TaskGraph
 
 
 class WorkflowContext(LoggerMixin):

http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/blob/107c9729/aria/workflows/api/task_graph.py
--
diff --git a/aria/workflows/api/task_graph.py b/aria/workflows/api/task_graph.py
new file mode 100644
index 000..fdc4e2b
--- /dev/null
+++ b/aria/workflows/api/task_graph.py
@@ -0,0 +1,305 @@
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements.  See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License.  You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+"""
+Task graph. Used by users to build workflows
+"""
+
+from uuid import uuid4
+
+from networkx import DiGraph
+
+
+class TaskNotInGraphError(Exception):
+"""
+An error representing a scenario where a given task is not in the graph as 
expected
+"""
+pass
+
+
+class TaskGraph(object):
+"""
+A tasks graph builder.
+Build an operations flow graph
+"""
+
+def __init__(self, name):
+self.name = name
+self._id = str(uuid4())
+self._graph = DiGraph()
+
+def __repr__(self):
+return '{name}(id={self._id}, name={self.name}, 
graph={self._graph!r})'.format(
+name=self.__class__.__name__, self=self)
+
+# graph traversal methods
+
+@property
+def tasks(self):
+"""
+An iterator on tasks added to the graph
+:yields: Iterator over all tasks in the graph
+"""
+for _, data in self._graph.nodes_iter(data=True):
+yield data['task']
+
+def get_task_dependencies(self, dependent_task):
+"""
+Iterates over the task's dependencies
+:param BaseTask dependent_task: The task whose dependencies are 
requested
+:yields: Iterator over all tasks which dependency_task depends on
+:raise: TaskNotInGraphError if dependent_task is not in the graph
+"""
+if not self.has_task(dependent_task):
+raise TaskNotInGraphError('Task id: {0}'.format(dependent_task.id))
+for _, dependency_id in 

[5/5] incubator-ariatosca git commit: ARIA-4 modified graph group api

2016-10-30 Thread ran
ARIA-4 modified graph group api


Project: http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/repo
Commit: 
http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/commit/e721ba61
Tree: http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/tree/e721ba61
Diff: http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/diff/e721ba61

Branch: refs/heads/ARIA-3-api-for-creating-workflows
Commit: e721ba61ba1ac13f55a622cb43b0dd9f86288f6e
Parents: 6084453
Author: Ran Ziv 
Authored: Sun Oct 30 09:05:23 2016 +0200
Committer: Ran Ziv 
Committed: Sun Oct 30 09:05:23 2016 +0200

--
 aria/workflows/api/task_graph.py   | 113 +++-
 tests/workflows/api/test_task_graph.py |  28 +++
 2 files changed, 43 insertions(+), 98 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-ariatosca/blob/e721ba61/aria/workflows/api/task_graph.py
--
diff --git a/aria/workflows/api/task_graph.py b/aria/workflows/api/task_graph.py
index f645580..2d8ee54 100644
--- a/aria/workflows/api/task_graph.py
+++ b/aria/workflows/api/task_graph.py
@@ -215,64 +215,32 @@ class TaskGraph(object):
 self._graph.remove_edge(dependent_task.id, dependency_task.id)
 return True
 
-def sequence(self, item, *items):
-"""
-A graph-building helper, useful for chaining items in a sequence -
-it'll add a dependency for each item on the one that came before it
-
-an item may be either a task, a sequence or a parallel
-this method will also add to the graph each of the items not already 
present in it
-
-:param BaseTask|_TasksArrangement item: The first item (task, sequence 
or parallel)
-:param BaseTask|_TasksArrangement *items: The rest of the items (task, 
sequence or parallel)
-:return: The sequence object
-:rtype: _TasksSequence
-"""
-all_items = [item] + [i for i in items if i]
-prev_item = None
-
-for an_item in all_items:
-if not isinstance(an_item, TaskGraph._TasksArrangement) and not 
self.has_task(an_item):
-self.add_task(an_item)
-if prev_item is not None:
-self.add_dependency(an_item, prev_item)
-prev_item = an_item
-
-return self._TasksSequence(all_items)
-
-def parallel(self, item, *items):
-"""
-A graph-building helper, useful for allowing for several items to 
execute in parallel
-this method won't actually add any dependency between the items passed 
to it -
-but the returned object may be used to add dependencies for and on 
this group of items
+def sequence(self, *items):
+group = self.parallel(*items)
 
-an item may be either a task, a sequence or a parallel
-this method will also add to the graph each of the items not already 
present in it
+for i in xrange(1, len(items)):
+self.add_dependency(items[i], items[i-1])
 
-:param BaseTask|_TasksArrangement item: One item (task, sequence or 
parallel)
-:param BaseTask|_TasksArrangement *items: The rest of the items (task, 
sequence or parallel)
-:return: The parallel object
-:rtype: _TasksParallel
-"""
-all_items = [item] + [i for i in items if i]
+return group
 
-for an_item in all_items:
-if not isinstance(an_item, TaskGraph._TasksArrangement) and not 
self.has_task(an_item):
-self.add_task(an_item)
+def parallel(self, *items):
+for item in items:
+if not isinstance(item, _TasksGroup):
+self.add_task(item)
 
-return self._TasksParallel(all_items)
+return _TasksGroup(items)
 
 def _extract_dependent_and_dependency_tasks(self, dependent, dependency):
-if isinstance(dependent, TaskGraph._TasksArrangement):
-dependent_tasks = dependent.get_first_tasks()
+if isinstance(dependent, _TasksGroup):
+dependent_tasks = dependent.tasks
 else:
 if not self._graph.has_node(dependent.id):
 raise TaskNotInGraphError(
 'dependent task {0!r} is not in graph (task id: 
{0.id})'.format(dependent))
 dependent_tasks = [dependent]
 
-if isinstance(dependency, TaskGraph._TasksArrangement):
-dependency_tasks = dependency.get_last_tasks()
+if isinstance(dependency, _TasksGroup):
+dependency_tasks = dependency.tasks
 else:
 if not self._graph.has_node(dependency.id):
 raise TaskNotInGraphError(
@@ -281,42 +249,17 @@ class TaskGraph(object):
 
 return dependent_tasks, dependency_tasks
 
-class 

[jira] [Closed] (ARIATOSCA-6) Add tox.ini and .travis files for CI

2016-10-30 Thread Ran Ziv (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARIATOSCA-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ran Ziv closed ARIATOSCA-6.
---

> Add tox.ini and .travis files for CI
> 
>
> Key: ARIATOSCA-6
> URL: https://issues.apache.org/jira/browse/ARIATOSCA-6
> Project: AriaTosca
>  Issue Type: Task
>Reporter: Ran Ziv
>Assignee: Ran Ziv
> Fix For: 0.1.0
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)