incubator-airflow git commit: closes apache/incubator-airflow#1797 *closed for inactivity*

[sanand]

Repository: incubator-airflow
Updated Branches:
  refs/heads/master b8d739aaf -> 04168f34a


closes apache/incubator-airflow#1797 *closed for inactivity*


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/04168f34
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/04168f34
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/04168f34

Branch: refs/heads/master
Commit: 04168f34a16f90530761189b565a5fd885e81618
Parents: b8d739a
Author: Siddharth Anand 
Authored: Wed Nov 2 22:42:10 2016 -0700
Committer: Siddharth Anand 
Committed: Wed Nov 2 22:42:10 2016 -0700

--

--

[jira] [Commented] (AIRFLOW-1) Migrate GitHub code to Apache git

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/AIRFLOW-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631673#comment-15631673
 ] 

ASF subversion and git services commented on AIRFLOW-1:
---

Commit b8d739aaf4148e73c5cb8a163c091a91439c3ccc in incubator-airflow's branch 
refs/heads/master from [~mbreining]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=b8d739a ]

[AIRFLOW-614][AIRFLOW-1] Add Madrone as Airflow user

Closes #1866 from mbreining/master


> Migrate GitHub code to Apache git
> -
>
> Key: AIRFLOW-1
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: project-management
>Reporter: Maxime Beauchemin
>Assignee: Maxime Beauchemin
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (AIRFLOW-614) Add Madrone as Airflow user

[Siddharth Anand (JIRA)]

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Siddharth Anand resolved AIRFLOW-614.
-
Resolution: Fixed

Issue resolved by pull request #1866
[https://github.com/apache/incubator-airflow/pull/1866]

> Add Madrone as Airflow user
> ---
>
> Key: AIRFLOW-614
> URL: https://issues.apache.org/jira/browse/AIRFLOW-614
> Project: Apache Airflow
>  Issue Type: Task
>  Components: Documentation
>Reporter: Martin Breining
>Assignee: Martin Breining
>Priority: Trivial
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (AIRFLOW-614) Add Madrone as Airflow user

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/AIRFLOW-614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631672#comment-15631672
 ] 

ASF subversion and git services commented on AIRFLOW-614:
-

Commit b8d739aaf4148e73c5cb8a163c091a91439c3ccc in incubator-airflow's branch 
refs/heads/master from [~mbreining]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=b8d739a ]

[AIRFLOW-614][AIRFLOW-1] Add Madrone as Airflow user

Closes #1866 from mbreining/master


> Add Madrone as Airflow user
> ---
>
> Key: AIRFLOW-614
> URL: https://issues.apache.org/jira/browse/AIRFLOW-614
> Project: Apache Airflow
>  Issue Type: Task
>  Components: Documentation
>Reporter: Martin Breining
>Assignee: Martin Breining
>Priority: Trivial
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

incubator-airflow git commit: [AIRFLOW-614][AIRFLOW-1] Add Madrone as Airflow user

[sanand]

Repository: incubator-airflow
Updated Branches:
  refs/heads/master 372e4c7a2 -> b8d739aaf


[AIRFLOW-614][AIRFLOW-1] Add Madrone as Airflow user

Closes #1866 from mbreining/master


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/b8d739aa
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/b8d739aa
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/b8d739aa

Branch: refs/heads/master
Commit: b8d739aaf4148e73c5cb8a163c091a91439c3ccc
Parents: 372e4c7
Author: Martin Breining 
Authored: Wed Nov 2 22:33:41 2016 -0700
Committer: Siddharth Anand 
Committed: Wed Nov 2 22:33:41 2016 -0700

--
 README.md | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-airflow/blob/b8d739aa/README.md
--
diff --git a/README.md b/README.md
index b67bd16..ca0bf7e 100644
--- a/README.md
+++ b/README.md
@@ -116,6 +116,7 @@ Currently **officially** using Airflow:
 1. [LingoChamp](http://www.liulishuo.com/) 
[[@haitaoyao](https://github.com/haitaoyao)]
 1. [Lucid](http://luc.id) [[@jbrownlucid](https://github.com/jbrownlucid) & 
[@kkourtchikov](https://github.com/kkourtchikov)]
 1. 
[Lyft](https://www.lyft.com/)[[@SaurabhBajaj](https://github.com/SaurabhBajaj)]
+1. [Madrone](http://madroneco.com/) 
[[@mbreining](https://github.com/mbreining) & 
[@scotthb](https://github.com/scotthb)]
 1. [Markovian](https://markovian.com/) [[@al-xv](https://github.com/al-xv), 
[@skogsbaeck](https://github.com/skogsbaeck), 
[@waltherg](https://github.com/waltherg)]
 1. [MFG Labs](https://github.com/MfgLabs)
 1. [Nerdwallet](https://www.nerdwallet.com)

[jira] [Updated] (AIRFLOW-614) Add Madrone as Airflow user

[Martin Breining (JIRA)]

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Martin Breining updated AIRFLOW-614:

External issue URL: https://github.com/apache/incubator-airflow/pull/1866

> Add Madrone as Airflow user
> ---
>
> Key: AIRFLOW-614
> URL: https://issues.apache.org/jira/browse/AIRFLOW-614
> Project: Apache Airflow
>  Issue Type: Task
>  Components: Documentation
>Reporter: Martin Breining
>Assignee: Martin Breining
>Priority: Trivial
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (AIRFLOW-614) Add Madrone as Airflow user

[Martin Breining (JIRA)]

Martin Breining created AIRFLOW-614:
---

 Summary: Add Madrone as Airflow user
 Key: AIRFLOW-614
 URL: https://issues.apache.org/jira/browse/AIRFLOW-614
 Project: Apache Airflow
  Issue Type: Task
  Components: Documentation
Reporter: Martin Breining
Assignee: Martin Breining
Priority: Trivial






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (AIRFLOW-605) TI's without dagrun never set to failed or none.

[Paul Yang (JIRA)]

[ 
https://issues.apache.org/jira/browse/AIRFLOW-605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630490#comment-15630490
 ] 

Paul Yang commented on AIRFLOW-605:
---

I think the logic that sets tasks to those states if there is no DAG run could 
be removed and replaced with another mechanism. I'll see if I can get to it 
later this week.

> TI's without dagrun never set to failed or none.
> 
>
> Key: AIRFLOW-605
> URL: https://issues.apache.org/jira/browse/AIRFLOW-605
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: scheduler
>Reporter: Gerard Toonstra
>Priority: Minor
>
> The code that sets the task instance state to FAILED or NONE if there's no 
> dagrun associated with them always evaluates to True.
> dag_is_running = True
> for dag_run in dag_runs:
> if dag_run.state == State.RUNNING:
> dag_is_running = True
> break
> This code can be found in the jobs.py file.
> This probably never surfaced because usually they would have associated 
> dagruns, but I believe it can have an impact for manual runs and perhaps 
> backfills.
> I found this when browsing the source code, not because it was observed when 
> running airflow.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (AIRFLOW-613) Add Astronomer as Airflow user

[Siddharth Anand (JIRA)]

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Siddharth Anand resolved AIRFLOW-613.
-
Resolution: Fixed

Issue resolved by pull request #1864
[https://github.com/apache/incubator-airflow/pull/1864]

> Add Astronomer as Airflow user
> --
>
> Key: AIRFLOW-613
> URL: https://issues.apache.org/jira/browse/AIRFLOW-613
> Project: Apache Airflow
>  Issue Type: Task
>Reporter: Greg Neiheisel
>Assignee: Greg Neiheisel
>Priority: Trivial
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (AIRFLOW-1) Migrate GitHub code to Apache git

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/AIRFLOW-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630387#comment-15630387
 ] 

ASF subversion and git services commented on AIRFLOW-1:
---

Commit 372e4c7a286529fbc29345c3dbf2e2ba5db084e8 in incubator-airflow's branch 
refs/heads/master from [~schnie]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=372e4c7 ]

[AIRFLOW-613][AIRFLOW-1] Add Astronomer as Airflow user

Closes #1864 from schnie/master


> Migrate GitHub code to Apache git
> -
>
> Key: AIRFLOW-1
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: project-management
>Reporter: Maxime Beauchemin
>Assignee: Maxime Beauchemin
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (AIRFLOW-613) Add Astronomer as Airflow user

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/AIRFLOW-613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630386#comment-15630386
 ] 

ASF subversion and git services commented on AIRFLOW-613:
-

Commit 372e4c7a286529fbc29345c3dbf2e2ba5db084e8 in incubator-airflow's branch 
refs/heads/master from [~schnie]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=372e4c7 ]

[AIRFLOW-613][AIRFLOW-1] Add Astronomer as Airflow user

Closes #1864 from schnie/master


> Add Astronomer as Airflow user
> --
>
> Key: AIRFLOW-613
> URL: https://issues.apache.org/jira/browse/AIRFLOW-613
> Project: Apache Airflow
>  Issue Type: Task
>Reporter: Greg Neiheisel
>Assignee: Greg Neiheisel
>Priority: Trivial
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

incubator-airflow git commit: [AIRFLOW-613][AIRFLOW-1] Add Astronomer as Airflow user

[sanand]

Repository: incubator-airflow
Updated Branches:
  refs/heads/master e79ea3b8f -> 372e4c7a2


[AIRFLOW-613][AIRFLOW-1] Add Astronomer as Airflow user

Closes #1864 from schnie/master


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/372e4c7a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/372e4c7a
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/372e4c7a

Branch: refs/heads/master
Commit: 372e4c7a286529fbc29345c3dbf2e2ba5db084e8
Parents: e79ea3b
Author: schnie 
Authored: Wed Nov 2 13:37:53 2016 -0700
Committer: Siddharth Anand 
Committed: Wed Nov 2 13:37:53 2016 -0700

--
 README.md | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-airflow/blob/372e4c7a/README.md
--
diff --git a/README.md b/README.md
index 61cb56e..b67bd16 100644
--- a/README.md
+++ b/README.md
@@ -85,6 +85,7 @@ Currently **officially** using Airflow:
 1. [allegro.pl](http://allegro.tech/) [[@kretes](https://github.com/kretes)]
 1. [AltX](https://www.getaltx.com/about) 
[[@pedromduarte](https://github.com/pedromduarte)]
 1. [Apigee](https://apigee.com) [[@btallman](https://github.com/btallman)]
+1. [Astronomer](http://www.astronomer.io) 
[[@schnie](https://github.com/schnie)]
 1. [Auth0](https://auth0.com) [[@sicarul](https://github.com/sicarul)]
 1. [BandwidthX](http://www.bandwidthx.com) 
[[@dineshdsharma](https://github.com/dineshdsharma)]
 1. [Bellhops](https://github.com/bellhops)

[jira] [Updated] (AIRFLOW-613) Add Astronomer as Airflow user

[Siddharth Anand (JIRA)]

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Siddharth Anand updated AIRFLOW-613:

Assignee: Greg Neiheisel

> Add Astronomer as Airflow user
> --
>
> Key: AIRFLOW-613
> URL: https://issues.apache.org/jira/browse/AIRFLOW-613
> Project: Apache Airflow
>  Issue Type: Task
>Reporter: Greg Neiheisel
>Assignee: Greg Neiheisel
>Priority: Trivial
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (AIRFLOW-613) Add Astronomer as Airflow user

[Greg Neiheisel (JIRA)]

Greg Neiheisel created AIRFLOW-613:
--

 Summary: Add Astronomer as Airflow user
 Key: AIRFLOW-613
 URL: https://issues.apache.org/jira/browse/AIRFLOW-613
 Project: Apache Airflow
  Issue Type: Task
Reporter: Greg Neiheisel
Priority: Trivial






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (AIRFLOW-612) Moving and linking to the ressources links in the to wiki

[Siddharth Anand (JIRA)]

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Siddharth Anand resolved AIRFLOW-612.
-
Resolution: Fixed

Issue resolved by pull request #1863
[https://github.com/apache/incubator-airflow/pull/1863]

> Moving and linking to the ressources links in the to wiki
> -
>
> Key: AIRFLOW-612
> URL: https://issues.apache.org/jira/browse/AIRFLOW-612
> Project: Apache Airflow
>  Issue Type: Bug
>Reporter: Maxime Beauchemin
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

incubator-airflow git commit: [AIRFLOW-612] Move resources/articles links to wiki

[sanand]

Repository: incubator-airflow
Updated Branches:
  refs/heads/master 26c2df33b -> e79ea3b8f


[AIRFLOW-612] Move resources/articles links to wiki

Closes #1863 from mistercrunch/docs_links


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/e79ea3b8
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/e79ea3b8
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/e79ea3b8

Branch: refs/heads/master
Commit: e79ea3b8f001f81cafca4aa9de082608ad9506e6
Parents: 26c2df3
Author: Maxime Beauchemin 
Authored: Wed Nov 2 12:24:06 2016 -0700
Committer: Siddharth Anand 
Committed: Wed Nov 2 12:24:11 2016 -0700

--
 docs/project.rst | 19 +--
 1 file changed, 5 insertions(+), 14 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-airflow/blob/e79ea3b8/docs/project.rst
--
diff --git a/docs/project.rst b/docs/project.rst
index 0c18ffd..ff575ea 100644
--- a/docs/project.rst
+++ b/docs/project.rst
@@ -33,24 +33,15 @@ Contributor page:
 Resources & links
 -
 
+* `Airflow's official documentation `_
 * Mailing list (send emails to
-  ``dev-subscr...@airflow.incubator.apache.org`` and
+  ``dev-subscr...@airflow.incubator.apache.org`` and/or
   ``commits-subscr...@airflow.incubator.apache.org``
   to subscribe to each)
-* `Issues `_
-* `Airbnb Blog Post about Airflow `_
-* `Airflow Common Pitfalls 
`_
-* `Hadoop Summit Airflow Video `_
-* `Airflow at Agari Blog Post `_
-* `Talk: Best practices with Airflow (nov 2015) 
`_
-* `Airflow Lesson 1: TriggerDagRunOperator 
`_
-* `Docker Airflow (externally maintained) 
`_
-* `Airflow: Tips, Tricks, and Pitfalls @ Handy 
`_
-* `Airflow Chef recipe (community contributed) 
`_ ,
-  `another here `_
-* Airflow Puppet Module (community contributed) `puppet-airflow 
`_,
-  `airflow `_
+* `Issues on Apache's Jira `_
 * `Gitter (chat) Channel `_
+* `More resources and links to Airflow related content on the Wiki 
`_
+
 
 
 Roadmap

[jira] [Updated] (AIRFLOW-464) Add setdefault method to Variable Object

[Ben Tallman (JIRA)]

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ben Tallman updated AIRFLOW-464:

Description: 
In order to assist with environment migrations, we added a setdefault method to
the Variable object. This allows default variables to be created (and then
edited) with less chance for typos/copy+paste bugs.

Variable.setdefault(key, default, deserialize_json=[True|False]) returns either 
the
value stored in Variable(key) or sets Variable(key) = default and returns 
default.

  was:
In order to assist with environment migrations, add a create_if_none option
to the Variable.get function. This allows default variables to be created (and 
then
edited) with less chance for typos/copy+paste bugs.


> Add setdefault method to Variable Object
> 
>
> Key: AIRFLOW-464
> URL: https://issues.apache.org/jira/browse/AIRFLOW-464
> Project: Apache Airflow
>  Issue Type: Improvement
>Reporter: Ben Tallman
>Assignee: Ben Tallman
>Priority: Trivial
>
> In order to assist with environment migrations, we added a setdefault method 
> to
> the Variable object. This allows default variables to be created (and then
> edited) with less chance for typos/copy+paste bugs.
> Variable.setdefault(key, default, deserialize_json=[True|False]) returns 
> either the
> value stored in Variable(key) or sets Variable(key) = default and returns 
> default.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (AIRFLOW-464) Add setdefault method to Variable Object

[Ben Tallman (JIRA)]

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ben Tallman updated AIRFLOW-464:

Summary: Add setdefault method to Variable Object  (was: Add create_if_none 
option to Variable.get)

> Add setdefault method to Variable Object
> 
>
> Key: AIRFLOW-464
> URL: https://issues.apache.org/jira/browse/AIRFLOW-464
> Project: Apache Airflow
>  Issue Type: Improvement
>Reporter: Ben Tallman
>Assignee: Ben Tallman
>Priority: Trivial
>
> In order to assist with environment migrations, add a create_if_none option
> to the Variable.get function. This allows default variables to be created 
> (and then
> edited) with less chance for typos/copy+paste bugs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (AIRFLOW-612) Moving and linking to the ressources links in the to wiki

[Maxime Beauchemin (JIRA)]

Maxime Beauchemin created AIRFLOW-612:
-

 Summary: Moving and linking to the ressources links in the to wiki
 Key: AIRFLOW-612
 URL: https://issues.apache.org/jira/browse/AIRFLOW-612
 Project: Apache Airflow
  Issue Type: Bug
Reporter: Maxime Beauchemin






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (AIRFLOW-411) Add Python3 support to hipchat_operator

[Jeremiah Lowin (JIRA)]

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jeremiah Lowin resolved AIRFLOW-411.

Resolution: Fixed

Issue resolved by pull request #1721
[https://github.com/apache/incubator-airflow/pull/1721]

> Add Python3 support to hipchat_operator  
> -
>
> Key: AIRFLOW-411
> URL: https://issues.apache.org/jira/browse/AIRFLOW-411
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: contrib, operators
>Reporter: Dmitriy Lee
>Assignee: Dmitriy Lee
>
> HipChatAPISendRoomNotificationOperator uses dictionary method iteritems() 
> which was removed in Python3. Operator should detect python interpreter 
> version and use items() instead of iteritems() when running on python3



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (AIRFLOW-411) Add Python3 support to hipchat_operator

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/AIRFLOW-411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629992#comment-15629992
 ] 

ASF subversion and git services commented on AIRFLOW-411:
-

Commit 26c2df33bea5f04378131e49e84d1b7e66b36b4b in incubator-airflow's branch 
refs/heads/master from [~dmitriy.i.lee]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=26c2df3 ]

[AIRFLOW-411] Add Python3 support to hipchat_operator

Closes #1721 from d-lee/hipchat_operator_python3


> Add Python3 support to hipchat_operator  
> -
>
> Key: AIRFLOW-411
> URL: https://issues.apache.org/jira/browse/AIRFLOW-411
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: contrib, operators
>Reporter: Dmitriy Lee
>Assignee: Dmitriy Lee
>
> HipChatAPISendRoomNotificationOperator uses dictionary method iteritems() 
> which was removed in Python3. Operator should detect python interpreter 
> version and use items() instead of iteritems() when running on python3



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

incubator-airflow git commit: [AIRFLOW-411] Add Python3 support to hipchat_operator

[jlowin]

Repository: incubator-airflow
Updated Branches:
  refs/heads/master 39499e8aa -> 26c2df33b


[AIRFLOW-411] Add Python3 support to hipchat_operator

Closes #1721 from d-lee/hipchat_operator_python3


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/26c2df33
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/26c2df33
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/26c2df33

Branch: refs/heads/master
Commit: 26c2df33bea5f04378131e49e84d1b7e66b36b4b
Parents: 39499e8
Author: Dmitriy Lee 
Authored: Wed Nov 2 14:36:09 2016 -0400
Committer: Jeremiah Lowin 
Committed: Wed Nov 2 14:36:15 2016 -0400

--
 airflow/contrib/operators/hipchat_operator.py | 9 -
 1 file changed, 4 insertions(+), 5 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-airflow/blob/26c2df33/airflow/contrib/operators/hipchat_operator.py
--
diff --git a/airflow/contrib/operators/hipchat_operator.py 
b/airflow/contrib/operators/hipchat_operator.py
index cdfd573..0bc7cbe 100644
--- a/airflow/contrib/operators/hipchat_operator.py
+++ b/airflow/contrib/operators/hipchat_operator.py
@@ -12,6 +12,8 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
 
+from builtins import str
+
 from airflow.utils.decorators import apply_defaults
 from airflow.models import BaseOperator
 from airflow.exceptions import AirflowException
@@ -27,7 +29,6 @@ class HipChatAPIOperator(BaseOperator):
 at https://www.hipchat.com/docs/apiv2. Before using any HipChat API 
operators you need
 to get an authentication token at https://www.hipchat.com/docs/apiv2/auth.
 In the future additional HipChat operators will be derived from this class 
as well.
-
 :param token: HipChat REST API authentication token
 :type token: str
 :param base_url: HipChat REST API base url.
@@ -50,7 +51,6 @@ class HipChatAPIOperator(BaseOperator):
 """
 Used by the execute function. Set the request method, url, and body of 
HipChat's
 REST API call.
-
 Override in child class. Each HipChatAPI child operator is responsible 
for having
 a prepare_request method call which sets self.method, self.url, and 
self.body.
 """
@@ -76,7 +76,6 @@ class 
HipChatAPISendRoomNotificationOperator(HipChatAPIOperator):
 """
 Send notification to a specific HipChat room.
 More info: https://www.hipchat.com/docs/apiv2/method/send_room_notification
-
 :param room_id: Room in which to send notification on HipChat
 :type room_id: str
 :param message: The message body
@@ -110,7 +109,7 @@ class 
HipChatAPISendRoomNotificationOperator(HipChatAPIOperator):
 'notify': False,
 'card': None
 }
-for (prop, default) in default_options.iteritems():
+for (prop, default) in default_options.items():
 setattr(self, prop, kwargs.get(prop, default))
 
 def prepare_request(self):
@@ -127,4 +126,4 @@ class 
HipChatAPISendRoomNotificationOperator(HipChatAPIOperator):
 self.method = 'POST'
 self.url = '%s/room/%s/notification' % (self.base_url, self.room_id)
 self.body = json.dumps(dict(
-(k.encode('utf-8'), v.encode('utf-8')) for k, v in 
params.iteritems() if v))
+(str(k), str(v)) for k, v in params.items() if v))

[jira] [Resolved] (AIRFLOW-551) upgrade to flask to 0.11

[Siddharth Anand (JIRA)]

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Siddharth Anand resolved AIRFLOW-551.
-
Resolution: Fixed

Issue resolved by pull request #1825
[https://github.com/apache/incubator-airflow/pull/1825]

> upgrade to flask to 0.11
> 
>
> Key: AIRFLOW-551
> URL: https://issues.apache.org/jira/browse/AIRFLOW-551
> Project: Apache Airflow
>  Issue Type: Improvement
>Reporter: Haydn Dufrene
>Assignee: Haydn Dufrene
>
> airflow currently pins flask at <0.11 which can cause dependency issues with 
> other applications requiring 0.11. 0.11 has very minimal breaking changes, 
> going to test that everything is compatible.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (AIRFLOW-551) upgrade to flask to 0.11

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/AIRFLOW-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15628102#comment-15628102
 ] 

ASF subversion and git services commented on AIRFLOW-551:
-

Commit 39499e8aa8d1967012b04912bef9a057c0ab87ed in incubator-airflow's branch 
refs/heads/master from jedipi
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=39499e8 ]

[AIRFLOW-551] pin flask to >=0.11, <0.12

Closes #1825 from jedipi/improvement/upgrade-flask


> upgrade to flask to 0.11
> 
>
> Key: AIRFLOW-551
> URL: https://issues.apache.org/jira/browse/AIRFLOW-551
> Project: Apache Airflow
>  Issue Type: Improvement
>Reporter: Haydn Dufrene
>Assignee: Haydn Dufrene
>
> airflow currently pins flask at <0.11 which can cause dependency issues with 
> other applications requiring 0.11. 0.11 has very minimal breaking changes, 
> going to test that everything is compatible.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (AIRFLOW-552) upgrade funcsigs to 1.0.2

[Siddharth Anand (JIRA)]

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Siddharth Anand resolved AIRFLOW-552.
-
Resolution: Fixed

Issue resolved by pull request #1826
[https://github.com/apache/incubator-airflow/pull/1826]

> upgrade funcsigs to 1.0.2
> -
>
> Key: AIRFLOW-552
> URL: https://issues.apache.org/jira/browse/AIRFLOW-552
> Project: Apache Airflow
>  Issue Type: Improvement
>Reporter: Haydn Dufrene
>Assignee: Haydn Dufrene
>
> airflow currently pins funcigs at <1 which can cause dependency issues with 
> other applications requiring current versions (1.0.2).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (AIRFLOW-590) Set module parameter in Oracle hook

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/AIRFLOW-590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15628065#comment-15628065
 ] 

ASF subversion and git services commented on AIRFLOW-590:
-

Commit 2daf7a8168fc57801e430d78e37ed62ec99d50dc in incubator-airflow's branch 
refs/heads/master from [~g.toonstra]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=2daf7a8 ]

[AIRFLOW-590] Set module parameter in OracleHook

Closes #1848 from gtoonstra/oracle_action_module


> Set module parameter in Oracle hook
> ---
>
> Key: AIRFLOW-590
> URL: https://issues.apache.org/jira/browse/AIRFLOW-590
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: hooks
>Reporter: Gerard Toonstra
>Priority: Trivial
>
> The Oracle database has the possibility to specify the module that accesses 
> the database and the action that this module is performing. This can be set 
> through a write-only property immediately after the connection is made. 
> By setting the module in the connection parameters under "extra_json", which 
> is usually where the service_name and SID are also kept, every oracle hook 
> that is run can then have the module specified automatically (if module is 
> set).
> Developers can then personally decide if they wish to set the "action" 
> property in their operators or totally ignore it . 
> The way this looks in the session view of Oracle is like this:
> Before:
> amsterdam inactivetest_dag.py@myserver (TNS V1-V3)
> After:
> amsterdam inactiveairflow
> (or variations thereof, like "airflow@myserver", "airflow@datascience", etc.).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

incubator-airflow git commit: [AIRFLOW-590] Set module parameter in OracleHook

[sanand]

Repository: incubator-airflow
Updated Branches:
  refs/heads/master 0b6ac66e4 -> 2daf7a816


[AIRFLOW-590] Set module parameter in OracleHook

Closes #1848 from gtoonstra/oracle_action_module


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/2daf7a81
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/2daf7a81
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/2daf7a81

Branch: refs/heads/master
Commit: 2daf7a8168fc57801e430d78e37ed62ec99d50dc
Parents: 0b6ac66
Author: gtoonstra 
Authored: Wed Nov 2 00:33:54 2016 -0700
Committer: Siddharth Anand 
Committed: Wed Nov 2 00:33:54 2016 -0700

--
 airflow/hooks/oracle_hook.py | 8 +++-
 1 file changed, 7 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-airflow/blob/2daf7a81/airflow/hooks/oracle_hook.py
--
diff --git a/airflow/hooks/oracle_hook.py b/airflow/hooks/oracle_hook.py
index 6556ce7..1386d6d 100644
--- a/airflow/hooks/oracle_hook.py
+++ b/airflow/hooks/oracle_hook.py
@@ -44,6 +44,8 @@ class OracleHook(DbApiHook):
 conn = self.get_connection(self.oracle_conn_id)
 dsn = conn.extra_dejson.get('dsn', None)
 sid = conn.extra_dejson.get('sid', None)
+mod = conn.extra_dejson.get('module', None)
+
 service_name = conn.extra_dejson.get('service_name', None)
 if dsn and sid and not service_name:
 dsn = cx_Oracle.makedsn(dsn, conn.port, sid)
@@ -53,9 +55,13 @@ class OracleHook(DbApiHook):
 conn = cx_Oracle.connect(conn.login, conn.password, dsn=dsn)
 else:
 conn = cx_Oracle.connect(conn.login, conn.password, conn.host)
+
+if mod is not None:
+conn.module = mod
+
 return conn
 
-def insert_rows(self, table, rows, target_fields = None, commit_every = 
1000):
+def insert_rows(self, table, rows, target_fields=None, commit_every=1000):
 """
 A generic way to insert a set of tuples into a table,
 the whole set of inserts is treated as one transaction

incubator-airflow git commit: closes apache/incubator-airflow#1692 *closed for inactivity*

[sanand]

Repository: incubator-airflow
Updated Branches:
  refs/heads/master 044894874 -> 0b6ac66e4


closes apache/incubator-airflow#1692 *closed for inactivity*


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/0b6ac66e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/0b6ac66e
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/0b6ac66e

Branch: refs/heads/master
Commit: 0b6ac66e43784ac277c657d32dff727ed6a061be
Parents: 0448948
Author: Siddharth Anand 
Authored: Wed Nov 2 00:24:10 2016 -0700
Committer: Siddharth Anand 
Committed: Wed Nov 2 00:24:10 2016 -0700

--

--

incubator-airflow git commit: closes apache/incubator-airflow#915 *closed for inactivity*

[sanand]

Repository: incubator-airflow
Updated Branches:
  refs/heads/master 730d35324 -> 044894874


closes apache/incubator-airflow#915 *closed for inactivity*


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/04489487
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/04489487
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/04489487

Branch: refs/heads/master
Commit: 0448948742f414925befb9566a2198fa32b28360
Parents: 730d353
Author: Siddharth Anand 
Authored: Wed Nov 2 00:20:28 2016 -0700
Committer: Siddharth Anand 
Committed: Wed Nov 2 00:20:28 2016 -0700

--

--

incubator-airflow git commit: closes apache/incubator-airflow#1439 *fixed by other PR:#1760*

[sanand]

Repository: incubator-airflow
Updated Branches:
  refs/heads/master e26c2e4b1 -> 730d35324


closes apache/incubator-airflow#1439 *fixed by other PR:#1760*


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/730d3532
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/730d3532
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/730d3532

Branch: refs/heads/master
Commit: 730d353249f4f066813529f75c07ddbd7731ef8c
Parents: e26c2e4
Author: Siddharth Anand 
Authored: Wed Nov 2 00:18:47 2016 -0700
Committer: Siddharth Anand 
Committed: Wed Nov 2 00:18:47 2016 -0700

--

--

incubator-airflow git commit: closes apache/incubator-airflow#1497 *closed for inactivity*

[sanand]

Repository: incubator-airflow
Updated Branches:
  refs/heads/master 4f4285746 -> e26c2e4b1


closes apache/incubator-airflow#1497 *closed for inactivity*


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/e26c2e4b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/e26c2e4b
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/e26c2e4b

Branch: refs/heads/master
Commit: e26c2e4b1b9fd04ee37d56c24d7867aef08c6d88
Parents: 4f42857
Author: Siddharth Anand 
Authored: Wed Nov 2 00:10:59 2016 -0700
Committer: Siddharth Anand 
Committed: Wed Nov 2 00:10:59 2016 -0700

--

--

incubator-airflow git commit: closes apache/incubator-airflow#1391 *closed for inactivity*

[sanand]

Repository: incubator-airflow
Updated Branches:
  refs/heads/master 527e3ecdb -> 4f4285746


closes apache/incubator-airflow#1391 *closed for inactivity*


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/4f428574
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/4f428574
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/4f428574

Branch: refs/heads/master
Commit: 4f4285746c00ef8b60e945d306290b49c0540ceb
Parents: 527e3ec
Author: Siddharth Anand 
Authored: Wed Nov 2 00:09:39 2016 -0700
Committer: Siddharth Anand 
Committed: Wed Nov 2 00:09:39 2016 -0700

--

--