[jira] [Created] (AIRFLOW-731) NamedHivePartitionSensor chokes on partition predicate with periods.

2017-01-04 Thread Arthur Wiedmer (JIRA) 
Arthur Wiedmer created AIRFLOW-731:
--

 Summary: NamedHivePartitionSensor chokes on partition predicate 
with periods.
 Key: AIRFLOW-731
 URL: https://issues.apache.org/jira/browse/AIRFLOW-731
 Project: Apache Airflow
  Issue Type: Bug
Affects Versions: Airflow 1.7.1, Airflow 1.7.0
Reporter: Arthur Wiedmer
Assignee: Arthur Wiedmer
Priority: Trivial


The partition parsing function did not limit splitting around the first period 
leading to issues.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (AIRFLOW-730) Add Handshake to list of Airflow users

2017-01-04 Thread Siddharth Anand (JIRA) 

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Siddharth Anand resolved AIRFLOW-730.
-
Resolution: Fixed

Issue resolved by pull request #1972
[https://github.com/apache/incubator-airflow/pull/1972]

> Add Handshake to list of Airflow users
> --
>
> Key: AIRFLOW-730
> URL: https://issues.apache.org/jira/browse/AIRFLOW-730
> Project: Apache Airflow
>  Issue Type: Task
>  Components: Documentation
>Reporter: Matt Hickman
>Assignee: Matt Hickman
>Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (AIRFLOW-730) Add Handshake to list of Airflow users

2017-01-04 Thread ASF subversion and git services (JIRA) 

[ 
https://issues.apache.org/jira/browse/AIRFLOW-730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799627#comment-15799627
 ] 

ASF subversion and git services commented on AIRFLOW-730:
-

Commit 3f7b875013f2302407e5a6ae13afbab542b05654 in incubator-airflow's branch 
refs/heads/master from [~mhickman]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=3f7b875 ]

[AIRFLOW-730] Add Handshake to Airflow users

Closes #1972 from mhickman/master


> Add Handshake to list of Airflow users
> --
>
> Key: AIRFLOW-730
> URL: https://issues.apache.org/jira/browse/AIRFLOW-730
> Project: Apache Airflow
>  Issue Type: Task
>  Components: Documentation
>Reporter: Matt Hickman
>Assignee: Matt Hickman
>Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

incubator-airflow git commit: [AIRFLOW-730] Add Handshake to Airflow users

2017-01-04 Thread sanand 
Repository: incubator-airflow
Updated Branches:
  refs/heads/master 9df4789a9 -> 3f7b87501


[AIRFLOW-730] Add Handshake to Airflow users

Closes #1972 from mhickman/master


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/3f7b8750
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/3f7b8750
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/3f7b8750

Branch: refs/heads/master
Commit: 3f7b875013f2302407e5a6ae13afbab542b05654
Parents: 9df4789
Author: Matt Hickman 
Authored: Wed Jan 4 15:00:26 2017 -0800
Committer: Siddharth Anand 
Committed: Wed Jan 4 15:00:32 2017 -0800

--
 README.md | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-airflow/blob/3f7b8750/README.md
--
diff --git a/README.md b/README.md
index 1c7798a..f682117 100644
--- a/README.md
+++ b/README.md
@@ -105,6 +105,7 @@ Currently **officially** using Airflow:
 1. [Gentner Lab](http://github.com/gentnerlab) 
[[@neuromusic](https://github.com/neuromusic)]
 1. [Glassdoor](https://github.com/Glassdoor) 
[[@syvineckruyk](https://github.com/syvineckruyk)]
 1. [Gusto](https://gusto.com) [[@frankhsu](https://github.com/frankhsu)]
+1. [Handshake](https://joinhandshake.com/) 
[[@mhickman](https://github.com/mhickman)]
 1. [Handy](http://www.handy.com/careers/73115?gh_jid=73115_src=o5qcxn) 
[[@marcintustin](https://github.com/marcintustin) / 
[@mtustin-handy](https://github.com/mtustin-handy)]
 1. [HelloFresh](https://www.hellofresh.com) 
[[@tammymendt](https://github.com/tammymendt) & 
[@davidsbatista](https://github.com/davidsbatista) & 
[@iuriinedostup](https://github.com/iuriinedostup)]
 1. [Holimetrix](http://holimetrix.com/) 
[[@thibault-ketterer](https://github.com/thibault-ketterer)]

svn commit: r17671 - /release/incubator/airflow/1.8.0-incubating/

2017-01-04 Thread bolke 
Author: bolke
Date: Wed Jan  4 18:38:47 2017
New Revision: 17671

Log:
Add 1.8.0 release directory

Added:
release/incubator/airflow/1.8.0-incubating/

svn commit: r17670 - /release/incubator/airflow/KEYS

2017-01-04 Thread bolke 
Author: bolke
Date: Wed Jan  4 18:31:11 2017
New Revision: 17670

Log:
Add Bolke de Bruin

Modified:
release/incubator/airflow/KEYS

Modified: release/incubator/airflow/KEYS
==
--- release/incubator/airflow/KEYS (original)
+++ release/incubator/airflow/KEYS Wed Jan  4 18:31:11 2017
@@ -49,3 +49,60 @@ nq3QRmQodMrYAE1xFO8mGgDZa76gXPqTvE7p8tBu
 9nWFeFonQdDRsOMsWZAx/vx5zv5s9tf3inWb2HNzjxT5
 =GeJQ
 -END PGP PUBLIC KEY BLOCK-
+pub   4096R/D905A0BA 2016-08-31
+uid   [ unknown] Bolke de Bruin (CODE SIGNING KEY) 
+sig 3D905A0BA 2016-08-31  Bolke de Bruin (CODE SIGNING KEY) 

+sub   4096R/A6D6C333 2016-08-31
+sig  D905A0BA 2016-08-31  Bolke de Bruin (CODE SIGNING KEY) 

+
+-BEGIN PGP PUBLIC KEY BLOCK-
+
+mQINBFfHKlQBEAC3cTr8KN+ex455jawyPCT1IMdH0t1bI7M68Rtki5Y1qcMBeBGE
+fN6SDySHNplBThNfBICJBK2BQqRjGQOCH4H0XfgQbyG6EJW/BfVzZhbYMrl9Am/Y
+KkhzjtjES9Atn2v39cpH2npS8k6+cDj4AnqcMFvz3cOU+T/AdLgZKvLjqMcefSiu
+itNozJvRCnmArk3UrI2rCx1AVCDJWENDWWHx+uFomdBWJnr3pTsSpF42N9i9nZc6
+GnJoPQ2jNQKmU29CGFTnpBWQ0ZaXBxTkwooT0faSaDQTkXk4TUAfoSz8rU3OVaKM
+45qeHwvJIoKK+HjgIeI3WuGeYVjCN31Oc3MggkHsDYwRjkTQbYpVykb9TSYhLM4P
+I/+1ZoPaLEAvgxj93UsENPpmKJhtSFTsg0Hpr3vspsLx98DP+tREqGeJpctOGU/4
+FBWVXsWXFwrPjUWtw5JHjrHZnPgpg5HPLv2zfNePCHL+8UZHmAgUwBC1etnWwdku
+b5hIi6OfY+AqFgIiuEBLruW7mhV7LLl3Afs78RCIAecZ22pKbwyXwy8iUQVJMvPa
+NGVpqMS+ZvBnpgwM9lV696WrdXnhYAEc3LHnlUaaHWPr0IundI9z+zPXUQw+H+3T
+E1Oue90tXjWLZl0uMwvQwAdUau4qkIas941vxkzI4kUn5IpG2ib0n0NjWwARAQAB
+tDRCb2xrZSBkZSBCcnVpbiAoQ09ERSBTSUdOSU5HIEtFWSkgPGJvbGtlQGFwYWNo
+ZS5vcmc+iQI3BBMBCgAhBQJXxypUAhsDBQsJCAcDBRUKCQgLBRYCAwEAAh4BAheA
+AAoJEDUZC4PZBaC6YBUP/18NEF8sRo284Sl++gnZYRj2j1Dqosj79hay4Fvk8OaC
+MYlU9gzdfTRazlInUYqq1UpdTk/761ZHThWrmL2NbF5G/c5Ry2QNZg814Bh0ZNu2
+GUzPgaMqJ54UUWOSbN7qYEhpChWJLD4HQ4vHpZwUMLZv6hlq3jJqhKUs5OvDoN4B
+pPz75u/T4MmjNBSyhV1HGAXFK1rwU7yAj9nDji1+jhKWsFJjI7+lhRlAW5yB1MF+
+zOT+ugaXQYzQFq/KNAoGeYfhiTqOyDRypz6s68fRwZjGakmkus8yKPtUaz9eXMC0
+9gz1YwgfRdamDGfC40y94k9uvCPgQ7N5DP71oaNwztJ1//3f4F3xYFBfCu9AhuDn
+okQ9ftmCFFdjSHSFctYd3RGSQbsYZZ0vVoOWPn7Pq3Rp/llU+u+4qKbcNaOs0JBF
+uERtQC6jAs/JPfuRbWT/IUErbK6jnapKT/9BZ8xkxg7++OyBQ5+NLu2RARrURfgV
+dZGVslMQyM8mojXKn93174bkwMYbMBXaLFfxt3KT5ClyAAUk3MFdihBZ+txRiPQP
+pOHn/76LgSGruAoUbYM8YaAESM9t+w1PRB0YgfOSaQBIr/IhQB7sdhlk9xmqucV/
+PhUbiOqV3/DlOSIIccAtd1L45jJJKPXxDYZCIP7R1ncThjbFniBgkmBPNK5Hxj0y
+uQINBFfHKlQBEADMDeBeJqMY/ozT9Lk8w7P2KGASmTd02zLlwN6PaCGqe9r2RTHZ
+dbOcsbe9zrMkYPNVHGnyje1kLHd5/LxombJ6HMws1ZSt11rGI0aLjtSoWfYwGtky
++4UJ0rSFuKR8IZNK+IaPI5aEetlW0RYnxKhUSzps73vdfS4pTVQu2RGmDzzVxjGN
+1OfDRoGPef/oFXHGXTukib9uEnT4Elz6hz8FXOqX78C4iNVpOpjNzIK7r6Uip6oT
+ZhBINsEBhwIa5RVp8CzvoeCAFqHZSqLqGA2e6mg9/01U/Yi18Ud9naskfbUd1hw8
+Qi09h+ALoOrzec1iKTQr5qZ2xQWH+tbV5Ef2eQQwXw3Us1JvM62IghvkUT7ZbCFu
+6CYHVScEP0zS/DTXge47z4cR41YkN9WeQqBku5QLrVVMtVWj0fS56PdZ8ui0HBS5
+mKCsi0rnuNpW9yMdQW8zH2lmH1R768Z58ltM2+ug8gbgEL1Xup0tHXVdXV/42nDD
+TXiTA7QgkqI2AsE1UJ/taarSL0DpoKABVPZPZ3f7kQSWMosebdUgPBhzJG7PqvQx
+5eGfZ8RnfBKs966k8YdnKSvI7hrDjm4rFVXT6/9j7kdGYvq9Nng94RqvpD93oBoC
+57EwQ1pCirzXaZq739rkBWMlK34V7LiuYSeDhtLmUcSUyURYl8hYUtFKxQARAQAB
+iQIfBBgBCgAJBQJXxypUAhsMAAoJEDUZC4PZBaC6uOEQAKhGltzufI++DZOzthR3
+FTul1EPbrc83HIuv/dRRM10B7srKYmN0oFusLGpac+afMRfx8IVU2mjieN3YXXH+
+zbn/RC/rcZxgvdNCe6R5eWYWgSB5qFCad+Yp1F//3L1FfdDkwVcqXE10pCo8Xn0x
+xDbQc180AlHoMCeTUunAovwd6JgiYDRzPNdQuiVEaPb2AeA0zvMVOIEHbzio3ldj
+TGT/vaQTrlczMML1cFz1qJUKwo5Auen8E/FbI3BhKwTfIkmGBMrdaWXd2aRreRRN
+IdcCDb2z5lDfoNtfLKM37rye61bS7+ft58M/AI/XCILwVQgYAdGPa+QZ0YOptOKg
+QZgAoi5eHNvj0QvKfwTyRyIzgJS3x8Iz6hsgFBHMmAd7+uCVDdVWp1nYmGe+d+N4
+3l7yJGSLPVPFgRrW6QSKpXp42aeRgAuXizn7Qi2kRxdeQxTEckaRbokZotiDOrBl
+3nh5mU2pUtmFSUwgac/v4st9PXWpIynKMsxPi0D3LUzOBqswg6q192hmB4ixJ9QE
+u3CCA4oRFVCZtCsOC0+gDJVBxGddf/vdDVaOiQ1PbhfzlkclyEC1dKI+xNxpnkY/
+G6K3WOWXER2Cu5pEJo00Nik7u9qZKi5jHmZPDFNX0jVJlCDLeGAS/q+0wa5BcdPM
+VI92yOQJ6LdUq0ze/hbHbZs3
+=11vL
+-END PGP PUBLIC KEY BLOCK-

incubator-airflow git commit: Bump version to 1.8.0alpha2

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/v1-8-test 9df4789a9 -> 55842308f


Bump version to 1.8.0alpha2


Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/55842308
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/55842308
Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/55842308

Branch: refs/heads/v1-8-test
Commit: 55842308f60cd1f38942e4421f79eba950e65bdc
Parents: 9df4789
Author: Bolke de Bruin 
Authored: Wed Jan 4 16:45:17 2017 +0100
Committer: Bolke de Bruin 
Committed: Wed Jan 4 16:45:17 2017 +0100

--
 airflow/version.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-airflow/blob/55842308/airflow/version.py
--
diff --git a/airflow/version.py b/airflow/version.py
index 227536d..f9fd688 100644
--- a/airflow/version.py
+++ b/airflow/version.py
@@ -13,4 +13,4 @@
 # limitations under the License.
 #
 
-version = '1.7.2.dev0'
+version = '1.8.0a2'

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/kill_undeads [deleted] b8b1b2101

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/kill_highcharts [deleted] eab1db617

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/list_dags_report [deleted] b94293345

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/set_shutdown_ui [deleted] b2c061385

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/more_logging [deleted] b2ab6ea08

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/rm_reqs [deleted] 1dec1fe07

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/rb.1.7.0 [deleted] ffc070100

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/fixing_landscape_suggested_issues [deleted] 3d41f9caf

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/extend-config [deleted] 20d41b671

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/fix_dr_tree [deleted] b42257b21

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/airbnb_staging [deleted] ea16895a0

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/ddavydov/why_isnt_my_task_running_view [deleted] c26c79867

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/ddavydov/test-PR-855 [deleted] 76e1b408a

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/undead_2 [deleted] dbeed8ee7

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/nopool [deleted] 1d01a2668

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/dag_validate [deleted] d6c4e2786

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/airbnb_1.7.0rc1-hotfix.1-gunicorn-timeout-increase [deleted] 
1bd3f3e90

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/branch-1.7.2-apache [deleted] bb7b75345

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/coveralls_STFU [deleted] c795246af

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/airbnb_prod [deleted] ea16895a0

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/adding_force_option_for_backfill [deleted] 7e2c517c2

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/AIRFLOW-721 [deleted] 9de7762d4

[incubator-airflow] Git Push Summary

2017-01-04 Thread bolke 
Repository: incubator-airflow
Updated Branches:
  refs/heads/v1-8-test [created] 9df4789a9

[jira] [Work stopped] (AIRFLOW-729) Google Dataproc cluster creation operator

2017-01-04 Thread Bob De Schutter (JIRA) 

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on AIRFLOW-729 stopped by Bob De Schutter.
---
> Google Dataproc cluster creation operator
> -
>
> Key: AIRFLOW-729
> URL: https://issues.apache.org/jira/browse/AIRFLOW-729
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: gcp, operators
>Reporter: Bob De Schutter
>Assignee: Bob De Schutter
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> Add an operator that creates a Google Cloud Dataproc cluster.
> The operator checks if there is already a cluster running with the provided 
> name in the provided project. If so, the operator finishes successfully. 
> Otherwise, the operator issues a rest API call to initiate the cluster 
> creation and waits until the creation is successful before exiting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (AIRFLOW-729) Google Dataproc cluster creation operator

2017-01-04 Thread Bob De Schutter (JIRA) 

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bob De Schutter updated AIRFLOW-729:

Description: 
Add an operator that creates a Google Cloud Dataproc cluster.

The operator checks if there is already a cluster running with the provided 
name in the provided project. If so, the operator finishes successfully. 
Otherwise, the operator issues a rest API call to initiate the cluster creation 
and waits until the creation is successful before exiting.

  was:Add an operator that creates a Google Cloud Dataproc cluster.


> Google Dataproc cluster creation operator
> -
>
> Key: AIRFLOW-729
> URL: https://issues.apache.org/jira/browse/AIRFLOW-729
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: gcp, operators
>Reporter: Bob De Schutter
>Assignee: Bob De Schutter
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> Add an operator that creates a Google Cloud Dataproc cluster.
> The operator checks if there is already a cluster running with the provided 
> name in the provided project. If so, the operator finishes successfully. 
> Otherwise, the operator issues a rest API call to initiate the cluster 
> creation and waits until the creation is successful before exiting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (AIRFLOW-729) Google Dataproc cluster creation operator

2017-01-04 Thread Bob De Schutter (JIRA) 
Bob De Schutter created AIRFLOW-729:
---

 Summary: Google Dataproc cluster creation operator
 Key: AIRFLOW-729
 URL: https://issues.apache.org/jira/browse/AIRFLOW-729
 Project: Apache Airflow
  Issue Type: New Feature
  Components: gcp, operators
Reporter: Bob De Schutter
Assignee: Bob De Schutter


Add an operator that creates a Google Cloud Dataproc cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Work started] (AIRFLOW-729) Google Dataproc cluster creation operator

2017-01-04 Thread Bob De Schutter (JIRA) 

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on AIRFLOW-729 started by Bob De Schutter.
---
> Google Dataproc cluster creation operator
> -
>
> Key: AIRFLOW-729
> URL: https://issues.apache.org/jira/browse/AIRFLOW-729
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: gcp, operators
>Reporter: Bob De Schutter
>Assignee: Bob De Schutter
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> Add an operator that creates a Google Cloud Dataproc cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Work stopped] (AIRFLOW-728) Google Bigquery table exists sensor

2017-01-04 Thread Bob De Schutter (JIRA) 

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on AIRFLOW-728 stopped by Bob De Schutter.
---
> Google Bigquery table exists sensor
> ---
>
> Key: AIRFLOW-728
> URL: https://issues.apache.org/jira/browse/AIRFLOW-728
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: gcp
>Reporter: Bob De Schutter
>Assignee: Bob De Schutter
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> Design a sensor that checks whether a certain table is present in bigquery. 
> The sensor will accept the google cloud project id, bigquery dataset id and 
> bigquery table id to check as parameters.
> Internally, it will use the bigquery hook to check for the existence of the 
> table. Therefore a 'table_exists' method will be added to the existing 
> Bigquery hook.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Work started] (AIRFLOW-728) Google Bigquery table exists sensor

2017-01-04 Thread Bob De Schutter (JIRA) 

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on AIRFLOW-728 started by Bob De Schutter.
---
> Google Bigquery table exists sensor
> ---
>
> Key: AIRFLOW-728
> URL: https://issues.apache.org/jira/browse/AIRFLOW-728
> Project: Apache Airflow
>  Issue Type: New Feature
>  Components: gcp
>Reporter: Bob De Schutter
>Assignee: Bob De Schutter
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> Design a sensor that checks whether a certain table is present in bigquery. 
> The sensor will accept the google cloud project id, bigquery dataset id and 
> bigquery table id to check as parameters.
> Internally, it will use the bigquery hook to check for the existence of the 
> table. Therefore a 'table_exists' method will be added to the existing 
> Bigquery hook.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (AIRFLOW-728) Google Bigquery table exists sensor

2017-01-04 Thread Bob De Schutter (JIRA) 
Bob De Schutter created AIRFLOW-728:
---

 Summary: Google Bigquery table exists sensor
 Key: AIRFLOW-728
 URL: https://issues.apache.org/jira/browse/AIRFLOW-728
 Project: Apache Airflow
  Issue Type: New Feature
  Components: gcp
Reporter: Bob De Schutter
Assignee: Bob De Schutter


Design a sensor that checks whether a certain table is present in bigquery. The 
sensor will accept the google cloud project id, bigquery dataset id and 
bigquery table id to check as parameters.

Internally, it will use the bigquery hook to check for the existence of the 
table. Therefore a 'table_exists' method will be added to the existing Bigquery 
hook.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)