[jira] [Work logged] (BEAM-5339) Implement new policy on Beam dependency tooling

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-5339?focusedWorklogId=147956=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147956
 ]

ASF GitHub Bot logged work on BEAM-5339:


Author: ASF GitHub Bot
Created on: 26/Sep/18 05:51
Start Date: 26/Sep/18 05:51
Worklog Time Spent: 10m 
  Work Description: chamikaramj commented on issue #6430: [BEAM-5339]/apply 
new policy on Beam dependency tooling
URL: https://github.com/apache/beam/pull/6430#issuecomment-424593220
 
 
   Thanks. Please fix up commits for merging.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147956)
Time Spent: 3h 50m  (was: 3h 40m)

> Implement new policy on Beam dependency tooling
> ---
>
> Key: BEAM-5339
> URL: https://issues.apache.org/jira/browse/BEAM-5339
> Project: Beam
>  Issue Type: Bug
>  Components: testing
>Reporter: yifan zou
>Assignee: yifan zou
>Priority: Major
>  Time Spent: 3h 50m
>  Remaining Estimate: 0h
>
> (1) Instead of a dependency "owners" list we will be maintaining an 
> "interested parties" list. When we create a JIRA for a dependency we will not 
> assign it to an owner but rather we will CC all the folks that mentioned that 
> they will be interested in receiving updates related to that dependency. Hope 
> is that some of the interested parties will also put forward the effort to 
> upgrade dependencies they are interested in but the responsibility of 
> upgrading dependencies lie with the community as a whole.
>  (2) We will be creating JIRAs for upgrading individual dependencies, not for 
> upgrading to specific versions of those dependencies. For example, if a given 
> dependency X is three minor versions or an year behind we will create a JIRA 
> for upgrading that. But the specific version to upgrade to has to be 
> determined by the Beam community. Beam community might choose to close a JIRA 
> if there are known issues with available recent releases. Tool may reopen 
> such a closed JIRA in the future if new information becomes available (for 
> example, 3 new versions have been released since JIRA was closed)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-5339) Implement new policy on Beam dependency tooling

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-5339?focusedWorklogId=147955=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147955
 ]

ASF GitHub Bot logged work on BEAM-5339:


Author: ASF GitHub Bot
Created on: 26/Sep/18 05:50
Start Date: 26/Sep/18 05:50
Worklog Time Spent: 10m 
  Work Description: chamikaramj commented on issue #6430: [BEAM-5339]/apply 
new policy on Beam dependency tooling
URL: https://github.com/apache/beam/pull/6430#issuecomment-424593082
 
 
   LGTM.
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147955)
Time Spent: 3h 40m  (was: 3.5h)

> Implement new policy on Beam dependency tooling
> ---
>
> Key: BEAM-5339
> URL: https://issues.apache.org/jira/browse/BEAM-5339
> Project: Beam
>  Issue Type: Bug
>  Components: testing
>Reporter: yifan zou
>Assignee: yifan zou
>Priority: Major
>  Time Spent: 3h 40m
>  Remaining Estimate: 0h
>
> (1) Instead of a dependency "owners" list we will be maintaining an 
> "interested parties" list. When we create a JIRA for a dependency we will not 
> assign it to an owner but rather we will CC all the folks that mentioned that 
> they will be interested in receiving updates related to that dependency. Hope 
> is that some of the interested parties will also put forward the effort to 
> upgrade dependencies they are interested in but the responsibility of 
> upgrading dependencies lie with the community as a whole.
>  (2) We will be creating JIRAs for upgrading individual dependencies, not for 
> upgrading to specific versions of those dependencies. For example, if a given 
> dependency X is three minor versions or an year behind we will create a JIRA 
> for upgrading that. But the specific version to upgrade to has to be 
> determined by the Beam community. Beam community might choose to close a JIRA 
> if there are known issues with available recent releases. Tool may reopen 
> such a closed JIRA in the future if new information becomes available (for 
> example, 3 new versions have been released since JIRA was closed)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[beam] branch release-2.7.0 updated (3af6991 -> 17c47bb)

[ccy]

This is an automated email from the ASF dual-hosted git repository.

ccy pushed a change to branch release-2.7.0
in repository https://gitbox.apache.org/repos/asf/beam.git.


 discard 3af6991  trigger commit

This update removed existing revisions from the reference, leaving the
reference pointing at a previous point in the repository history.

 * -- * -- N   refs/heads/release-2.7.0 (17c47bb)
\
 O -- O -- O   (3af6991)

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:

[beam] branch release-2.7.0 updated: trigger commit

[ccy]

This is an automated email from the ASF dual-hosted git repository.

ccy pushed a commit to branch release-2.7.0
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/release-2.7.0 by this push:
 new 3af6991  trigger commit
3af6991 is described below

commit 3af6991baa3a67d964bedbe87b3b65acf844341f
Author: Charles Chen 
AuthorDate: Tue Sep 25 21:37:48 2018 -0700

trigger commit

svn commit: r29696 - /dev/beam/2.7.0/python/

[ccy]

Author: ccy
Date: Wed Sep 26 04:27:29 2018
New Revision: 29696

Log:
Apache Beam 2.7.0 RC3 wheel signatures

Added:

dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.asc

dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.sha512
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_i686.whl.asc

dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_i686.whl.sha512
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_x86_64.whl.asc

dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_x86_64.whl.sha512
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27mu-manylinux1_i686.whl.asc

dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27mu-manylinux1_i686.whl.sha512

dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27mu-manylinux1_x86_64.whl.asc

dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27mu-manylinux1_x86_64.whl.sha512

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.asc

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.sha512

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-manylinux1_i686.whl.asc

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-manylinux1_i686.whl.sha512

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-manylinux1_x86_64.whl.asc

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-manylinux1_x86_64.whl.sha512

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27mu-manylinux1_i686.whl.asc

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27mu-manylinux1_i686.whl.sha512

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27mu-manylinux1_x86_64.whl.asc

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27mu-manylinux1_x86_64.whl.sha512

Added: 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.asc
==
--- 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.asc
 (added)
+++ 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.asc
 Wed Sep 26 04:27:29 2018
@@ -0,0 +1,16 @@
+-BEGIN PGP SIGNATURE-
+
+iQIzBAABCgAdFiEE7RIcRVSVKnIGUOhaRcYKqtEV9WAFAlurCnsACgkQRcYKqtEV
+9WD1qw//VDkH+Vah3AL0qGlDKXx619WnB/eBGJySjEFKPatBLmj8ZzSQBPDt6J34
+TVA156VSlWO6DDqGEPJYy/9MWUpeYSx9Rak6U+/Jn+zq+gZZuNhtApK3XTiHmu9c
+ImVDkq3NdfDJu+3gpXiGl9ymaF7Z5EEd/6rmy3BNQE5RbsUKz6wuEO6nVITa7MS3
+Z/RWXh8qjK0bauUPSJ4Ws7HBlcCPjlLRni9NLVnp9Hu4W513i3ooGRjPn6iQkBmw
+qPDYeNH16evOTjOV6dZdhHU3emA/AcmS5dXr5abwjvlhUIpPWf2tnPay4Ti5L37/
+NLtoQ07Ypkz5NkEmCtlGI8el0o/SkxDis7Pw4LsG9mPiP+cKuEQTjWU+BaqhsvJV
+p1TiRJevhRgogsvIFdmbVhVUu6t+RL22dNb2MOdIcB/ZEg6sAu1Gng4OPYolykjc
+rKI5CJdF0lwJgMWp17Pq54qeRdcKEdnb9IGlYO9VE6LpZ/+qoJkwOB5rPxLSyACI
+5LwA8x5KxlNk5hXZxKvXrj35ZwYvUDD9R61kOdZwIK25SxQlL1vF31kkaNvMeDXN
+Kn1klWyoI4H37Oq7VEogj5YRvMrbIAakI4z1VrldcUKIoXohaB/3WysBgBzSeuyn
+aWBYNJowiyxolKQ1euYMGa0T7gmvl1d66YIkVTLkeGa6ugtT+AY=
+=FhQU
+-END PGP SIGNATURE-

Added: 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.sha512
==
--- 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.sha512
 (added)
+++ 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl.sha512
 Wed Sep 26 04:27:29 2018
@@ -0,0 +1 @@
+ff4554223d389fc60c4919582261b1c0b473326c0a5ff6a4f58e040e9e8cbdb951282e5f28348ff33dfd95666a9147ef5d16557bb750be98f3aefd504eaac937
  
apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl

Added: 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_i686.whl.asc
==
--- dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_i686.whl.asc 
(added)
+++ dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_i686.whl.asc 
Wed Sep 26 04:27:29 2018
@@ -0,0 +1,16 @@
+-BEGIN PGP SIGNATURE-
+
+iQIzBAABCgAdFiEE7RIcRVSVKnIGUOhaRcYKqtEV9WAFAlurCn8ACgkQRcYKqtEV
+9WAOmw/9HUl88qcMcLexMKkTI/mGpCGNOjXMjdEI6B862WIOyG5zTic1fW9Mee3J

svn commit: r29695 - /dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27mu-manylinux1_i686.whl

[ccy]

Author: ccy
Date: Wed Sep 26 04:22:47 2018
New Revision: 29695

Log:
Upload python wheels

Added:
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27mu-manylinux1_i686.whl   
(with props)

Added: dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27mu-manylinux1_i686.whl
==
Binary file - no diff available.

Propchange: 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27mu-manylinux1_i686.whl
--
svn:mime-type = application/octet-stream

svn commit: r29694 - /dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_i686.whl

[ccy]

Author: ccy
Date: Wed Sep 26 04:22:36 2018
New Revision: 29694

Log:
Upload python wheels

Added:
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_i686.whl   
(with props)

Added: dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_i686.whl
==
Binary file - no diff available.

Propchange: 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_i686.whl
--
svn:mime-type = application/octet-stream

svn commit: r29693 - /dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_x86_64.whl

[ccy]

Author: ccy
Date: Wed Sep 26 04:20:40 2018
New Revision: 29693

Log:
Upload python wheels

Added:
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_x86_64.whl   
(with props)

Added: dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_x86_64.whl
==
Binary file - no diff available.

Propchange: 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-manylinux1_x86_64.whl
--
svn:mime-type = application/octet-stream

svn commit: r29692 - /dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27mu-manylinux1_x86_64.whl

[ccy]

Author: ccy
Date: Wed Sep 26 04:19:23 2018
New Revision: 29692

Log:
Upload python wheels

Added:
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27mu-manylinux1_x86_64.whl   
(with props)

Added: dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27mu-manylinux1_x86_64.whl
==
Binary file - no diff available.

Propchange: 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27mu-manylinux1_x86_64.whl
--
svn:mime-type = application/octet-stream

svn commit: r29691 - /dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-manylinux1_i686.whl

[ccy]

Author: ccy
Date: Wed Sep 26 04:19:10 2018
New Revision: 29691

Log:
Upload python wheels

Added:
dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-manylinux1_i686.whl  
 (with props)

Added: 
dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-manylinux1_i686.whl
==
Binary file - no diff available.

Propchange: 
dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-manylinux1_i686.whl
--
svn:mime-type = application/octet-stream

svn commit: r29690 - /dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl

[ccy]

Author: ccy
Date: Wed Sep 26 04:19:08 2018
New Revision: 29690

Log:
Upload python wheels

Added:

dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl
   (with props)

Added: 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl
==
Binary file - no diff available.

Propchange: 
dev/beam/2.7.0/python/apache_beam-2.7.0-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl
--
svn:mime-type = application/octet-stream

svn commit: r29689 - /dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27mu-manylinux1_x86_64.whl

[ccy]

Author: ccy
Date: Wed Sep 26 04:16:27 2018
New Revision: 29689

Log:
Upload python wheels

Added:

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27mu-manylinux1_x86_64.whl   
(with props)

Added: 
dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27mu-manylinux1_x86_64.whl
==
Binary file - no diff available.

Propchange: 
dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27mu-manylinux1_x86_64.whl
--
svn:mime-type = application/octet-stream

svn commit: r29688 - /dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl

[ccy]

Author: ccy
Date: Wed Sep 26 04:15:58 2018
New Revision: 29688

Log:
Upload python wheels

Added:

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl
   (with props)

Added: 
dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl
==
Binary file - no diff available.

Propchange: 
dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl
--
svn:mime-type = application/octet-stream

svn commit: r29687 - /dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27mu-manylinux1_i686.whl

[ccy]

Author: ccy
Date: Wed Sep 26 04:15:34 2018
New Revision: 29687

Log:
Upload python wheels

Added:
dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27mu-manylinux1_i686.whl 
  (with props)

Added: 
dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27mu-manylinux1_i686.whl
==
Binary file - no diff available.

Propchange: 
dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27mu-manylinux1_i686.whl
--
svn:mime-type = application/octet-stream

svn commit: r29686 - /dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-manylinux1_x86_64.whl

[ccy]

Author: ccy
Date: Wed Sep 26 04:15:31 2018
New Revision: 29686

Log:
Upload python wheels

Added:

dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-manylinux1_x86_64.whl   
(with props)

Added: 
dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-manylinux1_x86_64.whl
==
Binary file - no diff available.

Propchange: 
dev/beam/2.7.0/python/apache_beam-2.7.0.rc1-cp27-cp27m-manylinux1_x86_64.whl
--
svn:mime-type = application/octet-stream

svn commit: r29685 - in /dev/beam/2.7.0/python: ./ apache-beam-2.7.0.zip apache-beam-2.7.0.zip.asc apache-beam-2.7.0.zip.sha512

[ccy]

Author: ccy
Date: Wed Sep 26 04:11:25 2018
New Revision: 29685

Log:
Apache Beam 2.7.0 RC2 Python source files

Added:
dev/beam/2.7.0/python/
dev/beam/2.7.0/python/apache-beam-2.7.0.zip   (with props)
dev/beam/2.7.0/python/apache-beam-2.7.0.zip.asc
dev/beam/2.7.0/python/apache-beam-2.7.0.zip.sha512

Added: dev/beam/2.7.0/python/apache-beam-2.7.0.zip
==
Binary file - no diff available.

Propchange: dev/beam/2.7.0/python/apache-beam-2.7.0.zip
--
svn:mime-type = application/octet-stream

Added: dev/beam/2.7.0/python/apache-beam-2.7.0.zip.asc
==
--- dev/beam/2.7.0/python/apache-beam-2.7.0.zip.asc (added)
+++ dev/beam/2.7.0/python/apache-beam-2.7.0.zip.asc Wed Sep 26 04:11:25 2018
@@ -0,0 +1,16 @@
+-BEGIN PGP SIGNATURE-
+
+iQIzBAABCgAdFiEE7RIcRVSVKnIGUOhaRcYKqtEV9WAFAlurBo4ACgkQRcYKqtEV
+9WC6WxAAw3cYDFNQeF7Z8wmmlHtw5u7uZAjEb8jJ4ChEB8na1qxQLereF7SRMpog
+BFocOCTEU2c9O3itlOkkPE2RY+FNTBF2Ac16EvQBv2eR1HaC8KZxjEgKj5E6upVH
+bB9k2SV+qtH6mKYDphJLjr+jzSYq591w6ade5A7R+4o9FtlxZXNC3jewr0xto27p
+4fPDwrFrErL4HAcRE3kR+Xzmt8EWuFr1lzInu8tD2zFinxkUuNzlaz1qWkSg47Ye
+aT1qxx5hBP9e8Sg3kX39ZYIeV4neaEy2dD6m0VvV2CoyxNuUAuh0xwGUAxw7Dg6T
+fm9+c07RdVqRAOW+MMNiDjGqiZDkImajJBEskkLI+FAU42DhjhNW/7IFe9HGxlo7
+Vh1nz5/p8i333N4r76UrCBHzygOz+bn8HAZwJZYEg2YNAjUDjIuwgdsu3WZRbziV
+NcNoS2T9FEXKx+ZpB3hX4SEDpwppBlDKgUHDH7ZYCghy3A2avNbOmiqgylP7HNe+
+5NkHprmi2fArQDCbIIdbv3i42dJUIw5xFTBPAydPdy20sjQ9ez+AU7ysBGt5ncMo
+7HU63iR1Y4Ggymwl+SNL3vZwV9wqkQuVddnbJ8CdmTWCzRGBeBlWGlGcwENz2HQX
+qtdnfG1FAmisM7Vw8vz8Wh5rsbhq46ihacOK8ORcFkZosVj7a1k=
+=wkor
+-END PGP SIGNATURE-

Added: dev/beam/2.7.0/python/apache-beam-2.7.0.zip.sha512
==
--- dev/beam/2.7.0/python/apache-beam-2.7.0.zip.sha512 (added)
+++ dev/beam/2.7.0/python/apache-beam-2.7.0.zip.sha512 Wed Sep 26 04:11:25 2018
@@ -0,0 +1 @@
+ac06f585083387e6b900822ea9635c6aac90ecd61d5c9e3d69ed58d0d1c340b9a0f447d125d41454ceeea8439591c0b641b524ef3ebf2a3ec8155b6347f2808f
  apache-beam-2.7.0.zip

svn commit: r29684 - in /dev/beam/2.7.0: ./ apache-beam-2.7.0-source-release.zip apache-beam-2.7.0-source-release.zip.asc apache-beam-2.7.0-source-release.zip.sha512

[ccy]

Author: ccy
Date: Wed Sep 26 04:08:57 2018
New Revision: 29684

Log:
Apache Beam 2.7.0, release candidate 3 source files

Added:
dev/beam/2.7.0/
dev/beam/2.7.0/apache-beam-2.7.0-source-release.zip   (with props)
dev/beam/2.7.0/apache-beam-2.7.0-source-release.zip.asc
dev/beam/2.7.0/apache-beam-2.7.0-source-release.zip.sha512

Added: dev/beam/2.7.0/apache-beam-2.7.0-source-release.zip
==
Binary file - no diff available.

Propchange: dev/beam/2.7.0/apache-beam-2.7.0-source-release.zip
--
svn:mime-type = application/octet-stream

Added: dev/beam/2.7.0/apache-beam-2.7.0-source-release.zip.asc
==
--- dev/beam/2.7.0/apache-beam-2.7.0-source-release.zip.asc (added)
+++ dev/beam/2.7.0/apache-beam-2.7.0-source-release.zip.asc Wed Sep 26 04:08:57 
2018
@@ -0,0 +1,16 @@
+-BEGIN PGP SIGNATURE-
+
+iQIzBAABCgAdFiEE7RIcRVSVKnIGUOhaRcYKqtEV9WAFAlurBi8ACgkQRcYKqtEV
+9WCBkA//UmLmu0blY1D4FftDfnLJMdfkZy0fgbnw4f4XosUXkj5zfT6Etysv3Dtz
+xnUjIn+t7v/IXe0FAmtGc9h8mqsfxsigOoqOhFa5Or7dKpnCQYwqdjk0Dt8+KN6P
+xsw8K91KLW3/vu6y3sZJSDjpObS9LuyClwmfe1fmSimkmpDsuidPwXjYZLkfJJJC
+I9c0PS+MdASiVwtfKQjpPGtpn8lNB5EqyNDM5s+QAjJ8fu1zqNpAN0x/ysYfipuL
+o83DcnwtTOzNy/Ba3SagMTOAoug5ytTdGvjzmPKN4pl7VRHJCr1ekakiYlQb6Gbf
+SzyLDq3zM5/ds40Mm7HsIW3u+EPVKi4y9E12UBMNdqdyWP/fsuTHcLi9k0RjEE+Y
+HhjV8+MY2EGEc62KE12BcAPN0SJv0EBCWqsaovV5qMJfOuuWdv7GokwQ5kXnQeD8
+WojMwp46VhzTMP+sNU1yTGuzMuWUVLSYD79nhpPA3ijm13c5seFRiwjJ6WvId0Yl
+4YsBKYLb+dfBY58tOZll0w/pEe+PD+z/P92/CHjnihem/hGEgpdXCVHvxIbqaPGi
+ByiEVIRHHE2NaA2sDTSJiPs56305qn5sMeiZfS6bgJ4kUqd6cVw/0Wb0F5gUEXcj
+rfIahWPQbqEhkzNZad/hed1vmYlZ/tm6ySu6Iq2C2ql61zO4Tw4=
+=kH9O
+-END PGP SIGNATURE-

Added: dev/beam/2.7.0/apache-beam-2.7.0-source-release.zip.sha512
==
--- dev/beam/2.7.0/apache-beam-2.7.0-source-release.zip.sha512 (added)
+++ dev/beam/2.7.0/apache-beam-2.7.0-source-release.zip.sha512 Wed Sep 26 
04:08:57 2018
@@ -0,0 +1 @@
+bb324541947f99819a7c23f32dadea7c7887d33a5022ea05fbc53b94ad8b544eb933ad820c2c8d8162b2b817c676fdb3e1b63145b1891484bd7a8cae17732174
  apache-beam-2.7.0-source-release.zip

[jira] [Work logged] (BEAM-5427) Fix sample code (AverageFn) in Combine.java

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-5427?focusedWorklogId=147935=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147935
 ]

ASF GitHub Bot logged work on BEAM-5427:


Author: ASF GitHub Bot
Created on: 26/Sep/18 04:04
Start Date: 26/Sep/18 04:04
Worklog Time Spent: 10m 
  Work Description: HuangLED commented on a change in pull request #6439: 
[BEAM-5427] Fix and update sample code for CombineFn.
URL: https://github.com/apache/beam/pull/6439#discussion_r220421063
 
 

 ##
 File path: 
sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Combine.java
 ##
 @@ -254,10 +254,26 @@ private Combine() {
*
* {@code
* public class AverageFn extends CombineFn {
-   *   public static class Accum {
+   *   public static class Accum implements java.io.Serializable {
 
 Review comment:
   Ack.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147935)
Time Spent: 3h  (was: 2h 50m)

> Fix sample code (AverageFn) in Combine.java
> ---
>
> Key: BEAM-5427
> URL: https://issues.apache.org/jira/browse/BEAM-5427
> Project: Beam
>  Issue Type: Improvement
>  Components: examples-java
>Reporter: Ruoyun Huang
>Assignee: Ruoyun Huang
>Priority: Minor
>  Time Spent: 3h
>  Remaining Estimate: 0h
>
> Sample code missing coder. 
> In its current state, job run fails with Coder missing error. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147934=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147934
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 04:01
Start Date: 26/Sep/18 04:01
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website publish via jenkins to beam asf-site branch
URL: https://github.com/apache/beam/pull/6431#issuecomment-424576839
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147934)
Time Spent: 16h 50m  (was: 16h 40m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 16h 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147933=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147933
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 04:01
Start Date: 26/Sep/18 04:01
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website publish via jenkins to beam asf-site branch
URL: https://github.com/apache/beam/pull/6431#issuecomment-424576819
 
 
   Run Seed


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147933)
Time Spent: 16h 40m  (was: 16.5h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 16h 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147931=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147931
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:58
Start Date: 26/Sep/18 03:58
Worklog Time Spent: 10m 
  Work Description: alanmyrvold opened a new pull request #6431: 
[BEAM-4496] Website publish via jenkins to beam asf-site branch
URL: https://github.com/apache/beam/pull/6431
 
 
   New Jenkins job to run with label 
[git-websites](https://builds.apache.org/label/git-websites/) and build and 
push the beam website from master into the asf-site branch of the beam 
repository.
   
   The website is built by :beam-website:buildWebsite into build/website/content
   This is copied into website/content and pushed to the asf-site branch.
   
   
   

   
   Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
   --- | --- | --- | --- | --- | --- | --- | ---
   Go | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/)
 | --- | --- | --- | --- | --- | ---
   Java | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/)
   Python | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/)
 | --- | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)
  [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/)
 | --- | --- | --- | ---
   
   
   
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147931)
Time Spent: 16h 20m  (was: 16h 10m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 16h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147929=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147929
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:58
Start Date: 26/Sep/18 03:58
Worklog Time Spent: 10m 
  Work Description: alanmyrvold closed pull request #6431: [BEAM-4496] 
Website publish via jenkins to beam asf-site branch
URL: https://github.com/apache/beam/pull/6431
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/.test-infra/jenkins/CommonJobProperties.groovy 
b/.test-infra/jenkins/CommonJobProperties.groovy
index 428ac0de449..40725c42c2b 100644
--- a/.test-infra/jenkins/CommonJobProperties.groovy
+++ b/.test-infra/jenkins/CommonJobProperties.groovy
@@ -63,14 +63,14 @@ class CommonJobProperties {
String branch = 'master',
int timeout = 100,
boolean allowRemotePoll = true,
-   boolean localPerfTest = false) {
+   String jenkinsExecutorLabel =  
'beam') {
 setTopLevelJobProperties(
 context,
 'beam',
 branch,
 timeout,
 allowRemotePoll,
-localPerfTest)
+jenkinsExecutorLabel)
   }
 
   // Sets common top-level job properties. Accessed through one of the above
@@ -80,12 +80,7 @@ class CommonJobProperties {
String defaultBranch,
int defaultTimeout,
boolean allowRemotePoll = true,
-   boolean localPerfTest = false) {
-def jenkinsExecutorLabel = 'beam'
-if (localPerfTest) {
-  jenkinsExecutorLabel = 'beam-perf'
-}
-
+   String jenkinsExecutorLabel = 
'beam') {
 // GitHub project.
 context.properties {
   githubProjectUrl('https://github.com/apache/' + repositoryName + '/')
diff --git a/.test-infra/jenkins/PostcommitJobBuilder.groovy 
b/.test-infra/jenkins/PostcommitJobBuilder.groovy
index 45b841e64c4..394c8200c45 100644
--- a/.test-infra/jenkins/PostcommitJobBuilder.groovy
+++ b/.test-infra/jenkins/PostcommitJobBuilder.groovy
@@ -42,7 +42,9 @@ class PostcommitJobBuilder {
 jobDefinition = {}) {
 PostcommitJobBuilder jb = new PostcommitJobBuilder(scope, jobDefinition)
 jb.defineAutoPostCommitJob(nameBase)
-jb.defineGhprbTriggeredJob(nameBase + "_PR", triggerPhrase, githubUiHint, 
false)
+if (triggerPhrase) {
+  jb.defineGhprbTriggeredJob(nameBase + "_PR", triggerPhrase, 
githubUiHint, false)
+}
   }
 
   void defineAutoPostCommitJob(name) {
diff --git a/.test-infra/jenkins/job_PostCommit_Java_Nexmark_Direct.groovy 
b/.test-infra/jenkins/job_PostCommit_Java_Nexmark_Direct.groovy
index a2dc54c83d9..80dff3cd118 100644
--- a/.test-infra/jenkins/job_PostCommit_Java_Nexmark_Direct.groovy
+++ b/.test-infra/jenkins/job_PostCommit_Java_Nexmark_Direct.groovy
@@ -26,7 +26,7 @@ 
NoPhraseTriggeringPostCommitBuilder.postCommitJob('beam_PostCommit_Java_Nexmark_
   description('Runs the Nexmark suite on the Direct runner.')
 
   // Set common parameters.
-  commonJobProperties.setTopLevelMainJobProperties(delegate, 'master', 240, 
true, true)
+  commonJobProperties.setTopLevelMainJobProperties(delegate, 'master', 240, 
true, 'beam-perf')
 
   // Gradle goals for this job.
   steps {
diff --git a/.test-infra/jenkins/job_PostCommit_Java_Nexmark_Flink.groovy 
b/.test-infra/jenkins/job_PostCommit_Java_Nexmark_Flink.groovy
index e21f14d0968..05434afabaf 100644
--- a/.test-infra/jenkins/job_PostCommit_Java_Nexmark_Flink.groovy
+++ b/.test-infra/jenkins/job_PostCommit_Java_Nexmark_Flink.groovy
@@ -26,7 +26,7 @@ 
NoPhraseTriggeringPostCommitBuilder.postCommitJob('beam_PostCommit_Java_Nexmark_
   description('Runs the Nexmark suite on the Flink runner.')
 
   // Set common parameters.
-  commonJobProperties.setTopLevelMainJobProperties(delegate, 'master', 240, 
true, true)
+  commonJobProperties.setTopLevelMainJobProperties(delegate, 'master', 240, 
true, 'beam-perf')
 
   // Gradle goals for this job.
   steps {
diff --git a/.test-infra/jenkins/job_PostCommit_Java_Nexmark_Spark.groovy 
b/.test-infra/jenkins/job_PostCommit_Java_Nexmark_Spark.groovy
index c6690f75c97..dbf2333c312 100644
--- a/.test-infra/jenkins/job_PostCommit_Java_Nexmark_Spark.groovy
+++ 

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147932=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147932
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:58
Start Date: 26/Sep/18 03:58
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website publish via jenkins to beam asf-site branch
URL: https://github.com/apache/beam/pull/6431#issuecomment-424576839
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147932)
Time Spent: 16.5h  (was: 16h 20m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 16.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147930=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147930
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:58
Start Date: 26/Sep/18 03:58
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website publish via jenkins to beam asf-site branch
URL: https://github.com/apache/beam/pull/6431#issuecomment-424576819
 
 
   Run Seed


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147930)
Time Spent: 16h 10m  (was: 16h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 16h 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147928=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147928
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:51
Start Date: 26/Sep/18 03:51
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424575798
 
 
   Passed in a triggered test, 
https://builds.apache.org/job/beam_PostCommit_Website_Publish_PR/27/ and 
successfully pushed a commit to asf-site.
   
   @swegner PTAL?


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147928)
Time Spent: 15h 50m  (was: 15h 40m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 15h 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147925=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147925
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:46
Start Date: 26/Sep/18 03:46
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424574257
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147925)
Time Spent: 15.5h  (was: 15h 20m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 15.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147926=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147926
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:46
Start Date: 26/Sep/18 03:46
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424575062
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147926)
Time Spent: 15h 40m  (was: 15.5h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 15h 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147924=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147924
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:44
Start Date: 26/Sep/18 03:44
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on a change in pull request 
#6431: [BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#discussion_r219661218
 
 

 ##
 File path: website/build.gradle
 ##
 @@ -104,3 +106,32 @@ task testWebsite(type: Exec) {
 task preCommit {
   dependsOn testWebsite
 }
+
+task mergeWebsite << {
 
 Review comment:
   The content gets generated in the build directory which persists when 
changing branches.
   Nuked the content in the repo with git remove and delete before copying it 
in.
   Added some assert's to ensure the content is there,  but moving to a temp 
directory didn't seem needed.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147924)
Time Spent: 15h 20m  (was: 15h 10m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 15h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147923=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147923
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:43
Start Date: 26/Sep/18 03:43
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on a change in pull request 
#6431: [BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#discussion_r219661201
 
 

 ##
 File path: website/build.gradle
 ##
 @@ -22,6 +22,8 @@ apply plugin: "base"
 def dockerImageTag = 'beam-website'
 def dockerWorkDir = "/repo"
 def buildDir = "$project.rootDir/build/website"
+def contentBuildDir = "$buildDir/content"
+def contentRepoDir = "$project.rootDir/website/content"
 
 Review comment:
   Removing the website/generated-content directory, both with git remove and 
gradle delete call before copying in the generated content.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147923)
Time Spent: 15h 10m  (was: 15h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 15h 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147922=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147922
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:42
Start Date: 26/Sep/18 03:42
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on a change in pull request 
#6431: [BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#discussion_r219661177
 
 

 ##
 File path: website/build.gradle
 ##
 @@ -104,3 +106,32 @@ task testWebsite(type: Exec) {
 task preCommit {
   dependsOn testWebsite
 }
+
+task mergeWebsite << {
+  /* Disabled for now, for testing
+  exec {
+executable 'git'
 
 Review comment:
   Added the org.ajoberstar.grgit plugin, which worked for all the operations 
except pushing.
   Used a command line to push.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147922)
Time Spent: 15h  (was: 14h 50m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 15h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147918=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147918
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:41
Start Date: 26/Sep/18 03:41
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424574257
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147918)
Time Spent: 14h 20m  (was: 14h 10m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 14h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147919=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147919
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:41
Start Date: 26/Sep/18 03:41
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424555113
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147919)
Time Spent: 14.5h  (was: 14h 20m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 14.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147921=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147921
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:41
Start Date: 26/Sep/18 03:41
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on a change in pull request 
#6431: [BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#discussion_r220418673
 
 

 ##
 File path: .test-infra/jenkins/job_PostCommit_Website_Merge.groovy
 ##
 @@ -0,0 +1,40 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+import CommonJobProperties as commonJobProperties
+import PostcommitJobBuilder
+
+
+// This job builds and merges the website.
+PostcommitJobBuilder.postCommitJob('beam_PostCommit_Website_Merge', 'Run 
Website Merge',
 
 Review comment:
   Removed the trigger phrase.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147921)
Time Spent: 14h 50m  (was: 14h 40m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 14h 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147920=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147920
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:41
Start Date: 26/Sep/18 03:41
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-423716563
 
 
   Run Website Publish
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147920)
Time Spent: 14h 40m  (was: 14.5h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 14h 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[beam] 02/03: Publishing website 2018/09/26 03:22:29 at commit 4edeecc

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit b50c0ae618bbae4a7315a083aa5ff562c95edb73
Author: jenkins 
AuthorDate: Wed Sep 26 03:22:29 2018 +

Publishing website 2018/09/26 03:22:29 at commit 4edeecc

[beam] branch asf-site updated (b16bd7d -> 1feddae)

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git.


from b16bd7d  Publishing website 2018/09/26 03:07:13 at commit 86f7f05
 new 4edeecc  Publishing website 2018/09/26 03:14:38 at commit b16bd7d
 new b50c0ae  Publishing website 2018/09/26 03:22:29 at commit 4edeecc
 new 1feddae  Publishing website 2018/09/26 03:27:28 at commit b50c0ae

The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:

[beam] 01/03: Publishing website 2018/09/26 03:14:38 at commit b16bd7d

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 4edeeccd15c33a52f31e0685a2da043f91f7122b
Author: jenkins 
AuthorDate: Wed Sep 26 03:14:38 2018 +

Publishing website 2018/09/26 03:14:38 at commit b16bd7d

[beam] 03/03: Publishing website 2018/09/26 03:27:28 at commit b50c0ae

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 1feddae2a8f50540c5cda88ee237cf393bbf2b7c
Author: jenkins 
AuthorDate: Wed Sep 26 03:27:28 2018 +

Publishing website 2018/09/26 03:27:28 at commit b50c0ae

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147917=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147917
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:26
Start Date: 26/Sep/18 03:26
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424572286
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147917)
Time Spent: 14h 10m  (was: 14h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 14h 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147916=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147916
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:21
Start Date: 26/Sep/18 03:21
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424571525
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147916)
Time Spent: 14h  (was: 13h 50m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 14h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147914=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147914
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:13
Start Date: 26/Sep/18 03:13
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424570462
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147914)
Time Spent: 13h 50m  (was: 13h 40m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 13h 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4747) Python LocalFileSystem directory-creation semantics

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4747?focusedWorklogId=147913=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147913
 ]

ASF GitHub Bot logged work on BEAM-4747:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:11
Start Date: 26/Sep/18 03:11
Worklog Time Spent: 10m 
  Work Description: charlesccychen closed pull request #6494: Revert 
"[BEAM-4747] mkdirs if they don't exist in localfilesystem (#5903)
URL: https://github.com/apache/beam/pull/6494
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/sdks/python/apache_beam/io/localfilesystem.py 
b/sdks/python/apache_beam/io/localfilesystem.py
index ddd5022b2bb..b634d2adc7e 100644
--- a/sdks/python/apache_beam/io/localfilesystem.py
+++ b/sdks/python/apache_beam/io/localfilesystem.py
@@ -144,9 +144,6 @@ def create(self, path, mime_type='application/octet-stream',
 
 Returns: file handle with a close function for the user to use
 """
-parent = os.path.dirname(path)
-if not os.path.exists(parent):
-  os.makedirs(parent)
 return self._path_open(path, 'wb', mime_type, compression_type)
 
   def open(self, path, mime_type='application/octet-stream',
@@ -188,10 +185,6 @@ def _copy_path(source, destination):
 if os.path.isdir(source):
   shutil.copytree(source, destination)
 else:
-  parent = os.path.dirname(destination)
-  if not os.path.exists(parent):
-os.makedirs(parent)
-
   shutil.copy2(source, destination)
   except OSError as err:
 raise IOError(err)
@@ -224,10 +217,6 @@ def rename(self, source_file_names, 
destination_file_names):
 def _rename_file(source, destination):
   """Rename a single file object"""
   try:
-parent = os.path.dirname(destination)
-if not os.path.exists(parent):
-  os.makedirs(parent)
-
 os.rename(source, destination)
   except OSError as err:
 raise IOError(err)
diff --git a/sdks/python/apache_beam/io/localfilesystem_test.py 
b/sdks/python/apache_beam/io/localfilesystem_test.py
index bc45e4221dd..5187dc0f93a 100644
--- a/sdks/python/apache_beam/io/localfilesystem_test.py
+++ b/sdks/python/apache_beam/io/localfilesystem_test.py
@@ -196,8 +196,8 @@ def test_copy_error(self):
  [(path1, path2)])
 
   def test_copy_directory(self):
-path_t1 = os.path.join(self.tmpdir, 't1/11')
-path_t2 = os.path.join(self.tmpdir, 't2/22')
+path_t1 = os.path.join(self.tmpdir, 't1')
+path_t2 = os.path.join(self.tmpdir, 't2')
 self.fs.mkdirs(path_t1)
 self.fs.mkdirs(path_t2)
 
@@ -209,19 +209,6 @@ def test_copy_directory(self):
 self.fs.copy([path_t1], [path_t2])
 self.assertTrue(filecmp.cmp(path1, path2))
 
-  def test_create_mkdirs_open(self):
-path = os.path.join(self.tmpdir, 't1/t2/t3')
-with self.fs.create(path) as f:
-  f.write("yay")
-
-with self.fs.open(path) as f:
-  self.assertEqual(f.read(), "yay")
-
-  def test_open_error(self):
-path = os.path.join(self.tmpdir, 't1')
-with self.assertRaisesRegexp(IOError, r'No such file or directory'):
-  self.fs.open(path)
-
   def test_rename(self):
 path1 = os.path.join(self.tmpdir, 'f1')
 path2 = os.path.join(self.tmpdir, 'f2')
@@ -257,22 +244,6 @@ def test_rename_directory(self):
 self.assertTrue(self.fs.exists(path2))
 self.assertFalse(self.fs.exists(path1))
 
-  def test_rename_mkdirs(self):
-path_t1 = os.path.join(self.tmpdir, 't1')
-path_t2 = os.path.join(self.tmpdir, 't2/t3/t4')
-self.fs.mkdirs(path_t1)
-
-path1 = os.path.join(path_t1, 'f1')
-path2 = os.path.join(path_t2, 'f1')
-with open(path1, 'a') as f:
-  f.write('Hello')
-
-self.fs.rename([path_t1], [path_t2])
-self.assertTrue(self.fs.exists(path_t2))
-self.assertFalse(self.fs.exists(path_t1))
-self.assertTrue(self.fs.exists(path2))
-self.assertFalse(self.fs.exists(path1))
-
   def test_exists(self):
 path1 = os.path.join(self.tmpdir, 'f1')
 path2 = os.path.join(self.tmpdir, 'f2')


 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147913)
Time Spent: 2h 40m  (was: 2.5h)

> Python LocalFileSystem directory-creation semantics
> ---
>
> Key: BEAM-4747
> URL: 

Build failed in Jenkins: beam_PostCommit_Website_Publish #4

[Apache Jenkins Server]

See 


Changes:

[ccy] Revert "[BEAM-4747] mkdirs if they don't exist in localfilesystem

--
Started by GitHub push by charlesccychen
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b33528b068e9a810eb4a720c3c6a6c63e6b04828 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f b33528b068e9a810eb4a720c3c6a6c63e6b04828
Commit message: "Merge pull request #6494 from charlesccychen/revert-5903"
 > git rev-list --no-walk cd36af1eced5297d6dad226e6233e9528bc7e3da # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ 
 
--info --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g 
-Dorg.gradle.jvmargs=-Xmx4g :beam-website:clean :beam-website:publishWebsite
Initialized native services in: /home/jenkins/.gradle/native
To honour the JVM settings for this build a new JVM will be forked. Please 
consider using the daemon: 
https://docs.gradle.org/4.10.2/userguide/gradle_daemon.html.
Starting process 'Gradle build daemon'. Working directory: 
/home/jenkins/.gradle/daemon/4.10.2 Command: 
/usr/local/asfpackages/java/jdk1.8.0_172/bin/java -Xmx4g -Dfile.encoding=UTF-8 
-Duser.country=US -Duser.language=en -Duser.variant -cp 
/home/jenkins/.gradle/wrapper/dists/gradle-4.10.2-bin/cghg6c4gf4vkiutgsab8yrnwv/gradle-4.10.2/lib/gradle-launcher-4.10.2.jar
 org.gradle.launcher.daemon.bootstrap.GradleDaemon 4.10.2
Successfully started process 'Gradle build daemon'
An attempt to start the daemon took 0.885 secs.
The client will now receive all logging from the daemon (pid: 12068). The 
daemon log file: /home/jenkins/.gradle/daemon/4.10.2/daemon-12068.out.log
Closing daemon's stdin at end of input.
The daemon will no longer process any standard input.
Daemon will be stopped at the end of the build stopping after processing
Using 12 worker leases.
Starting Build
Parallel execution is an incubating feature.

> Configure project :buildSrc
Evaluating project ':buildSrc' using build file 
'
file or directory 
'
 not found
Selected primary task 'build' from project :
file or directory 
'
 not found
:buildSrc:compileJava (Thread[Task worker for ':buildSrc' Thread 5,5,main]) 
started.
Using local directory build cache for build ':buildSrc' (location = 
/home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days).

> Task :buildSrc:compileJava NO-SOURCE
file or directory 
'
 not found
Skipping task ':buildSrc:compileJava' as it has no source files and no previous 
output files.
:buildSrc:compileJava (Thread[Task worker for ':buildSrc' Thread 5,5,main]) 
completed. Took 0.098 secs.
:buildSrc:compileGroovy (Thread[Task worker for ':buildSrc' Thread 5,5,main]) 
started.

> Task :buildSrc:compileGroovy FROM-CACHE
Build cache key for task ':buildSrc:compileGroovy' is 
b7efbcdfb1f6a14677e6c3a860d8e96b
Task ':buildSrc:compileGroovy' is not up-to-date because:
  No history is available.
Origin for task ':buildSrc:compileGroovy': {executionTime=5719, 
hostName=jenkins-websites1.apache.org, operatingSystem=Linux, 
buildInvocationId=b4ta5o7vhrcofli5g53i2bciia, creationTime=1537590844006, 
type=org.gradle.api.tasks.compile.GroovyCompile_Decorated, userName=jenkins, 
gradleVersion=4.10.2, 
rootPath=
 path=:compileGroovy}
Unpacked output for task ':buildSrc:compileGroovy' from cache.
:buildSrc:compileGroovy 

[beam] branch master updated (cd36af1 -> b33528b)

[ccy]

This is an automated email from the ASF dual-hosted git repository.

ccy pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from cd36af1  Merge pull request #6492 from pabloem/fix-pylint23
 add d76f888  Revert "[BEAM-4747] mkdirs if they don't exist in 
localfilesystem (#5903)"
 new b33528b  Merge pull request #6494 from charlesccychen/revert-5903

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/python/apache_beam/io/localfilesystem.py  | 11 
 sdks/python/apache_beam/io/localfilesystem_test.py | 33 ++
 2 files changed, 2 insertions(+), 42 deletions(-)

[beam] 01/01: Merge pull request #6494 from charlesccychen/revert-5903

[ccy]

This is an automated email from the ASF dual-hosted git repository.

ccy pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit b33528b068e9a810eb4a720c3c6a6c63e6b04828
Merge: cd36af1 d76f888
Author: Charles Chen 
AuthorDate: Tue Sep 25 23:10:57 2018 -0400

Merge pull request #6494 from charlesccychen/revert-5903

Revert "[BEAM-4747] mkdirs if they don't exist in localfilesystem (#5903)

 sdks/python/apache_beam/io/localfilesystem.py  | 11 
 sdks/python/apache_beam/io/localfilesystem_test.py | 33 ++
 2 files changed, 2 insertions(+), 42 deletions(-)

[beam] 08/10: Publishing website 2018/09/26 03:00:36 at commit ba06d1f

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 7576a9beda0863a06955765b31ebac9ff5886223
Author: jenkins 
AuthorDate: Wed Sep 26 03:00:36 2018 +

Publishing website 2018/09/26 03:00:36 at commit ba06d1f

[beam] 03/10: Publishing website 2018/09/26 02:20:18 at commit 8cf8566

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit fdcaa7cb5a132b11c69b05dc1f0322eef0d5bd0a
Author: jenkins 
AuthorDate: Wed Sep 26 02:20:18 2018 +

Publishing website 2018/09/26 02:20:18 at commit 8cf8566

[beam] 09/10: Publishing website 2018/09/26 03:03:34 at commit 7576a9b

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 86f7f050f258e3232e2ef75579fb19d4ed14cc95
Author: jenkins 
AuthorDate: Wed Sep 26 03:03:34 2018 +

Publishing website 2018/09/26 03:03:34 at commit 7576a9b

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147910=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147910
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:06
Start Date: 26/Sep/18 03:06
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424569380
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147910)
Time Spent: 13h 40m  (was: 13.5h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 13h 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[beam] 01/10: Publishing website 2018/09/26 01:51:44 at commit e9b7e5c

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit d87b42f07670499f4442e6fae078344b5eceb70c
Author: jenkins 
AuthorDate: Wed Sep 26 01:51:44 2018 +

Publishing website 2018/09/26 01:51:44 at commit e9b7e5c
---
 content  |   1 +
 website/generated-content/index.html | 405 +++
 2 files changed, 406 insertions(+)

diff --git a/content b/content
new file mode 12
index 000..6cb4abe
--- /dev/null
+++ b/content
@@ -0,0 +1 @@
+website/generated-content
\ No newline at end of file
diff --git a/website/generated-content/index.html 
b/website/generated-content/index.html
new file mode 100644
index 000..dbdaf3d
--- /dev/null
+++ b/website/generated-content/index.html
@@ -0,0 +1,405 @@
+
+
+
+
+  
+
+
+  
+  
+  
+  Apache Beam
+  
+  https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
+  
+  https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";>
+  
+  
+  
+  
+  
+  https://beam.apache.org/; data-proofer-ignore>
+  
+  https://beam.apache.org/feed.xml;>
+  
+
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new 
Date();a=s.createElement(o),
+
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+ga('create', 'UA-73650088-1', 'auto');
+ga('send', 'pageview');
+  
+
+
+  
+
+
+
+
+  
+Toggle navigation
+
+
+
+  
+
+  
+
+  
+
+
+
+
+
+  
+
+  Get Started
+
+
+  Documentation
+
+
+  SDKS
+
+
+  RUNNERS
+
+
+  Contribute
+
+
+  Community
+
+Blog
+  
+  
+
+  https://www.apache.org/foundation/press/kit/feather_small.png; alt="Apache 
Logo" style="height:20px;">
+  
+http://www.apache.org/;>ASF Homepage
+http://www.apache.org/licenses/;>License
+http://www.apache.org/security/;>Security
+http://www.apache.org/foundation/thanks.html;>Thanks
+http://www.apache.org/foundation/sponsorship.html;>Sponsorship
+https://www.apache.org/foundation/policies/conduct;>Code of 
Conduct
+  
+
+  
+
+
+
+
+  
+
+  
+
+  
+
+  
+Apache Beam: An advanced unified programming model
+  
+  
+Implement batch and streaming data processing jobs that run on any 
execution engine.
+  
+  
+Learn more
+Download Beam SDK 2.6.0
+  
+  
+Java 
Quickstart
+Python 
Quickstart
+   Go 
Quickstart
+  
+
+  
+  
+
+  
+The latest from the blog
+  
+  
+
+
+  Beam Summit Europe 
2018
+  Aug 21, 2018
+
+
+
+  A review of input 
streaming connectors
+  Aug 20, 2018
+
+
+
+  Apache Beam 
2.6.0
+  Aug 10, 2018
+
+
+  
+
+  
+
+  
+
+
+
+  
+All about Apache Beam
+  
+  
+
+
+  
+Unified
+  
+  
+Use a single programming model for both batch and streaming use cases.
+  
+
+
+
+  
+Portable
+  
+  
+Execute pipelines on multiple execution environments.
+  
+
+
+
+  
+Extensible
+  
+  
+Write and share new SDKs, IO connectors, and transformation libraries.
+  
+
+
+  
+
+
+
+
+
+
+
+
+
+  
+Works with
+  
+  
+
+
+  http://apex.apache.org;>
+
+
+
+  http://flink.apache.org;>
+
+
+
+  http://spark.apache.org/;>
+
+
+
+  https://cloud.google.com/dataflow/;>
+
+
+
+  http://gearpump.apache.org/;>
+
+
+
+  http://samza.apache.org/;>
+
+
+  
+
+
+
+  
+
+  Testimonials
+
+
+  
+  
+
+  A framework that delivers the flexibility and advanced functionality 
our customers need.
+
+
+  
+  
+–Talend
+  
+
+  
+  
+  
+
+  Apache Beam has powerful semantics that solve real-world challenges 
of stream processing.
+
+
+  
+  
+–PayPal
+  
+
+  
+  
+  
+
+  Apache Beam represents 

[beam] 06/10: Publishing website 2018/09/26 02:39:15 at commit 7875d2c

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 6fb19ce621077b307e1cdc2c5007a51a08dfed96
Author: jenkins 
AuthorDate: Wed Sep 26 02:39:15 2018 +

Publishing website 2018/09/26 02:39:15 at commit 7875d2c

[beam] branch asf-site updated (e9b7e5c -> b16bd7d)

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git.


from e9b7e5c  Merge pull request #6270: [BEAM-5210] Support VARBINARY in 
BeamSqlPrimitive
 new d87b42f  Publishing website 2018/09/26 01:51:44 at commit e9b7e5c
 new 8cf8566  Publishing website 2018/09/26 02:14:31 at commit d87b42f
 new fdcaa7c  Publishing website 2018/09/26 02:20:18 at commit 8cf8566
 new 076f73c  Publishing website 2018/09/26 02:26:05 at commit fdcaa7c
 new 7875d2c  Publishing website 2018/09/26 02:31:39 at commit 076f73c
 new 6fb19ce  Publishing website 2018/09/26 02:39:15 at commit 7875d2c
 new ba06d1f  Publishing website 2018/09/26 02:51:58 at commit 6fb19ce
 new 7576a9b  Publishing website 2018/09/26 03:00:36 at commit ba06d1f
 new 86f7f05  Publishing website 2018/09/26 03:03:34 at commit 7576a9b
 new b16bd7d  Publishing website 2018/09/26 03:07:13 at commit 86f7f05

The 10 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 content  |   1 +
 website/generated-content/index.html | 405 +++
 2 files changed, 406 insertions(+)
 create mode 12 content
 create mode 100644 website/generated-content/index.html

[beam] 02/10: Publishing website 2018/09/26 02:14:31 at commit d87b42f

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 8cf85668f7a8beb101d09a259ad2be94bd48e9c1
Author: jenkins 
AuthorDate: Wed Sep 26 02:14:31 2018 +

Publishing website 2018/09/26 02:14:31 at commit d87b42f

[beam] 07/10: Publishing website 2018/09/26 02:51:58 at commit 6fb19ce

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit ba06d1f1e107ae5300998b68036d36eba6fd4269
Author: jenkins 
AuthorDate: Wed Sep 26 02:51:58 2018 +

Publishing website 2018/09/26 02:51:58 at commit 6fb19ce

[beam] 05/10: Publishing website 2018/09/26 02:31:39 at commit 076f73c

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 7875d2cde19f4506f60e41921fd61ca4fff340ec
Author: jenkins 
AuthorDate: Wed Sep 26 02:31:39 2018 +

Publishing website 2018/09/26 02:31:39 at commit 076f73c

[beam] 04/10: Publishing website 2018/09/26 02:26:05 at commit fdcaa7c

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 076f73c70cb6fc3959355d326bf1e7c3a53c118a
Author: jenkins 
AuthorDate: Wed Sep 26 02:26:05 2018 +

Publishing website 2018/09/26 02:26:05 at commit fdcaa7c

[beam] 10/10: Publishing website 2018/09/26 03:07:13 at commit 86f7f05

[git-site-role]

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git

commit b16bd7d35638a5887a3373d1b3f335ab82469a04
Author: jenkins 
AuthorDate: Wed Sep 26 03:07:13 2018 +

Publishing website 2018/09/26 03:07:13 at commit 86f7f05

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147908=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147908
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:02
Start Date: 26/Sep/18 03:02
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-42456
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147908)
Time Spent: 13.5h  (was: 13h 20m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 13.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147907=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147907
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 03:00
Start Date: 26/Sep/18 03:00
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424568421
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147907)
Time Spent: 13h 20m  (was: 13h 10m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 13h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147906=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147906
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:59
Start Date: 26/Sep/18 02:59
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424565173
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147906)
Time Spent: 13h 10m  (was: 13h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 13h 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

svn commit: r29681 - /dev/beam/2.7.0/

[ccy]

Author: ccy
Date: Wed Sep 26 02:52:50 2018
New Revision: 29681

Log:
Clean dist directory for Beam 2.7.0 RC3

Removed:
dev/beam/2.7.0/

[beam] branch release-2.7.0 updated (3189926 -> e2edd49)

[ccy]

This is an automated email from the ASF dual-hosted git repository.

ccy pushed a change to branch release-2.7.0
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 3189926  Merge pull request #6495 from charlesccychen/revert-5903-cp
 add e2edd49  [Gradle Release Plugin] - pre tag commit:  'v2.7.0-RC3'.

No new revisions were added by this update.

Summary of changes:
 gradle.properties | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

[beam] branch release-2.7.0 updated (e2edd49 -> 17c47bb)

[ccy]

This is an automated email from the ASF dual-hosted git repository.

ccy pushed a change to branch release-2.7.0
in repository https://gitbox.apache.org/repos/asf/beam.git.


from e2edd49  [Gradle Release Plugin] - pre tag commit:  'v2.7.0-RC3'.
 add 17c47bb  [Gradle Release Plugin] - new version commit:  
'v2.7.0-SNAPSHOT'.

No new revisions were added by this update.

Summary of changes:
 gradle.properties | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

[beam] annotated tag v2.7.0-RC3 updated (e2edd49 -> 51e57fd)

[ccy]

This is an automated email from the ASF dual-hosted git repository.

ccy pushed a change to annotated tag v2.7.0-RC3
in repository https://gitbox.apache.org/repos/asf/beam.git.


*** WARNING: tag v2.7.0-RC3 was modified! ***

from e2edd49  (commit)
  to 51e57fd  (tag)
 tagging e2edd4918ac7a6f9b39b1186bbd6f6bb783568d3 (commit)
 replaces v2.7.0-RC2
  by Charles Chen
  on Wed Sep 26 02:48:38 2018 +

- Log -
[Gradle Release Plugin] - creating tag:  'v2.7.0-RC3'.
---


No new revisions were added by this update.

Summary of changes:

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147905=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147905
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:46
Start Date: 26/Sep/18 02:46
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424566425
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147905)
Time Spent: 13h  (was: 12h 50m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 13h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4747) Python LocalFileSystem directory-creation semantics

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4747?focusedWorklogId=147904=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147904
 ]

ASF GitHub Bot logged work on BEAM-4747:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:44
Start Date: 26/Sep/18 02:44
Worklog Time Spent: 10m 
  Work Description: charlesccychen closed pull request #6495: Revert 
"[BEAM-4747] mkdirs if they don't exist in localfilesystem (#5903)
URL: https://github.com/apache/beam/pull/6495
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/sdks/python/apache_beam/io/localfilesystem.py 
b/sdks/python/apache_beam/io/localfilesystem.py
index 73d9a4de6cd..0dad3620353 100644
--- a/sdks/python/apache_beam/io/localfilesystem.py
+++ b/sdks/python/apache_beam/io/localfilesystem.py
@@ -144,9 +144,6 @@ def create(self, path, mime_type='application/octet-stream',
 
 Returns: file handle with a close function for the user to use
 """
-parent = os.path.dirname(path)
-if not os.path.exists(parent):
-  os.makedirs(parent)
 return self._path_open(path, 'wb', mime_type, compression_type)
 
   def open(self, path, mime_type='application/octet-stream',
@@ -188,10 +185,6 @@ def _copy_path(source, destination):
 if os.path.isdir(source):
   shutil.copytree(source, destination)
 else:
-  parent = os.path.dirname(destination)
-  if not os.path.exists(parent):
-os.makedirs(parent)
-
   shutil.copy2(source, destination)
   except OSError as err:
 raise IOError(err)
@@ -224,10 +217,6 @@ def rename(self, source_file_names, 
destination_file_names):
 def _rename_file(source, destination):
   """Rename a single file object"""
   try:
-parent = os.path.dirname(destination)
-if not os.path.exists(parent):
-  os.makedirs(parent)
-
 os.rename(source, destination)
   except OSError as err:
 raise IOError(err)
diff --git a/sdks/python/apache_beam/io/localfilesystem_test.py 
b/sdks/python/apache_beam/io/localfilesystem_test.py
index 5d032db59a1..d6d8eb4c217 100644
--- a/sdks/python/apache_beam/io/localfilesystem_test.py
+++ b/sdks/python/apache_beam/io/localfilesystem_test.py
@@ -196,8 +196,8 @@ def test_copy_error(self):
  [(path1, path2)])
 
   def test_copy_directory(self):
-path_t1 = os.path.join(self.tmpdir, 't1/11')
-path_t2 = os.path.join(self.tmpdir, 't2/22')
+path_t1 = os.path.join(self.tmpdir, 't1')
+path_t2 = os.path.join(self.tmpdir, 't2')
 self.fs.mkdirs(path_t1)
 self.fs.mkdirs(path_t2)
 
@@ -209,19 +209,6 @@ def test_copy_directory(self):
 self.fs.copy([path_t1], [path_t2])
 self.assertTrue(filecmp.cmp(path1, path2))
 
-  def test_create_mkdirs_open(self):
-path = os.path.join(self.tmpdir, 't1/t2/t3')
-with self.fs.create(path) as f:
-  f.write("yay")
-
-with self.fs.open(path) as f:
-  self.assertEqual(f.read(), "yay")
-
-  def test_open_error(self):
-path = os.path.join(self.tmpdir, 't1')
-with self.assertRaisesRegexp(IOError, r'No such file or directory'):
-  self.fs.open(path)
-
   def test_rename(self):
 path1 = os.path.join(self.tmpdir, 'f1')
 path2 = os.path.join(self.tmpdir, 'f2')
@@ -257,22 +244,6 @@ def test_rename_directory(self):
 self.assertTrue(self.fs.exists(path2))
 self.assertFalse(self.fs.exists(path1))
 
-  def test_rename_mkdirs(self):
-path_t1 = os.path.join(self.tmpdir, 't1')
-path_t2 = os.path.join(self.tmpdir, 't2/t3/t4')
-self.fs.mkdirs(path_t1)
-
-path1 = os.path.join(path_t1, 'f1')
-path2 = os.path.join(path_t2, 'f1')
-with open(path1, 'a') as f:
-  f.write('Hello')
-
-self.fs.rename([path_t1], [path_t2])
-self.assertTrue(self.fs.exists(path_t2))
-self.assertFalse(self.fs.exists(path_t1))
-self.assertTrue(self.fs.exists(path2))
-self.assertFalse(self.fs.exists(path1))
-
   def test_exists(self):
 path1 = os.path.join(self.tmpdir, 'f1')
 path2 = os.path.join(self.tmpdir, 'f2')


 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147904)
Time Spent: 2.5h  (was: 2h 20m)

> Python LocalFileSystem directory-creation semantics
> ---
>
> Key: BEAM-4747
> URL: 

[jira] [Work logged] (BEAM-4747) Python LocalFileSystem directory-creation semantics

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4747?focusedWorklogId=147903=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147903
 ]

ASF GitHub Bot logged work on BEAM-4747:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:43
Start Date: 26/Sep/18 02:43
Worklog Time Spent: 10m 
  Work Description: charlesccychen commented on issue #6495: Revert 
"[BEAM-4747] mkdirs if they don't exist in localfilesystem (#5903)
URL: https://github.com/apache/beam/pull/6495#issuecomment-424565955
 
 
   Merging as the only issue is with the :beam-sdks-python:docs test, which 
fails in a file unrelated to this change:
   
   ```
   22:24:16 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/sdks/python/apache_beam/testing/pipeline_verifiers.py:docstring
 of apache_beam.testing.pipeline_verifiers.PipelineStateMatcher:1: WARNING: 
py:class reference target not found: hamcrest.core.base_matcher.BaseMatcher
   22:24:16 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/sdks/python/apache_beam/testing/pipeline_verifiers.py:docstring
 of apache_beam.testing.pipeline_verifiers.FileChecksumMatcher:1: WARNING: 
py:class reference target not found: hamcrest.core.base_matcher.BaseMatcher
   22:24:25 Command exited with non-zero status 1
   22:24:25 41.01user 5.13system 0:17.09elapsed 270%CPU (0avgtext+0avgdata 
167472maxresident)k
   22:24:25 0inputs+46304outputs (0major+701640minor)pagefaults 0swaps
   22:24:25 ERROR: InvocationError for command '/usr/bin/time 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/sdks/python/scripts/generate_pydoc.sh'
 (exited with code 1)
   22:24:25 ___ summary 

   22:24:25 ERROR:   docs: commands failed
   22:24:25 
   22:24:25 > Task :beam-sdks-python:docs FAILED
   ```


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147903)
Time Spent: 2h 20m  (was: 2h 10m)

> Python LocalFileSystem directory-creation semantics
> ---
>
> Key: BEAM-4747
> URL: https://issues.apache.org/jira/browse/BEAM-4747
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Affects Versions: 2.5.0
>Reporter: Ryan Williams
>Assignee: Ryan Williams
>Priority: Minor
>  Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> Coming out of discussion on 
> [BEAM-4742|https://issues.apache.org/jira/browse/BEAM-4742] / 
> [#5903|https://github.com/apache/beam/pull/5903] is a question of whether 
> {{LocalFileSystem.open,create,copy,rename}} should create 
> intermediate (destination) directories, or fail with {{IOError}}'s (as the 
> stdlib {{os}} module generally will).
> If the semantics of {{LocalFileSystem}} should mimic those of distributed 
> filesystems (in the spirit of [recent discussion about {{DirectRunner}} being 
> more like a local simulation of a distributed runner than a production-grade 
> local 
> runner|https://www.mail-archive.com/dev@beam.apache.org/msg08410.html]), then 
> this makes sense, and it sounds like [~lcwik] and [~angoenka] are in favor of 
> this interpretation.
> I'll repurpose [#5903|https://github.com/apache/beam/pull/5903] to this end 
> unless I hear otherwise.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: beam_PostCommit_Website_Publish #3

[Apache Jenkins Server]

See 


Changes:

[qinyeli] Interactive Beam -- read_cache_ids and write_cache_ids

[qinyeli] Interactive Beam -- renaming variables and functions

[afulton] Fix unstable test by ensuring acks are processed synchronously

[andrew] Ensuring Spotless Java compliance

[qinyeli] Interactive Beam -- fixing PTransform # display issue

[github] typo Python -> Go

[herohde] Remove gcemd and gcsproxy containers images

[mxm] Add tests for port supplier methods in ServerFactory

[tweise] [BEAM-4594] Skip test_pardo_state_only for Flink PVR.

[tweise] [BEAM-5467] Add Python Flink VR job status to README and rename

[tweise] [BEAM-5467] Update status links after seedjob run.

[ptomasroos] Fix combine.go to run on dataflow

[github] Update TODO to reference Jira

[aaltay] [BEAM-5209] Precommit timings notebook: fix illegal characters in URL,

[pablo] [BEAM-5240] Add metrics dashboard deployment script and logic (#6277)

[aaltay] Remove standard_library.import_aliases() calls (#6471)

[github] Fix sliding time windows example documentation

[pablo] Revert "[BEAM-5240] Add metrics dashboard deployment script and logic

[mergebot] Fix a few typos in beam site docs

[apilloud] [BEAM-5491] Update NightlySnapshot job name

[github] [BEAM-5378] Remove go wordcap example Dataflow runner (#6395)

[ehudm] GCSIO: Allow empty object prefix in list_prefix().

[swegner] Upgrade assertj dependecny to latest (3.11.1)

[github] Improved Flatten input error message

[migryz] Add metrics dashboard deployment script and logic

[migryz] Fix rat issues

[aaltay] [BEAM-1251] Upgrade pylint version for py27-lint3 (#6489)

[aaltay] [BEAM-5319] Partially port runners (#6451)

[pablo] Fixing Py2-3 lint issue

--
Started by GitHub push by charlesccychen
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision cd36af1eced5297d6dad226e6233e9528bc7e3da (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f cd36af1eced5297d6dad226e6233e9528bc7e3da
Commit message: "Merge pull request #6492 from pabloem/fix-pylint23"
 > git rev-list --no-walk 9a1f917227dfbcd23cf5e6129c2312848ceffc27 # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ 
 
--info --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g 
-Dorg.gradle.jvmargs=-Xmx4g :beam-website:clean :beam-website:publishWebsite
Initialized native services in: /home/jenkins/.gradle/native
To honour the JVM settings for this build a new JVM will be forked. Please 
consider using the daemon: 
https://docs.gradle.org/4.10.2/userguide/gradle_daemon.html.
Starting process 'Gradle build daemon'. Working directory: 
/home/jenkins/.gradle/daemon/4.10.2 Command: 
/usr/local/asfpackages/java/jdk1.8.0_172/bin/java -Xmx4g -Dfile.encoding=UTF-8 
-Duser.country=US -Duser.language=en -Duser.variant -cp 
/home/jenkins/.gradle/wrapper/dists/gradle-4.10.2-bin/cghg6c4gf4vkiutgsab8yrnwv/gradle-4.10.2/lib/gradle-launcher-4.10.2.jar
 org.gradle.launcher.daemon.bootstrap.GradleDaemon 4.10.2
Successfully started process 'Gradle build daemon'
An attempt to start the daemon took 0.978 secs.
The client will now receive all logging from the daemon (pid: 30525). The 
daemon log file: /home/jenkins/.gradle/daemon/4.10.2/daemon-30525.out.log
Closing daemon's stdin at end of input.
The daemon will no longer process any standard input.
Daemon will be stopped at the end of the build stopping after processing
Using 12 worker leases.
Starting Build
Parallel execution is an incubating feature.

> Configure project :buildSrc
Evaluating project ':buildSrc' using build file 
'
file or directory 
'
 

[beam] branch release-2.7.0 updated (71401d4 -> 3189926)

[ccy]

This is an automated email from the ASF dual-hosted git repository.

ccy pushed a change to branch release-2.7.0
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 71401d4  [Gradle Release Plugin] - new version commit:  
'v2.7.0-SNAPSHOT'.
 add 5b9937b  Revert "[BEAM-4747] mkdirs if they don't exist in 
localfilesystem (#5903)"
 add 3189926  Merge pull request #6495 from charlesccychen/revert-5903-cp

No new revisions were added by this update.

Summary of changes:
 sdks/python/apache_beam/io/localfilesystem.py  | 11 
 sdks/python/apache_beam/io/localfilesystem_test.py | 33 ++
 2 files changed, 2 insertions(+), 42 deletions(-)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147900=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147900
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:38
Start Date: 26/Sep/18 02:38
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424565173
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147900)
Time Spent: 12h 50m  (was: 12h 40m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 12h 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147899=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147899
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:30
Start Date: 26/Sep/18 02:30
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424564026
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147899)
Time Spent: 12h 40m  (was: 12.5h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 12h 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147898=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147898
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:25
Start Date: 26/Sep/18 02:25
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424561050
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147898)
Time Spent: 12.5h  (was: 12h 20m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 12.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147897=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147897
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:25
Start Date: 26/Sep/18 02:25
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424561349
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147897)
Time Spent: 12h 20m  (was: 12h 10m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 12h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147895=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147895
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:25
Start Date: 26/Sep/18 02:25
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424563150
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147895)
Time Spent: 12h  (was: 11h 50m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 12h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147896=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147896
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:25
Start Date: 26/Sep/18 02:25
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424562260
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147896)
Time Spent: 12h 10m  (was: 12h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 12h 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147894=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147894
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:25
Start Date: 26/Sep/18 02:25
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424563150
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147894)
Time Spent: 11h 50m  (was: 11h 40m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 11h 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4747) Python LocalFileSystem directory-creation semantics

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4747?focusedWorklogId=147892=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147892
 ]

ASF GitHub Bot logged work on BEAM-4747:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:22
Start Date: 26/Sep/18 02:22
Worklog Time Spent: 10m 
  Work Description: charlesccychen commented on issue #6495: Revert 
"[BEAM-4747] mkdirs if they don't exist in localfilesystem (#5903)
URL: https://github.com/apache/beam/pull/6495#issuecomment-424562662
 
 
   Run Python PreCommit


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147892)
Time Spent: 2h 10m  (was: 2h)

> Python LocalFileSystem directory-creation semantics
> ---
>
> Key: BEAM-4747
> URL: https://issues.apache.org/jira/browse/BEAM-4747
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Affects Versions: 2.5.0
>Reporter: Ryan Williams
>Assignee: Ryan Williams
>Priority: Minor
>  Time Spent: 2h 10m
>  Remaining Estimate: 0h
>
> Coming out of discussion on 
> [BEAM-4742|https://issues.apache.org/jira/browse/BEAM-4742] / 
> [#5903|https://github.com/apache/beam/pull/5903] is a question of whether 
> {{LocalFileSystem.open,create,copy,rename}} should create 
> intermediate (destination) directories, or fail with {{IOError}}'s (as the 
> stdlib {{os}} module generally will).
> If the semantics of {{LocalFileSystem}} should mimic those of distributed 
> filesystems (in the spirit of [recent discussion about {{DirectRunner}} being 
> more like a local simulation of a distributed runner than a production-grade 
> local 
> runner|https://www.mail-archive.com/dev@beam.apache.org/msg08410.html]), then 
> this makes sense, and it sounds like [~lcwik] and [~angoenka] are in favor of 
> this interpretation.
> I'll repurpose [#5903|https://github.com/apache/beam/pull/5903] to this end 
> unless I hear otherwise.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147888=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147888
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:19
Start Date: 26/Sep/18 02:19
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424562260
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147888)
Time Spent: 11h 40m  (was: 11.5h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 11h 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147886=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147886
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:13
Start Date: 26/Sep/18 02:13
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424561349
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147886)
Time Spent: 11.5h  (was: 11h 20m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 11.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Jenkins build is back to normal : beam_PostCommit_Python_Verify #6088

[Apache Jenkins Server]

See 

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147885=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147885
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:11
Start Date: 26/Sep/18 02:11
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424561050
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147885)
Time Spent: 11h 20m  (was: 11h 10m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 11h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (BEAM-5490) Beam should not irreversibly modify inspect.getargspec

[Ahmet Altay (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-5490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ahmet Altay reassigned BEAM-5490:
-

Assignee: Valentyn Tymofieiev

> Beam should not irreversibly modify inspect.getargspec
> --
>
> Key: BEAM-5490
> URL: https://issues.apache.org/jira/browse/BEAM-5490
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Chuan Yu Foo
>Assignee: Valentyn Tymofieiev
>Priority: Major
>
> In the Python SDK, in {{typehints/decorators.py}}, Beam irreversibly 
> monkey-patches {{inspect.getargspec}} for its own purposes. This is really 
> bad form, since it leads to hard to debug issues in other modules which also 
> use {{inspect.getargspec}} when Beam is imported. 
> Beam should either maintain its own modified copy of the functions it needs, 
> or else it should always reverse the monkey-patching so that it does not 
> affect other modules.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4747) Python LocalFileSystem directory-creation semantics

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4747?focusedWorklogId=147884=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147884
 ]

ASF GitHub Bot logged work on BEAM-4747:


Author: ASF GitHub Bot
Created on: 26/Sep/18 02:00
Start Date: 26/Sep/18 02:00
Worklog Time Spent: 10m 
  Work Description: charlesccychen commented on issue #6495: Revert 
"[BEAM-4747] mkdirs if they don't exist in localfilesystem (#5903)
URL: https://github.com/apache/beam/pull/6495#issuecomment-424559127
 
 
   Run Python PostCommit


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147884)
Time Spent: 2h  (was: 1h 50m)

> Python LocalFileSystem directory-creation semantics
> ---
>
> Key: BEAM-4747
> URL: https://issues.apache.org/jira/browse/BEAM-4747
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Affects Versions: 2.5.0
>Reporter: Ryan Williams
>Assignee: Ryan Williams
>Priority: Minor
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> Coming out of discussion on 
> [BEAM-4742|https://issues.apache.org/jira/browse/BEAM-4742] / 
> [#5903|https://github.com/apache/beam/pull/5903] is a question of whether 
> {{LocalFileSystem.open,create,copy,rename}} should create 
> intermediate (destination) directories, or fail with {{IOError}}'s (as the 
> stdlib {{os}} module generally will).
> If the semantics of {{LocalFileSystem}} should mimic those of distributed 
> filesystems (in the spirit of [recent discussion about {{DirectRunner}} being 
> more like a local simulation of a distributed runner than a production-grade 
> local 
> runner|https://www.mail-archive.com/dev@beam.apache.org/msg08410.html]), then 
> this makes sense, and it sounds like [~lcwik] and [~angoenka] are in favor of 
> this interpretation.
> I'll repurpose [#5903|https://github.com/apache/beam/pull/5903] to this end 
> unless I hear otherwise.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4747) Python LocalFileSystem directory-creation semantics

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4747?focusedWorklogId=147882=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147882
 ]

ASF GitHub Bot logged work on BEAM-4747:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:59
Start Date: 26/Sep/18 01:59
Worklog Time Spent: 10m 
  Work Description: charlesccychen opened a new pull request #6495: Revert 
"[BEAM-4747] mkdirs if they don't exist in localfilesystem (#5903)
URL: https://github.com/apache/beam/pull/6495
 
 
   This reverts commit d903dcfc7ff7300355688b08b779da880f15fe9d (PR #5903) 
because it causes release 2.7.0 RC2 validation to fail (the code does not deal 
well with relative paths).
   
   This is a cherry-pick of #6494 into the release-2.7.0 branch.
   
   **Please** add a meaningful description for your change here
   
   
   
   Follow this checklist to help us incorporate your contribution quickly and 
easily:
   
- [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in 
ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA 
issue, if applicable. This will automatically link the pull request to the 
issue.
- [ ] If this contribution is large, please file an Apache [Individual 
Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
   
   It will help us expedite review of your Pull Request if you tag someone 
(e.g. `@username`) to look at it.
   
   Post-Commit Tests Status (on master branch)
   

   
   Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
   --- | --- | --- | --- | --- | --- | --- | ---
   Go | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/)
 | --- | --- | --- | --- | --- | ---
   Java | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/)
   Python | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/)
 | --- | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)
  [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/)
 | --- | --- | ---
   
   
   
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147882)
Time Spent: 1h 40m  (was: 1.5h)

> Python LocalFileSystem directory-creation semantics
> 

[jira] [Work logged] (BEAM-4747) Python LocalFileSystem directory-creation semantics

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4747?focusedWorklogId=147883=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147883
 ]

ASF GitHub Bot logged work on BEAM-4747:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:59
Start Date: 26/Sep/18 01:59
Worklog Time Spent: 10m 
  Work Description: charlesccychen commented on issue #6495: Revert 
"[BEAM-4747] mkdirs if they don't exist in localfilesystem (#5903)
URL: https://github.com/apache/beam/pull/6495#issuecomment-424559107
 
 
   R: @aaltay
   CC: @ryan-williams


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147883)
Time Spent: 1h 50m  (was: 1h 40m)

> Python LocalFileSystem directory-creation semantics
> ---
>
> Key: BEAM-4747
> URL: https://issues.apache.org/jira/browse/BEAM-4747
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Affects Versions: 2.5.0
>Reporter: Ryan Williams
>Assignee: Ryan Williams
>Priority: Minor
>  Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> Coming out of discussion on 
> [BEAM-4742|https://issues.apache.org/jira/browse/BEAM-4742] / 
> [#5903|https://github.com/apache/beam/pull/5903] is a question of whether 
> {{LocalFileSystem.open,create,copy,rename}} should create 
> intermediate (destination) directories, or fail with {{IOError}}'s (as the 
> stdlib {{os}} module generally will).
> If the semantics of {{LocalFileSystem}} should mimic those of distributed 
> filesystems (in the spirit of [recent discussion about {{DirectRunner}} being 
> more like a local simulation of a distributed runner than a production-grade 
> local 
> runner|https://www.mail-archive.com/dev@beam.apache.org/msg08410.html]), then 
> this makes sense, and it sounds like [~lcwik] and [~angoenka] are in favor of 
> this interpretation.
> I'll repurpose [#5903|https://github.com/apache/beam/pull/5903] to this end 
> unless I hear otherwise.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4747) Python LocalFileSystem directory-creation semantics

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4747?focusedWorklogId=147880=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147880
 ]

ASF GitHub Bot logged work on BEAM-4747:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:57
Start Date: 26/Sep/18 01:57
Worklog Time Spent: 10m 
  Work Description: charlesccychen commented on issue #6494: Revert 
"[BEAM-4747] mkdirs if they don't exist in localfilesystem (#5903)
URL: https://github.com/apache/beam/pull/6494#issuecomment-424558738
 
 
   R: @aaltay 
   CC: @ryan-williams


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147880)
Time Spent: 1h 20m  (was: 1h 10m)

> Python LocalFileSystem directory-creation semantics
> ---
>
> Key: BEAM-4747
> URL: https://issues.apache.org/jira/browse/BEAM-4747
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Affects Versions: 2.5.0
>Reporter: Ryan Williams
>Assignee: Ryan Williams
>Priority: Minor
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Coming out of discussion on 
> [BEAM-4742|https://issues.apache.org/jira/browse/BEAM-4742] / 
> [#5903|https://github.com/apache/beam/pull/5903] is a question of whether 
> {{LocalFileSystem.open,create,copy,rename}} should create 
> intermediate (destination) directories, or fail with {{IOError}}'s (as the 
> stdlib {{os}} module generally will).
> If the semantics of {{LocalFileSystem}} should mimic those of distributed 
> filesystems (in the spirit of [recent discussion about {{DirectRunner}} being 
> more like a local simulation of a distributed runner than a production-grade 
> local 
> runner|https://www.mail-archive.com/dev@beam.apache.org/msg08410.html]), then 
> this makes sense, and it sounds like [~lcwik] and [~angoenka] are in favor of 
> this interpretation.
> I'll repurpose [#5903|https://github.com/apache/beam/pull/5903] to this end 
> unless I hear otherwise.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4747) Python LocalFileSystem directory-creation semantics

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4747?focusedWorklogId=147881=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147881
 ]

ASF GitHub Bot logged work on BEAM-4747:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:57
Start Date: 26/Sep/18 01:57
Worklog Time Spent: 10m 
  Work Description: charlesccychen commented on issue #6494: Revert 
"[BEAM-4747] mkdirs if they don't exist in localfilesystem (#5903)
URL: https://github.com/apache/beam/pull/6494#issuecomment-424558760
 
 
   Run Python PostCommit


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147881)
Time Spent: 1.5h  (was: 1h 20m)

> Python LocalFileSystem directory-creation semantics
> ---
>
> Key: BEAM-4747
> URL: https://issues.apache.org/jira/browse/BEAM-4747
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Affects Versions: 2.5.0
>Reporter: Ryan Williams
>Assignee: Ryan Williams
>Priority: Minor
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Coming out of discussion on 
> [BEAM-4742|https://issues.apache.org/jira/browse/BEAM-4742] / 
> [#5903|https://github.com/apache/beam/pull/5903] is a question of whether 
> {{LocalFileSystem.open,create,copy,rename}} should create 
> intermediate (destination) directories, or fail with {{IOError}}'s (as the 
> stdlib {{os}} module generally will).
> If the semantics of {{LocalFileSystem}} should mimic those of distributed 
> filesystems (in the spirit of [recent discussion about {{DirectRunner}} being 
> more like a local simulation of a distributed runner than a production-grade 
> local 
> runner|https://www.mail-archive.com/dev@beam.apache.org/msg08410.html]), then 
> this makes sense, and it sounds like [~lcwik] and [~angoenka] are in favor of 
> this interpretation.
> I'll repurpose [#5903|https://github.com/apache/beam/pull/5903] to this end 
> unless I hear otherwise.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4747) Python LocalFileSystem directory-creation semantics

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4747?focusedWorklogId=147879=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147879
 ]

ASF GitHub Bot logged work on BEAM-4747:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:56
Start Date: 26/Sep/18 01:56
Worklog Time Spent: 10m 
  Work Description: charlesccychen opened a new pull request #6494: Revert 
"[BEAM-4747] mkdirs if they don't exist in localfilesystem (#5903)
URL: https://github.com/apache/beam/pull/6494
 
 
   This reverts commit d903dcfc7ff7300355688b08b779da880f15fe9d (PR #5903) 
because it causes release 2.7.0 RC2 validation to fail (the code does not deal 
well with relative paths).
   
   **Please** add a meaningful description for your change here
   
   
   
   Follow this checklist to help us incorporate your contribution quickly and 
easily:
   
- [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in 
ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA 
issue, if applicable. This will automatically link the pull request to the 
issue.
- [ ] If this contribution is large, please file an Apache [Individual 
Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
   
   It will help us expedite review of your Pull Request if you tag someone 
(e.g. `@username`) to look at it.
   
   Post-Commit Tests Status (on master branch)
   

   
   Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
   --- | --- | --- | --- | --- | --- | --- | ---
   Go | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/)
 | --- | --- | --- | --- | --- | ---
   Java | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/)
   Python | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/)
 | --- | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)
  [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/)
 | --- | --- | ---
   
   
   
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147879)
Time Spent: 1h 10m  (was: 1h)

> Python LocalFileSystem directory-creation semantics
> ---
>
> Key: 

[jira] [Work logged] (BEAM-4747) Python LocalFileSystem directory-creation semantics

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4747?focusedWorklogId=147878=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147878
 ]

ASF GitHub Bot logged work on BEAM-4747:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:53
Start Date: 26/Sep/18 01:53
Worklog Time Spent: 10m 
  Work Description: charlesccychen commented on issue #5903: [BEAM-4747] 
mkdirs if they don't exist in localfilesystem
URL: https://github.com/apache/beam/pull/5903#issuecomment-424558094
 
 
   This PR breaks the 2.7.0 RC2 because it doesn't take into account relative 
paths.  I will therefore be reverting this.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147878)
Time Spent: 1h  (was: 50m)

> Python LocalFileSystem directory-creation semantics
> ---
>
> Key: BEAM-4747
> URL: https://issues.apache.org/jira/browse/BEAM-4747
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Affects Versions: 2.5.0
>Reporter: Ryan Williams
>Assignee: Ryan Williams
>Priority: Minor
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> Coming out of discussion on 
> [BEAM-4742|https://issues.apache.org/jira/browse/BEAM-4742] / 
> [#5903|https://github.com/apache/beam/pull/5903] is a question of whether 
> {{LocalFileSystem.open,create,copy,rename}} should create 
> intermediate (destination) directories, or fail with {{IOError}}'s (as the 
> stdlib {{os}} module generally will).
> If the semantics of {{LocalFileSystem}} should mimic those of distributed 
> filesystems (in the spirit of [recent discussion about {{DirectRunner}} being 
> more like a local simulation of a distributed runner than a production-grade 
> local 
> runner|https://www.mail-archive.com/dev@beam.apache.org/msg08410.html]), then 
> this makes sense, and it sounds like [~lcwik] and [~angoenka] are in favor of 
> this interpretation.
> I'll repurpose [#5903|https://github.com/apache/beam/pull/5903] to this end 
> unless I hear otherwise.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147877=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147877
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:50
Start Date: 26/Sep/18 01:50
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424557723
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147877)
Time Spent: 11h 10m  (was: 11h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 11h 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147875=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147875
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:47
Start Date: 26/Sep/18 01:47
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424555757
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147875)
Time Spent: 11h  (was: 10h 50m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 11h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147874=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147874
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:46
Start Date: 26/Sep/18 01:46
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424556506
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147874)
Time Spent: 10h 50m  (was: 10h 40m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 10h 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147873=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147873
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:46
Start Date: 26/Sep/18 01:46
Worklog Time Spent: 10m 
  Work Description: alanmyrvold removed a comment on issue #6431: 
[BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424557082
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147873)
Time Spent: 10h 40m  (was: 10.5h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 10h 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147872=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147872
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:46
Start Date: 26/Sep/18 01:46
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424557082
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147872)
Time Spent: 10.5h  (was: 10h 20m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 10.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (BEAM-5509) Python pipeline_options doesn't handle int type

[Thomas Weise (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628141#comment-16628141
 ] 

Thomas Weise commented on BEAM-5509:


Pass --parallelism=1 and then job_utils.dict_to_struct(options) yields
{code:java}
fields {
  key: "beam:option:parallelism:v1"
  value {
    number_value: 1.0
  }
}{code}
Parsing in SDK harness will bark at it:
{code:java}
sdk_worker_main.py: error: argument --parallelism: invalid int value: u'1.0'

[grpc-default-worker-ELG-3-3] DEBUG 
org.apache.beam.vendor.grpc.v1.io.grpc.netty.NettyServerHandler - [id: 
0x284d90f2, L:/127.0.0.1:57436 - R:/127.0.0.1:57442] INBOUND DATA: streamId=1 
padding=0 endStream=false length=980 
bytes=0003cf0acc070806120c08ccb8abdd0510e8b5f5e1011a9707507974686f6e2073646b206861726e657373206661696c65643a200a54726163656261636b...

[grpc-default-worker-ELG-3-3] DEBUG 
org.apache.beam.vendor.grpc.v1.io.grpc.netty.NettyServerHandler - [id: 
0x284d90f2, L:/127.0.0.1:57436 - R:/127.0.0.1:57442] INBOUND DATA: streamId=1 
padding=0 endStream=true length=0 bytes=

[grpc-default-executor-0] ERROR sdk_worker_main.main - Python sdk harness 
failed:

Traceback (most recent call last):

  File 
"/Users/tweise/python-ve/beam/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker_main.py",
 line 136, in main

    sdk_pipeline_options.get_all_options(drop_default=True))

  File 
"/Users/tweise/python-ve/beam/lib/python2.7/site-packages/apache_beam/options/pipeline_options.py",
 line 216, in get_all_options

    known_args, _ = parser.parse_known_args(self._flags)

  File 
"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/argparse.py",
 line 1740, in parse_known_args

    self.error(str(err))

  File 
"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/argparse.py",
 line 2374, in error

    self.exit(2, _('%s: error: %s\n') % (self.prog, message))

  File 
"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/argparse.py",
 line 2362, in exit

    _sys.exit(status)

SystemExit: 2{code}
 

> Python pipeline_options doesn't handle int type
> ---
>
> Key: BEAM-5509
> URL: https://issues.apache.org/jira/browse/BEAM-5509
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-harness
>Reporter: Thomas Weise
>Assignee: Robert Bradshaw
>Priority: Major
>
> The int option supplied at the command line is turned into a decimal during 
> serialization and then the parser in SDK harness fails to restore it as int.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147869=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147869
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:42
Start Date: 26/Sep/18 01:42
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424556506
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147869)
Time Spent: 10h 20m  (was: 10h 10m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 10h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (BEAM-5509) Python pipeline_options doesn't handle int type

[Thomas Weise (JIRA)]

Thomas Weise created BEAM-5509:
--

 Summary: Python pipeline_options doesn't handle int type
 Key: BEAM-5509
 URL: https://issues.apache.org/jira/browse/BEAM-5509
 Project: Beam
  Issue Type: Bug
  Components: sdk-py-harness
Reporter: Thomas Weise
Assignee: Robert Bradshaw


The int option supplied at the command line is turned into a decimal during 
serialization and then the parser in SDK harness fails to restore it as int.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147867=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147867
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:38
Start Date: 26/Sep/18 01:38
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #6431: [BEAM-4496] 
Website merge
URL: https://github.com/apache/beam/pull/6431#issuecomment-424555757
 
 
   Run Website Publish


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147867)
Time Spent: 10h 10m  (was: 10h)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 10h 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4496) Create Jenkins job to push generated HTML to asf-site branch

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4496?focusedWorklogId=147866=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-147866
 ]

ASF GitHub Bot logged work on BEAM-4496:


Author: ASF GitHub Bot
Created on: 26/Sep/18 01:36
Start Date: 26/Sep/18 01:36
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on a change in pull request 
#6431: [BEAM-4496] Website merge
URL: https://github.com/apache/beam/pull/6431#discussion_r219661201
 
 

 ##
 File path: website/build.gradle
 ##
 @@ -22,6 +22,8 @@ apply plugin: "base"
 def dockerImageTag = 'beam-website'
 def dockerWorkDir = "/repo"
 def buildDir = "$project.rootDir/build/website"
+def contentBuildDir = "$buildDir/content"
+def contentRepoDir = "$project.rootDir/website/content"
 
 Review comment:
   Removing the website/generated-content, both with git remove and gradle 
delete call.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 147866)
Time Spent: 10h  (was: 9h 50m)

> Create Jenkins job to push generated HTML to asf-site branch
> 
>
> Key: BEAM-4496
> URL: https://issues.apache.org/jira/browse/BEAM-4496
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system, website
>Reporter: Scott Wegner
>Assignee: Alan Myrvold
>Priority: Major
>  Labels: beam-site-automation-reliability
>  Time Spent: 10h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (BEAM-5508) Upgrade gradle-versions-plugin to 0.20.0

[Ted Yu (JIRA)]

Ted Yu created BEAM-5508:


 Summary: Upgrade gradle-versions-plugin to 0.20.0
 Key: BEAM-5508
 URL: https://issues.apache.org/jira/browse/BEAM-5508
 Project: Beam
  Issue Type: Task
  Components: build-system
Reporter: Ted Yu
Assignee: Luke Cwik


Currently 0.17.0 is used for gradle-versions-plugin

This task upgrades to 0.20.0 version

https://bintray.com/fooberger/maven/com.github.ben-manes%3Agradle-versions-plugin/0.20.0



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)