[jira] [Updated] (BEAM-9018) Beam Dependency Update Request: httplib2
[ https://issues.apache.org/jira/browse/BEAM-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Beam JIRA Bot updated BEAM-9018: Description: - 2019-12-23 12:05:07.739677 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.15.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2019-12-30 14:00:50.038093 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.15.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-06 12:04:16.448089 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.15.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-13 12:04:37.840332 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.15.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-20 12:04:14.892687 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.16.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-27 12:04:58.455497 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.17.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-02-03 12:07:25.549852 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.17.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. was: - 2019-12-23 12:05:07.739677 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.15.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2019-12-30 14:00:50.038093 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.15.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-06 12:04:16.448089 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.15.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-13 12:04:37.840332 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.15.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-20 12:04:14.892687 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.16.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-27 12:04:58.455497 - Please consider upgrading the dependency httplib2. The current version is 0.12.0. The latest version is 0.17.0 cc:
[jira] [Updated] (BEAM-9155) Beam Dependency Update Request: PyHamcrest
[ https://issues.apache.org/jira/browse/BEAM-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Beam JIRA Bot updated BEAM-9155: Description: - 2020-01-20 12:04:45.491512 - Please consider upgrading the dependency PyHamcrest. The current version is 1.10.1. The latest version is 2.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-27 12:05:23.805271 - Please consider upgrading the dependency PyHamcrest. The current version is 1.10.1. The latest version is 2.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-02-03 12:07:49.921383 - Please consider upgrading the dependency PyHamcrest. The current version is 1.10.1. The latest version is 2.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. was: - 2020-01-20 12:04:45.491512 - Please consider upgrading the dependency PyHamcrest. The current version is 1.10.1. The latest version is 2.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-27 12:05:23.805271 - Please consider upgrading the dependency PyHamcrest. The current version is 1.10.1. The latest version is 2.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. > Beam Dependency Update Request: PyHamcrest > -- > > Key: BEAM-9155 > URL: https://issues.apache.org/jira/browse/BEAM-9155 > Project: Beam > Issue Type: Bug > Components: dependencies >Reporter: Beam JIRA Bot >Priority: Major > > - 2020-01-20 12:04:45.491512 > - > Please consider upgrading the dependency PyHamcrest. > The current version is 1.10.1. The latest version is 2.0.0 > cc: > Please refer to [Beam Dependency Guide > |https://beam.apache.org/contribute/dependencies/]for more information. > Do Not Modify The Description Above. > - 2020-01-27 12:05:23.805271 > - > Please consider upgrading the dependency PyHamcrest. > The current version is 1.10.1. The latest version is 2.0.0 > cc: > Please refer to [Beam Dependency Guide > |https://beam.apache.org/contribute/dependencies/]for more information. > Do Not Modify The Description Above. > - 2020-02-03 12:07:49.921383 > - > Please consider upgrading the dependency PyHamcrest. > The current version is 1.10.1. The latest version is 2.0.0 > cc: > Please refer to [Beam Dependency Guide > |https://beam.apache.org/contribute/dependencies/]for more information. > Do Not Modify The Description Above. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (BEAM-9017) Beam Dependency Update Request: cachetools
[ https://issues.apache.org/jira/browse/BEAM-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Beam JIRA Bot updated BEAM-9017: Description: - 2019-12-23 12:04:17.483984 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2019-12-30 14:00:14.523312 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-06 12:03:38.328424 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-13 12:04:04.593478 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-20 12:03:36.859072 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-27 12:04:22.622190 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-02-03 12:06:51.686822 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. was: - 2019-12-23 12:04:17.483984 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2019-12-30 14:00:14.523312 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-06 12:03:38.328424 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-13 12:04:04.593478 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-20 12:03:36.859072 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc: Please refer to [Beam Dependency Guide |https://beam.apache.org/contribute/dependencies/]for more information. Do Not Modify The Description Above. - 2020-01-27 12:04:22.622190 - Please consider upgrading the dependency cachetools. The current version is 3.1.1. The latest version is 4.0.0 cc:
[jira] [Work logged] (BEAM-9175) Introduce an autoformatting tool to Python SDK
[ https://issues.apache.org/jira/browse/BEAM-9175?focusedWorklogId=380913=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380913 ] ASF GitHub Bot logged work on BEAM-9175: Author: ASF GitHub Bot Created on: 03/Feb/20 12:05 Start Date: 03/Feb/20 12:05 Worklog Time Spent: 10m Work Description: mwalenia commented on issue #10684: [BEAM-9175] Introduce an autoformatting tool to Python SDK URL: https://github.com/apache/beam/pull/10684#issuecomment-581382827 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 380913) Time Spent: 7h 40m (was: 7.5h) > Introduce an autoformatting tool to Python SDK > -- > > Key: BEAM-9175 > URL: https://issues.apache.org/jira/browse/BEAM-9175 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core, sdk-py-harness >Reporter: Michał Walenia >Assignee: Kamil Wasilewski >Priority: Major > Time Spent: 7h 40m > Remaining Estimate: 0h > > It seems there are three main options: > * black - very simple, but not configurable at all (except for line length), > would drastically change code style > * yapf - more options to tweak, can omit parts of code > * autopep8 - more similar to spotless - only touches code that breaks > formatting guidelines, can use pycodestyle and flake8 as configuration > The rigidity of Black makes it unusable for Beam. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9175) Introduce an autoformatting tool to Python SDK
[ https://issues.apache.org/jira/browse/BEAM-9175?focusedWorklogId=380893=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380893 ] ASF GitHub Bot logged work on BEAM-9175: Author: ASF GitHub Bot Created on: 03/Feb/20 11:06 Start Date: 03/Feb/20 11:06 Worklog Time Spent: 10m Work Description: mwalenia commented on issue #10684: [BEAM-9175] Introduce an autoformatting tool to Python SDK URL: https://github.com/apache/beam/pull/10684#issuecomment-581359325 Run PythonFormatter PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 380893) Time Spent: 7.5h (was: 7h 20m) > Introduce an autoformatting tool to Python SDK > -- > > Key: BEAM-9175 > URL: https://issues.apache.org/jira/browse/BEAM-9175 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core, sdk-py-harness >Reporter: Michał Walenia >Assignee: Kamil Wasilewski >Priority: Major > Time Spent: 7.5h > Remaining Estimate: 0h > > It seems there are three main options: > * black - very simple, but not configurable at all (except for line length), > would drastically change code style > * yapf - more options to tweak, can omit parts of code > * autopep8 - more similar to spotless - only touches code that breaks > formatting guidelines, can use pycodestyle and flake8 as configuration > The rigidity of Black makes it unusable for Beam. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9175) Introduce an autoformatting tool to Python SDK
[ https://issues.apache.org/jira/browse/BEAM-9175?focusedWorklogId=380888=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380888 ] ASF GitHub Bot logged work on BEAM-9175: Author: ASF GitHub Bot Created on: 03/Feb/20 11:02 Start Date: 03/Feb/20 11:02 Worklog Time Spent: 10m Work Description: mwalenia commented on issue #10684: [BEAM-9175] Introduce an autoformatting tool to Python SDK URL: https://github.com/apache/beam/pull/10684#issuecomment-581357658 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 380888) Time Spent: 7h 10m (was: 7h) > Introduce an autoformatting tool to Python SDK > -- > > Key: BEAM-9175 > URL: https://issues.apache.org/jira/browse/BEAM-9175 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core, sdk-py-harness >Reporter: Michał Walenia >Assignee: Kamil Wasilewski >Priority: Major > Time Spent: 7h 10m > Remaining Estimate: 0h > > It seems there are three main options: > * black - very simple, but not configurable at all (except for line length), > would drastically change code style > * yapf - more options to tweak, can omit parts of code > * autopep8 - more similar to spotless - only touches code that breaks > formatting guidelines, can use pycodestyle and flake8 as configuration > The rigidity of Black makes it unusable for Beam. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9175) Introduce an autoformatting tool to Python SDK
[ https://issues.apache.org/jira/browse/BEAM-9175?focusedWorklogId=380889=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380889 ] ASF GitHub Bot logged work on BEAM-9175: Author: ASF GitHub Bot Created on: 03/Feb/20 11:02 Start Date: 03/Feb/20 11:02 Worklog Time Spent: 10m Work Description: mwalenia commented on issue #10684: [BEAM-9175] Introduce an autoformatting tool to Python SDK URL: https://github.com/apache/beam/pull/10684#issuecomment-581357099 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 380889) Time Spent: 7h 20m (was: 7h 10m) > Introduce an autoformatting tool to Python SDK > -- > > Key: BEAM-9175 > URL: https://issues.apache.org/jira/browse/BEAM-9175 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core, sdk-py-harness >Reporter: Michał Walenia >Assignee: Kamil Wasilewski >Priority: Major > Time Spent: 7h 20m > Remaining Estimate: 0h > > It seems there are three main options: > * black - very simple, but not configurable at all (except for line length), > would drastically change code style > * yapf - more options to tweak, can omit parts of code > * autopep8 - more similar to spotless - only touches code that breaks > formatting guidelines, can use pycodestyle and flake8 as configuration > The rigidity of Black makes it unusable for Beam. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9175) Introduce an autoformatting tool to Python SDK
[ https://issues.apache.org/jira/browse/BEAM-9175?focusedWorklogId=380887=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380887 ] ASF GitHub Bot logged work on BEAM-9175: Author: ASF GitHub Bot Created on: 03/Feb/20 11:01 Start Date: 03/Feb/20 11:01 Worklog Time Spent: 10m Work Description: mwalenia commented on issue #10684: [BEAM-9175] Introduce an autoformatting tool to Python SDK URL: https://github.com/apache/beam/pull/10684#issuecomment-581357099 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 380887) Time Spent: 7h (was: 6h 50m) > Introduce an autoformatting tool to Python SDK > -- > > Key: BEAM-9175 > URL: https://issues.apache.org/jira/browse/BEAM-9175 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core, sdk-py-harness >Reporter: Michał Walenia >Assignee: Kamil Wasilewski >Priority: Major > Time Spent: 7h > Remaining Estimate: 0h > > It seems there are three main options: > * black - very simple, but not configurable at all (except for line length), > would drastically change code style > * yapf - more options to tweak, can omit parts of code > * autopep8 - more similar to spotless - only touches code that breaks > formatting guidelines, can use pycodestyle and flake8 as configuration > The rigidity of Black makes it unusable for Beam. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9175) Introduce an autoformatting tool to Python SDK
[ https://issues.apache.org/jira/browse/BEAM-9175?focusedWorklogId=380881=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380881 ] ASF GitHub Bot logged work on BEAM-9175: Author: ASF GitHub Bot Created on: 03/Feb/20 10:52 Start Date: 03/Feb/20 10:52 Worklog Time Spent: 10m Work Description: mwalenia commented on issue #10684: [BEAM-9175] Introduce an autoformatting tool to Python SDK URL: https://github.com/apache/beam/pull/10684#issuecomment-581353462 Run seed job This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 380881) Time Spent: 6h 50m (was: 6h 40m) > Introduce an autoformatting tool to Python SDK > -- > > Key: BEAM-9175 > URL: https://issues.apache.org/jira/browse/BEAM-9175 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core, sdk-py-harness >Reporter: Michał Walenia >Assignee: Kamil Wasilewski >Priority: Major > Time Spent: 6h 50m > Remaining Estimate: 0h > > It seems there are three main options: > * black - very simple, but not configurable at all (except for line length), > would drastically change code style > * yapf - more options to tweak, can omit parts of code > * autopep8 - more similar to spotless - only touches code that breaks > formatting guidelines, can use pycodestyle and flake8 as configuration > The rigidity of Black makes it unusable for Beam. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9175) Introduce an autoformatting tool to Python SDK
[ https://issues.apache.org/jira/browse/BEAM-9175?focusedWorklogId=380880=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380880 ] ASF GitHub Bot logged work on BEAM-9175: Author: ASF GitHub Bot Created on: 03/Feb/20 10:52 Start Date: 03/Feb/20 10:52 Worklog Time Spent: 10m Work Description: mwalenia commented on issue #10684: [BEAM-9175] Introduce an autoformatting tool to Python SDK URL: https://github.com/apache/beam/pull/10684#issuecomment-581352628 Run PythonFormatter PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 380880) Time Spent: 6h 40m (was: 6.5h) > Introduce an autoformatting tool to Python SDK > -- > > Key: BEAM-9175 > URL: https://issues.apache.org/jira/browse/BEAM-9175 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core, sdk-py-harness >Reporter: Michał Walenia >Assignee: Kamil Wasilewski >Priority: Major > Time Spent: 6h 40m > Remaining Estimate: 0h > > It seems there are three main options: > * black - very simple, but not configurable at all (except for line length), > would drastically change code style > * yapf - more options to tweak, can omit parts of code > * autopep8 - more similar to spotless - only touches code that breaks > formatting guidelines, can use pycodestyle and flake8 as configuration > The rigidity of Black makes it unusable for Beam. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9175) Introduce an autoformatting tool to Python SDK
[ https://issues.apache.org/jira/browse/BEAM-9175?focusedWorklogId=380878=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380878 ] ASF GitHub Bot logged work on BEAM-9175: Author: ASF GitHub Bot Created on: 03/Feb/20 10:50 Start Date: 03/Feb/20 10:50 Worklog Time Spent: 10m Work Description: mwalenia commented on issue #10684: [BEAM-9175] Introduce an autoformatting tool to Python SDK URL: https://github.com/apache/beam/pull/10684#issuecomment-581352628 Run PythonFormatter PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 380878) Time Spent: 6.5h (was: 6h 20m) > Introduce an autoformatting tool to Python SDK > -- > > Key: BEAM-9175 > URL: https://issues.apache.org/jira/browse/BEAM-9175 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core, sdk-py-harness >Reporter: Michał Walenia >Assignee: Kamil Wasilewski >Priority: Major > Time Spent: 6.5h > Remaining Estimate: 0h > > It seems there are three main options: > * black - very simple, but not configurable at all (except for line length), > would drastically change code style > * yapf - more options to tweak, can omit parts of code > * autopep8 - more similar to spotless - only touches code that breaks > formatting guidelines, can use pycodestyle and flake8 as configuration > The rigidity of Black makes it unusable for Beam. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (BEAM-9234) beam_PerformanceTests_WordCountIT_Py* failing
[ https://issues.apache.org/jira/browse/BEAM-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028855#comment-17028855 ] Kamil Wasilewski edited comment on BEAM-9234 at 2/3/20 10:46 AM: - It fails because of recent changes in PerfKitBenchmarker: [https://github.com/GoogleCloudPlatform/PerfKitBenchmarker/commit/6b2d9ae36c60a09e3e36a5996e7a44dd139b3b5a|https://github.com/GoogleCloudPlatform/PerfKitBenchmarker/commit/6b2d9ae36c60a09e3e36a5996e7a44dd139b3b5a.] We use dev version from the top of the master branch, not one of the released versions, that's why we are affected. I think the solution is to stop using PerfKitBenchmarker completety. I believe this test is already the last PerfKitBenchmarker's leftover. was (Author: kamilwu): It fails because of recent changes in PerfKitBenchmarker: [https://github.com/GoogleCloudPlatform/PerfKitBenchmarker/commit/6b2d9ae36c60a09e3e36a5996e7a44dd139b3b5a.] We use dev version from the top of the master branch, not one of the released versions, that's why we are affected. I think the solution is to stop using PerfKitBenchmarker completety. I believe this test is already the last PerfKitBenchmarker's leftover. > beam_PerformanceTests_WordCountIT_Py* failing > - > > Key: BEAM-9234 > URL: https://issues.apache.org/jira/browse/BEAM-9234 > Project: Beam > Issue Type: Bug > Components: test-failures >Reporter: Kyle Weaver >Assignee: Kamil Wasilewski >Priority: Major > > https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py37/1015 > 11:17:23 Traceback (most recent call last): > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/pkb.py", > line 19, in > 11:17:23 from perfkitbenchmarker.pkb import Main > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", > line 75, in > 11:17:23 from perfkitbenchmarker import archive > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/perfkitbenchmarker/archive.py", > line 24, in > 11:17:23 from perfkitbenchmarker.providers.aws.util import AWS_PATH > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py", > line 19, in > 11:17:23 from perfkitbenchmarker import events > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/perfkitbenchmarker/events.py", > line 26, in > 11:17:23 from perfkitbenchmarker import data > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py", > line 34, in > 11:17:23 from perfkitbenchmarker import temp_dir > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py", > line 29, in > 11:17:23 import functools32 as functools > 11:17:23 ImportError: No module named functools32 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-9234) beam_PerformanceTests_WordCountIT_Py* failing
[ https://issues.apache.org/jira/browse/BEAM-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028855#comment-17028855 ] Kamil Wasilewski commented on BEAM-9234: It fails because of recent changes in PerfKitBenchmarker: [https://github.com/GoogleCloudPlatform/PerfKitBenchmarker/commit/6b2d9ae36c60a09e3e36a5996e7a44dd139b3b5a.] We use dev version from the top of the master branch, not one of the released versions, that's why we are affected. I think the solution is to stop using PerfKitBenchmarker completety. I believe this test is already the last PerfKitBenchmarker's leftover. > beam_PerformanceTests_WordCountIT_Py* failing > - > > Key: BEAM-9234 > URL: https://issues.apache.org/jira/browse/BEAM-9234 > Project: Beam > Issue Type: Bug > Components: test-failures >Reporter: Kyle Weaver >Assignee: Kamil Wasilewski >Priority: Major > > https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py37/1015 > 11:17:23 Traceback (most recent call last): > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/pkb.py", > line 19, in > 11:17:23 from perfkitbenchmarker.pkb import Main > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", > line 75, in > 11:17:23 from perfkitbenchmarker import archive > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/perfkitbenchmarker/archive.py", > line 24, in > 11:17:23 from perfkitbenchmarker.providers.aws.util import AWS_PATH > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py", > line 19, in > 11:17:23 from perfkitbenchmarker import events > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/perfkitbenchmarker/events.py", > line 26, in > 11:17:23 from perfkitbenchmarker import data > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py", > line 34, in > 11:17:23 from perfkitbenchmarker import temp_dir > 11:17:23 File > "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py37/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py", > line 29, in > 11:17:23 import functools32 as functools > 11:17:23 ImportError: No module named functools32 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Issue Comment Deleted] (BEAM-8916) external_test_it.py is not collected by pytest
[ https://issues.apache.org/jira/browse/BEAM-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Warburton updated BEAM-8916: - Comment: was deleted (was: This is closed by the PR: [https://github.com/apache/beam/pull/10749]) > external_test_it.py is not collected by pytest > -- > > Key: BEAM-8916 > URL: https://issues.apache.org/jira/browse/BEAM-8916 > Project: Beam > Issue Type: Bug > Components: sdk-py-core, testing >Reporter: Udi Meiri >Assignee: Chamikara Madhusanka Jayalath >Priority: Critical > Time Spent: 0.5h > Remaining Estimate: 0h > > pytest only collects tests matching these patterns: > https://github.com/apache/beam/blob/8066d78f0fd2237b718859d4a776511203880df0/sdks/python/pytest.ini#L27 > Please rename the file. (ex: external_integration_test.py) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-8916) external_test_it.py is not collected by pytest
[ https://issues.apache.org/jira/browse/BEAM-8916?focusedWorklogId=380871=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380871 ] ASF GitHub Bot logged work on BEAM-8916: Author: ASF GitHub Bot Created on: 03/Feb/20 10:38 Start Date: 03/Feb/20 10:38 Worklog Time Spent: 10m Work Description: jswarburton commented on issue #10749: [BEAM-8916] Rename external_test_it so that it is picked up by pytest URL: https://github.com/apache/beam/pull/10749#issuecomment-581347722 @charlesccychen @aaltay This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 380871) Time Spent: 0.5h (was: 20m) > external_test_it.py is not collected by pytest > -- > > Key: BEAM-8916 > URL: https://issues.apache.org/jira/browse/BEAM-8916 > Project: Beam > Issue Type: Bug > Components: sdk-py-core, testing >Reporter: Udi Meiri >Assignee: Chamikara Madhusanka Jayalath >Priority: Critical > Time Spent: 0.5h > Remaining Estimate: 0h > > pytest only collects tests matching these patterns: > https://github.com/apache/beam/blob/8066d78f0fd2237b718859d4a776511203880df0/sdks/python/pytest.ini#L27 > Please rename the file. (ex: external_integration_test.py) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (BEAM-8916) external_test_it.py is not collected by pytest
[ https://issues.apache.org/jira/browse/BEAM-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028844#comment-17028844 ] Jonathan Warburton edited comment on BEAM-8916 at 2/3/20 10:27 AM: --- This is closed by the PR: [https://github.com/apache/beam/pull/10749] was (Author: jswarburton): This is covered by the PR: [https://github.com/apache/beam/pull/10749] > external_test_it.py is not collected by pytest > -- > > Key: BEAM-8916 > URL: https://issues.apache.org/jira/browse/BEAM-8916 > Project: Beam > Issue Type: Bug > Components: sdk-py-core, testing >Reporter: Udi Meiri >Assignee: Chamikara Madhusanka Jayalath >Priority: Critical > Time Spent: 20m > Remaining Estimate: 0h > > pytest only collects tests matching these patterns: > https://github.com/apache/beam/blob/8066d78f0fd2237b718859d4a776511203880df0/sdks/python/pytest.ini#L27 > Please rename the file. (ex: external_integration_test.py) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-8916) external_test_it.py is not collected by pytest
[ https://issues.apache.org/jira/browse/BEAM-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028844#comment-17028844 ] Jonathan Warburton commented on BEAM-8916: -- This is covered by the PR: [https://github.com/apache/beam/pull/10749] > external_test_it.py is not collected by pytest > -- > > Key: BEAM-8916 > URL: https://issues.apache.org/jira/browse/BEAM-8916 > Project: Beam > Issue Type: Bug > Components: sdk-py-core, testing >Reporter: Udi Meiri >Assignee: Chamikara Madhusanka Jayalath >Priority: Critical > Time Spent: 20m > Remaining Estimate: 0h > > pytest only collects tests matching these patterns: > https://github.com/apache/beam/blob/8066d78f0fd2237b718859d4a776511203880df0/sdks/python/pytest.ini#L27 > Please rename the file. (ex: external_integration_test.py) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-8916) external_test_it.py is not collected by pytest
[ https://issues.apache.org/jira/browse/BEAM-8916?focusedWorklogId=380865=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380865 ] ASF GitHub Bot logged work on BEAM-8916: Author: ASF GitHub Bot Created on: 03/Feb/20 10:26 Start Date: 03/Feb/20 10:26 Worklog Time Spent: 10m Work Description: jswarburton commented on issue #10749: [BEAM-8916] Rename external_test_it so that it is picked up by pytest URL: https://github.com/apache/beam/pull/10749#issuecomment-581342455 Closes https://issues.apache.org/jira/browse/BEAM-8916 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 380865) Time Spent: 20m (was: 10m) > external_test_it.py is not collected by pytest > -- > > Key: BEAM-8916 > URL: https://issues.apache.org/jira/browse/BEAM-8916 > Project: Beam > Issue Type: Bug > Components: sdk-py-core, testing >Reporter: Udi Meiri >Assignee: Chamikara Madhusanka Jayalath >Priority: Critical > Time Spent: 20m > Remaining Estimate: 0h > > pytest only collects tests matching these patterns: > https://github.com/apache/beam/blob/8066d78f0fd2237b718859d4a776511203880df0/sdks/python/pytest.ini#L27 > Please rename the file. (ex: external_integration_test.py) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-8916) external_test_it.py is not collected by pytest
[ https://issues.apache.org/jira/browse/BEAM-8916?focusedWorklogId=380864=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380864 ] ASF GitHub Bot logged work on BEAM-8916: Author: ASF GitHub Bot Created on: 03/Feb/20 10:26 Start Date: 03/Feb/20 10:26 Worklog Time Spent: 10m Work Description: jswarburton commented on pull request #10749: [BEAM-8916] Rename external_test_it so that it is picked up by pytest URL: https://github.com/apache/beam/pull/10749 Pytest only collects tests matching these patterns: https://github.com/apache/beam/blob/8066d78f0fd2237b718859d4a776511203880df0/sdks/python/pytest.ini#L27 This test was not being picked up by pytest as a result, so has been renamed to meet the required naming standards. Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] [**Choose reviewer(s)**](https://beam.apache.org/contribute/#make-your-change) and mention them in a comment (`R: @username`). - [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). See the [Contributor Guide](https://beam.apache.org/contribute) for more tips on [how to make review process smoother](https://beam.apache.org/contribute/#make-reviewers-job-easier). Post-Commit Tests Status (on master branch) Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark --- | --- | --- | --- | --- | --- | --- | --- Go | [](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/) Java | [](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/lastCompletedBuild/)
[jira] [Work logged] (BEAM-8691) Beam Dependency Update Request: com.google.cloud.bigtable:bigtable-client-core
[ https://issues.apache.org/jira/browse/BEAM-8691?focusedWorklogId=380847=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380847 ] ASF GitHub Bot logged work on BEAM-8691: Author: ASF GitHub Bot Created on: 03/Feb/20 09:51 Start Date: 03/Feb/20 09:51 Worklog Time Spent: 10m Work Description: alexvanboxel commented on issue #10714: [BEAM-8691] bigtable-client-core dependency upgrade URL: https://github.com/apache/beam/pull/10714#issuecomment-581327949 Run Java_Examples_Dataflow PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 380847) Time Spent: 6h 40m (was: 6.5h) > Beam Dependency Update Request: com.google.cloud.bigtable:bigtable-client-core > -- > > Key: BEAM-8691 > URL: https://issues.apache.org/jira/browse/BEAM-8691 > Project: Beam > Issue Type: Sub-task > Components: dependencies >Reporter: Beam JIRA Bot >Assignee: Tomo Suzuki >Priority: Major > Time Spent: 6h 40m > Remaining Estimate: 0h > > - 2019-11-15 19:39:51.523448 > - > Please consider upgrading the dependency > com.google.cloud.bigtable:bigtable-client-core. > The current version is 1.8.0. The latest version is 1.12.1 > cc: > Please refer to [Beam Dependency Guide > |https://beam.apache.org/contribute/dependencies/]for more information. > Do Not Modify The Description Above. > - 2019-11-19 21:05:43.901882 > - > Please consider upgrading the dependency > com.google.cloud.bigtable:bigtable-client-core. > The current version is 1.8.0. The latest version is 1.12.1 > cc: > Please refer to [Beam Dependency Guide > |https://beam.apache.org/contribute/dependencies/]for more information. > Do Not Modify The Description Above. > - 2019-12-02 12:11:30.163557 > - > Please consider upgrading the dependency > com.google.cloud.bigtable:bigtable-client-core. > The current version is 1.8.0. The latest version is 1.12.1 > cc: > Please refer to [Beam Dependency Guide > |https://beam.apache.org/contribute/dependencies/]for more information. > Do Not Modify The Description Above. > - 2019-12-09 12:10:37.979355 > - > Please consider upgrading the dependency > com.google.cloud.bigtable:bigtable-client-core. > The current version is 1.8.0. The latest version is 1.12.1 > cc: > Please refer to [Beam Dependency Guide > |https://beam.apache.org/contribute/dependencies/]for more information. > Do Not Modify The Description Above. > - 2019-12-23 12:10:39.422837 > - > Please consider upgrading the dependency > com.google.cloud.bigtable:bigtable-client-core. > The current version is 1.8.0. The latest version is 1.12.1 > cc: > Please refer to [Beam Dependency Guide > |https://beam.apache.org/contribute/dependencies/]for more information. > Do Not Modify The Description Above. > - 2019-12-30 14:06:11.312353 > - > Please consider upgrading the dependency > com.google.cloud.bigtable:bigtable-client-core. > The current version is 1.8.0. The latest version is 1.12.1 > cc: > Please refer to [Beam Dependency Guide > |https://beam.apache.org/contribute/dependencies/]for more information. > Do Not Modify The Description Above. > - 2020-01-06 12:09:45.627449 > - > Please consider upgrading the dependency > com.google.cloud.bigtable:bigtable-client-core. > The current version is 1.8.0. The latest version is 1.12.1 > cc: > Please refer to [Beam Dependency Guide > |https://beam.apache.org/contribute/dependencies/]for more information. > Do Not Modify The Description Above. > - 2020-01-13 12:09:23.823869 > - > Please consider upgrading the dependency > com.google.cloud.bigtable:bigtable-client-core. > The current version is 1.8.0. The latest version is 1.12.1 > cc: > Please refer to [Beam Dependency Guide > |https://beam.apache.org/contribute/dependencies/]for more information. > Do
[jira] [Commented] (BEAM-8919) Move JAVA_11_HOME and JAVA_8_HOME variables to Jenkins envs.
[ https://issues.apache.org/jira/browse/BEAM-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028821#comment-17028821 ] Michał Walenia commented on BEAM-8919: -- [~yifanzou] Can you take a look at this? It would be great to have env variables available on the workers. Thanks! > Move JAVA_11_HOME and JAVA_8_HOME variables to Jenkins envs. > > > Key: BEAM-8919 > URL: https://issues.apache.org/jira/browse/BEAM-8919 > Project: Beam > Issue Type: Bug > Components: testing >Reporter: Lukasz Gajowy >Priority: Minor > > Some tests that use different java versions rely on the following paths to > java home: > final String JAVA_11_HOME = '/usr/lib/jvm/java-11-openjdk-amd64' > final String JAVA_8_HOME = '/usr/lib/jvm/java-8-openjdk-amd64' > > The paths itself should be held as jenkins env variables. Benefits: > - easier to reuse > - no room for typo in the path > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (BEAM-9244) Bump version of GCloud tools on Jenkins workers to at least 258.0.0
Michał Walenia created BEAM-9244: Summary: Bump version of GCloud tools on Jenkins workers to at least 258.0.0 Key: BEAM-9244 URL: https://issues.apache.org/jira/browse/BEAM-9244 Project: Beam Issue Type: Improvement Components: testing Reporter: Michał Walenia Assignee: Yifan Zou I recently tried to add a param to a GCloud command to limit lifetime of created Dataproc clusters. This broke the job due to the parameter not being recognized by the tool. Can we update gcloud on the workers? -- This message was sent by Atlassian Jira (v8.3.4#803005)
