[GitHub] [beam] robertwb merged pull request #12361: Use with statements rather than explict pipeline.run().

2020-07-23 Thread GitBox
robertwb merged pull request #12361: URL: https://github.com/apache/beam/pull/12361 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] leiyiz commented on pull request #12365: [BEAM-8258] python nexmark query 0-2 improvements

2020-07-23 Thread GitBox
leiyiz commented on pull request #12365: URL: https://github.com/apache/beam/pull/12365#issuecomment-663351585 `R: @pabloem ` `R: @y1chi ` This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] leiyiz opened a new pull request #12365: [BEAM-8258] python nexmark query 0-2 improvements

2020-07-23 Thread GitBox
leiyiz opened a new pull request #12365: URL: https://github.com/apache/beam/pull/12365 changed parser and serialization code to use the same json format to represent models, added auction_price model and corrected the behavior of query 0 - 2 to align with the nexmark specification.

[GitHub] [beam] youngoli commented on a change in pull request #12350: [BEAM-10289] Dynamic splitting implementation.

2020-07-23 Thread GitBox
youngoli commented on a change in pull request #12350: URL: https://github.com/apache/beam/pull/12350#discussion_r459851264 ## File path: sdks/go/pkg/beam/core/runtime/exec/sdf.go ## @@ -325,6 +337,63 @@ func (n *ProcessSizedElementsAndRestrictions) String() string {

[GitHub] [beam] youngoli commented on a change in pull request #12350: [BEAM-10289] Dynamic splitting implementation.

2020-07-23 Thread GitBox
youngoli commented on a change in pull request #12350: URL: https://github.com/apache/beam/pull/12350#discussion_r459850801 ## File path: sdks/go/pkg/beam/core/runtime/exec/datasource.go ## @@ -302,31 +302,67 @@ func (n *DataSource) Split(splits []int64, frac float64, bufSize

[GitHub] [beam] youngoli commented on a change in pull request #12350: [BEAM-10289] Dynamic splitting implementation.

2020-07-23 Thread GitBox
youngoli commented on a change in pull request #12350: URL: https://github.com/apache/beam/pull/12350#discussion_r459848001 ## File path: sdks/go/pkg/beam/core/runtime/exec/datasource.go ## @@ -302,31 +302,67 @@ func (n *DataSource) Split(splits []int64, frac float64, bufSize

[GitHub] [beam] youngoli commented on a change in pull request #12350: [BEAM-10289] Dynamic splitting implementation.

2020-07-23 Thread GitBox
youngoli commented on a change in pull request #12350: URL: https://github.com/apache/beam/pull/12350#discussion_r459841473 ## File path: sdks/go/pkg/beam/core/runtime/exec/translate.go ## @@ -418,7 +418,8 @@ func (b *builder) makeLink(from string, id linkID) (Node, error) {

[GitHub] [beam] chamikaramj commented on pull request #12355: [BEAM-10559] Add some comments and clean up SQL example.

2020-07-23 Thread GitBox
chamikaramj commented on pull request #12355: URL: https://github.com/apache/beam/pull/12355#issuecomment-663332591 LGTM other than the note about Docker. This is an automated message from the Apache Git Service. To respond

[GitHub] [beam] Hannah-Jiang commented on pull request #12364: [BEAM-10567] Updating etcd dependency in gogradle.lock

2020-07-23 Thread GitBox
Hannah-Jiang commented on pull request #12364: URL: https://github.com/apache/beam/pull/12364#issuecomment-663325401 > R: @Hannah-Jiang > > Hannah, do you know if running the PythonDocker PreCommit will test this, or if any extra steps have to be taken to make sure Jenkins uses the

[GitHub] [beam] kennknowles commented on pull request #12354: [BEAM-10560] Enable checker in :sdks:java:extensions:sketching

2020-07-23 Thread GitBox
kennknowles commented on pull request #12354: URL: https://github.com/apache/beam/pull/12354#issuecomment-663316534 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] kennknowles commented on pull request #12349: [BEAM-10561] Eliminate nullability issues from :sdks:java:extensions:sorter and enable checker

2020-07-23 Thread GitBox
kennknowles commented on pull request #12349: URL: https://github.com/apache/beam/pull/12349#issuecomment-663316609 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] pabloem merged pull request #12335: [BEAM-10378] Creates Azure Blob Storage Resource Id

2020-07-23 Thread GitBox
pabloem merged pull request #12335: URL: https://github.com/apache/beam/pull/12335 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] tvalentyn commented on pull request #12239: [BEAM-9980] tests tied with Python versions configurable

2020-07-23 Thread GitBox
tvalentyn commented on pull request #12239: URL: https://github.com/apache/beam/pull/12239#issuecomment-663310669 thanks a lot for this work, @lazylynx. Sorry for taking too long to respond, will try to take a look tomorrow.

[GitHub] [beam] tvalentyn edited a comment on pull request #12239: [BEAM-9980] tests tied with Python versions configurable

2020-07-23 Thread GitBox
tvalentyn edited a comment on pull request #12239: URL: https://github.com/apache/beam/pull/12239#issuecomment-663310669 thanks a lot for this work, @lazylynx. Sorry for taking too long to respond, will try to take a closer look tomorrow.

[GitHub] [beam] kennknowles commented on pull request #12359: [BEAM-10568] Suppress spotbugs warnings caused by JDK11 try-with-resources compilation

2020-07-23 Thread GitBox
kennknowles commented on pull request #12359: URL: https://github.com/apache/beam/pull/12359#issuecomment-663306620 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] youngoli merged pull request #12364: [BEAM-10567] Updating etcd dependency in gogradle.lock

2020-07-23 Thread GitBox
youngoli merged pull request #12364: URL: https://github.com/apache/beam/pull/12364 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] youngoli commented on pull request #12364: [BEAM-10567] Updating etcd dependency in gogradle.lock

2020-07-23 Thread GitBox
youngoli commented on pull request #12364: URL: https://github.com/apache/beam/pull/12364#issuecomment-663306219 PythonDocker Precommit has these lines: ``` 17:15:48 Fetching from https://github.com/etcd-io/etcd.git 17:15:48 Resolving github.com/etcd-io/etcd:

[GitHub] [beam] tvalentyn commented on a change in pull request #12150: [BEAM-10398] Use GitHub Actions in wheels release process for Python

2020-07-23 Thread GitBox
tvalentyn commented on a change in pull request #12150: URL: https://github.com/apache/beam/pull/12150#discussion_r459084533 ## File path: release/src/main/scripts/build_release_candidate.sh ## @@ -154,41 +155,60 @@ if [[ $confirmation = "y" ]]; then rm -rf

[GitHub] [beam] ettirapp commented on pull request #12335: [BEAM-10378] Creates Azure Blob Storage Resource Id

2020-07-23 Thread GitBox
ettirapp commented on pull request #12335: URL: https://github.com/apache/beam/pull/12335#issuecomment-663301394 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] ettirapp commented on pull request #12335: [BEAM-10378] Creates Azure Blob Storage Resource Id

2020-07-23 Thread GitBox
ettirapp commented on pull request #12335: URL: https://github.com/apache/beam/pull/12335#issuecomment-663300035 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] KevinGG commented on pull request #12339: Interactive: clean up when pipeline is out of scope

2020-07-23 Thread GitBox
KevinGG commented on pull request #12339: URL: https://github.com/apache/beam/pull/12339#issuecomment-663297219 Run PythonDocker PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] chamikaramj commented on a change in pull request #12355: [BEAM-10559] Add some comments and clean up SQL example.

2020-07-23 Thread GitBox
chamikaramj commented on a change in pull request #12355: URL: https://github.com/apache/beam/pull/12355#discussion_r459796883 ## File path: sdks/python/apache_beam/examples/wordcount_xlang_sql.py ## @@ -15,12 +15,16 @@ # limitations under the License. # -"""A

[GitHub] [beam] robertwb merged pull request #11963: Add relational GroupBy transform to Python.

2020-07-23 Thread GitBox
robertwb merged pull request #11963: URL: https://github.com/apache/beam/pull/11963 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] youngoli commented on pull request #12364: [BEAM-10567] Updating etcd dependency in gogradle.lock

2020-07-23 Thread GitBox
youngoli commented on pull request #12364: URL: https://github.com/apache/beam/pull/12364#issuecomment-663293791 CC: @lostluck This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [beam] robertwb commented on pull request #11963: Add relational GroupBy transform to Python.

2020-07-23 Thread GitBox
robertwb commented on pull request #11963: URL: https://github.com/apache/beam/pull/11963#issuecomment-663293495 :sdks:python:test-suites:dataflow:py2:preCommitIT_streaming is unrelated. This is an automated message from the

[GitHub] [beam] chamikaramj commented on a change in pull request #12355: [BEAM-10559] Add some comments and clean up SQL example.

2020-07-23 Thread GitBox
chamikaramj commented on a change in pull request #12355: URL: https://github.com/apache/beam/pull/12355#discussion_r459795347 ## File path: sdks/python/apache_beam/examples/wordcount_xlang_sql.py ## @@ -15,12 +15,17 @@ # limitations under the License. # -"""A

[GitHub] [beam] youngoli commented on pull request #12364: [BEAM-10567] Updating etcd dependency in gogradle.lock

2020-07-23 Thread GitBox
youngoli commented on pull request #12364: URL: https://github.com/apache/beam/pull/12364#issuecomment-663292844 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] youngoli removed a comment on pull request #12364: [BEAM-10567] Updating etcd dependency in gogradle.lock

2020-07-23 Thread GitBox
youngoli removed a comment on pull request #12364: URL: https://github.com/apache/beam/pull/12364#issuecomment-663291683 Run PythonDocker PreCommit This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] chamikaramj commented on a change in pull request #12355: [BEAM-10559] Add some comments and clean up SQL example.

2020-07-23 Thread GitBox
chamikaramj commented on a change in pull request #12355: URL: https://github.com/apache/beam/pull/12355#discussion_r459795347 ## File path: sdks/python/apache_beam/examples/wordcount_xlang_sql.py ## @@ -15,12 +15,17 @@ # limitations under the License. # -"""A

[GitHub] [beam] youngoli commented on pull request #12364: [BEAM-10567] Updating etcd dependency in gogradle.lock

2020-07-23 Thread GitBox
youngoli commented on pull request #12364: URL: https://github.com/apache/beam/pull/12364#issuecomment-663292504 R: @Hannah-Jiang Hannah, do you know if running the PythonDocker PreCommit will test this, or if any extra steps have to be taken to make sure Jenkins uses the updated

[GitHub] [beam] robertwb commented on pull request #12361: Use with statements rather than explict pipeline.run().

2020-07-23 Thread GitBox
robertwb commented on pull request #12361: URL: https://github.com/apache/beam/pull/12361#issuecomment-663292613 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [beam] robertwb commented on a change in pull request #12355: [BEAM-10559] Add some comments and clean up SQL example.

2020-07-23 Thread GitBox
robertwb commented on a change in pull request #12355: URL: https://github.com/apache/beam/pull/12355#discussion_r459795151 ## File path: sdks/python/apache_beam/examples/wordcount_xlang_sql.py ## @@ -15,12 +15,16 @@ # limitations under the License. # -"""A cross-language

[GitHub] [beam] TheNeuralBit commented on a change in pull request #12355: [BEAM-10559] Add some comments and clean up SQL example.

2020-07-23 Thread GitBox
TheNeuralBit commented on a change in pull request #12355: URL: https://github.com/apache/beam/pull/12355#discussion_r459795116 ## File path: sdks/python/apache_beam/examples/wordcount_xlang_sql.py ## @@ -15,12 +15,16 @@ # limitations under the License. # -"""A

[GitHub] [beam] youngoli commented on pull request #12364: [BEAM-10567] Updating etcd dependency in gogradle.lock

2020-07-23 Thread GitBox
youngoli commented on pull request #12364: URL: https://github.com/apache/beam/pull/12364#issuecomment-663291683 Run PythonDocker PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] youngoli opened a new pull request #12364: [BEAM-10567] Updating etcd dependency in gogradle.lock

2020-07-23 Thread GitBox
youngoli opened a new pull request #12364: URL: https://github.com/apache/beam/pull/12364 Looks like etcd's github repo changed from https://github.com/coreos/etcd to https://github.com/etcd-io/etcd. That may be the source of the :sdks:go:resolveBuildDependencies in the PythonDocker

[GitHub] [beam] ettirapp commented on pull request #12335: [BEAM-10378] Creates Azure Blob Storage Resource Id

2020-07-23 Thread GitBox
ettirapp commented on pull request #12335: URL: https://github.com/apache/beam/pull/12335#issuecomment-663287660 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] chamikaramj commented on a change in pull request #12355: [BEAM-10559] Add some comments and clean up SQL example.

2020-07-23 Thread GitBox
chamikaramj commented on a change in pull request #12355: URL: https://github.com/apache/beam/pull/12355#discussion_r459788328 ## File path: sdks/python/apache_beam/examples/wordcount_xlang_sql.py ## @@ -31,51 +35,35 @@ from apache_beam.io import WriteToText from

[GitHub] [beam] chamikaramj commented on a change in pull request #12355: [BEAM-10559] Add some comments and clean up SQL example.

2020-07-23 Thread GitBox
chamikaramj commented on a change in pull request #12355: URL: https://github.com/apache/beam/pull/12355#discussion_r459787582 ## File path: sdks/python/apache_beam/examples/wordcount_xlang_sql.py ## @@ -15,12 +15,16 @@ # limitations under the License. # -"""A

[GitHub] [beam] ettirapp commented on pull request #12335: [BEAM-10378] Creates Azure Blob Storage Resource Id

2020-07-23 Thread GitBox
ettirapp commented on pull request #12335: URL: https://github.com/apache/beam/pull/12335#issuecomment-663284529 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] ettirapp commented on pull request #12335: [BEAM-10378] Creates Azure Blob Storage Resource Id

2020-07-23 Thread GitBox
ettirapp commented on pull request #12335: URL: https://github.com/apache/beam/pull/12335#issuecomment-663284231 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] TheNeuralBit commented on a change in pull request #12355: [BEAM-10559] Add some comments and clean up SQL example.

2020-07-23 Thread GitBox
TheNeuralBit commented on a change in pull request #12355: URL: https://github.com/apache/beam/pull/12355#discussion_r459785878 ## File path: sdks/python/apache_beam/examples/wordcount_xlang_sql.py ## @@ -101,12 +89,33 @@ def main(): # workflow rely on global context (e.g.,

[GitHub] [beam] ettirapp commented on pull request #12335: [BEAM-10378] Creates Azure Blob Storage Resource Id

2020-07-23 Thread GitBox
ettirapp commented on pull request #12335: URL: https://github.com/apache/beam/pull/12335#issuecomment-663283902 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #12335: [BEAM-10378] Creates Azure Blob Storage Resource Id

2020-07-23 Thread GitBox
pabloem commented on pull request #12335: URL: https://github.com/apache/beam/pull/12335#issuecomment-663283554 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] aaltay merged pull request #12077: Disable defensive_copy by default in InMemoryUnmergedState

2020-07-23 Thread GitBox
aaltay merged pull request #12077: URL: https://github.com/apache/beam/pull/12077 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] aaltay merged pull request #12328: [BEAM-7390] Add combinevalues code snippets

2020-07-23 Thread GitBox
aaltay merged pull request #12328: URL: https://github.com/apache/beam/pull/12328 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] aaltay merged pull request #12356: [BEAM-7390] Add distinct code snippets

2020-07-23 Thread GitBox
aaltay merged pull request #12356: URL: https://github.com/apache/beam/pull/12356 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] pabloem commented on pull request #12335: [BEAM-10378] Creates Azure Blob Storage Resource Id

2020-07-23 Thread GitBox
pabloem commented on pull request #12335: URL: https://github.com/apache/beam/pull/12335#issuecomment-663280275 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] pabloem commented on pull request #12082: Standardizing BigQuery job names in Beam Python and Java SDKs

2020-07-23 Thread GitBox
pabloem commented on pull request #12082: URL: https://github.com/apache/beam/pull/12082#issuecomment-663279975 Run JavaPortabilityApi PreCommit This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] pabloem commented on pull request #12335: [BEAM-10378] Creates Azure Blob Storage Resource Id

2020-07-23 Thread GitBox
pabloem commented on pull request #12335: URL: https://github.com/apache/beam/pull/12335#issuecomment-663278351 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] chamikaramj opened a new pull request #12363: Test filebasedsource.py

2020-07-23 Thread GitBox
chamikaramj opened a new pull request #12363: URL: https://github.com/apache/beam/pull/12363 **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate your contribution

[GitHub] [beam] saavannanavati commented on pull request #12352: [BEAM-10549] Improve runtime type checking performance for the Python SDK

2020-07-23 Thread GitBox
saavannanavati commented on pull request #12352: URL: https://github.com/apache/beam/pull/12352#issuecomment-663274833 Retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] TheNeuralBit commented on a change in pull request #12355: [BEAM-10559] Add some comments and clean up SQL example.

2020-07-23 Thread GitBox
TheNeuralBit commented on a change in pull request #12355: URL: https://github.com/apache/beam/pull/12355#discussion_r459775292 ## File path: sdks/python/apache_beam/examples/wordcount_xlang_sql.py ## @@ -31,51 +35,35 @@ from apache_beam.io import WriteToText from

[GitHub] [beam] robertwb merged pull request #12347: Fix typos on website

2020-07-23 Thread GitBox
robertwb merged pull request #12347: URL: https://github.com/apache/beam/pull/12347 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [beam] pabloem commented on pull request #12082: Standardizing BigQuery job names in Beam Python and Java SDKs

2020-07-23 Thread GitBox
pabloem commented on pull request #12082: URL: https://github.com/apache/beam/pull/12082#issuecomment-663269119 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] robertwb commented on a change in pull request #12355: [BEAM-10559] Add some comments and clean up SQL example.

2020-07-23 Thread GitBox
robertwb commented on a change in pull request #12355: URL: https://github.com/apache/beam/pull/12355#discussion_r459765700 ## File path: sdks/python/apache_beam/examples/wordcount_xlang_sql.py ## @@ -15,12 +15,16 @@ # limitations under the License. # -"""A cross-language

[GitHub] [beam] sddhrthrt commented on pull request #12347: Fix typos on website

2020-07-23 Thread GitBox
sddhrthrt commented on pull request #12347: URL: https://github.com/apache/beam/pull/12347#issuecomment-663267094 Ready for merge This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] danielxjd commented on pull request #12106: [BEAM-9792] Fixing the IOException handling in InsertAll for BigQuery

2020-07-23 Thread GitBox
danielxjd commented on pull request #12106: URL: https://github.com/apache/beam/pull/12106#issuecomment-663266467 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] kennknowles commented on pull request #12338: [BEAM-10556] Make rawtypes an error. Add flag to ignore rawtype errors and add to modules with errors.

2020-07-23 Thread GitBox
kennknowles commented on pull request #12338: URL: https://github.com/apache/beam/pull/12338#issuecomment-663263325 Tried just running precommit locally and publishing a scan. See a timeout (flake?) in Euphoria tests:

[GitHub] [beam] pabloem commented on a change in pull request #12082: Standardizing BigQuery job names in Beam Python and Java SDKs

2020-07-23 Thread GitBox
pabloem commented on a change in pull request #12082: URL: https://github.com/apache/beam/pull/12082#discussion_r459756841 ## File path: sdks/python/apache_beam/io/gcp/bigquery_tools.py ## @@ -1465,3 +1465,23 @@ def get_avro_schema_from_table_schema(schema):

[GitHub] [beam] tvalentyn edited a comment on pull request #12228: [BEAM-10458] Message limit for grpc message is set to default 4 MB

2020-07-23 Thread GitBox
tvalentyn edited a comment on pull request #12228: URL: https://github.com/apache/beam/pull/12228#issuecomment-663256339 Good catch, @charlesccychen . Thanks! This is an automated message from the Apache Git Service. To

[GitHub] [beam] tvalentyn commented on pull request #12228: [BEAM-10458] Message limit for grpc message is set to default 4 MB

2020-07-23 Thread GitBox
tvalentyn commented on pull request #12228: URL: https://github.com/apache/beam/pull/12228#issuecomment-663256339 Good catch, @charlesccychen This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] tvalentyn closed pull request #12228: [BEAM-10458] Message limit for grpc message is set to default 4 MB

2020-07-23 Thread GitBox
tvalentyn closed pull request #12228: URL: https://github.com/apache/beam/pull/12228 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] robertwb commented on pull request #11963: Add relational GroupBy transform to Python.

2020-07-23 Thread GitBox
robertwb commented on pull request #11963: URL: https://github.com/apache/beam/pull/11963#issuecomment-663254641 Run Python PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] robertwb commented on pull request #11963: Add relational GroupBy transform to Python.

2020-07-23 Thread GitBox
robertwb commented on pull request #11963: URL: https://github.com/apache/beam/pull/11963#issuecomment-663252987 Thanks. Filed a bug and added a TODO about a Python SDK logical type. I'll look at the inference separately.

[GitHub] [beam] udim merged pull request #12300: [BEAM-8473] Fix minor issue in the Generator type hint

2020-07-23 Thread GitBox
udim merged pull request #12300: URL: https://github.com/apache/beam/pull/12300 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [beam] kennknowles commented on pull request #12338: [BEAM-10556] Make rawtypes an error. Add flag to ignore rawtype errors and add to modules with errors.

2020-07-23 Thread GitBox
kennknowles commented on pull request #12338: URL: https://github.com/apache/beam/pull/12338#issuecomment-663250011 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] udim commented on pull request #12300: [BEAM-8473] Fix minor issue in the Generator type hint

2020-07-23 Thread GitBox
udim commented on pull request #12300: URL: https://github.com/apache/beam/pull/12300#issuecomment-663249697 Opened bug for PythonDocker failure: https://issues.apache.org/jira/browse/BEAM-10567 This is an automated message

[GitHub] [beam] udim commented on pull request #12326: [BEAM-9865] Cleanup Jenkins WS on successful jobs

2020-07-23 Thread GitBox
udim commented on pull request #12326: URL: https://github.com/apache/beam/pull/12326#issuecomment-663248519 > With that change, all workspaces will be always cleared, just after the build. Isn't that a problem in case of some possible investigations in the future? > > We may

[GitHub] [beam] robertwb commented on pull request #12362: Convert katas to use with syntax rather than explicit run call.

2020-07-23 Thread GitBox
robertwb commented on pull request #12362: URL: https://github.com/apache/beam/pull/12362#issuecomment-663246772 R: @henryken This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [beam] aaltay edited a comment on pull request #12198: Widen ranges for GCP libraries

2020-07-23 Thread GitBox
aaltay edited a comment on pull request #12198: URL: https://github.com/apache/beam/pull/12198#issuecomment-663161698 Thank you @busunkim96. We do not get notifications for all PRs. For python PRs feel free to ping me or @tvalentyn in a comment for reviews. (We usually do this with R:

[GitHub] [beam] robertwb opened a new pull request #12362: Convert katas to use with syntax rather than explicit run call.

2020-07-23 Thread GitBox
robertwb opened a new pull request #12362: URL: https://github.com/apache/beam/pull/12362 This is the preferred style for writing Beam pipelines. Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly

[GitHub] [beam] udim merged pull request #12358: [BEAM-10566] Update PythonDocker in GH README and template

2020-07-23 Thread GitBox
udim merged pull request #12358: URL: https://github.com/apache/beam/pull/12358 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [beam] pabloem commented on pull request #12335: [BEAM-10378] Creates Azure Blob Storage Resource Id

2020-07-23 Thread GitBox
pabloem commented on pull request #12335: URL: https://github.com/apache/beam/pull/12335#issuecomment-663243103 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] charlesccychen commented on pull request #12228: [BEAM-10458] Message limit for grpc message is set to default 4 MB

2020-07-23 Thread GitBox
charlesccychen commented on pull request #12228: URL: https://github.com/apache/beam/pull/12228#issuecomment-663242953 We should drop this PR because it is against the 2.22 release branch. The corresponding PR for master was already merged: https://github.com/apache/beam/pull/12104.

[GitHub] [beam] robertwb commented on pull request #12360: [BEAM-10569] Auto-convert spanner tests.

2020-07-23 Thread GitBox
robertwb commented on pull request #12360: URL: https://github.com/apache/beam/pull/12360#issuecomment-663242468 R: @mszb This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [beam] lostluck commented on a change in pull request #12350: [BEAM-10289] Dynamic splitting implementation.

2020-07-23 Thread GitBox
lostluck commented on a change in pull request #12350: URL: https://github.com/apache/beam/pull/12350#discussion_r459721826 ## File path: sdks/go/pkg/beam/core/runtime/exec/datasource.go ## @@ -302,31 +302,67 @@ func (n *DataSource) Split(splits []int64, frac float64, bufSize

[GitHub] [beam] TheNeuralBit merged pull request #12344: [BEAM-10565] Fixes for XVR_Direct

2020-07-23 Thread GitBox
TheNeuralBit merged pull request #12344: URL: https://github.com/apache/beam/pull/12344 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [beam] robertwb opened a new pull request #12361: Use with statements rather than explict pipeline.run().

2020-07-23 Thread GitBox
robertwb opened a new pull request #12361: URL: https://github.com/apache/beam/pull/12361 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] [**Choose

[GitHub] [beam] kennknowles commented on pull request #12338: [BEAM-10556] Make rawtypes an error. Add flag to ignore rawtype errors and add to modules with errors.

2020-07-23 Thread GitBox
kennknowles commented on pull request #12338: URL: https://github.com/apache/beam/pull/12338#issuecomment-663239945 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] kennknowles commented on pull request #12349: [BEAM-10561] Eliminate nullability issues from :sdks:java:extensions:sorter and enable checker

2020-07-23 Thread GitBox
kennknowles commented on pull request #12349: URL: https://github.com/apache/beam/pull/12349#issuecomment-663239693 Run JavaPortabilityApi PreCommit This is an automated message from the Apache Git Service. To respond to the

[GitHub] [beam] kennknowles commented on pull request #12349: [BEAM-10561] Eliminate nullability issues from :sdks:java:extensions:sorter and enable checker

2020-07-23 Thread GitBox
kennknowles commented on pull request #12349: URL: https://github.com/apache/beam/pull/12349#issuecomment-663239582 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] kennknowles commented on pull request #12354: [BEAM-10560] Enable checker in :sdks:java:extensions:sketching

2020-07-23 Thread GitBox
kennknowles commented on pull request #12354: URL: https://github.com/apache/beam/pull/12354#issuecomment-663239250 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] kennknowles commented on a change in pull request #11924: [BEAM-8543] Dataflow streaming timers are not strictly time ordered when set earlier mid-bundle

2020-07-23 Thread GitBox
kennknowles commented on a change in pull request #11924: URL: https://github.com/apache/beam/pull/11924#discussion_r459729767 ## File path: runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/StreamingModeExecutionContext.java ##

[GitHub] [beam] robertwb opened a new pull request #12360: [BEAM-10569] Auto-convert spanner tests.

2020-07-23 Thread GitBox
robertwb opened a new pull request #12360: URL: https://github.com/apache/beam/pull/12360 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] [**Choose

[GitHub] [beam] damgad commented on pull request #12326: [BEAM-9865] Cleanup Jenkins WS on successful jobs

2020-07-23 Thread GitBox
damgad commented on pull request #12326: URL: https://github.com/apache/beam/pull/12326#issuecomment-663238151 With that change, all workspaces will be always cleared, just after the build. Isn't that a problem in case of some possible investigations in the future? We may implement

[GitHub] [beam] ananvay commented on pull request #12228: [BEAM-10458] Message limit for grpc message is set to default 4 MB

2020-07-23 Thread GitBox
ananvay commented on pull request #12228: URL: https://github.com/apache/beam/pull/12228#issuecomment-663235430 I think we've done something similar for the Go SDK Harness already, so we should be set. @lostluck to confirm. I'm surprised we missed the python side of things.

[GitHub] [beam] tvalentyn commented on pull request #12228: [BEAM-10458] Message limit for grpc message is set to default 4 MB

2020-07-23 Thread GitBox
tvalentyn commented on pull request #12228: URL: https://github.com/apache/beam/pull/12228#issuecomment-663234092 @ananvay @lukecwik do you know if we need to adjust maximum message size on the harness as well? This is an

[GitHub] [beam] tvalentyn commented on pull request #12198: Widen ranges for GCP libraries

2020-07-23 Thread GitBox
tvalentyn commented on pull request #12198: URL: https://github.com/apache/beam/pull/12198#issuecomment-663232598 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [beam] tvalentyn commented on pull request #12198: Widen ranges for GCP libraries

2020-07-23 Thread GitBox
tvalentyn commented on pull request #12198: URL: https://github.com/apache/beam/pull/12198#issuecomment-663232471 Run Python 3.5 Postcommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] tvalentyn commented on pull request #12198: Widen ranges for GCP libraries

2020-07-23 Thread GitBox
tvalentyn commented on pull request #12198: URL: https://github.com/apache/beam/pull/12198#issuecomment-663232055 R: @chamikaramj This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [beam] tvalentyn commented on pull request #12198: Widen ranges for GCP libraries

2020-07-23 Thread GitBox
tvalentyn commented on pull request #12198: URL: https://github.com/apache/beam/pull/12198#issuecomment-663232379 Run Python 2 Postcommit This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [beam] kennknowles commented on a change in pull request #12155: [BEAM-10400] Fix race condition in DirectRunner watermark update

2020-07-23 Thread GitBox
kennknowles commented on a change in pull request #12155: URL: https://github.com/apache/beam/pull/12155#discussion_r459724232 ## File path: runners/direct-java/src/main/java/org/apache/beam/runners/direct/QuiescenceDriver.java ## @@ -70,6 +71,8 @@ public static

[GitHub] [beam] kennknowles merged pull request #12155: [BEAM-10400] Fix race condition in DirectRunner watermark update

2020-07-23 Thread GitBox
kennknowles merged pull request #12155: URL: https://github.com/apache/beam/pull/12155 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [beam] pabloem commented on a change in pull request #12082: Standardizing BigQuery job names in Beam Python and Java SDKs

2020-07-23 Thread GitBox
pabloem commented on a change in pull request #12082: URL: https://github.com/apache/beam/pull/12082#discussion_r459717944 ## File path: sdks/python/apache_beam/io/gcp/bigquery_tools.py ## @@ -1465,3 +1465,23 @@ def get_avro_schema_from_table_schema(schema):

[GitHub] [beam] pabloem commented on a change in pull request #12082: Standardizing BigQuery job names in Beam Python and Java SDKs

2020-07-23 Thread GitBox
pabloem commented on a change in pull request #12082: URL: https://github.com/apache/beam/pull/12082#discussion_r459713758 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryResourceNaming.java ## @@ -0,0 +1,107 @@ +/* +

[GitHub] [beam] chamikaramj commented on a change in pull request #12203: [BEAM-6928] Make Python SDK custom Sink the default Sink for BigQuery

2020-07-23 Thread GitBox
chamikaramj commented on a change in pull request #12203: URL: https://github.com/apache/beam/pull/12203#discussion_r459703269 ## File path: CHANGES.md ## @@ -55,6 +55,9 @@ * New overloads for BigtableIO.Read.withKeyRange() and BigtableIO.Read.withRowFilter() methods

[GitHub] [beam] aaltay commented on pull request #12356: [BEAM-7390] Add distinct code snippets

2020-07-23 Thread GitBox
aaltay commented on pull request #12356: URL: https://github.com/apache/beam/pull/12356#issuecomment-663214713 LGTM. I can merge once @rosetn reviews. This is an automated message from the Apache Git Service. To respond to

[GitHub] [beam] aaltay commented on pull request #12328: [BEAM-7390] Add combinevalues code snippets

2020-07-23 Thread GitBox
aaltay commented on pull request #12328: URL: https://github.com/apache/beam/pull/12328#issuecomment-663212932 Is this ready to be merged now? Seems like the snippet issue is fixed. This is an automated message from the

[GitHub] [beam] pabloem commented on a change in pull request #12082: Standardizing BigQuery job names in Beam Python and Java SDKs

2020-07-23 Thread GitBox
pabloem commented on a change in pull request #12082: URL: https://github.com/apache/beam/pull/12082#discussion_r459700149 ## File path: sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryResourceNaming.java ## @@ -0,0 +1,107 @@ +/* +

[GitHub] [beam] udim commented on a change in pull request #12358: [BEAM-10566] Update PythonDocker in GH README and template

2020-07-23 Thread GitBox
udim commented on a change in pull request #12358: URL: https://github.com/apache/beam/pull/12358#discussion_r459699455 ## File path: .github/PULL_REQUEST_TEMPLATE.md ## @@ -26,7 +26,7 @@ Pre-Commit Tests Status (on master branch) --- |Java | Python | Go | Website --- |

  1   2   >