[GitHub] [beam] TheNeuralBit commented on pull request #13347: [release-2.26.0][BEAM-11264] Add Reshuffle in pd.read_*

2020-11-16 Thread GitBox


TheNeuralBit commented on pull request #13347:
URL: https://github.com/apache/beam/pull/13347#issuecomment-728384639


   Thanks!



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [beam] TheNeuralBit commented on pull request #13347: [release-2.26.0][BEAM-11264] Add Reshuffle in pd.read_*

2020-11-16 Thread GitBox


TheNeuralBit commented on pull request #13347:
URL: https://github.com/apache/beam/pull/13347#issuecomment-728365075


   Well I can't find any documentation stating that Python tests will fail, 
just that Dataflow tests will fail. But looking at the last [Python PreCommit 
failure](https://ci-beam.apache.org/job/beam_PreCommit_Python_Phrase/2316) it 
looks like the issue was hanging Dataflow tests:
   
   ```
   12:24:47 > Task :sdks:python:test-suites:dataflow:py36:preCommitIT_batch_V2
   12:24:47 
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-11-16T20:24:29.045Z: 
JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric 
descriptors, so new user metrics of the form custom.googleapis.com/* will not 
be created. However, all user metrics are also available in the metric 
dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, 
you can delete old / unused metric descriptors. See 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
 and 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
   12:24:49 
   12:24:49 > Task :sdks:python:test-suites:dataflow:py37:preCommitIT_batch_V2
   12:24:49 
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-11-16T20:24:46.063Z: 
JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on 
the rate of progress in the currently running stage(s).
   12:25:17 
   12:25:17 > Task :sdks:python:test-suites:dataflow:py36:preCommitIT_batch_V2
   12:25:17 
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-11-16T20:24:47.927Z: 
JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on 
the rate of progress in the currently running stage(s).
   12:25:19 
   12:25:19 > Task :sdks:python:test-suites:dataflow:py37:preCommitIT_batch_V2
   12:25:19 
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-11-16T20:25:16.445Z: 
JOB_MESSAGE_DETAILED: Workers have started successfully.
   12:25:19 
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-11-16T20:25:16.480Z: 
JOB_MESSAGE_DETAILED: Workers have started successfully.
   12:25:47 
   12:25:47 > Task :sdks:python:test-suites:dataflow:py36:preCommitIT_batch_V2
   12:25:47 
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-11-16T20:25:23.244Z: 
JOB_MESSAGE_DETAILED: Workers have started successfully.
   12:25:47 
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-11-16T20:25:23.307Z: 
JOB_MESSAGE_DETAILED: Workers have started successfully.
   12:48:35 Build was aborted
   ```
   
   It looks like the same suites didn't fail on your verification branch 
though.. maybe something has changed?



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [beam] TheNeuralBit commented on pull request #13347: [release-2.26.0][BEAM-11264] Add Reshuffle in pd.read_*

2020-11-16 Thread GitBox


TheNeuralBit commented on pull request #13347:
URL: https://github.com/apache/beam/pull/13347#issuecomment-728361839


   I think it's expected that Python test suites fail on the release branch 
until a Dataflow container release. Let me verify that



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [beam] TheNeuralBit commented on pull request #13347: [release-2.26.0][BEAM-11264] Add Reshuffle in pd.read_*

2020-11-13 Thread GitBox


TheNeuralBit commented on pull request #13347:
URL: https://github.com/apache/beam/pull/13347#issuecomment-727117498


   R: @robertwb 
   R: @lostluck 



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org