damccorm commented on PR #35621: URL: https://github.com/apache/beam/pull/35621#issuecomment-3085282774
Running the timing out tests locally, I got: ``` INFO root:pipeline.py:203 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. INFO apache_beam.yaml.yaml_transform:yaml_transform.py:501 Expanding "Create" at line 26 INFO apache_beam.yaml.yaml_transform:yaml_transform.py:501 Expanding "WriteToJson" at line 32 WARNING apache_beam.options.pipeline_options:pipeline_options.py:490 Unknown pipeline options received: -v,apache_beam/yaml/integration_tests.py. Ignore if flags are used for internal purposes. WARNING apache_beam.options.pipeline_options:pipeline_options.py:526 Discarding flag -v, single dash flags are not allowed. INFO root:external.py:1086 Starting a JAR-based expansion service from JAR /Users/dannymccormick/beam/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.67.0-SNAPSHOT.jar INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 Jul 17, 2025 3:32:23 PM org.apache.beam.sdk.expansion.service.ExpansionService expand INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 INFO: Expanding 'WriteToJson/beam:schematransform:org.apache.beam:json_write:v1' with URN 'beam:expansion:payload:schematransform:v1' WARNING apache_beam.options.pipeline_options:pipeline_options.py:534 Discarding unparseable args: ['-v', 'apache_beam/yaml/integration_tests.py'] WARNING apache_beam.options.pipeline_options:pipeline_options.py:534 Discarding unparseable args: ['-v', 'apache_beam/yaml/integration_tests.py'] INFO apache_beam.runners.worker.statecache:statecache.py:214 Creating state cache with size 104857600 INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:522 starting control server on port 58249 INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:523 starting data server on port 58250 INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:524 starting state server on port 58251 INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:525 starting logging server on port 58252 INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:624 Requesting worker at localhost:58227 INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:628 self.control_address: localhost:58249 INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 Jul 17, 2025 3:32:23 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 INFO: Starting worker worker_7 pointing at localhost:58249. INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 Jul 17, 2025 3:32:23 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0 INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 SEVERE: Failed to start worker worker_7. INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 java.util.concurrent.RejectedExecutionException: Task org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask@74521c87[Not completed, task = org.apache.beam.fn.harness.control.ExecutionStateSampler$$Lambda$292/0x0000000800633c40@706d9652] rejected from java.util.concurrent.ThreadPoolExecutor@31509c69[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 9] INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055) INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1355) INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 at org.apache.beam.sdk.util.UnboundedScheduledExecutorService.submit(UnboundedScheduledExecutorService.java:405) INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 at org.apache.beam.fn.harness.control.ExecutionStateSampler.<init>(ExecutionStateSampler.java:106) INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 at org.apache.beam.fn.harness.FnHarness.main(FnHarness.java:281) INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 at org.apache.beam.fn.harness.FnHarness.main(FnHarness.java:236) INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 at org.apache.beam.fn.harness.ExternalWorkerService.lambda$startWorker$0(ExternalWorkerService.java:105) INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 at java.base/java.lang.Thread.run(Thread.java:829) INFO apache_beam.utils.subprocess_server:subprocess_server.py:223 INFO apache_beam.runners.worker.data_plane:data_plane.py:550 Detected input queue delay longer than 300 seconds. Waiting to receive elements in input queue for instruction: bundle_22 for 300.04 seconds. INFO apache_beam.runners.worker.data_plane:data_plane.py:550 Detected input queue delay longer than 300 seconds. Waiting to receive elements in input queue for instruction: bundle_22 for 600.79 seconds. ``` This isn't showing up in CI because stdout is only logged when a suite fails, but we're timing out before that can happen. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
