xinyuiscool commented on code in PR #23313:
URL: https://github.com/apache/beam/pull/23313#discussion_r980577576
##########
runners/samza/src/main/java/org/apache/beam/runners/samza/SamzaPipelineOptions.java:
##########
@@ -129,4 +134,30 @@ public interface SamzaPipelineOptions extends
PipelineOptions {
long getMaxBundleTimeMs();
void setMaxBundleTimeMs(long maxBundleTimeMs);
+
+ @Description(
+ "The number of threads to run DoFn.processElements in parallel. Used
only in non-portable mode.")
Review Comment:
Good question. For now, it's only used in the non-portable mode. For
portable mode, we are sending the bundle elements over to the workers. The
mechanism of parallelism is a bit different, and the workload will be
distributed among the workers. We need to take a deeper look to see whether we
want even further parallelism there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
