[
https://issues.apache.org/jira/browse/BEAM-7861?focusedWorklogId=369173&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-369173
]
ASF GitHub Bot logged work on BEAM-7861:
----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Jan/20 17:10
Start Date: 09/Jan/20 17:10
Worklog Time Spent: 10m
Work Description: Hannah-Jiang commented on pull request #10536:
[BEAM-7861] Add direct_running_mode option for direct runners to switch between
multi_threading and multi_processing easily
URL: https://github.com/apache/beam/pull/10536#discussion_r364859623
##########
File path: sdks/python/apache_beam/options/pipeline_options.py
##########
@@ -438,6 +438,12 @@ def _add_argparse_args(cls, parser):
type=int,
default=1,
help='number of parallel running workers.')
+ parser.add_argument(
+ '--direct_running_mode',
+ default=None,
Review comment:
Yes, that makes more sense, I will make a commit.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 369173)
Time Spent: 50m (was: 40m)
> Make it easy to change between multi-process and multi-thread mode for Python
> Direct runners
> --------------------------------------------------------------------------------------------
>
> Key: BEAM-7861
> URL: https://issues.apache.org/jira/browse/BEAM-7861
> Project: Beam
> Issue Type: Sub-task
> Components: sdk-py-core
> Reporter: Hannah Jiang
> Assignee: Hannah Jiang
> Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> BEAM-3645 makes it possible to run a map task parallel.
> However, users need to change runner when switch between multithreading and
> multiprocessing mode.
> We want to add a flag (ex: --use-multiprocess) to make the switch easy
> without changing the runner each time.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
