Hi All, I've put together a document that proposes a Splittable DoFn API for Python SDK.
https://docs.google.com/document/d/1h_zprJrOilivK2xfvl4L42vaX4DMYGfH1YDmi-s_ozM/edit?usp=sharing Splittable DoFn framework [1] is currently being implemented for Java SDK [2] and will unlock many use-cases that are not possible with the current BoundedSource framework [3] (see [1] for details). So, I believe, it will be good to add a similar framework to Python SDK as well. Please let me know what you think. Thanks, Cham [1] http://s.apache.org/splittable-do-fn [2] https://issues.apache.org/jira/browse/BEAM-65 [3] https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/iobase.py
