Pablo Estrada created BEAM-3042: ----------------------------------- Summary: Add tracking of bytes read / time spent when reading side inputs Key: BEAM-3042 URL: https://issues.apache.org/jira/browse/BEAM-3042 Project: Beam Issue Type: Bug Components: sdk-py-core Reporter: Pablo Estrada Assignee: Pablo Estrada
It is difficult for Dataflow users to understand how modifying a pipeline or data set can affect how much inter-transform IO is used in their job. The intent of this feature request is to help users understand how side inputs behave when they are consumed. For further information, please review the internal Google doc go/insights-transform-io-design-doc. -- This message was sent by Atlassian JIRA (v6.4.14#64029)