Abacn commented on issue #24365: URL: https://github.com/apache/beam/issues/24365#issuecomment-1329842295
@cozos This issue attracted me partly because, actually, Python text IO write has obviously worse performance than Java SDK: Java metrics: http://104.154.241.245/d/bnlHKP3Wz/java-io-it-tests-dataflow?orgId=1&viewPanel=4 Python metrics: http://104.154.241.245/d/gP7vMPqZz/python-io-it-tests-dataflow?orgId=1&viewPanel=5 Java Read ~20s; Java Write ~30s; Python Read ~100s; Python Write 350s I recently implemented this Python performance test and found this. And trying to figure out the performance bottlenecks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
