Flaky test issue report (29)

This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determin

P1 issues report (42)

This is your daily summary of Beam's current P1 issues, not including flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20priority%20%3D%20P1%20AND%20(labels%20is%20EMPTY%20OR%20labels%20!%3D%20flake). See https://beam.apache.

Re: FileIO with custom sharding function

I don't think this has anything to do with external shuffle services. Arbitrarily recomputing data is fundamentally incompatible with Beam, since Beam does not restrict transforms to being deterministic. The Spark runner works (at least it did last I checked) by checkpointing the RDD. Spark will n