tions) somewhat to enable this use-case. I haven't worked out the
details yet, but it will take some thought to make this work in a non-hacky way.
Thanks
Matt Rudary
, this use case
may make sense in case you are dealing with multiple storage vendors.
Matt
On 2021/05/19 13:27:16, Matt Rudary
mailto:m...@twosigma.com>> wrote:
> Hi,>
>
> This is a quick sketch of a proposal - I wanted to get a sense of whether
> there's g
I've filed https://issues.apache.org/jira/browse/BEAM-12435 to track this
improvement.
From: Matt Rudary
Sent: Monday, May 24, 2021 4:49 PM
To: dev@beam.apache.org
Subject: Re: Proposal: Generalize S3FileSystem
Thanks for the comments all. I forgot to subscribe to dev before I sent ou
My general question is what responsibility we have to maintain forward and
backward compatibility for serialization of objects in the SDK. My specific
question is about org.apache.beam.sdk.io.aws.s3.S3ResourceId - how can I tell
whether ResourceIds are serialized anywhere that would require stab
In practice, restriction tracker methods are called via a
RestrictionTrackerObserver, which synchronizes
(https://github.com/apache/beam/blob/master/sdks/java/fn-execution/src/main/java/org/apache/beam/sdk/fn/splittabledofn/RestrictionTrackers.java)
-Original Message-
From: Jan Lukavský
Does anyone do Beam development on an M1 Mac? Any tips to getting things up and
running?
Alternatively, does anyone have a good "workstation in the cloud" setup?
Thanks
Matt
