[jira] [Assigned] (BEAM-5511) Improve documentation when using AvroIO dynamic destination with user define objects

[ https://issues.apache.org/jira/browse/BEAM-5511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-5511: -- Assignee: (was: Eugene Kirpichov) > Improve documentation when using AvroIO

[jira] [Commented] (BEAM-5511) Improve documentation when using AvroIO dynamic destination with user define objects

[ https://issues.apache.org/jira/browse/BEAM-5511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630998#comment-16630998 ] Eugene Kirpichov commented on BEAM-5511: This should equally apply to documentation of

[jira] [Assigned] (BEAM-5438) why not add a Gemfire IO

[ https://issues.apache.org/jira/browse/BEAM-5438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-5438: -- Assignee: (was: Eugene Kirpichov) > why not add a Gemfire IO >

[jira] [Commented] (BEAM-4792) Add support for bounded SDF to all runners

[ https://issues.apache.org/jira/browse/BEAM-4792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16544249#comment-16544249 ] Eugene Kirpichov commented on BEAM-4792: https://github.com/apache/beam/pull/5940 > Add support

[jira] [Created] (BEAM-4792) Add support for bounded SDF to all runners

Eugene Kirpichov created BEAM-4792: -- Summary: Add support for bounded SDF to all runners Key: BEAM-4792 URL: https://issues.apache.org/jira/browse/BEAM-4792 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-4779) Python PortableTestRunner that runs VR tests against a given portable runner

Eugene Kirpichov created BEAM-4779: -- Summary: Python PortableTestRunner that runs VR tests against a given portable runner Key: BEAM-4779 URL: https://issues.apache.org/jira/browse/BEAM-4779

[jira] [Created] (BEAM-4780) Entry point for ULR JobService compatible with TestPortableRunner

Eugene Kirpichov created BEAM-4780: -- Summary: Entry point for ULR JobService compatible with TestPortableRunner Key: BEAM-4780 URL: https://issues.apache.org/jira/browse/BEAM-4780 Project: Beam

[jira] [Created] (BEAM-4778) Less wasteful ArtifactStagingService

Eugene Kirpichov created BEAM-4778: -- Summary: Less wasteful ArtifactStagingService Key: BEAM-4778 URL: https://issues.apache.org/jira/browse/BEAM-4778 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-4777) Python PortableRunner should support metrics

[ https://issues.apache.org/jira/browse/BEAM-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4777: --- Description: BEAM-4775 concerns adding metrics to the JobService API; the current issue is

[jira] [Created] (BEAM-4777) Python PortableRunner should support metrics

Eugene Kirpichov created BEAM-4777: -- Summary: Python PortableRunner should support metrics Key: BEAM-4777 URL: https://issues.apache.org/jira/browse/BEAM-4777 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-4777) Python PortableRunner should support metrics

[ https://issues.apache.org/jira/browse/BEAM-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4777: --- Component/s: (was: runner-core) sdk-py-core > Python PortableRunner

[jira] [Closed] (BEAM-4206) Python: WordCount runs against manually started Flink at master

[ https://issues.apache.org/jira/browse/BEAM-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4206. -- Resolution: Fixed Fix Version/s: 2.6.0 > Python: WordCount runs against manually

[jira] [Closed] (BEAM-4205) Java: WordCount runs against manually started Flink at master

[ https://issues.apache.org/jira/browse/BEAM-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4205. -- Resolution: Fixed Fix Version/s: 2.6.0 > Java: WordCount runs against manually started

[jira] [Created] (BEAM-4776) Java PortableRunner should support metrics

Eugene Kirpichov created BEAM-4776: -- Summary: Java PortableRunner should support metrics Key: BEAM-4776 URL: https://issues.apache.org/jira/browse/BEAM-4776 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-4775) JobService should support returning metrics

Eugene Kirpichov created BEAM-4775: -- Summary: JobService should support returning metrics Key: BEAM-4775 URL: https://issues.apache.org/jira/browse/BEAM-4775 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-4758) Avro-Protobuf support

[ https://issues.apache.org/jira/browse/BEAM-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4758: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > Avro-Protobuf support >

[jira] [Commented] (BEAM-4758) Avro-Protobuf support

[ https://issues.apache.org/jira/browse/BEAM-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540614#comment-16540614 ] Eugene Kirpichov commented on BEAM-4758: Hi - thanks for the feedback, this seems like something

[jira] [Created] (BEAM-4745) SDF tests broken by innocent change due to Dataflow worker dependencies

Eugene Kirpichov created BEAM-4745: -- Summary: SDF tests broken by innocent change due to Dataflow worker dependencies Key: BEAM-4745 URL: https://issues.apache.org/jira/browse/BEAM-4745 Project:

[jira] [Created] (BEAM-4737) SplittableDoFn dynamic rebalancing in Dataflow

Eugene Kirpichov created BEAM-4737: -- Summary: SplittableDoFn dynamic rebalancing in Dataflow Key: BEAM-4737 URL: https://issues.apache.org/jira/browse/BEAM-4737 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-4372) Need an undeprecated Reshuffle transform

[ https://issues.apache.org/jira/browse/BEAM-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4372: -- Assignee: Yueyang Qiu (was: Eugene Kirpichov) > Need an undeprecated Reshuffle

[jira] [Assigned] (BEAM-3194) Support annotating that a DoFn requires stable / deterministic input for replay/retry

[ https://issues.apache.org/jira/browse/BEAM-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3194: -- Assignee: Yueyang Qiu (was: Eugene Kirpichov) > Support annotating that a DoFn

[jira] [Assigned] (BEAM-4288) SplittableDoFn: splitAtFraction() API for Python

[ https://issues.apache.org/jira/browse/BEAM-4288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4288: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > SplittableDoFn:

[jira] [Assigned] (BEAM-4204) Python: PortableRunner - p.run() via given JobService

[ https://issues.apache.org/jira/browse/BEAM-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4204: -- Assignee: Ankur Goenka (was: Eugene Kirpichov) > Python: PortableRunner - p.run() via

[jira] [Closed] (BEAM-4204) Python: PortableRunner - p.run() via given JobService

[ https://issues.apache.org/jira/browse/BEAM-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4204. -- Resolution: Fixed Fix Version/s: (was: Not applicable) 2.5.0 >

[jira] [Closed] (BEAM-3268) getPerDestinationOutputFilenames() is getting processed before write is finished on dataflow runner

[ https://issues.apache.org/jira/browse/BEAM-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3268. -- Resolution: Fixed Fix Version/s: 2.5.0 > getPerDestinationOutputFilenames() is getting

[jira] [Closed] (BEAM-4166) FnApiDoFnRunner doesn't invoke setup/teardown

[ https://issues.apache.org/jira/browse/BEAM-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4166. -- Resolution: Fixed Fix Version/s: 2.5.0 > FnApiDoFnRunner doesn't invoke setup/teardown >

[jira] [Assigned] (BEAM-4064) ClassCastExeption when reading Avro files using specific records with org.apache.avro.util.Utf8 fields

[ https://issues.apache.org/jira/browse/BEAM-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4064: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > ClassCastExeption when reading

[jira] [Assigned] (BEAM-3874) Switch AvroIO sink default codec to Snappy

[ https://issues.apache.org/jira/browse/BEAM-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3874: -- Assignee: (was: Eugene Kirpichov) > Switch AvroIO sink default codec to Snappy >

[jira] [Assigned] (BEAM-3945) TFRecord Performance Tests doesn't work on hdfs

[ https://issues.apache.org/jira/browse/BEAM-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3945: -- Assignee: Udi Meiri (was: Eugene Kirpichov) > TFRecord Performance Tests doesn't work

[jira] [Closed] (BEAM-3907) Clarify how watermark is estimated for watchForNewFiles() transforms

[ https://issues.apache.org/jira/browse/BEAM-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3907. -- Resolution: Fixed Fix Version/s: 2.6.0 This will not need clarification since I fixed a

[jira] [Assigned] (BEAM-3857) Dynamic output support for python

[ https://issues.apache.org/jira/browse/BEAM-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3857: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > Dynamic output support for

[jira] [Assigned] (BEAM-3742) Support for running a streaming SDF in Python SDK

[ https://issues.apache.org/jira/browse/BEAM-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3742: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > Support for running a

[jira] [Closed] (BEAM-3595) Normalize URNs across SDKs and runners.

[ https://issues.apache.org/jira/browse/BEAM-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3595. -- Resolution: Fixed Fix Version/s: 2.5.0 Yeah this was done to a sufficient degree some

[jira] [Assigned] (BEAM-3837) Python SDK harness should understand a BundleSplitRequest and respond with a BundleSplit before bundle finishes

[ https://issues.apache.org/jira/browse/BEAM-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3837: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > Python SDK harness should

[jira] [Assigned] (BEAM-3834) Python SDK harness should detect SDF ProcessFn and proactively checkpoint it

[ https://issues.apache.org/jira/browse/BEAM-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3834: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > Python SDK harness should

[jira] [Closed] (BEAM-2826) Need to generate a single XML file when write is performed on small amount of data

[ https://issues.apache.org/jira/browse/BEAM-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2826. -- Resolution: Fixed Fix Version/s: 2.2.0 This is indeed addressed by FileIO.write which I

[jira] [Closed] (BEAM-2883) Poor error message when forgetting to specify a Datastore project.

[ https://issues.apache.org/jira/browse/BEAM-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2883. -- Resolution: Fixed Fix Version/s: Not applicable Fixed a long time ago. > Poor error

[jira] [Closed] (BEAM-2682) Merge AvroIOTest and AvroIOTransformTest

[ https://issues.apache.org/jira/browse/BEAM-2682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2682. -- Resolution: Fixed Fix Version/s: Not applicable Was fixed a long time ago. > Merge

[jira] [Closed] (BEAM-2751) Write PCollection elements to individual files

[ https://issues.apache.org/jira/browse/BEAM-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2751. -- Resolution: Fixed Fix Version/s: 2.2.0 This can be done closely enough using

[jira] [Closed] (BEAM-1190) FileBasedSource should ignore files that matched the glob but don't exist

[ https://issues.apache.org/jira/browse/BEAM-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1190. -- Resolution: Won't Fix Fix Version/s: Not applicable This is an old issue, proposing a

[jira] [Closed] (BEAM-1824) Adapter for running SDF on a statically known input as a Source

[ https://issues.apache.org/jira/browse/BEAM-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1824. -- Resolution: Won't Fix Fix Version/s: Not applicable At this point it's better to just

[jira] [Closed] (BEAM-217) BoundedSource.splitAtFraction should be splitAfterFraction

[ https://issues.apache.org/jira/browse/BEAM-217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-217. - Resolution: Won't Fix Not worth investing into BoundedSource anymore. But SDF will get this right.

[jira] [Commented] (BEAM-1841) FileBasedSource should have safeguards for when set of files grows while job is running

[ https://issues.apache.org/jira/browse/BEAM-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530528#comment-16530528 ] Eugene Kirpichov commented on BEAM-1841: (especially because there is already a transform for

[jira] [Closed] (BEAM-1841) FileBasedSource should have safeguards for when set of files grows while job is running

[ https://issues.apache.org/jira/browse/BEAM-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1841. -- Resolution: Won't Fix Fix Version/s: Not applicable Probably not worth investing more

[jira] [Closed] (BEAM-4689) Dataflow cannot deserialize SplittableParDo DoFns

[ https://issues.apache.org/jira/browse/BEAM-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4689. -- Resolution: Fixed Fix Version/s: 2.6.0 > Dataflow cannot deserialize SplittableParDo

[jira] [Closed] (BEAM-3883) Python SDK stages artifacts when talking to job server

[ https://issues.apache.org/jira/browse/BEAM-3883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3883. -- Resolution: Fixed > Python SDK stages artifacts when talking to job server >

[jira] [Commented] (BEAM-4206) Python: WordCount runs against manually started Flink at master

[ https://issues.apache.org/jira/browse/BEAM-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522982#comment-16522982 ] Eugene Kirpichov commented on BEAM-4206: Robert and Axel are working on this, and it's *that*

[jira] [Assigned] (BEAM-4205) Java: WordCount runs against manually started Flink at master

[ https://issues.apache.org/jira/browse/BEAM-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4205: -- Assignee: Ankur Goenka > Java: WordCount runs against manually started Flink at master

[jira] [Assigned] (BEAM-4206) Python: WordCount runs against manually started Flink at master

[ https://issues.apache.org/jira/browse/BEAM-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4206: -- Assignee: Axel Magnuson (was: Aljoscha Krettek) > Python: WordCount runs against

[jira] [Closed] (BEAM-4267) Implement a reusable library that can run an ExecutableStage with a given Environment

[ https://issues.apache.org/jira/browse/BEAM-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4267. -- Resolution: Fixed Fix Version/s: 2.6.0 I think we're good here :) > Implement a

[jira] [Closed] (BEAM-3833) Java SDK harness should detect SDF ProcessFn and proactively checkpoint it

[ https://issues.apache.org/jira/browse/BEAM-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3833. -- Resolution: Fixed Fix Version/s: 2.6.0 https://github.com/apache/beam/pull/5566 > Java

[jira] [Closed] (BEAM-3743) Support for SDF splitting protocol in ULR

[ https://issues.apache.org/jira/browse/BEAM-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3743. -- Resolution: Fixed Fix Version/s: 2.6.0 https://github.com/apache/beam/pull/5566 >

[jira] [Closed] (BEAM-3741) Proto changes for splitting over Fn API

[ https://issues.apache.org/jira/browse/BEAM-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3741. -- Resolution: Fixed Fix Version/s: 2.5.0 > Proto changes for splitting over Fn API >

[jira] [Closed] (BEAM-4145) Java SDK Harness populates control request headers with worker id

[ https://issues.apache.org/jira/browse/BEAM-4145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4145. -- Resolution: Fixed Fix Version/s: 2.6.0 > Java SDK Harness populates control request

[jira] [Commented] (BEAM-4145) Java SDK Harness populates control request headers with worker id

[ https://issues.apache.org/jira/browse/BEAM-4145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516491#comment-16516491 ] Eugene Kirpichov commented on BEAM-4145: I'll take over tgroh's PR since he's currently

[jira] [Assigned] (BEAM-4145) Java SDK Harness populates control request headers with worker id

[ https://issues.apache.org/jira/browse/BEAM-4145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4145: -- Assignee: Eugene Kirpichov (was: Thomas Groh) > Java SDK Harness populates control

[jira] [Closed] (BEAM-4149) Java SDK Harness should populate worker id in control plane headers

[ https://issues.apache.org/jira/browse/BEAM-4149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4149. -- Resolution: Duplicate Fix Version/s: Not applicable > Java SDK Harness should populate

[jira] [Closed] (BEAM-2588) Portable Flink Runner Job API

[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2588. -- Resolution: Fixed Fix Version/s: 2.6.0 > Portable Flink Runner Job API >

[jira] [Closed] (BEAM-4291) ArtifactRetrievalService that retrieves artifacts from a distributed filesystem

[ https://issues.apache.org/jira/browse/BEAM-4291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4291. -- Resolution: Fixed Fix Version/s: 2.6.0 > ArtifactRetrievalService that retrieves

[jira] [Closed] (BEAM-4216) Flink: Staged artifacts are delivered to the SDK container

[ https://issues.apache.org/jira/browse/BEAM-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4216. -- Resolution: Fixed Fix Version/s: 2.6.0 > Flink: Staged artifacts are delivered to the

[jira] [Closed] (BEAM-4281) GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky

[ https://issues.apache.org/jira/browse/BEAM-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4281. -- Resolution: Fixed Fix Version/s: 2.6.0 >

[jira] [Closed] (BEAM-4473) Flaky org.apache.beam.runners.direct.portable.ReferenceRunnerTest.pipelineExecution

[ https://issues.apache.org/jira/browse/BEAM-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4473. -- Resolution: Fixed Fix Version/s: 2.6.0 Fixed in https://github.com/apache/beam/pull/5585

[jira] [Assigned] (BEAM-4281) GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky

[ https://issues.apache.org/jira/browse/BEAM-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4281: -- Assignee: Eugene Kirpichov (was: Thomas Groh) >

[jira] [Commented] (BEAM-4281) GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky

[ https://issues.apache.org/jira/browse/BEAM-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511810#comment-16511810 ] Eugene Kirpichov commented on BEAM-4281: Will be fixed by 

[jira] [Created] (BEAM-4557) Propagate keyed-ness of PValues properly in ReferenceRunner

Eugene Kirpichov created BEAM-4557: -- Summary: Propagate keyed-ness of PValues properly in ReferenceRunner Key: BEAM-4557 URL: https://issues.apache.org/jira/browse/BEAM-4557 Project: Beam

[jira] [Commented] (BEAM-4473) Flaky org.apache.beam.runners.direct.portable.ReferenceRunnerTest.pipelineExecution

[ https://issues.apache.org/jira/browse/BEAM-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506482#comment-16506482 ] Eugene Kirpichov commented on BEAM-4473: I think the bug is that at

[jira] [Commented] (BEAM-4267) Implement a reusable library that can run an ExecutableStage with a given Environment

[ https://issues.apache.org/jira/browse/BEAM-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16484476#comment-16484476 ] Eugene Kirpichov commented on BEAM-4267: Woohoo! Now I think it just remains to hook up side

[jira] [Created] (BEAM-4375) Gradle doesn't run tests under RunWith(Enclosed.class)

Eugene Kirpichov created BEAM-4375: -- Summary: Gradle doesn't run tests under RunWith(Enclosed.class) Key: BEAM-4375 URL: https://issues.apache.org/jira/browse/BEAM-4375 Project: Beam Issue

[jira] [Commented] (BEAM-2588) Portable Flink Runner Job API

[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479875#comment-16479875 ] Eugene Kirpichov commented on BEAM-2588: Axel said Robert is going to work on this. > Portable

[jira] [Commented] (BEAM-2588) Portable Flink Runner Job API

[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479874#comment-16479874 ] Eugene Kirpichov commented on BEAM-2588: Now it remains to create a Flink-specific JobInvoker

[jira] [Comment Edited] (BEAM-2588) Portable Flink Runner Job API

[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479874#comment-16479874 ] Eugene Kirpichov edited comment on BEAM-2588 at 5/17/18 11:26 PM: -- Now it

[jira] [Assigned] (BEAM-2588) Portable Flink Runner Job API

[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-2588: -- Assignee: Robert Bradshaw (was: Axel Magnuson) > Portable Flink Runner Job API >

[jira] [Created] (BEAM-4291) ArtifactRetrievalService that retrieves artifacts from a distributed filesystem

Eugene Kirpichov created BEAM-4291: -- Summary: ArtifactRetrievalService that retrieves artifacts from a distributed filesystem Key: BEAM-4291 URL: https://issues.apache.org/jira/browse/BEAM-4291

[jira] [Created] (BEAM-4290) ArtifactStagingService that stages to a distributed filesystem

Eugene Kirpichov created BEAM-4290: -- Summary: ArtifactStagingService that stages to a distributed filesystem Key: BEAM-4290 URL: https://issues.apache.org/jira/browse/BEAM-4290 Project: Beam

[jira] [Assigned] (BEAM-4267) Implement a reusable library that can run an ExecutableStage with a given Environment

[ https://issues.apache.org/jira/browse/BEAM-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4267: -- Assignee: Ben Sidhom (was: Axel Magnuson) > Implement a reusable library that can run

[jira] [Created] (BEAM-4288) SplittableDoFn: splitAtFraction() API for Python

Eugene Kirpichov created BEAM-4288: -- Summary: SplittableDoFn: splitAtFraction() API for Python Key: BEAM-4288 URL: https://issues.apache.org/jira/browse/BEAM-4288 Project: Beam Issue Type:

[jira] [Created] (BEAM-4287) SplittableDoFn: splitAtFraction() API

Eugene Kirpichov created BEAM-4287: -- Summary: SplittableDoFn: splitAtFraction() API Key: BEAM-4287 URL: https://issues.apache.org/jira/browse/BEAM-4287 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-4287) SplittableDoFn: splitAtFraction() API for Java

[ https://issues.apache.org/jira/browse/BEAM-4287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4287: --- Summary: SplittableDoFn: splitAtFraction() API for Java (was: SplittableDoFn:

[jira] [Closed] (BEAM-3515) Use portable ParDoPayload for SDF in DataflowRunner

[ https://issues.apache.org/jira/browse/BEAM-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3515. -- Resolution: Fixed Fix Version/s: 2.5.0 > Use portable ParDoPayload for SDF in

[jira] [Created] (BEAM-4281) GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky

Eugene Kirpichov created BEAM-4281: -- Summary: GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky Key: BEAM-4281 URL: https://issues.apache.org/jira/browse/BEAM-4281

[jira] [Closed] (BEAM-2597) FlinkRunner ExecutableStage batch operator

[ https://issues.apache.org/jira/browse/BEAM-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2597. -- Resolution: Fixed Fix Version/s: 2.5.0 > FlinkRunner ExecutableStage batch operator >

[jira] [Updated] (BEAM-2594) Python shim for submitting to a JobService

[ https://issues.apache.org/jira/browse/BEAM-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-2594: --- Summary: Python shim for submitting to a JobService (was: Python shim for submitting to the

[jira] [Commented] (BEAM-2594) Python shim for submitting to the ULR

[ https://issues.apache.org/jira/browse/BEAM-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469772#comment-16469772 ] Eugene Kirpichov commented on BEAM-2594: I think this Jira is misformulated. We need a Jira for a

[jira] [Closed] (BEAM-4242) Wait.on() is O(n)

[ https://issues.apache.org/jira/browse/BEAM-4242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4242. -- Resolution: Fixed Fix Version/s: 2.5.0 > Wait.on() is O(n) > - > >

[jira] [Created] (BEAM-4242) Wait.on() is O(n)

Eugene Kirpichov created BEAM-4242: -- Summary: Wait.on() is O(n) Key: BEAM-4242 URL: https://issues.apache.org/jira/browse/BEAM-4242 Project: Beam Issue Type: Bug Components:

[jira] [Commented] (BEAM-4147) Abstractions for artifact delivery via arbitrary storage backends

[ https://issues.apache.org/jira/browse/BEAM-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461703#comment-16461703 ] Eugene Kirpichov commented on BEAM-4147: This covers an ArtifactStagingService and

[jira] [Updated] (BEAM-4147) Abstractions for artifact delivery via arbitrary storage backends

[ https://issues.apache.org/jira/browse/BEAM-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4147: --- Summary: Abstractions for artifact delivery via arbitrary storage backends (was: Artifact

[jira] [Reopened] (BEAM-4204) Python: PortableRunner - p.run() via given JobService

[ https://issues.apache.org/jira/browse/BEAM-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reopened BEAM-4204: Assignee: Eugene Kirpichov (was: Robert Bradshaw) universal_local_runner does more than

[jira] [Closed] (BEAM-4217) Java SDK stages artifacts when talking to job server

[ https://issues.apache.org/jira/browse/BEAM-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4217. -- Resolution: Fixed Fix Version/s: 2.5.0 Per Ben, this is already done in the Job API shim.

[jira] [Closed] (BEAM-4144) SplittableParDoProcessFnTest has had a masked failure

[ https://issues.apache.org/jira/browse/BEAM-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4144. -- Resolution: Fixed Fix Version/s: 2.5.0 > SplittableParDoProcessFnTest has had a masked

[jira] [Commented] (BEAM-3714) JdbcIO.read() should create a forward-only, read-only result set

[ https://issues.apache.org/jira/browse/BEAM-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459818#comment-16459818 ] Eugene Kirpichov commented on BEAM-3714: JB, what's the reason for reassigning this issue to

[jira] [Created] (BEAM-4217) Java SDK stages artifacts when talking to job server

Eugene Kirpichov created BEAM-4217: -- Summary: Java SDK stages artifacts when talking to job server Key: BEAM-4217 URL: https://issues.apache.org/jira/browse/BEAM-4217 Project: Beam Issue

[jira] [Created] (BEAM-4216) Flink: Staged artifacts are delivered to the SDK container

Eugene Kirpichov created BEAM-4216: -- Summary: Flink: Staged artifacts are delivered to the SDK container Key: BEAM-4216 URL: https://issues.apache.org/jira/browse/BEAM-4216 Project: Beam

[jira] [Closed] (BEAM-4204) Python: PortableRunner - p.run() via given JobService

[ https://issues.apache.org/jira/browse/BEAM-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4204. -- Resolution: Duplicate Fix Version/s: Not applicable This appears to be a dupe of

[jira] [Updated] (BEAM-4213) Python: Portable batch Flink runner passes all ValidatesRunner tests

[ https://issues.apache.org/jira/browse/BEAM-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4213: --- Description: Like BEAM-4176, but 1) for Python; 2) there is no baseline; 3) the set of

[jira] [Created] (BEAM-4214) Python ValidatesRunner test coverage is very poor

Eugene Kirpichov created BEAM-4214: -- Summary: Python ValidatesRunner test coverage is very poor Key: BEAM-4214 URL: https://issues.apache.org/jira/browse/BEAM-4214 Project: Beam Issue Type:

[jira] [Created] (BEAM-4213) Python: Portable batch Flink runner passes all ValidatesRunner tests

Eugene Kirpichov created BEAM-4213: -- Summary: Python: Portable batch Flink runner passes all ValidatesRunner tests Key: BEAM-4213 URL: https://issues.apache.org/jira/browse/BEAM-4213 Project: Beam

[jira] [Updated] (BEAM-4176) Java: Portable batch runner passes all ValidatesRunner tests that non-portable runner passes

[ https://issues.apache.org/jira/browse/BEAM-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4176: --- Summary: Java: Portable batch runner passes all ValidatesRunner tests that non-portable runner

[jira] [Created] (BEAM-4212) Flink portable ValidatesRunner tests continuously run on Jenkins

Eugene Kirpichov created BEAM-4212: -- Summary: Flink portable ValidatesRunner tests continuously run on Jenkins Key: BEAM-4212 URL: https://issues.apache.org/jira/browse/BEAM-4212 Project: Beam

[jira] [Created] (BEAM-4211) Python: FlinkPortableTestRunner: runs portably via self-started local Flink

Eugene Kirpichov created BEAM-4211: -- Summary: Python: FlinkPortableTestRunner: runs portably via self-started local Flink Key: BEAM-4211 URL: https://issues.apache.org/jira/browse/BEAM-4211 Project:

  1   2   3   4   5   6   7   >