[jira] [Assigned] (BEAM-13624) pipeline_fragment incorrectly prunes producer transform

2022-02-17 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-13624: Assignee: Sam Rohde > pipeline_fragment incorrectly prunes producer transform > --

[jira] [Updated] (BEAM-12984) InteractiveRunner cannot collect PCollections from composites

2021-09-30 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-12984: - Resolution: Fixed Status: Resolved (was: Open) > InteractiveRunner cannot collect PCollections f

[jira] [Created] (BEAM-12984) InteractiveRunner cannot collect PCollections from composites

2021-09-29 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-12984: Summary: InteractiveRunner cannot collect PCollections from composites Key: BEAM-12984 URL: https://issues.apache.org/jira/browse/BEAM-12984 Project: Beam Issue Ty

[jira] [Commented] (BEAM-12843) (Broken Pipe induced) Bricked Dataflow Pipeline 

2021-09-23 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17419460#comment-17419460 ] Sam Rohde commented on BEAM-12843: -- Nothing concrete. It could be that GCS updated their

[jira] [Commented] (BEAM-12843) (Broken Pipe induced) Bricked Dataflow Pipeline 

2021-09-23 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17419433#comment-17419433 ] Sam Rohde commented on BEAM-12843: -- Looking at this a little bit more, the IO uses a [GC

[jira] [Commented] (BEAM-12842) StreamingDataflowWorkerTest.testHotKeyLogging test flake

2021-09-10 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413267#comment-17413267 ] Sam Rohde commented on BEAM-12842: -- Made https://github.com/apache/beam/pull/15492 > St

[jira] [Commented] (BEAM-12842) StreamingDataflowWorkerTest.testHotKeyLogging test flake

2021-09-10 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413246#comment-17413246 ] Sam Rohde commented on BEAM-12842: -- Looking at the code, the test puts a 0 as the timest

[jira] [Updated] (BEAM-12842) StreamingDataflowWorkerTest.testHotKeyLogging test flake

2021-09-10 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-12842: - Summary: StreamingDataflowWorkerTest.testHotKeyLogging test flake (was: StreamingDataflowWorkerTest.test

[jira] [Commented] (BEAM-12842) StreamingDataflowWorkerTest.testHotKeyLogging tests are flaky

2021-09-07 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411379#comment-17411379 ] Sam Rohde commented on BEAM-12842: -- The test is essentially a copy of testBasic except w

[jira] [Commented] (BEAM-12764) Can't get attribute 'new_block' on

2021-08-24 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404084#comment-17404084 ] Sam Rohde commented on BEAM-12764: -- Yes, that's fine to go ahead and rollback. > Can't

[jira] [Commented] (BEAM-12764) Can't get attribute 'new_block' on

2021-08-23 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403397#comment-17403397 ] Sam Rohde commented on BEAM-12764: -- Yeah, that's my guess too. I'll take a look today >

[jira] [Commented] (BEAM-12698) Some binary operations on DeferredSeries don't work

2021-08-19 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401845#comment-17401845 ] Sam Rohde commented on BEAM-12698: -- I am unable to reproduce on either 2.31.0 or 2.32.0.

[jira] [Updated] (BEAM-12531) ib.show does not handle deferred dataframe instances

2021-07-15 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-12531: - Resolution: Fixed Status: Resolved (was: Open) > ib.show does not handle deferred dataframe inst

[jira] [Assigned] (BEAM-12388) Improve caching experience on InteractiveRunner with dataframes

2021-07-08 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-12388: Assignee: Sam Rohde > Improve caching experience on InteractiveRunner with dataframes > --

[jira] [Created] (BEAM-12388) Improve caching experience on InteractiveRunner with dataframes

2021-05-21 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-12388: Summary: Improve caching experience on InteractiveRunner with dataframes Key: BEAM-12388 URL: https://issues.apache.org/jira/browse/BEAM-12388 Project: Beam Issue T

[jira] [Work started] (BEAM-12246) ib.collect doesn't preserve the index from DeferredDataFrame instances

2021-04-28 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-12246 started by Sam Rohde. > ib.collect doesn't preserve the index from DeferredDataFrame instances > -

[jira] [Updated] (BEAM-10994) Add Hot Key Logging in Dataflow Runner

2021-04-28 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10994: - Status: Resolved (was: Resolved) > Add Hot Key Logging in Dataflow Runner >

[jira] [Updated] (BEAM-10970) apache_beam.runners.interactive.recording_manager_test.ElementStreamTest is flaky on Windows

2021-04-12 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10970: - Resolution: Fixed Status: Resolved (was: Resolved) > apache_beam.runners.interactive.recording_m

[jira] [Updated] (BEAM-10921) Interactive Runner Python unit tests are flaky on Windows

2021-04-12 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10921: - Resolution: Fixed Status: Resolved (was: Resolved) > Interactive Runner Python unit tests are fl

[jira] [Updated] (BEAM-9687) Names of temporary files created by interactive runner include characters invalid on some platforms.

2021-04-12 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-9687: Resolution: Fixed Status: Resolved (was: Resolved) > Names of temporary files created by interactiv

[jira] [Updated] (BEAM-10994) Add Hot Key Logging in Dataflow Runner

2021-04-12 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10994: - Fix Version/s: 2.29.0 Resolution: Fixed Status: Resolved (was: Open) > Add Hot Key Log

[jira] [Updated] (BEAM-10956) PipelineInstrumentTest is flaky

2021-04-12 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10956: - Resolution: Fixed Status: Resolved (was: Resolved) > PipelineInstrumentTest is flaky > -

[jira] [Updated] (BEAM-10954) PipelineInstrumentTest.test_not_has_unbounded_source flaky on ubuntu

2021-04-12 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10954: - Resolution: Fixed Status: Resolved (was: Resolved) > PipelineInstrumentTest.test_not_has_unbound

[jira] [Updated] (BEAM-11151) Add ToString support

2021-04-12 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-11151: - Resolution: Fixed Status: Resolved (was: Open) > Add ToString support > > >

[jira] [Commented] (BEAM-11151) Add ToString support

2021-04-02 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17313996#comment-17313996 ] Sam Rohde commented on BEAM-11151: -- Still requires Go support > Add ToString support >

[jira] [Assigned] (BEAM-11855) ib.collect should accept DeferredDataFrame instances

2021-04-02 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-11855: Assignee: Sam Rohde > ib.collect should accept DeferredDataFrame instances > -

[jira] [Updated] (BEAM-10603) Large Source Recording for Interarctive Runner

2021-03-22 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10603: - Resolution: Fixed Status: Resolved (was: Open) > Large Source Recording for Interarctive Runner

[jira] [Commented] (BEAM-10603) Large Source Recording for Interarctive Runner

2021-03-22 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17306589#comment-17306589 ] Sam Rohde commented on BEAM-10603: -- Yep, thanks for the ping > Large Source Recording f

[jira] [Assigned] (BEAM-11151) Add ToString support

2021-03-01 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-11151: Assignee: Sam Rohde > Add ToString support > > > Key: BEAM-11

[jira] [Assigned] (BEAM-11666) apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky

2021-02-26 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-11666: Assignee: Sam Rohde > apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.

[jira] [Assigned] (BEAM-10994) Add Hot Key Logging in Dataflow Runner

2021-02-05 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-10994: Assignee: Sam Rohde > Add Hot Key Logging in Dataflow Runner > ---

[jira] [Updated] (BEAM-10994) Add Hot Key Logging in Dataflow Runner

2021-02-05 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10994: - Labels: (was: stale-P2) > Add Hot Key Logging in Dataflow Runner >

[jira] [Assigned] (BEAM-10921) Python unit tests on windows flaky

2020-11-02 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-10921: Assignee: Ning Kang (was: Sam Rohde) > Python unit tests on windows flaky > -

[jira] [Created] (BEAM-11151) Add ToString support

2020-10-28 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-11151: Summary: Add ToString support Key: BEAM-11151 URL: https://issues.apache.org/jira/browse/BEAM-11151 Project: Beam Issue Type: New Feature Components: beam-

[jira] [Commented] (BEAM-10970) apache_beam.runners.interactive.recording_manager_test.ElementStreamTest is flaky on Windows

2020-10-22 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17219235#comment-17219235 ] Sam Rohde commented on BEAM-10970: -- This is a dupe of https://issues.apache.org/jira/bro

[jira] [Updated] (BEAM-10970) apache_beam.runners.interactive.recording_manager_test.ElementStreamTest is flaky on Windows

2020-10-22 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10970: - Status: Resolved (was: Resolved) > apache_beam.runners.interactive.recording_manager_test.ElementStreamT

[jira] [Updated] (BEAM-10970) apache_beam.runners.interactive.recording_manager_test.ElementStreamTest is flaky on Windows

2020-10-22 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10970: - Status: Resolved (was: Triage Needed) > apache_beam.runners.interactive.recording_manager_test.ElementSt

[jira] [Commented] (BEAM-10921) Python unit tests on windows flaky

2020-10-19 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17217151#comment-17217151 ] Sam Rohde commented on BEAM-10921: -- Ack, taking a look > Python unit tests on windows f

[jira] [Created] (BEAM-10994) Add Hot Key Logging in Dataflow Runner

2020-09-30 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-10994: Summary: Add Hot Key Logging in Dataflow Runner Key: BEAM-10994 URL: https://issues.apache.org/jira/browse/BEAM-10994 Project: Beam Issue Type: New Feature

[jira] [Updated] (BEAM-10956) PipelineInstrumentTest is flaky

2020-09-23 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10956: - Status: Resolved (was: Open) > PipelineInstrumentTest is flaky > --- > >

[jira] [Updated] (BEAM-10956) PipelineInstrumentTest is flaky

2020-09-23 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10956: - Status: Resolved (was: Resolved) > PipelineInstrumentTest is flaky > --- > >

[jira] [Commented] (BEAM-10954) PipelineInstrumentTest.test_not_has_unbounded_source flaky on ubuntu

2020-09-23 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17201170#comment-17201170 ] Sam Rohde commented on BEAM-10954: -- Dupe of https://issues.apache.org/jira/browse/BEAM-1

[jira] [Updated] (BEAM-10954) PipelineInstrumentTest.test_not_has_unbounded_source flaky on ubuntu

2020-09-23 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10954: - Status: Resolved (was: Resolved) > PipelineInstrumentTest.test_not_has_unbounded_source flaky on ubuntu

[jira] [Updated] (BEAM-10954) PipelineInstrumentTest.test_not_has_unbounded_source flaky on ubuntu

2020-09-23 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10954: - Status: Resolved (was: Open) > PipelineInstrumentTest.test_not_has_unbounded_source flaky on ubuntu > --

[jira] [Commented] (BEAM-10956) PipelineInstrumentTest is flaky

2020-09-23 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17201048#comment-17201048 ] Sam Rohde commented on BEAM-10956: -- Able to repro with `for i in \{1..100}; do python pi

[jira] [Created] (BEAM-10956) PipelineInstrumentTest is flaky

2020-09-23 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-10956: Summary: PipelineInstrumentTest is flaky Key: BEAM-10956 URL: https://issues.apache.org/jira/browse/BEAM-10956 Project: Beam Issue Type: Improvement Compon

[jira] [Updated] (BEAM-10921) Python unit tests on windows flaky

2020-09-21 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10921: - Status: Resolved (was: Resolved) > Python unit tests on windows flaky >

[jira] [Updated] (BEAM-10695) Cannot evict PCollections from InteractiveEnvironment

2020-09-21 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10695: - Status: Resolved (was: Resolved) > Cannot evict PCollections from InteractiveEnvironment > -

[jira] [Updated] (BEAM-10695) Cannot evict PCollections from InteractiveEnvironment

2020-09-21 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10695: - Status: Resolved (was: Open) > Cannot evict PCollections from InteractiveEnvironment > -

[jira] [Commented] (BEAM-10921) Python unit tests on windows flaky

2020-09-17 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197874#comment-17197874 ] Sam Rohde commented on BEAM-10921: -- Made [https://github.com/apache/beam/pull/12866] for

[jira] [Commented] (BEAM-10921) Python unit tests on windows flaky

2020-09-17 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197861#comment-17197861 ] Sam Rohde commented on BEAM-10921: -- I noticed the flakiness yesterday and integrated a f

[jira] [Created] (BEAM-10695) Cannot evict PCollections from InteractiveEnvironment

2020-08-12 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-10695: Summary: Cannot evict PCollections from InteractiveEnvironment Key: BEAM-10695 URL: https://issues.apache.org/jira/browse/BEAM-10695 Project: Beam Issue Type: Improv

[jira] [Commented] (BEAM-10635) Incompatible google-api-core and google-cloud-bigquery

2020-08-04 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171039#comment-17171039 ] Sam Rohde commented on BEAM-10635: -- Bumped to a P0 because it breaks the build. > Incom

[jira] [Updated] (BEAM-10635) Incompatible google-api-core and google-cloud-bigquery

2020-08-04 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10635: - Priority: P0 (was: P1) > Incompatible google-api-core and google-cloud-bigquery > --

[jira] [Updated] (BEAM-10635) Incompatible google-api-core and google-cloud-bigquery

2020-08-04 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-10635: - Priority: P1 (was: P2) > Incompatible google-api-core and google-cloud-bigquery > --

[jira] [Created] (BEAM-10603) Large Source Recording for Interarctive Runner

2020-07-29 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-10603: Summary: Large Source Recording for Interarctive Runner Key: BEAM-10603 URL: https://issues.apache.org/jira/browse/BEAM-10603 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-9692) Clean Python DataflowRunner to use portable pipelines

2020-06-01 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde resolved BEAM-9692. - Fix Version/s: 2.23.0 Resolution: Fixed > Clean Python DataflowRunner to use portable pipelines > -

[jira] [Commented] (BEAM-9767) test_streaming_wordcount flaky timeouts

2020-05-13 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17106529#comment-17106529 ] Sam Rohde commented on BEAM-9767: - Yep, it should be the fix. > test_streaming_wordcount

[jira] [Closed] (BEAM-9767) test_streaming_wordcount flaky timeouts

2020-05-13 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde closed BEAM-9767. --- > test_streaming_wordcount flaky timeouts > --- > > Key: BEAM-

[jira] [Resolved] (BEAM-9767) test_streaming_wordcount flaky timeouts

2020-05-13 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde resolved BEAM-9767. - Fix Version/s: 2.22.0 Resolution: Fixed > test_streaming_wordcount flaky timeouts > ---

[jira] [Comment Edited] (BEAM-9767) test_streaming_wordcount flaky timeouts

2020-05-11 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104733#comment-17104733 ] Sam Rohde edited comment on BEAM-9767 at 5/11/20, 6:19 PM: --- Than

[jira] [Commented] (BEAM-9767) test_streaming_wordcount flaky timeouts

2020-05-11 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104733#comment-17104733 ] Sam Rohde commented on BEAM-9767: - Thanks for the update Brian, I have root caused it and

[jira] [Commented] (BEAM-9767) test_streaming_wordcount flaky timeouts

2020-04-22 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089912#comment-17089912 ] Sam Rohde commented on BEAM-9767: - Copying comment from Ning in duped JIRA:  > We'll prob

[jira] [Commented] (BEAM-9767) test_streaming_wordcount flaky timeouts

2020-04-22 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089908#comment-17089908 ] Sam Rohde commented on BEAM-9767: - PR 11440  didn't fix the flakiness, it only added a GRP

[jira] [Closed] (BEAM-9803) test_streaming_wordcount flaky

2020-04-22 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde closed BEAM-9803. --- Fix Version/s: Not applicable Resolution: Duplicate > test_streaming_wordcount flaky >

[jira] [Commented] (BEAM-9322) Python SDK ignores manually set PCollection tags

2020-04-08 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17078662#comment-17078662 ] Sam Rohde commented on BEAM-9322: - We can consider the issue resolved, but let's keep the

[jira] [Created] (BEAM-9692) Clean Python DataflowRunner to use portable pipelines

2020-04-03 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-9692: --- Summary: Clean Python DataflowRunner to use portable pipelines Key: BEAM-9692 URL: https://issues.apache.org/jira/browse/BEAM-9692 Project: Beam Issue Type: Improvemen

[jira] [Resolved] (BEAM-9601) Interactive test_streaming_wordcount failing

2020-04-03 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde resolved BEAM-9601. - Fix Version/s: 2.20.0 Resolution: Fixed > Interactive test_streaming_wordcount failing > --

[jira] [Resolved] (BEAM-9548) Bad error handling with errors from TestStreamService when using Interactive Beam

2020-04-03 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde resolved BEAM-9548. - Fix Version/s: 2.20.0 Resolution: Fixed > Bad error handling with errors from TestStreamService whe

[jira] [Resolved] (BEAM-8335) Add streaming support to Interactive Beam

2020-04-03 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde resolved BEAM-8335. - Fix Version/s: 2.20.0 Resolution: Fixed > Add streaming support to Interactive Beam > -

[jira] [Resolved] (BEAM-9013) Multi-output TestStream breaks the DataflowRunner

2020-04-03 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde resolved BEAM-9013. - Fix Version/s: 2.18.0 Resolution: Fixed > Multi-output TestStream breaks the DataflowRunner > -

[jira] [Closed] (BEAM-9524) ib.show() spins forever when cells are re-executed

2020-03-20 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde closed BEAM-9524. --- Fix Version/s: 2.21.0 Resolution: Fixed > ib.show() spins forever when cells are re-executed >

[jira] [Created] (BEAM-9548) Bad error handling with errors from TestStreamService when using Interactive Beam

2020-03-18 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-9548: --- Summary: Bad error handling with errors from TestStreamService when using Interactive Beam Key: BEAM-9548 URL: https://issues.apache.org/jira/browse/BEAM-9548 Project: Beam

[jira] [Created] (BEAM-9524) ib.show() spins forever when cells are re-executed

2020-03-16 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-9524: --- Summary: ib.show() spins forever when cells are re-executed Key: BEAM-9524 URL: https://issues.apache.org/jira/browse/BEAM-9524 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-9447) Generalize the InteractiveRunner StreamingCache

2020-03-04 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-9447: --- Assignee: Sam Rohde > Generalize the InteractiveRunner StreamingCache > -

[jira] [Created] (BEAM-9447) Generalize the InteractiveRunner StreamingCache

2020-03-04 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-9447: --- Summary: Generalize the InteractiveRunner StreamingCache Key: BEAM-9447 URL: https://issues.apache.org/jira/browse/BEAM-9447 Project: Beam Issue Type: Bug Co

[jira] [Commented] (BEAM-9322) Python SDK ignores manually set PCollection tags

2020-02-24 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17043991#comment-17043991 ] Sam Rohde commented on BEAM-9322: - No this Jira won't be able to be solved by by the 2.20.

[jira] [Created] (BEAM-9322) Python SDK ignores manually set PCollection tags

2020-02-14 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-9322: --- Summary: Python SDK ignores manually set PCollection tags Key: BEAM-9322 URL: https://issues.apache.org/jira/browse/BEAM-9322 Project: Beam Issue Type: Bug C

[jira] [Assigned] (BEAM-1833) Restructure Python pipeline construction to better follow the Runner API

2020-02-13 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-1833: --- Assignee: Sam Rohde > Restructure Python pipeline construction to better follow the Runner API >

[jira] [Created] (BEAM-9073) PipelineVisitor is topologically-order dependent

2020-01-08 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-9073: --- Summary: PipelineVisitor is topologically-order dependent Key: BEAM-9073 URL: https://issues.apache.org/jira/browse/BEAM-9073 Project: Beam Issue Type: Bug C

[jira] [Created] (BEAM-9013) Multi-output TestStream breaks the DataflowRunner

2019-12-20 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-9013: --- Summary: Multi-output TestStream breaks the DataflowRunner Key: BEAM-9013 URL: https://issues.apache.org/jira/browse/BEAM-9013 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-8582) Python SDK emits duplicate records for Default and AfterWatermark triggers

2019-12-10 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde closed BEAM-8582. --- > Python SDK emits duplicate records for Default and AfterWatermark triggers > ---

[jira] [Resolved] (BEAM-8581) Python SDK labels ontime empty panes as late

2019-12-10 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde resolved BEAM-8581. - Fix Version/s: 2.19.0 Resolution: Fixed > Python SDK labels ontime empty panes as late > --

[jira] [Resolved] (BEAM-8582) Python SDK emits duplicate records for Default and AfterWatermark triggers

2019-12-10 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde resolved BEAM-8582. - Fix Version/s: 2.19.0 Resolution: Fixed > Python SDK emits duplicate records for Default and AfterW

[jira] [Closed] (BEAM-8581) Python SDK labels ontime empty panes as late

2019-12-10 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde closed BEAM-8581. --- > Python SDK labels ontime empty panes as late > > >

[jira] [Updated] (BEAM-8738) Revisit timestamp and duration representation

2019-11-18 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-8738: Description: The current proto representation of timesetamp and durations in Beam is either raw int64s or t

[jira] [Updated] (BEAM-8738) Revisit timestamp and duration representation

2019-11-18 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde updated BEAM-8738: Description: The current proto representation of timesetamp and durations in Beam is either raw int64s or t

[jira] [Created] (BEAM-8738) Revisit timestamp and duration representation

2019-11-18 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-8738: --- Summary: Revisit timestamp and duration representation Key: BEAM-8738 URL: https://issues.apache.org/jira/browse/BEAM-8738 Project: Beam Issue Type: Improvement

[jira] [Closed] (BEAM-6274) Timer Backlog Bug

2019-11-07 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde closed BEAM-6274. --- Fix Version/s: Not applicable Resolution: Won't Fix > Timer Backlog Bug > - > >

[jira] [Assigned] (BEAM-6453) Create a single Jenkins job or Gradle task to serve for release test validation

2019-11-07 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-6453: --- Assignee: (was: Sam Rohde) > Create a single Jenkins job or Gradle task to serve for release test

[jira] [Assigned] (BEAM-6672) Make bundle execution with ExecutableStage support user states

2019-11-07 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-6672: --- Assignee: (was: Sam Rohde) > Make bundle execution with ExecutableStage support user states > ---

[jira] [Resolved] (BEAM-8491) Add ability for multiple output PCollections from composites

2019-11-07 Thread Sam Rohde (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde resolved BEAM-8491. - Fix Version/s: 2.16.0 Resolution: Fixed > Add ability for multiple output PCollections from composi

[jira] [Created] (BEAM-8582) Python SDK emits duplicate records for Default and AfterWatermark triggers

2019-11-07 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-8582: --- Summary: Python SDK emits duplicate records for Default and AfterWatermark triggers Key: BEAM-8582 URL: https://issues.apache.org/jira/browse/BEAM-8582 Project: Beam

[jira] [Created] (BEAM-8581) Python SDK labels ontime empty panes as late

2019-11-07 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-8581: --- Summary: Python SDK labels ontime empty panes as late Key: BEAM-8581 URL: https://issues.apache.org/jira/browse/BEAM-8581 Project: Beam Issue Type: Bug Compo

[jira] [Created] (BEAM-8491) Add ability for multiple output PCollections from composites

2019-10-25 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-8491: --- Summary: Add ability for multiple output PCollections from composites Key: BEAM-8491 URL: https://issues.apache.org/jira/browse/BEAM-8491 Project: Beam Issue Type: Im

[jira] [Created] (BEAM-8335) Add streaming support to Interactive Beam

2019-10-01 Thread Sam Rohde (Jira)
Sam Rohde created BEAM-8335: --- Summary: Add streaming support to Interactive Beam Key: BEAM-8335 URL: https://issues.apache.org/jira/browse/BEAM-8335 Project: Beam Issue Type: Improvement

[jira] [Assigned] (BEAM-6442) Incomplete JobService API Semantics

2019-08-15 Thread Sam Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-6442: --- Assignee: (was: Sam Rohde) > Incomplete JobService API Semantics > --

[jira] [Commented] (BEAM-6442) Incomplete JobService API Semantics

2019-08-15 Thread Sam Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908507#comment-16908507 ] Sam Rohde commented on BEAM-6442: - I unfortunately don't have time to work on this. > Inc

[jira] [Resolved] (BEAM-7820) Add hot key detection to Dataflow Runner

2019-08-13 Thread Sam Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde resolved BEAM-7820. - Resolution: Fixed Fix Version/s: 2.16.0 2.15.0 > Add hot key detection to Datafl

[jira] [Created] (BEAM-7820) Add hot key detection to Dataflow Runner

2019-07-25 Thread Sam Rohde (JIRA)
Sam Rohde created BEAM-7820: --- Summary: Add hot key detection to Dataflow Runner Key: BEAM-7820 URL: https://issues.apache.org/jira/browse/BEAM-7820 Project: Beam Issue Type: New Feature C

  1   2   3   >