[jira] [Created] (BEAM-14508) Parquetio should produce a schema'd PCollection

2022-05-24 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14508: -- Summary: Parquetio should produce a schema'd PCollection Key: BEAM-14508 URL: https://issues.apache.org/jira/browse/BEAM-14508 Project: Beam Issue Type:

[jira] [Updated] (BEAM-14476) Verbose logging causes pipelines to get stuck on Flink.

2022-05-16 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-14476: --- Description: Minimal reproduction:    {{def _run_pipeline(pipeline):}} {{    def process_data

[jira] [Updated] (BEAM-14476) Verbose logging causes pipelines to get stuck on Flink.

2022-05-16 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-14476: --- Description: Minimal reproduction:    {{def _run_pipeline(pipeline):}} {{    def process_data

[jira] [Created] (BEAM-14476) Verbose logging causes pipelines to get stuck on Flink.

2022-05-16 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14476: -- Summary: Verbose logging causes pipelines to get stuck on Flink. Key: BEAM-14476 URL: https://issues.apache.org/jira/browse/BEAM-14476 Project: Beam Issu

[jira] [Created] (BEAM-14464) Optimize precombining table.

2022-05-12 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14464: -- Summary: Optimize precombining table. Key: BEAM-14464 URL: https://issues.apache.org/jira/browse/BEAM-14464 Project: Beam Issue Type: Bug Compo

[jira] [Created] (BEAM-14426) Allow skipping of any output when writing an empty PCollection.

2022-05-05 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14426: -- Summary: Allow skipping of any output when writing an empty PCollection. Key: BEAM-14426 URL: https://issues.apache.org/jira/browse/BEAM-14426 Project: Beam

[jira] [Updated] (BEAM-14421) --dataflowServiceOptions=use_runner_v2 is broken

2022-05-05 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-14421: --- Description: Per [https://lists.apache.org/list.html?u...@beam.apache.org] passing `–dataflow

[jira] [Created] (BEAM-14421) --dataflowServiceOptions=use_runner_v2 is broken

2022-05-05 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14421: -- Summary: --dataflowServiceOptions=use_runner_v2 is broken Key: BEAM-14421 URL: https://issues.apache.org/jira/browse/BEAM-14421 Project: Beam Issue Type:

[jira] [Commented] (BEAM-14403) Allow Prime to be used with Legacy workers

2022-05-04 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531821#comment-17531821 ] Robert Bradshaw commented on BEAM-14403: I don't think the release has been cut y

[jira] [Assigned] (BEAM-14403) Allow Prime to be used with Legacy workers

2022-05-03 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-14403: -- Assignee: Robert Bradshaw > Allow Prime to be used with Legacy workers > -

[jira] [Created] (BEAM-14403) Allow Prime to be used with Legacy workers

2022-05-03 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14403: -- Summary: Allow Prime to be used with Legacy workers Key: BEAM-14403 URL: https://issues.apache.org/jira/browse/BEAM-14403 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-14391) Allow arithmetic between dataframe-derived deferred scalars.

2022-05-02 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-14391: -- Assignee: Robert Bradshaw > Allow arithmetic between dataframe-derived deferred scalar

[jira] [Updated] (BEAM-14391) Allow arithmetic between dataframe-derived deferred scalars.

2022-05-02 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-14391: --- Fix Version/s: 2.39.0 Resolution: Fixed Status: Resolved (was: Triage Neede

[jira] [Created] (BEAM-14391) Allow arithmetic between dataframe-derived deferred scalars.

2022-05-02 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14391: -- Summary: Allow arithmetic between dataframe-derived deferred scalars. Key: BEAM-14391 URL: https://issues.apache.org/jira/browse/BEAM-14391 Project: Beam

[jira] [Commented] (BEAM-14351) Example 'JsonCoder' object has no attribute 'to_type_hint'

2022-04-21 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526062#comment-17526062 ] Robert Bradshaw commented on BEAM-14351: [https://github.com/apache/beam/pull/174

[jira] [Created] (BEAM-14291) DataflowPipelineResult does not raise exception for unsuccessful states.

2022-04-11 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14291: -- Summary: DataflowPipelineResult does not raise exception for unsuccessful states. Key: BEAM-14291 URL: https://issues.apache.org/jira/browse/BEAM-14291 Project: B

[jira] [Commented] (BEAM-14250) Coder registration doesn't work for types in main module.

2022-04-04 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517168#comment-17517168 ] Robert Bradshaw commented on BEAM-14250: A workaround is to define the types in a

[jira] [Created] (BEAM-14250) Coder registration doesn't work for types in main module.

2022-04-04 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14250: -- Summary: Coder registration doesn't work for types in main module. Key: BEAM-14250 URL: https://issues.apache.org/jira/browse/BEAM-14250 Project: Beam Is

[jira] [Commented] (BEAM-12658) Rust SDK

2022-03-30 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17514995#comment-17514995 ] Robert Bradshaw commented on BEAM-12658: core_test could be a good starting point

[jira] [Assigned] (BEAM-14199) Expose dataframes/pandas top-level functions.

2022-03-29 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-14199: -- Assignee: Brian Hulette > Expose dataframes/pandas top-level functions. >

[jira] [Created] (BEAM-14199) Expose dataframes/pandas top-level functions.

2022-03-29 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14199: -- Summary: Expose dataframes/pandas top-level functions. Key: BEAM-14199 URL: https://issues.apache.org/jira/browse/BEAM-14199 Project: Beam Issue Type: Bu

[jira] [Commented] (BEAM-14171) CoGroupByKey loses values with large groups on Dataflow v1

2022-03-24 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512140#comment-17512140 ] Robert Bradshaw commented on BEAM-14171: Yes, the PR is a fix (and a simple one a

[jira] [Updated] (BEAM-14131) Very poor code wrapping on Spark comparison page.

2022-03-18 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-14131: --- Description: There is copious whitespace to the left, while the sample code to the right is

[jira] [Created] (BEAM-14131) Very poor code wrapping on Spark comparison page.

2022-03-18 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14131: -- Summary: Very poor code wrapping on Spark comparison page. Key: BEAM-14131 URL: https://issues.apache.org/jira/browse/BEAM-14131 Project: Beam Issue Type

[jira] [Commented] (BEAM-3911) Do we want to encourage release pinning?

2022-03-15 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507008#comment-17507008 ] Robert Bradshaw commented on BEAM-3911: --- I'm not sure. Should have recorded the exac

[jira] [Created] (BEAM-14092) pyparsing dependency issues

2022-03-10 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14092: -- Summary: pyparsing dependency issues Key: BEAM-14092 URL: https://issues.apache.org/jira/browse/BEAM-14092 Project: Beam Issue Type: Bug Compon

[jira] [Commented] (BEAM-12658) Rust SDK

2022-03-07 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502495#comment-17502495 ] Robert Bradshaw commented on BEAM-12658: I would definitely advise looking at the

[jira] [Created] (BEAM-14038) Add the ability to easily start up Python expansion services.

2022-03-02 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-14038: -- Summary: Add the ability to easily start up Python expansion services. Key: BEAM-14038 URL: https://issues.apache.org/jira/browse/BEAM-14038 Project: Beam

[jira] [Created] (BEAM-13994) More friendly Filestore API

2022-02-23 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-13994: -- Summary: More friendly Filestore API Key: BEAM-13994 URL: https://issues.apache.org/jira/browse/BEAM-13994 Project: Beam Issue Type: Improvement

[jira] [Comment Edited] (BEAM-12552) GroupBy and GroupByKey doesn't group composite keys

2022-02-10 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17490480#comment-17490480 ] Robert Bradshaw edited comment on BEAM-12552 at 2/10/22, 8:02 PM: -

[jira] [Commented] (BEAM-12552) GroupBy and GroupByKey doesn't group composite keys

2022-02-10 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17490480#comment-17490480 ] Robert Bradshaw commented on BEAM-12552: More recent SDKs reject this with ``` V

[jira] [Assigned] (BEAM-12914) Trivial Type Inference Fails On Lambda Functions in Python 3.9

2022-02-04 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-12914: -- Assignee: Robert Bradshaw > Trivial Type Inference Fails On Lambda Functions in Python

[jira] [Created] (BEAM-13800) Allow user to select their own version of Avro when running portably.

2022-02-01 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-13800: -- Summary: Allow user to select their own version of Avro when running portably. Key: BEAM-13800 URL: https://issues.apache.org/jira/browse/BEAM-13800 Project: Beam

[jira] [Updated] (BEAM-13601) Failure in apache_beam.tools.microbenchmarks_test.MicrobenchmarksTest.test_coders_microbenchmark

2022-01-13 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-13601: --- Description: apache_beam.tools.microbenchmarks_test.MicrobenchmarksTest.test_coders_microbenc

[jira] [Updated] (BEAM-13601) Failure in apache_beam.tools.microbenchmarks_test.MicrobenchmarksTest.test_coders_microbenchmark

2022-01-13 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-13601: --- Description: apache_beam.tools.microbenchmarks_test.MicrobenchmarksTest.test_coders_microbenc

[jira] [Updated] (BEAM-13601) Failure in apache_beam.tools.microbenchmarks_test.MicrobenchmarksTest.test_coders_microbenchmark

2022-01-13 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-13601: --- Resolution: Fixed Status: Resolved (was: Open) > Failure in > apache_beam.tools.mic

[jira] [Updated] (BEAM-6404) FnAPI translation error

2022-01-12 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-6404: -- Resolution: Fixed Status: Resolved (was: Open) > FnAPI translation error >

[jira] [Commented] (BEAM-6404) FnAPI translation error

2022-01-12 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475034#comment-17475034 ] Robert Bradshaw commented on BEAM-6404: --- I just verified this is not an issue at HEA

[jira] [Reopened] (BEAM-13213) OnWindowExpiration does not work without other state

2022-01-11 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reopened BEAM-13213: Assignee: Emily Ye (was: Lara Schmidt) The fix has been merged into master, but re-opening

[jira] [Updated] (BEAM-13213) OnWindowExpiration does not work without other state

2022-01-11 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-13213: --- Priority: P0 (was: P2) > OnWindowExpiration does not work without other state >

[jira] [Created] (BEAM-13601) Failure in apache_beam.tools.microbenchmarks_test.MicrobenchmarksTest.test_coders_microbenchmark

2022-01-04 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-13601: -- Summary: Failure in apache_beam.tools.microbenchmarks_test.MicrobenchmarksTest.test_coders_microbenchmark Key: BEAM-13601 URL: https://issues.apache.org/jira/browse/BEAM-13601

[jira] [Updated] (BEAM-13541) Use runtime information to improve CoGroupByKey caching

2021-12-28 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-13541: --- Fix Version/s: 2.36.0 > Use runtime information to improve CoGroupByKey caching > ---

[jira] [Updated] (BEAM-13541) Use runtime information to improve CoGroupByKey caching

2021-12-28 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-13541: --- Priority: P0 (was: P2) > Use runtime information to improve CoGroupByKey caching > -

[jira] [Assigned] (BEAM-13541) Use runtime information to improve CoGroupByKey caching

2021-12-23 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-13541: -- Assignee: Robert Bradshaw > Use runtime information to improve CoGroupByKey caching >

[jira] [Created] (BEAM-13495) Provide a good error message when container versions are misaligned.

2021-12-20 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-13495: -- Summary: Provide a good error message when container versions are misaligned. Key: BEAM-13495 URL: https://issues.apache.org/jira/browse/BEAM-13495 Project: Beam

[jira] [Created] (BEAM-13482) Allow external Python transforms to be instantiated by fully qualified name.

2021-12-16 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-13482: -- Summary: Allow external Python transforms to be instantiated by fully qualified name. Key: BEAM-13482 URL: https://issues.apache.org/jira/browse/BEAM-13482 Projec

[jira] [Created] (BEAM-13454) Dataframe read_fwf fails reading incrementally.

2021-12-13 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-13454: -- Summary: Dataframe read_fwf fails reading incrementally. Key: BEAM-13454 URL: https://issues.apache.org/jira/browse/BEAM-13454 Project: Beam Issue Type:

[jira] [Commented] (BEAM-13231) Globbing asterisk cannot be escaped in file reads.

2021-11-12 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17442922#comment-17442922 ] Robert Bradshaw commented on BEAM-13231: There may be issues with other glob char

[jira] [Created] (BEAM-13231) Globbing asterisk cannot be escaped in file reads.

2021-11-11 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-13231: -- Summary: Globbing asterisk cannot be escaped in file reads. Key: BEAM-13231 URL: https://issues.apache.org/jira/browse/BEAM-13231 Project: Beam Issue Typ

[jira] [Created] (BEAM-13117) Remove legacy dataflow support for Python

2021-10-26 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-13117: -- Summary: Remove legacy dataflow support for Python Key: BEAM-13117 URL: https://issues.apache.org/jira/browse/BEAM-13117 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-13087) apache_beam.runners.portability.fn_api_runner.translations_test.TranslationsTest.test_run_packable_combine_globally 'apache_beam.coders.coder_impl._AbstractIterable' ob

2021-10-20 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17431453#comment-17431453 ] Robert Bradshaw commented on BEAM-13087: https://github.com/apache/beam/pull/1575

[jira] [Assigned] (BEAM-9818) Remove legacy staging protocol.

2021-10-15 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-9818: - Assignee: Heejong Lee (was: Robert Bradshaw) > Remove legacy staging protocol. > ---

[jira] [Created] (BEAM-13066) IterableCoder often returns a List

2021-10-15 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-13066: -- Summary: IterableCoder often returns a List Key: BEAM-13066 URL: https://issues.apache.org/jira/browse/BEAM-13066 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-13053) Avoid runner v2 when streaming engine explicitly disabled.

2021-10-14 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-13053: -- Summary: Avoid runner v2 when streaming engine explicitly disabled. Key: BEAM-13053 URL: https://issues.apache.org/jira/browse/BEAM-13053 Project: Beam I

[jira] [Created] (BEAM-12934) Python should length prefix coders according to the capabilities of the environment.

2021-09-22 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12934: -- Summary: Python should length prefix coders according to the capabilities of the environment. Key: BEAM-12934 URL: https://issues.apache.org/jira/browse/BEAM-12934

[jira] [Created] (BEAM-12933) Java runners should length prefix coders according to the capabilities of the environment.

2021-09-22 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12933: -- Summary: Java runners should length prefix coders according to the capabilities of the environment. Key: BEAM-12933 URL: https://issues.apache.org/jira/browse/BEAM-12933

[jira] [Created] (BEAM-12866) TestStream should only emit bytes

2021-09-09 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12866: -- Summary: TestStream should only emit bytes Key: BEAM-12866 URL: https://issues.apache.org/jira/browse/BEAM-12866 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-7246) Add Google Spanner IO on Python SDK

2021-09-09 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17412664#comment-17412664 ] Robert Bradshaw commented on BEAM-7246: --- apache_beam.io.gcp.experimental.spannerio_t

[jira] [Created] (BEAM-12854) Merge rather than override resource specs on substitution.

2021-09-07 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12854: -- Summary: Merge rather than override resource specs on substitution. Key: BEAM-12854 URL: https://issues.apache.org/jira/browse/BEAM-12854 Project: Beam I

[jira] [Created] (BEAM-12827) Let TestStream primitive always produce bytes.

2021-08-31 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12827: -- Summary: Let TestStream primitive always produce bytes. Key: BEAM-12827 URL: https://issues.apache.org/jira/browse/BEAM-12827 Project: Beam Issue Type: B

[jira] [Updated] (BEAM-12781) SDFBoundedSourceReader behaves much slower compared with the original behavior of BoundedSource

2021-08-24 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-12781: --- Fix Version/s: 2.33.0 > SDFBoundedSourceReader behaves much slower compared with the original

[jira] [Updated] (BEAM-12781) SDFBoundedSourceReader behaves much slower compared with the original behavior of BoundedSource

2021-08-24 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-12781: --- Priority: P1 (was: P2) > SDFBoundedSourceReader behaves much slower compared with the origin

[jira] [Updated] (BEAM-8897) JdbcIO.readRows issue when type is Numeric

2021-08-10 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-8897: -- Priority: P2 (was: P3) > JdbcIO.readRows issue when type is Numeric > -

[jira] [Updated] (BEAM-12646) Optimize global window grouping in Spark

2021-08-05 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-12646: --- Resolution: Duplicate Status: Resolved (was: Triage Needed) > Optimize global window

[jira] [Created] (BEAM-12646) Optimize global window grouping in Spark

2021-07-21 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12646: -- Summary: Optimize global window grouping in Spark Key: BEAM-12646 URL: https://issues.apache.org/jira/browse/BEAM-12646 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-12587) Python "object" row type rejects null values.

2021-07-08 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12587: -- Summary: Python "object" row type rejects null values. Key: BEAM-12587 URL: https://issues.apache.org/jira/browse/BEAM-12587 Project: Beam Issue Type: Bu

[jira] [Created] (BEAM-12475) When bundle processors are re-used, do not respond to splits for previous bundles.

2021-06-10 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12475: -- Summary: When bundle processors are re-used, do not respond to splits for previous bundles. Key: BEAM-12475 URL: https://issues.apache.org/jira/browse/BEAM-12475

[jira] [Created] (BEAM-12326) Resource hints not respected after transform substitution.

2021-05-11 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12326: -- Summary: Resource hints not respected after transform substitution. Key: BEAM-12326 URL: https://issues.apache.org/jira/browse/BEAM-12326 Project: Beam I

[jira] [Updated] (BEAM-12304) EmptyMatchTreatment.DISALLOW not respected in MatchFiles

2021-05-07 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-12304: --- Affects Version/s: 2.29.0 > EmptyMatchTreatment.DISALLOW not respected in MatchFiles > --

[jira] [Created] (BEAM-12304) EmptyMatchTreatment.DISALLOW not respected in MatchFiles

2021-05-06 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12304: -- Summary: EmptyMatchTreatment.DISALLOW not respected in MatchFiles Key: BEAM-12304 URL: https://issues.apache.org/jira/browse/BEAM-12304 Project: Beam Iss

[jira] [Updated] (BEAM-12204) Portable Java caches entirety of iterable side inputs.

2021-04-29 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-12204: --- Resolution: Fixed Status: Resolved (was: Open) > Portable Java caches entirety of it

[jira] [Created] (BEAM-12239) Squashed code snippets

2021-04-27 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12239: -- Summary: Squashed code snippets Key: BEAM-12239 URL: https://issues.apache.org/jira/browse/BEAM-12239 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-12238) StateBackedIterable is not Serializable

2021-04-27 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12238: -- Summary: StateBackedIterable is not Serializable Key: BEAM-12238 URL: https://issues.apache.org/jira/browse/BEAM-12238 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-12204) Portable Java caches entirety of iterable side inputs.

2021-04-21 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12204: -- Summary: Portable Java caches entirety of iterable side inputs. Key: BEAM-12204 URL: https://issues.apache.org/jira/browse/BEAM-12204 Project: Beam Issue

[jira] [Updated] (BEAM-12170) [beam_PostCommit_Java_PVR_Spark_Batch] Multiple entries with same key

2021-04-20 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-12170: --- Resolution: Fixed Status: Resolved (was: Triage Needed) > [beam_PostCommit_Java_PVR_

[jira] [Comment Edited] (BEAM-11929) DataframeTransfom, BatchRowsAsDataFrame do not preserve field order when schema created with beam.Row

2021-03-25 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309050#comment-17309050 ] Robert Bradshaw edited comment on BEAM-11929 at 3/25/21, 11:52 PM:

[jira] [Commented] (BEAM-11929) DataframeTransfom, BatchRowsAsDataFrame do not preserve field order when schema created with beam.Row

2021-03-25 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309050#comment-17309050 ] Robert Bradshaw commented on BEAM-11929: Per the recent thread on the dev list, t

[jira] [Updated] (BEAM-12043) Terminal external transforms broken on Dataflow

2021-03-23 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-12043: --- Resolution: Fixed Status: Resolved (was: Open) > Terminal external transforms broken

[jira] [Created] (BEAM-12043) Terminal external transforms broken on Dataflow

2021-03-23 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12043: -- Summary: Terminal external transforms broken on Dataflow Key: BEAM-12043 URL: https://issues.apache.org/jira/browse/BEAM-12043 Project: Beam Issue Type:

[jira] [Commented] (BEAM-10382) The Python SDK is not handling the sessions properly.

2021-03-15 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301926#comment-17301926 ] Robert Bradshaw commented on BEAM-10382: In Java IIRC we just prohibit the second

[jira] [Created] (BEAM-11949) Remove SDK-side dataflow runnerv2 blockers.

2021-03-09 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-11949: -- Summary: Remove SDK-side dataflow runnerv2 blockers. Key: BEAM-11949 URL: https://issues.apache.org/jira/browse/BEAM-11949 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-11882) Avoid returning bare lists for iterables in CombineFn.merge_accumulators

2021-02-26 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-11882: -- Summary: Avoid returning bare lists for iterables in CombineFn.merge_accumulators Key: BEAM-11882 URL: https://issues.apache.org/jira/browse/BEAM-11882 Project: B

[jira] [Created] (BEAM-11842) Add the ability to specify resource hints to the Beam environments

2021-02-19 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-11842: -- Summary: Add the ability to specify resource hints to the Beam environments Key: BEAM-11842 URL: https://issues.apache.org/jira/browse/BEAM-11842 Project: Beam

[jira] [Commented] (BEAM-11830) ValidateRunnerXlangTest tsts failing in beam_PostCommit_XVR_Dataflow

2021-02-18 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286768#comment-17286768 ] Robert Bradshaw commented on BEAM-11830: It would be surprising if the rollback l

[jira] [Commented] (BEAM-11797) Flaky interactive test in Precommit

2021-02-10 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282831#comment-17282831 ] Robert Bradshaw commented on BEAM-11797: self = mocked_display_javascript = moc

[jira] [Created] (BEAM-11797) Flaky interactive test in Precommit

2021-02-10 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-11797: -- Summary: Flaky interactive test in Precommit Key: BEAM-11797 URL: https://issues.apache.org/jira/browse/BEAM-11797 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-11429) User-friendly stage name for packed combiners

2021-02-10 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-11429: --- Resolution: Fixed Status: Resolved (was: Triage Needed) > User-friendly stage name f

[jira] [Assigned] (BEAM-11429) User-friendly stage name for packed combiners

2021-02-10 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-11429: -- Assignee: Robert Bradshaw > User-friendly stage name for packed combiners > --

[jira] [Reopened] (BEAM-11700) Optimizations skipped in PortableRunner when pre_optimize is 'default' or 'all'

2021-02-04 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reopened BEAM-11700: It appears that the "all" optimization (which is pretty important) is still not working. > Op

[jira] [Assigned] (BEAM-11700) Optimizations skipped in PortableRunner when pre_optimize is 'default' or 'all'

2021-02-04 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-11700: -- Assignee: Robert Bradshaw (was: Yifan Mai) > Optimizations skipped in PortableRunner

[jira] [Created] (BEAM-11723) PairWithVoid consolidation yields should have packed name.

2021-01-29 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-11723: -- Summary: PairWithVoid consolidation yields should have packed name. Key: BEAM-11723 URL: https://issues.apache.org/jira/browse/BEAM-11723 Project: Beam I

[jira] [Assigned] (BEAM-11719) Enforce deterministic coding for GroupByKey and Stateful DoFns

2021-01-29 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-11719: -- Assignee: Robert Bradshaw > Enforce deterministic coding for GroupByKey and Stateful D

[jira] [Created] (BEAM-11719) Enforce deterministic coding for GroupByKey and Stateful DoFns

2021-01-29 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-11719: -- Summary: Enforce deterministic coding for GroupByKey and Stateful DoFns Key: BEAM-11719 URL: https://issues.apache.org/jira/browse/BEAM-11719 Project: Beam

[jira] [Updated] (BEAM-11718) Actually run pre-optimize phases

2021-01-29 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-11718: --- Resolution: Fixed Status: Resolved (was: Triage Needed) > Actually run pre-optimize

[jira] [Updated] (BEAM-11716) Ensure combiner packing maintains internal CombinePerKeys structure

2021-01-29 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-11716: --- Resolution: Fixed Status: Resolved (was: Triage Needed) > Ensure combiner packing ma

[jira] [Created] (BEAM-11718) Actually run pre-optimize phases

2021-01-29 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-11718: -- Summary: Actually run pre-optimize phases Key: BEAM-11718 URL: https://issues.apache.org/jira/browse/BEAM-11718 Project: Beam Issue Type: Bug C

[jira] [Created] (BEAM-11717) Validate post-optimized pipeline proto.

2021-01-29 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-11717: -- Summary: Validate post-optimized pipeline proto. Key: BEAM-11717 URL: https://issues.apache.org/jira/browse/BEAM-11717 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-11716) Ensure combiner packing maintains internal CombinePerKeys structure

2021-01-29 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-11716: -- Summary: Ensure combiner packing maintains internal CombinePerKeys structure Key: BEAM-11716 URL: https://issues.apache.org/jira/browse/BEAM-11716 Project: Beam

[jira] [Updated] (BEAM-11355) pipeline_from_stages after sort_stages can return non-topologically ordered pipelines

2020-12-08 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-11355: --- Resolution: Fixed Status: Resolved (was: Open) > pipeline_from_stages after sort_sta

[jira] [Assigned] (BEAM-11361) Allow dynamic splitting of dataframe IOs.

2020-11-30 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-11361: -- Assignee: Robert Bradshaw > Allow dynamic splitting of dataframe IOs. > -

  1   2   3   4   5   >