[jira] [Created] (BEAM-12477) pipeline.run() blocks when using FlinkRunner

2021-06-10 Thread Stefan Wachter (Jira)
Stefan Wachter created BEAM-12477: - Summary: pipeline.run() blocks when using FlinkRunner Key: BEAM-12477 URL: https://issues.apache.org/jira/browse/BEAM-12477 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-10655) Cannot write "google.protobuf.Timestamp" (NanosInstant) to BigQuery through schemas

2021-06-10 Thread Yueyao Zhu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361453#comment-17361453 ] Yueyao Zhu commented on BEAM-10655: --- Any update? We ran into the same issue (`Exception

[jira] [Updated] (BEAM-12459) Watch does not properly advance the watermark by default

2021-06-10 Thread Luke Cwik (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-12459: - Fix Version/s: (was: 2.31.0) 2.32.0 > Watch does not properly advance the watermar

[jira] [Updated] (BEAM-12459) Watch does not properly advance the watermark by default

2021-06-10 Thread Luke Cwik (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-12459: - Fix Version/s: 2.31.0 Resolution: Fixed Status: Resolved (was: Open) > Watch does not

[jira] [Commented] (BEAM-12467) java.io.InvalidClassException With Flink Kafka

2021-06-10 Thread Ravikiran Borse (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361321#comment-17361321 ] Ravikiran Borse commented on BEAM-12467: [~chamikara] [~kenn] I've changed the V

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-06-10 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361316#comment-17361316 ] Evan Galpin commented on BEAM-5172: --- @Andrew I have a PR open[1] which attempts to allev

[jira] [Updated] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-06-10 Thread Andrew Pilloud (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Pilloud updated BEAM-5172: - Affects Version/s: 2.31.0 > org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky > --

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-06-10 Thread Andrew Pilloud (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361314#comment-17361314 ] Andrew Pilloud commented on BEAM-5172: -- This is pretty aggressively affecting the 2.3

[jira] [Assigned] (BEAM-8880) Integrate PubsubAvroTable into Data Catalog

2021-06-10 Thread Robin Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robin Qiu reassigned BEAM-8880: --- Assignee: (was: Robin Qiu) > Integrate PubsubAvroTable into Data Catalog > --

[jira] [Created] (BEAM-12476) DataFrame API: Fully implement sample

2021-06-10 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-12476: Summary: DataFrame API: Fully implement sample Key: BEAM-12476 URL: https://issues.apache.org/jira/browse/BEAM-12476 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-12476) DataFrame API: Fully implement sample

2021-06-10 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-12476: - Status: Open (was: Triage Needed) > DataFrame API: Fully implement sample >

[jira] [Work logged] (BEAM-11359) Clean up temporary dataset after ReadAllFromBQ executes

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11359?focusedWorklogId=609992&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609992 ] ASF GitHub Bot logged work on BEAM-11359: - Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609989&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609989 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609988&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609988 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-12169) DataFrame API: Allow non-deferred column operations on categorical columns

2021-06-10 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361295#comment-17361295 ] Brian Hulette commented on BEAM-12169: -- Are there dtypes other than categorical and

[jira] [Updated] (BEAM-12169) DataFrame API: Allow non-deferred column operations on categorical columns

2021-06-10 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-12169: - Description: There are several operations that we currently disallow because they produce a vari

[jira] [Updated] (BEAM-12169) DataFrame API: Allow non-deferred column operations on categorical columns

2021-06-10 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-12169: - Description: There are several operations that we currently disallow because they produce a vari

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609987&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609987 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609986&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609986 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-12475) When bundle processors are re-used, do not respond to splits for previous bundles.

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12475?focusedWorklogId=609984&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609984 ] ASF GitHub Bot logged work on BEAM-12475: - Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-12459) Watch does not properly advance the watermark by default

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12459?focusedWorklogId=609982&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609982 ] ASF GitHub Bot logged work on BEAM-12459: - Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-12475) When bundle processors are re-used, do not respond to splits for previous bundles.

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12475?focusedWorklogId=609983&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609983 ] ASF GitHub Bot logged work on BEAM-12475: - Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609980&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609980 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609979&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609979 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-12169) DataFrame API: Allow non-deferred column operations on categorical columns

2021-06-10 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-12169: - Description: There are several operations that we currently disallow because they produce a vari

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609978&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609978 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609977&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609977 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609976&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609976 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609974&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609974 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609975&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609975 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609973&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609973 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609972&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609972 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609971&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609971 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609970&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609970 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609969&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609969 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609968&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609968 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609967&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609967 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8933) BigQuery IO should support reading Arrow format over Storage API

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8933?focusedWorklogId=609966&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609966 ] ASF GitHub Bot logged work on BEAM-8933: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609964&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609964 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609963&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609963 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8933) BigQuery IO should support reading Arrow format over Storage API

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8933?focusedWorklogId=609961&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609961 ] ASF GitHub Bot logged work on BEAM-8933: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609960&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609960 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8933) BigQuery IO should support reading Arrow format over Storage API

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8933?focusedWorklogId=609959&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609959 ] ASF GitHub Bot logged work on BEAM-8933: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609956&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609956 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8376) Add FirestoreIO connector to Java SDK

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8376?focusedWorklogId=609953&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609953 ] ASF GitHub Bot logged work on BEAM-8376: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9379) Upgrade to Calcite 1.26.0

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9379?focusedWorklogId=609952&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609952 ] ASF GitHub Bot logged work on BEAM-9379: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609951&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609951 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8933) BigQuery IO should support reading Arrow format over Storage API

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8933?focusedWorklogId=609947&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609947 ] ASF GitHub Bot logged work on BEAM-8933: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8933) BigQuery IO should support reading Arrow format over Storage API

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8933?focusedWorklogId=609945&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609945 ] ASF GitHub Bot logged work on BEAM-8933: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-12272) Python - Backport FirestoreIO connector's ramp-up to DatastoreIO connector

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12272?focusedWorklogId=609946&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609946 ] ASF GitHub Bot logged work on BEAM-12272: - Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8933) BigQuery IO should support reading Arrow format over Storage API

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8933?focusedWorklogId=609941&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609941 ] ASF GitHub Bot logged work on BEAM-8933: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-2492) Have PipelineOptions DisplayData filter out attributes marked with @org.apache.beam.sdk.options.Hidden

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2492?focusedWorklogId=609943&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609943 ] ASF GitHub Bot logged work on BEAM-2492: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-2492) Have PipelineOptions DisplayData filter out attributes marked with @org.apache.beam.sdk.options.Hidden

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2492?focusedWorklogId=609942&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609942 ] ASF GitHub Bot logged work on BEAM-2492: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609940&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609940 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4767) Java should update dataflow.container_version automatically for each release

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4767?focusedWorklogId=609939&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609939 ] ASF GitHub Bot logged work on BEAM-4767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-11359) Clean up temporary dataset after ReadAllFromBQ executes

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11359?focusedWorklogId=609936&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609936 ] ASF GitHub Bot logged work on BEAM-11359: - Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609934&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609934 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-12459) Watch does not properly advance the watermark by default

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12459?focusedWorklogId=609935&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609935 ] ASF GitHub Bot logged work on BEAM-12459: - Author: ASF GitHub Bot

[jira] [Created] (BEAM-12475) When bundle processors are re-used, do not respond to splits for previous bundles.

2021-06-10 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-12475: -- Summary: When bundle processors are re-used, do not respond to splits for previous bundles. Key: BEAM-12475 URL: https://issues.apache.org/jira/browse/BEAM-12475

[jira] [Updated] (BEAM-12475) When bundle processors are re-used, do not respond to splits for previous bundles.

2021-06-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-12475: --- Status: Open (was: Triage Needed) > When bundle processors are re-used, do not respond to sp

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609927&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609927 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8376) Add FirestoreIO connector to Java SDK

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8376?focusedWorklogId=609922&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609922 ] ASF GitHub Bot logged work on BEAM-8376: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-11514) Passing a PCollection without a schema to to_dataframe produces a non-obvious error

2021-06-10 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-11514: - Priority: P2 (was: P3) > Passing a PCollection without a schema to to_dataframe produces a non-o

[jira] [Assigned] (BEAM-11514) Passing a PCollection without a schema to to_dataframe produces a non-obvious error

2021-06-10 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reassigned BEAM-11514: Assignee: Brian Hulette > Passing a PCollection without a schema to to_dataframe produces

[jira] [Updated] (BEAM-11514) Passing a PCollection without a schema to to_dataframe produces a non-obvious error

2021-06-10 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-11514: - Fix Version/s: 2.32.0 > Passing a PCollection without a schema to to_dataframe produces a non-obv

[jira] [Work started] (BEAM-12444) GroupBy.apply on a series grouped by a callable fails

2021-06-10 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-12444 started by Brian Hulette. > GroupBy.apply on a series grouped by a callable fails > --

[jira] [Updated] (BEAM-12444) GroupBy.apply on a series grouped by a callable fails

2021-06-10 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-12444: - Affects Version/s: 2.31.0 > GroupBy.apply on a series grouped by a callable fails > -

[jira] [Work logged] (BEAM-9547) Implement all pandas operations (or raise WontImplementError)

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9547?focusedWorklogId=609916&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609916 ] ASF GitHub Bot logged work on BEAM-9547: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-8101) Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink

2021-06-10 Thread Andrew Pilloud (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361207#comment-17361207 ] Andrew Pilloud commented on BEAM-8101: -- This has flaked on spark in the 2.31 release

[jira] [Updated] (BEAM-8101) Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink

2021-06-10 Thread Andrew Pilloud (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Pilloud updated BEAM-8101: - Affects Version/s: 2.31.0 > Flakes in > ParDoLifecycleTest.testTeardownCalledAfterExceptionInStar

[jira] [Work logged] (BEAM-12442) RenameFields disregards renames in nested fields with DataflowRunner

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12442?focusedWorklogId=609905&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609905 ] ASF GitHub Bot logged work on BEAM-12442: - Author: ASF GitHub Bot

[jira] [Commented] (BEAM-8316) What is corresponding data type to set in UDF parameter to match RecordType

2021-06-10 Thread Jira
[ https://issues.apache.org/jira/browse/BEAM-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361197#comment-17361197 ] Jan Lukavský commented on BEAM-8316: This exception arises when applying UDAF on a str

[jira] [Work logged] (BEAM-12442) RenameFields disregards renames in nested fields with DataflowRunner

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12442?focusedWorklogId=609904&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609904 ] ASF GitHub Bot logged work on BEAM-12442: - Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8137) Worker pool option for Java SDK container

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8137?focusedWorklogId=609903&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609903 ] ASF GitHub Bot logged work on BEAM-8137: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-8316) What is corresponding data type to set in UDF parameter to match RecordType

2021-06-10 Thread Jira
[ https://issues.apache.org/jira/browse/BEAM-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jan Lukavský reassigned BEAM-8316: -- Assignee: (was: Jan Lukavský) > What is corresponding data type to set in UDF parameter to

[jira] [Work logged] (BEAM-8376) Add FirestoreIO connector to Java SDK

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8376?focusedWorklogId=609899&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609899 ] ASF GitHub Bot logged work on BEAM-8376: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-11359) Clean up temporary dataset after ReadAllFromBQ executes

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11359?focusedWorklogId=609900&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609900 ] ASF GitHub Bot logged work on BEAM-11359: - Author: ASF GitHub Bot

[jira] [Updated] (BEAM-10529) Kafka XLang fails for ?empty? key/values

2021-06-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-10529: - Priority: P1 (was: P2) > Kafka XLang fails for ?empty? key/value

[jira] [Work logged] (BEAM-12297) PubsubIO support for reading protos from schema

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12297?focusedWorklogId=609898&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609898 ] ASF GitHub Bot logged work on BEAM-12297: - Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-12297) PubsubIO support for reading protos from schema

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12297?focusedWorklogId=609897&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609897 ] ASF GitHub Bot logged work on BEAM-12297: - Author: ASF GitHub Bot

[jira] [Updated] (BEAM-12076) Update Python cross-language Kafka source to read metadata

2021-06-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-12076: - Priority: P1 (was: P2) > Update Python cross-language Kafka sour

[jira] [Work logged] (BEAM-12297) PubsubIO support for reading protos from schema

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12297?focusedWorklogId=609890&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609890 ] ASF GitHub Bot logged work on BEAM-12297: - Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8376) Add FirestoreIO connector to Java SDK

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8376?focusedWorklogId=609886&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609886 ] ASF GitHub Bot logged work on BEAM-8376: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8376) Add FirestoreIO connector to Java SDK

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8376?focusedWorklogId=609885&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609885 ] ASF GitHub Bot logged work on BEAM-8376: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-8316) What is corresponding data type to set in UDF parameter to match RecordType

2021-06-10 Thread Jira
[ https://issues.apache.org/jira/browse/BEAM-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jan Lukavský reassigned BEAM-8316: -- Assignee: Jan Lukavský > What is corresponding data type to set in UDF parameter to match Recor

[jira] [Assigned] (BEAM-12076) Update Python cross-language Kafka source to read metadata

2021-06-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-12076: Assignee: Chamikara Madhusanka Jayalath > Update Python cr

[jira] [Commented] (BEAM-12076) Update Python cross-language Kafka source to read metadata

2021-06-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361181#comment-17361181 ] Chamikara Madhusanka Jayalath commented on BEAM-12076: -- Thanks for t

[jira] [Commented] (BEAM-12467) java.io.InvalidClassException With Flink Kafka

2021-06-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361178#comment-17361178 ] Chamikara Madhusanka Jayalath commented on BEAM-12467: -- Is it possib

[jira] [Work logged] (BEAM-11985) Python Bigtable - Implement IO Request Count metrics

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11985?focusedWorklogId=609870&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609870 ] ASF GitHub Bot logged work on BEAM-11985: - Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-12464) Change ProtoSchemaTranslator beam schema creation to match the order for protobufs containing Oneof fields

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12464?focusedWorklogId=609869&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609869 ] ASF GitHub Bot logged work on BEAM-12464: - Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-12459) Watch does not properly advance the watermark by default

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12459?focusedWorklogId=609866&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609866 ] ASF GitHub Bot logged work on BEAM-12459: - Author: ASF GitHub Bot

[jira] [Commented] (BEAM-12467) java.io.InvalidClassException With Flink Kafka

2021-06-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361143#comment-17361143 ] Kenneth Knowles commented on BEAM-12467: Ping [~chamikara] and [~heejong] who may

[jira] [Updated] (BEAM-12467) java.io.InvalidClassException With Flink Kafka

2021-06-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-12467: --- Affects Version/s: (was: 2.29.0) > java.io.InvalidClassException With Flink Kafka > -

[jira] [Updated] (BEAM-12467) java.io.InvalidClassException With Flink Kafka

2021-06-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-12467: --- Component/s: (was: io-java-kafka) io-py-kafka > java.io.InvalidClassExce

[jira] [Updated] (BEAM-12467) java.io.InvalidClassException With Flink Kafka

2021-06-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-12467: --- Fix Version/s: (was: 2.30.0) (was: 2.29.0) > java.io.InvalidClassE

[jira] [Updated] (BEAM-12467) java.io.InvalidClassException With Flink Kafka

2021-06-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-12467: --- Status: Open (was: Triage Needed) > java.io.InvalidClassException With Flink Kafka > ---

[jira] [Updated] (BEAM-12467) java.io.InvalidClassException With Flink Kafka

2021-06-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-12467: --- Component/s: (was: beam-community) io-java-kafka > java.io.InvalidClassE

[jira] [Updated] (BEAM-12467) java.io.InvalidClassException With Flink Kafka

2021-06-10 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-12467: --- Priority: P1 (was: P0) > java.io.InvalidClassException With Flink Kafka > --

[jira] [Commented] (BEAM-11037) Python DirectRunner InputStream Issues (RuntimeError: VarLong too long)

2021-06-10 Thread Martin Funkquist (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361134#comment-17361134 ] Martin Funkquist commented on BEAM-11037: - I also have this problem. Specs are: 

[jira] [Work logged] (BEAM-11960) Bump bigdataoss to avoid dependency conflict

2021-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11960?focusedWorklogId=609847&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-609847 ] ASF GitHub Bot logged work on BEAM-11960: - Author: ASF GitHub Bot

  1   2   >