[jira] [Commented] (BEAM-9046) Kafka connector for Python throws ClassCastException when reading KafkaRecord

2020-01-07 Thread Ankur Goenka (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010192#comment-17010192 ] Ankur Goenka commented on BEAM-9046: cc: [~mxm] [~chamikara] > Kafka connector for Py

[jira] [Work logged] (BEAM-8933) BigQuery IO should support read/write in Arrow format

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8933?focusedWorklogId=367877&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367877 ] ASF GitHub Bot logged work on BEAM-8933: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9041) SchemaCoder equals should not rely on from/toRowFunction equality

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9041?focusedWorklogId=367878&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367878 ] ASF GitHub Bot logged work on BEAM-9041: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9041) SchemaCoder equals should not rely on from/toRowFunction equality

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9041?focusedWorklogId=367879&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367879 ] ASF GitHub Bot logged work on BEAM-9041: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9041) SchemaCoder equals should not rely on from/toRowFunction equality

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9041?focusedWorklogId=367880&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367880 ] ASF GitHub Bot logged work on BEAM-9041: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-9041) SchemaCoder equals should not rely on from/toRowFunction equality

2020-01-07 Thread Jira
[ https://issues.apache.org/jira/browse/BEAM-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010205#comment-17010205 ] Ismaël Mejía commented on BEAM-9041: Yes, this is a regression I just opened a PR to c

[jira] [Updated] (BEAM-9042) AvroUtils.schemaCoder(schema) produces a not serializable SchemaCoder

2020-01-07 Thread Jira
[ https://issues.apache.org/jira/browse/BEAM-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-9042: --- Description: After some recent change in the implementation of AvroUtils.schemaCoder(schema) the prod

[jira] [Work logged] (BEAM-9041) SchemaCoder equals should not rely on from/toRowFunction equality

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9041?focusedWorklogId=367881&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367881 ] ASF GitHub Bot logged work on BEAM-9041: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-9013) Multi-output TestStream breaks the DataflowRunner

2020-01-07 Thread Jira
[ https://issues.apache.org/jira/browse/BEAM-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-9013: --- Fix Version/s: (was: 2.18.0) 2.19.0 > Multi-output TestStream breaks the Datafl

[jira] [Work logged] (BEAM-8717) Beam Dependency Update Request: org.apache.commons:commons-lang3

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8717?focusedWorklogId=367882&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367882 ] ASF GitHub Bot logged work on BEAM-8717: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8717) Beam Dependency Update Request: org.apache.commons:commons-lang3

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8717?focusedWorklogId=367885&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367885 ] ASF GitHub Bot logged work on BEAM-8717: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7427) JmsCheckpointMark Avro Serialization issue with UnboundedSource

2020-01-07 Thread Jira
[ https://issues.apache.org/jira/browse/BEAM-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7427: --- Summary: JmsCheckpointMark Avro Serialization issue with UnboundedSource (was: JmsCheckpointMark Avro

[jira] [Work logged] (BEAM-6857) Support dynamic timers

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6857?focusedWorklogId=367887&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367887 ] ASF GitHub Bot logged work on BEAM-6857: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8932) Expose complete Cloud Pub/Sub messages through PubsubIO API

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8932?focusedWorklogId=367889&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367889 ] ASF GitHub Bot logged work on BEAM-8932: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7243) Release python{36,37}-fnapi containers images required by Dataflow runner.

2020-01-07 Thread Ankur Goenka (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010217#comment-17010217 ] Ankur Goenka commented on BEAM-7243: The PR was committed and the latest container is

[jira] [Resolved] (BEAM-7243) Release python{36,37}-fnapi containers images required by Dataflow runner.

2020-01-07 Thread Ankur Goenka (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka resolved BEAM-7243. Fix Version/s: 2.16.0 Resolution: Fixed > Release python{36,37}-fnapi containers images requi

[jira] [Resolved] (BEAM-5156) Apache Beam on dataflow runner can't find Tensorflow for workers

2020-01-07 Thread Ankur Goenka (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka resolved BEAM-5156. Fix Version/s: (was: 2.6.0) (was: 2.5.0) 2.17.0

[jira] [Commented] (BEAM-5156) Apache Beam on dataflow runner can't find Tensorflow for workers

2020-01-07 Thread Ankur Goenka (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010220#comment-17010220 ] Ankur Goenka commented on BEAM-5156: We have moved to an unbounded thread factory and

[jira] [Updated] (BEAM-6499) Support HDFS for artifact staging with Flink Runner

2020-01-07 Thread Ankur Goenka (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-6499: --- Issue Type: New Feature (was: Bug) > Support HDFS for artifact staging with Flink Runner > --

[jira] [Commented] (BEAM-6499) Support HDFS for artifact staging with Flink Runner

2020-01-07 Thread Ankur Goenka (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010221#comment-17010221 ] Ankur Goenka commented on BEAM-6499: We have introduced uber jar mode of pipeline subm

[jira] [Updated] (BEAM-8945) DirectStreamObserver race condition

2020-01-07 Thread Ankur Goenka (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-8945: --- Description: The DirectStreamObserver can get into a dead lock if the channel become unhealthy of is

[jira] [Work logged] (BEAM-8458) BigQueryIO.Read needs permissions to create datasets to be able to run queries

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8458?focusedWorklogId=367895&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367895 ] ASF GitHub Bot logged work on BEAM-8458: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-8413) test_streaming_pipeline_returns_expected_user_metrics_fnapi_it failed on latest PostCommit Py36

2020-01-07 Thread Ankur Goenka (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010224#comment-17010224 ] Ankur Goenka commented on BEAM-8413: The latest runs are passing [https://builds.apac

[jira] [Work logged] (BEAM-8844) [SQL] Create performance tests for BigQueryTable

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8844?focusedWorklogId=367897&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367897 ] ASF GitHub Bot logged work on BEAM-8844: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8844) [SQL] Create performance tests for BigQueryTable

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8844?focusedWorklogId=367898&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367898 ] ASF GitHub Bot logged work on BEAM-8844: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8844) [SQL] Create performance tests for BigQueryTable

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8844?focusedWorklogId=367901&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367901 ] ASF GitHub Bot logged work on BEAM-8844: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8844) [SQL] Create performance tests for BigQueryTable

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8844?focusedWorklogId=367899&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367899 ] ASF GitHub Bot logged work on BEAM-8844: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8844) [SQL] Create performance tests for BigQueryTable

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8844?focusedWorklogId=367900&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367900 ] ASF GitHub Bot logged work on BEAM-8844: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8844) [SQL] Create performance tests for BigQueryTable

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8844?focusedWorklogId=367902&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367902 ] ASF GitHub Bot logged work on BEAM-8844: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8844) [SQL] Create performance tests for BigQueryTable

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8844?focusedWorklogId=367903&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367903 ] ASF GitHub Bot logged work on BEAM-8844: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9041) SchemaCoder equals should not rely on from/toRowFunction equality

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9041?focusedWorklogId=367904&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367904 ] ASF GitHub Bot logged work on BEAM-9041: Author: ASF GitHub Bot

[jira] [Closed] (BEAM-9062) Improve Beam's assert_that+equal_to error message to describe what elements cause assertion to fail

2020-01-07 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev closed BEAM-9062. - Fix Version/s: Not applicable Resolution: Fixed > Improve Beam's assert_that+equal_

[jira] [Closed] (BEAM-9061) New release of pyhamcrest==1.10.0 breaks portable Python precommits.

2020-01-07 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev closed BEAM-9061. - Fix Version/s: Not applicable Resolution: Fixed > New release of pyhamcrest==1.10.0

[jira] [Created] (BEAM-9064) Add pytype to lint checks

2020-01-07 Thread Udi Meiri (Jira)
Udi Meiri created BEAM-9064: --- Summary: Add pytype to lint checks Key: BEAM-9064 URL: https://issues.apache.org/jira/browse/BEAM-9064 Project: Beam Issue Type: Improvement Components: sdk-

[jira] [Updated] (BEAM-9064) Add pytype to lint checks

2020-01-07 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-9064: Status: Open (was: Triage Needed) > Add pytype to lint checks > - > >

[jira] [Commented] (BEAM-8968) portableWordCount test for Spark/Flink failing: jar not found

2020-01-07 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010251#comment-17010251 ] Valentyn Tymofieiev commented on BEAM-8968: --- Verified that the error is caused b

[jira] [Work logged] (BEAM-9064) Add pytype to lint checks

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9064?focusedWorklogId=367915&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367915 ] ASF GitHub Bot logged work on BEAM-9064: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-8968) portableWordCount test for Spark/Flink failing: jar not found

2020-01-07 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev reassigned BEAM-8968: - Assignee: Valentyn Tymofieiev (was: Kyle Weaver) > portableWordCount test for Sp

[jira] [Updated] (BEAM-8968) portableWordCount test for Spark/Flink failing: jar not found

2020-01-07 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev updated BEAM-8968: -- Description: This affects portableWordCountSparkRunnerBatch, portableWordCountFlinkRunn

[jira] [Work logged] (BEAM-8932) Expose complete Cloud Pub/Sub messages through PubsubIO API

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8932?focusedWorklogId=367917&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367917 ] ASF GitHub Bot logged work on BEAM-8932: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-9064) Add pytype to lint checks

2020-01-07 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010258#comment-17010258 ] Chad Dombrova commented on BEAM-9064: - I am _very_ reticent to implement this.  I have

[jira] [Work logged] (BEAM-8624) Implement FnService for status api in Dataflow runner

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8624?focusedWorklogId=367925&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367925 ] ASF GitHub Bot logged work on BEAM-8624: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8932) Expose complete Cloud Pub/Sub messages through PubsubIO API

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8932?focusedWorklogId=367935&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367935 ] ASF GitHub Bot logged work on BEAM-8932: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-9064) Add pytype to lint checks

2020-01-07 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010295#comment-17010295 ] Udi Meiri commented on BEAM-9064: - I understand that, but what do we do about the internal

[jira] [Work logged] (BEAM-8953) Extend ParquetIO.Read/ReadFiles.Builder to support Avro GenericData model

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8953?focusedWorklogId=367938&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367938 ] ASF GitHub Bot logged work on BEAM-8953: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8953) Extend ParquetIO.Read/ReadFiles.Builder to support Avro GenericData model

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8953?focusedWorklogId=367937&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367937 ] ASF GitHub Bot logged work on BEAM-8953: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8953) Extend ParquetIO.Read/ReadFiles.Builder to support Avro GenericData model

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8953?focusedWorklogId=367936&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367936 ] ASF GitHub Bot logged work on BEAM-8953: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-9064) Add pytype to lint checks

2020-01-07 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010307#comment-17010307 ] Chad Dombrova commented on BEAM-9064: - Thoughts (which I will repeat in the mailing li

[jira] [Work logged] (BEAM-8953) Extend ParquetIO.Read/ReadFiles.Builder to support Avro GenericData model

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8953?focusedWorklogId=367948&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367948 ] ASF GitHub Bot logged work on BEAM-8953: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8932) Expose complete Cloud Pub/Sub messages through PubsubIO API

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8932?focusedWorklogId=367949&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367949 ] ASF GitHub Bot logged work on BEAM-8932: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-9030) Bump grpc to 1.26.0

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9030?focusedWorklogId=367959&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367959 ] ASF GitHub Bot logged work on BEAM-9030: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8932) Expose complete Cloud Pub/Sub messages through PubsubIO API

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8932?focusedWorklogId=367961&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367961 ] ASF GitHub Bot logged work on BEAM-8932: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6857) Support dynamic timers

2020-01-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6857?focusedWorklogId=367966&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-367966 ] ASF GitHub Bot logged work on BEAM-6857: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-4409) NoSuchMethodException reading from JmsIO

2020-01-07 Thread Neil Kolban (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010378#comment-17010378 ] Neil Kolban commented on BEAM-4409: --- What is the status of this issue?  I see its been o

<    1   2   3