[jira] [Updated] (BEAM-10848) Gauge metrics error when setting timers

2020-11-13 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-10848: Status: Resolved (was: Resolved) > Gauge metrics error when setting timers > -

[jira] [Updated] (BEAM-10848) Gauge metrics error when setting timers

2020-11-13 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-10848: Fix Version/s: 2.26.0 > Gauge metrics error when setting timers > -

[jira] [Assigned] (BEAM-10848) Gauge metrics error when setting timers

2020-11-13 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-10848: --- Assignee: maghamravikiran > Gauge metrics error when setting timers > --

[jira] [Updated] (BEAM-10848) Gauge metrics error when setting timers

2020-11-13 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-10848: Status: Resolved (was: Open) > Gauge metrics error when setting timers > -

[jira] [Updated] (BEAM-10089) Apex Runner tests failing [Java 11]

2020-08-19 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-10089: Fix Version/s: (was: 2.23.0) > Apex Runner tests failing [Java 11] > --

[jira] [Updated] (BEAM-2285) In WC Walkthrough: Document how logging works on Apache Apex

2020-08-19 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-2285: --- Fix Version/s: (was: 2.23.0) > In WC Walkthrough: Document how logging works on Apache Apex >

[jira] [Updated] (BEAM-838) Support parallelism in Apex runner

2020-08-19 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-838: -- Fix Version/s: (was: 2.23.0) > Support parallelism in Apex runner > -

[jira] [Updated] (BEAM-1114) Support for new Timer API in Apex runner

2020-08-19 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-1114: --- Fix Version/s: (was: 2.23.0) > Support for new Timer API in Apex runner >

[jira] [Updated] (BEAM-10760) Cleanup timers lead to unbounded state accumulation in global window

2020-08-19 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-10760: Description: For each key, the runner sets a cleanup timer that is designed to garbage collect sta

[jira] [Created] (BEAM-10760) Cleanup timers lead to unbounded state accumulation in global window

2020-08-19 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-10760: --- Summary: Cleanup timers lead to unbounded state accumulation in global window Key: BEAM-10760 URL: https://issues.apache.org/jira/browse/BEAM-10760 Project: Beam

[jira] [Updated] (BEAM-1888) Support Splittable DoFn in Apex Runner

2020-08-18 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-1888: --- Status: Resolved (was: Open) > Support Splittable DoFn in Apex Runner > -

[jira] [Commented] (BEAM-10385) Integrate SQL expansion into Flink job server

2020-07-07 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153147#comment-17153147 ] Thomas Weise commented on BEAM-10385: - Yes, I think we should backport this. CC: [~tv

[jira] [Comment Edited] (BEAM-5640) Portable python sdk worker leaks memory when PyOpenSSL package is present

2020-06-16 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17137917#comment-17137917 ] Thomas Weise edited comment on BEAM-5640 at 6/16/20, 8:46 PM: --

[jira] [Closed] (BEAM-5640) Portable python sdk worker leaks memory when PyOpenSSL package is present

2020-06-16 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-5640. -- Fix Version/s: Not applicable Resolution: Won't Fix No longer an issue after moving to py3. > Po

[jira] [Closed] (BEAM-4784) Python SDK harness container build fails

2020-06-16 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-4784. -- Fix Version/s: Not applicable Resolution: Cannot Reproduce > Python SDK harness container build f

[jira] [Closed] (BEAM-4847) Java PreCommit is flaky: Expiring Daemon because JVM Tenured space is exhausted

2020-06-16 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-4847. -- Fix Version/s: Not applicable Resolution: Done > Java PreCommit is flaky: Expiring Daemon because

[jira] [Assigned] (BEAM-2324) Apex Unittest Failed Locally if Directory Contains Space

2020-06-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-2324: -- Assignee: (was: Thomas Weise) > Apex Unittest Failed Locally if Directory Contains Space >

[jira] [Closed] (BEAM-2324) Apex Unittest Failed Locally if Directory Contains Space

2020-06-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-2324. -- Fix Version/s: Not applicable Resolution: Won't Fix > Apex Unittest Failed Locally if Directory C

[jira] [Closed] (BEAM-2323) Apex Unittest ApexYarnLauncherTest Failed on Jenkins If Directory Contains Space

2020-06-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-2323. -- Fix Version/s: Not applicable Resolution: Won't Fix > Apex Unittest ApexYarnLauncherTest Failed o

[jira] [Closed] (BEAM-783) Revisit View.AsSingleton custom transform in Apex runner

2020-06-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-783. - Fix Version/s: Not applicable Resolution: Won't Fix > Revisit View.AsSingleton custom transform in A

[jira] [Assigned] (BEAM-2323) Apex Unittest ApexYarnLauncherTest Failed on Jenkins If Directory Contains Space

2020-06-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-2323: -- Assignee: (was: Thomas Weise) > Apex Unittest ApexYarnLauncherTest Failed on Jenkins If Dir

[jira] [Assigned] (BEAM-3269) Occasional ClassCastException in ParDoTranslatorTest.testAssertionFailure

2020-06-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-3269: -- Assignee: (was: Thomas Weise) > Occasional ClassCastException in ParDoTranslatorTest.testAs

[jira] [Assigned] (BEAM-868) Support set/delete of timers by ID in Apex runner

2020-06-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-868: - Assignee: (was: Thomas Weise) > Support set/delete of timers by ID in Apex runner > --

[jira] [Assigned] (BEAM-783) Revisit View.AsSingleton custom transform in Apex runner

2020-06-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-783: - Assignee: (was: Thomas Weise) > Revisit View.AsSingleton custom transform in Apex runner > ---

[jira] [Assigned] (BEAM-3241) Apex runner does not respect ParDo's lifecycle on case of exceptions

2020-06-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-3241: -- Assignee: (was: Thomas Weise) > Apex runner does not respect ParDo's lifecycle on case of e

[jira] [Closed] (BEAM-7868) Hidden Flink Runner parameters are dropped in python pipelines

2020-06-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-7868. -- Fix Version/s: 2.19.0 Assignee: Ankur Goenka Resolution: Fixed > Hidden Flink Runner par

[jira] [Assigned] (BEAM-2266) WordCount on ApexRunner writes one word count per file

2020-06-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-2266: -- Assignee: (was: Thomas Weise) > WordCount on ApexRunner writes one word count per file > --

[jira] [Assigned] (BEAM-1140) Apex ParDoBoundTranslatorTest.testMultiOutputParDoWithSideInputs is flaky

2020-06-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-1140: -- Assignee: (was: Thomas Weise) > Apex ParDoBoundTranslatorTest.testMultiOutputParDoWithSideI

[jira] [Commented] (BEAM-9999) Remove support for EOLed runners (Apex, etc.)

2020-05-14 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17107792#comment-17107792 ] Thomas Weise commented on BEAM-: Apache Apex itself has moved to attic and there a

[jira] [Commented] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-25 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092348#comment-17092348 ] Thomas Weise commented on BEAM-9811: Last build was successful:  [https://builds.apach

[jira] [Resolved] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-25 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-9811. Fix Version/s: Not applicable Resolution: Fixed > beam_Release_NightlySnapshot failing due to

[jira] [Closed] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-25 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-9811. -- > beam_Release_NightlySnapshot failing due to "Failed to publish publication > 'mavenJava'" > -

[jira] [Commented] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091792#comment-17091792 ] Thomas Weise commented on BEAM-9811: Due to the dynamic construction of publish tasks

[jira] [Comment Edited] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091605#comment-17091605 ] Thomas Weise edited comment on BEAM-9811 at 4/24/20, 2:07 PM: --

[jira] [Commented] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091605#comment-17091605 ] Thomas Weise commented on BEAM-9811: Build still fails with this change, I will take a

[jira] [Comment Edited] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-23 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090948#comment-17090948 ] Thomas Weise edited comment on BEAM-9811 at 4/23/20, 9:36 PM: --

[jira] [Commented] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-23 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090948#comment-17090948 ] Thomas Weise commented on BEAM-9811: ./gradlew :sdks:java:bom:publishMavenJavaPublica

[jira] [Commented] (BEAM-9811) beam_Release_NightlySnapshot failing due to "Failed to publish publication 'mavenJava'"

2020-04-23 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090934#comment-17090934 ] Thomas Weise commented on BEAM-9811: First failing build:  [https://builds.apache.org/

[jira] [Resolved] (BEAM-9474) Environment cleanup is not robust enough and may leak resources

2020-03-11 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-9474. Fix Version/s: 2.21.0 Resolution: Fixed > Environment cleanup is not robust enough and may le

[jira] [Commented] (BEAM-9298) Drop support for Flink 1.7

2020-02-11 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17034809#comment-17034809 ] Thomas Weise commented on BEAM-9298: [~iemejia] yes, this should be on the mailing lis

[jira] [Resolved] (BEAM-9060) Flink suppresses stdout/stderr during JobGraph generation from JAR

2020-01-08 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-9060. Fix Version/s: 2.19.0 Resolution: Fixed > Flink suppresses stdout/stderr during JobGraph gene

[jira] [Resolved] (BEAM-8962) FlinkMetricContainer causes churn in the JobManager and lets the web frontend malfunction

2019-12-27 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-8962. Resolution: Fixed > FlinkMetricContainer causes churn in the JobManager and lets the web frontend >

[jira] [Resolved] (BEAM-8816) Load balance bundle processing w/ multiple SDK workers

2019-12-16 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-8816. Fix Version/s: 2.19.0 Resolution: Fixed > Load balance bundle processing w/ multiple SDK work

[jira] [Commented] (BEAM-8959) Boolean pipeline options which default to true cannot be set to false

2019-12-12 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16994909#comment-16994909 ] Thomas Weise commented on BEAM-8959: [https://stackoverflow.com/questions/15008758/par

[jira] [Resolved] (BEAM-8815) Portable pipeline execution without artifact staging

2019-12-03 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-8815. Resolution: Fixed > Portable pipeline execution without artifact staging > -

[jira] [Commented] (BEAM-8815) Portable pipeline execution without artifact staging

2019-11-26 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982811#comment-16982811 ] Thomas Weise commented on BEAM-8815: [~Ardagan] I'm marking this ticket for 2.17 just

[jira] [Updated] (BEAM-8815) Portable pipeline execution without artifact staging

2019-11-26 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8815: --- Fix Version/s: 2.17.0 > Portable pipeline execution without artifact staging > ---

[jira] [Assigned] (BEAM-8815) Portable pipeline execution without artifact staging

2019-11-23 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-8815: -- Assignee: Thomas Weise > Portable pipeline execution without artifact staging > ---

[jira] [Updated] (BEAM-8816) Load balance bundle processing w/ multiple SDK workers

2019-11-23 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8816: --- Description: We found skewed utilization of SDK workers causing excessive latency with Streaming/Pyth

[jira] [Created] (BEAM-8816) Load balance bundle processing w/ multiple SDK workers

2019-11-23 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8816: -- Summary: Load balance bundle processing w/ multiple SDK workers Key: BEAM-8816 URL: https://issues.apache.org/jira/browse/BEAM-8816 Project: Beam Issue Type: Imp

[jira] [Created] (BEAM-8815) Portable pipeline execution without artifact staging

2019-11-23 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8815: -- Summary: Portable pipeline execution without artifact staging Key: BEAM-8815 URL: https://issues.apache.org/jira/browse/BEAM-8815 Project: Beam Issue Type: Task

[jira] [Updated] (BEAM-8471) Flink native job submission for portable pipelines

2019-11-18 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8471: --- Fix Version/s: (was: 2.18.0) 2.17.0 > Flink native job submission for portable

[jira] [Closed] (BEAM-8670) Manage environment parallelism in DefaultJobBundleFactory

2019-11-15 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-8670. -- Fix Version/s: 2.18.0 Resolution: Fixed > Manage environment parallelism in DefaultJobBundleFacto

[jira] [Created] (BEAM-8670) Manage environment parallelism in DefaultJobBundleFactory

2019-11-14 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8670: -- Summary: Manage environment parallelism in DefaultJobBundleFactory Key: BEAM-8670 URL: https://issues.apache.org/jira/browse/BEAM-8670 Project: Beam Issue Type:

[jira] [Updated] (BEAM-8656) flink_master_url usage in flink_runner.py

2019-11-13 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8656: --- Issue Type: Bug (was: Improvement) > flink_master_url usage in flink_runner.py >

[jira] [Commented] (BEAM-8656) flink_master_url usage in flink_runner.py

2019-11-13 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973934#comment-16973934 ] Thomas Weise commented on BEAM-8656: +1 for updating the website, there are several mo

[jira] [Commented] (BEAM-8591) Exception is thrown while running Beam Pipeline on Kubernetes Flink Cluster.

2019-11-12 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972922#comment-16972922 ] Thomas Weise commented on BEAM-8591: Please see the following email thread and linked

[jira] [Commented] (BEAM-5187) Create a ProcessJobBundleFactory for non-dockerized SDK harness

2019-11-12 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972715#comment-16972715 ] Thomas Weise commented on BEAM-5187: The process environment factory that is part of B

[jira] [Comment Edited] (BEAM-7870) Externally configured KafkaIO / PubsubIO consumer causes coder problems

2019-11-03 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966364#comment-16966364 ] Thomas Weise edited comment on BEAM-7870 at 11/4/19 2:25 AM: -

[jira] [Commented] (BEAM-7870) Externally configured KafkaIO / PubsubIO consumer causes coder problems

2019-11-03 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966364#comment-16966364 ] Thomas Weise commented on BEAM-7870: Thanks for the update. I would also prefer the sp

[jira] [Commented] (BEAM-8243) Document behavior of FlinkRunner

2019-11-01 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965163#comment-16965163 ] Thomas Weise commented on BEAM-8243: I meant older Beam releases, we should probably o

[jira] [Commented] (BEAM-8243) Document behavior of FlinkRunner

2019-11-01 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965112#comment-16965112 ] Thomas Weise commented on BEAM-8243: There are IMO enough other reasons to not keep in

[jira] [Commented] (BEAM-8243) Document behavior of FlinkRunner

2019-10-31 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964541#comment-16964541 ] Thomas Weise commented on BEAM-8243: Looking forward to see the gradle commands disapp

[jira] [Commented] (BEAM-8243) Document behavior of FlinkRunner

2019-10-31 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964534#comment-16964534 ] Thomas Weise commented on BEAM-8243: [~ibzib] [~robertwb] is this going to cover docum

[jira] [Updated] (BEAM-8372) Allow submission of Flink UberJar directly to flink cluster.

2019-10-31 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8372: --- Fix Version/s: 2.17.0 > Allow submission of Flink UberJar directly to flink cluster. > ---

[jira] [Updated] (BEAM-8372) Allow submission of Flink UberJar directly to flink cluster.

2019-10-31 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8372: --- Labels: portability portability-flink (was: ) > Allow submission of Flink UberJar directly to flink c

[jira] [Assigned] (BEAM-8507) Unspecified flink_master fails on Python 3.6+

2019-10-30 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-8507: -- Assignee: Maximilian Michels > Unspecified flink_master fails on Python 3.6+ >

[jira] [Created] (BEAM-8518) Pipeline options translation fails silently with incompatible jackson-core library

2019-10-29 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8518: -- Summary: Pipeline options translation fails silently with incompatible jackson-core library Key: BEAM-8518 URL: https://issues.apache.org/jira/browse/BEAM-8518 Project: B

[jira] [Commented] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-28 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961628#comment-16961628 ] Thomas Weise commented on BEAM-8471: If anyone is interested to try this using curl wi

[jira] [Closed] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-28 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-8471. -- Fix Version/s: 2.18.0 Resolution: Implemented > Flink native job submission for portable pipeline

[jira] [Issue Comment Deleted] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-28 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8471: --- Comment: was deleted (was: CC: [~robertwb], [~ibzib], [~mxm] I'm going to upstream this: [https://git

[jira] [Commented] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16958933#comment-16958933 ] Thomas Weise commented on BEAM-8471: CC: [~robertwb], [~ibzib], [~mxm] I'm going to u

[jira] [Updated] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8471: --- Description: There are currently two methods to run a portable pipeline written in a non-JVM language

[jira] [Created] (BEAM-8471) Flink native job submission for portable pipelines

2019-10-24 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8471: -- Summary: Flink native job submission for portable pipelines Key: BEAM-8471 URL: https://issues.apache.org/jira/browse/BEAM-8471 Project: Beam Issue Type: Improve

[jira] [Closed] (BEAM-8417) Expose ExternalWorkerHandler hostname

2019-10-17 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-8417. -- Fix Version/s: 2.17.0 Resolution: Fixed > Expose ExternalWorkerHandler hostname > ---

[jira] [Resolved] (BEAM-8387) Remove sdk-worker-parallelism option from JobServerDriver

2019-10-14 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-8387. Fix Version/s: 2.17.0 Resolution: Fixed > Remove sdk-worker-parallelism option from JobServer

[jira] [Updated] (BEAM-8387) Remove sdk-worker-parallelism option from JobServerDriver

2019-10-14 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-8387: --- Status: Open (was: Triage Needed) > Remove sdk-worker-parallelism option from JobServerDriver > -

[jira] [Resolved] (BEAM-8183) Optionally bundle multiple pipelines into a single Flink jar

2019-10-11 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-8183. Fix Version/s: 2.17.0 Resolution: Implemented > Optionally bundle multiple pipelines into a s

[jira] [Created] (BEAM-8387) Remove sdk-worker-parallelism option from JobServerDriver

2019-10-11 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8387: -- Summary: Remove sdk-worker-parallelism option from JobServerDriver Key: BEAM-8387 URL: https://issues.apache.org/jira/browse/BEAM-8387 Project: Beam Issue Type:

[jira] [Commented] (BEAM-8115) Overwrite portable Flink application jar pipeline options at runtime

2019-10-11 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949726#comment-16949726 ] Thomas Weise commented on BEAM-8115: The first case will allow to change all runner an

[jira] [Closed] (BEAM-7980) External environment with containerized worker pool

2019-10-08 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-7980. -- Resolution: Implemented > External environment with containerized worker pool >

[jira] [Reopened] (BEAM-7980) External environment with containerized worker pool

2019-10-08 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reopened BEAM-7980: > External environment with containerized worker pool >

[jira] [Resolved] (BEAM-6829) Duplicate metric warnings clutter log

2019-10-08 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-6829. Fix Version/s: 2.17.0 Resolution: Fixed > Duplicate metric warnings clutter log > ---

[jira] [Assigned] (BEAM-8351) Support passing in arbitrary KV pairs to sdk worker via external environment config

2019-10-04 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned BEAM-8351: -- Assignee: Wanqi Lyu > Support passing in arbitrary KV pairs to sdk worker via external environm

[jira] [Commented] (BEAM-8183) Optionally bundle multiple pipelines into a single Flink jar

2019-10-03 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943638#comment-16943638 ] Thomas Weise commented on BEAM-8183: BEAM-8115 is indeed orthogonal and applicable for

[jira] [Commented] (BEAM-8183) Optionally bundle multiple pipelines into a single Flink jar

2019-10-02 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943170#comment-16943170 ] Thomas Weise commented on BEAM-8183: {quote}The major issue to me seems to be that we

[jira] [Commented] (BEAM-8183) Optionally bundle multiple pipelines into a single Flink jar

2019-10-02 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943015#comment-16943015 ] Thomas Weise commented on BEAM-8183: For context:  [https://lists.apache.org/thread.ht

[jira] [Commented] (BEAM-8183) Optionally bundle multiple pipelines into a single Flink jar

2019-09-27 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939795#comment-16939795 ] Thomas Weise commented on BEAM-8183: Hi Kyle, I have setup my Flink image build to use

[jira] [Commented] (BEAM-6733) Use Flink 1.6/1.7 prepareSnapshotPreBarrier to replace BufferedOutputManager

2019-09-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936920#comment-16936920 ] Thomas Weise commented on BEAM-6733: This has an effect on checkpointing that is proba

[jira] [Commented] (BEAM-8157) Key encoding for state requests is not consistent across SDKs

2019-09-24 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936835#comment-16936835 ] Thomas Weise commented on BEAM-8157: I would probably not backport since 2.16 doesn't

[jira] [Resolved] (BEAM-7722) Simplify running of Beam Python on Flink

2019-09-11 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-7722. Fix Version/s: 2.16.0 Resolution: Implemented > Simplify running of Beam Python on Flink > --

[jira] [Updated] (BEAM-7962) Drop support for Flink 1.5 and 1.6

2019-09-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-7962: --- Issue Type: Task (was: Bug) > Drop support for Flink 1.5 and 1.6 > --

[jira] [Commented] (BEAM-7730) Add Flink 1.9 build target and Make FlinkRunner compatible with Flink 1.9

2019-09-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926685#comment-16926685 ] Thomas Weise commented on BEAM-7730: Removing 2.16 fix version, this is not a release

[jira] [Commented] (BEAM-7962) Drop support for Flink 1.5 and 1.6

2019-09-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926684#comment-16926684 ] Thomas Weise commented on BEAM-7962: [~markflyhigh] this issue does not block the 2.16

[jira] [Updated] (BEAM-7730) Add Flink 1.9 build target and Make FlinkRunner compatible with Flink 1.9

2019-09-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-7730: --- Fix Version/s: (was: 2.16.0) > Add Flink 1.9 build target and Make FlinkRunner compatible with Fli

[jira] [Updated] (BEAM-7962) Drop support for Flink 1.5 and 1.6

2019-09-10 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-7962: --- Fix Version/s: (was: 2.16.0) > Drop support for Flink 1.5 and 1.6 > --

[jira] [Resolved] (BEAM-7980) External environment with containerized worker pool

2019-09-03 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-7980. Fix Version/s: 2.16.0 Resolution: Incomplete > External environment with containerized worker

[jira] [Created] (BEAM-8137) Worker pool option for Java SDK container

2019-09-03 Thread Thomas Weise (Jira)
Thomas Weise created BEAM-8137: -- Summary: Worker pool option for Java SDK container Key: BEAM-8137 URL: https://issues.apache.org/jira/browse/BEAM-8137 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-8115) Overwrite portable Flink application jar pipeline options at runtime

2019-08-30 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919657#comment-16919657 ] Thomas Weise commented on BEAM-8115: I believe this is would have to include support f

[jira] [Closed] (BEAM-8038) Python Precommit fail: 'BeamFnExternalWorkerPoolServicer' has no attribute '_worker_processes'

2019-08-22 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed BEAM-8038. -- Fix Version/s: Not applicable Resolution: Fixed > Python Precommit fail: 'BeamFnExternalWorkerPoo

  1   2   3   >