[jira] [Updated] (BEAM-8495) Change byte size estimate for compressed files for FileBasedSources

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8495: -- Summary: Change byte size estimate for compressed files for FileBasedSources (was: Change Dataf

[jira] [Updated] (BEAM-8495) Change byte size estimate for compressed files for FileBasedSources

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8495: -- Status: Open (was: Triage Needed) > Change byte size estimate for compressed files for FileBase

[jira] [Updated] (BEAM-8503) Improve TestBigQuery and TestPubsub

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8503: -- Status: Open (was: Triage Needed) > Improve TestBigQuery and TestPubsub > -

[jira] [Updated] (BEAM-8495) Change byte size estimate for compressed files for FileBasedSources

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8495: -- Description: Consider change the estimated byte size for file based sources for better initial a

[jira] [Resolved] (BEAM-8503) Improve TestBigQuery and TestPubsub

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-8503. --- Fix Version/s: 2.18.0 Resolution: Fixed > Improve TestBigQuery and TestPubsub > ---

[jira] [Commented] (BEAM-8547) Portable Wordcount fails with on stadalone Flink cluster

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965462#comment-16965462 ] Kenneth Knowles commented on BEAM-8547: --- Triaging this - what is the severity? It se

[jira] [Updated] (BEAM-8435) Allow access to PaneInfo from Python DoFns

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8435: -- Status: Open (was: Triage Needed) > Allow access to PaneInfo from Python DoFns > --

[jira] [Updated] (BEAM-8544) Install Beam SDK with ccache for faster re-install.

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8544: -- Status: Open (was: Triage Needed) > Install Beam SDK with ccache for faster re-install. > -

[jira] [Updated] (BEAM-8427) [SQL] Add support for MongoDB source

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8427: -- Status: Open (was: Triage Needed) > [SQL] Add support for MongoDB source >

[jira] [Updated] (BEAM-8547) Portable Wordcount fails with on stadalone Flink cluster

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8547: -- Status: Open (was: Triage Needed) > Portable Wordcount fails with on stadalone Flink cluster >

[jira] [Updated] (BEAM-8491) Add ability for multiple output PCollections from composites

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8491: -- Status: Open (was: Triage Needed) > Add ability for multiple output PCollections from composite

[jira] [Updated] (BEAM-8546) Moving Java external transform from core-construction-java to core

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8546: -- Component/s: (was: sdk-ideas) > Moving Java external transform from core-construction-java t

[jira] [Updated] (BEAM-8546) Moving Java external transform from core-construction-java to core

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8546: -- Status: Open (was: Triage Needed) > Moving Java external transform from core-construction-java

[jira] [Commented] (BEAM-8546) Moving Java external transform from core-construction-java to core

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965464#comment-16965464 ] Kenneth Knowles commented on BEAM-8546: --- I think we can actually merge core-construc

[jira] [Updated] (BEAM-8523) Add useful timestamp to job servicer GetJobs

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8523: -- Status: Open (was: Triage Needed) > Add useful timestamp to job servicer GetJobs >

[jira] [Assigned] (BEAM-8546) Moving Java external transform from core-construction-java to core

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-8546: - Assignee: Kenneth Knowles > Moving Java external transform from core-construction-java to

[jira] [Updated] (BEAM-8499) Enable dataflow workers to use private IPs

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8499: -- Status: Open (was: Triage Needed) > Enable dataflow workers to use private IPs > --

[jira] [Updated] (BEAM-8499) Enable dataflow workers to use private IPs

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8499: -- Component/s: runner-dataflow > Enable dataflow workers to use private IPs >

[jira] [Updated] (BEAM-8496) remove SDF translators in flink streaming transform translator

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8496: -- Status: Open (was: Triage Needed) > remove SDF translators in flink streaming transform transla

[jira] [Commented] (BEAM-8499) Enable dataflow workers to use private IPs

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965465#comment-16965465 ] Kenneth Knowles commented on BEAM-8499: --- The PR is merged. Is this closed? > Enable

[jira] [Updated] (BEAM-8499) Enable dataflow workers to use private IPs

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8499: -- Status: Open (was: Triage Needed) > Enable dataflow workers to use private IPs > --

[jira] [Updated] (BEAM-8499) Enable dataflow workers to use private IPs

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8499: -- Status: Triage Needed (was: Open) > Enable dataflow workers to use private IPs > --

[jira] [Updated] (BEAM-8542) Add async write to AWS SNS IO & remove retry logic

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8542: -- Priority: Major (was: Minor) > Add async write to AWS SNS IO & remove retry logic > ---

[jira] [Updated] (BEAM-8542) Add async write to AWS SNS IO & remove retry logic

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8542: -- Status: Open (was: Triage Needed) > Add async write to AWS SNS IO & remove retry logic > --

[jira] [Updated] (BEAM-8541) Beam directRunner documentation java tab has python information

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8541: -- Status: Open (was: Triage Needed) > Beam directRunner documentation java tab has python informa

[jira] [Commented] (BEAM-8542) Add async write to AWS SNS IO & remove retry logic

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965468#comment-16965468 ] Kenneth Knowles commented on BEAM-8542: --- [~jhalarua] any feedback? Are you the best

[jira] [Updated] (BEAM-8541) Beam directRunner documentation java tab has python information

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8541: -- Component/s: website > Beam directRunner documentation java tab has python information > ---

[jira] [Updated] (BEAM-8541) Beam directRunner documentation java tab has python information

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8541: -- Component/s: (was: beam-community) > Beam directRunner documentation java tab has python inf

[jira] [Updated] (BEAM-8514) ZetaSql should use cost-based optimization to take advantage of Join Reordering Rule and Push-Down Rule

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8514: -- Status: Open (was: Triage Needed) > ZetaSql should use cost-based optimization to take advantag

[jira] [Assigned] (BEAM-8541) Beam directRunner documentation java tab has python information

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-8541: - Assignee: (was: Aizhamal Nurmamat kyzy) > Beam directRunner documentation java tab ha

[jira] [Updated] (BEAM-8451) Interactive Beam example failing from stack overflow

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8451: -- Status: Open (was: Triage Needed) > Interactive Beam example failing from stack overflow >

[jira] [Updated] (BEAM-8536) Migrate usage of DelayedBundleApplication.requested_execution_time to time duration

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8536: -- Status: Open (was: Triage Needed) > Migrate usage of DelayedBundleApplication.requested_executi

[jira] [Updated] (BEAM-8536) Migrate usage of DelayedBundleApplication.requested_execution_time to time duration

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8536: -- Status: Triage Needed (was: Open) > Migrate usage of DelayedBundleApplication.requested_executi

[jira] [Commented] (BEAM-8536) Migrate usage of DelayedBundleApplication.requested_execution_time to time duration

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965469#comment-16965469 ] Kenneth Knowles commented on BEAM-8536: --- I notice that Dataflow and Java SDK harness

[jira] [Commented] (BEAM-8537) Provide WatermarkEstimatorProvider for different types of WatermarkEstimator

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965470#comment-16965470 ] Kenneth Knowles commented on BEAM-8537: --- Is there anything more to say in the descri

[jira] [Updated] (BEAM-8537) Provide WatermarkEstimatorProvider for different types of WatermarkEstimator

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8537: -- Status: Open (was: Triage Needed) > Provide WatermarkEstimatorProvider for different types of W

[jira] [Updated] (BEAM-8468) Add predicate/filter push-down capability to IO APIs

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8468: -- Status: Open (was: Triage Needed) > Add predicate/filter push-down capability to IO APIs >

[jira] [Updated] (BEAM-8532) Beam Python trigger driver sets incorrect timestamp for output windows.

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8532: -- Status: Open (was: Triage Needed) > Beam Python trigger driver sets incorrect timestamp for out

[jira] [Updated] (BEAM-8537) Provide WatermarkEstimatorProvider for different types of WatermarkEstimator

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8537: -- Status: Triage Needed (was: Open) > Provide WatermarkEstimatorProvider for different types of W

[jira] [Updated] (BEAM-8538) Python typehints: support namedtuples

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8538: -- Status: Open (was: Triage Needed) > Python typehints: support namedtuples > ---

[jira] [Assigned] (BEAM-8535) TextIO.read doesn't work with single wildcard with relative path

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-8535: - Assignee: Chamikara Madhusanka Jayalath > TextIO.read doesn't work with single wildcard w

[jira] [Commented] (BEAM-8535) TextIO.read doesn't work with single wildcard with relative path

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965471#comment-16965471 ] Kenneth Knowles commented on BEAM-8535: --- [~tim_f] would you be interested in trying

[jira] [Commented] (BEAM-8535) TextIO.read doesn't work with single wildcard with relative path

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965472#comment-16965472 ] Kenneth Knowles commented on BEAM-8535: --- Do you know if this is longstanding or a re

[jira] [Updated] (BEAM-8535) TextIO.read doesn't work with single wildcard with relative path

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8535: -- Priority: Critical (was: Major) > TextIO.read doesn't work with single wildcard with relative p

[jira] [Updated] (BEAM-8535) TextIO.read doesn't work with single wildcard with relative path

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8535: -- Fix Version/s: 2.17.0 > TextIO.read doesn't work with single wildcard with relative path > -

[jira] [Issue Comment Deleted] (BEAM-8535) TextIO.read doesn't work with single wildcard with relative path

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8535: -- Comment: was deleted (was: Do you know if this is longstanding or a regression?) > TextIO.read

[jira] [Assigned] (BEAM-8531) DoFnTester should be removed from the documentation

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-8531: - Assignee: Kenneth Knowles > DoFnTester should be removed from the documentation > ---

[jira] [Updated] (BEAM-8434) Allow trigger transcript tests to be run as ValidatesRunner tests.

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8434: -- Component/s: sdk-py-core > Allow trigger transcript tests to be run as ValidatesRunner tests. >

[jira] [Updated] (BEAM-8531) DoFnTester should be removed from the documentation

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8531: -- Summary: DoFnTester should be removed from the documentation (was: DoFnTester should either be

[jira] [Updated] (BEAM-8531) DoFnTester should either be removed from the documentation or undeprecated.

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8531: -- Component/s: website > DoFnTester should either be removed from the documentation or undeprecate

[jira] [Assigned] (BEAM-8531) DoFnTester should be removed from the documentation

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-8531: - Assignee: (was: Aizhamal Nurmamat kyzy) > DoFnTester should be removed from the docum

[jira] [Commented] (BEAM-8531) DoFnTester should be removed from the documentation

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965475#comment-16965475 ] Kenneth Knowles commented on BEAM-8531: --- Very good point. It certainly should be rem

[jira] [Commented] (BEAM-8535) TextIO.read doesn't work with single wildcard with relative path

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965474#comment-16965474 ] Kenneth Knowles commented on BEAM-8535: --- [~Ardagan] I just added Fix Version = 2.17.

[jira] [Updated] (BEAM-8531) DoFnTester should either be removed from the documentation or undeprecated.

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8531: -- Component/s: (was: beam-model) (was: beam-community) sd

[jira] [Commented] (BEAM-8535) TextIO.read doesn't work with single wildcard with relative path

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965473#comment-16965473 ] Kenneth Knowles commented on BEAM-8535: --- Thanks for catching the regression. I have

[jira] [Commented] (BEAM-8434) Allow trigger transcript tests to be run as ValidatesRunner tests.

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965476#comment-16965476 ] Kenneth Knowles commented on BEAM-8434: --- Would you also add this to Java? I was just

[jira] [Updated] (BEAM-8434) Allow trigger transcript tests to be run as ValidatesRunner tests.

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8434: -- Component/s: sdk-java-core > Allow trigger transcript tests to be run as ValidatesRunner tests.

[jira] [Updated] (BEAM-8189) Python DataflowRunner fails when using a Shared VPC from another project

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8189: -- Status: Open (was: Triage Needed) > Python DataflowRunner fails when using a Shared VPC from an

[jira] [Commented] (BEAM-8529) Samza runner does not allow using Void as key in grouping operations

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965480#comment-16965480 ] Kenneth Knowles commented on BEAM-8529: --- [~xinyu] thoughts? > Samza runner does not

[jira] [Commented] (BEAM-8189) Python DataflowRunner fails when using a Shared VPC from another project

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965479#comment-16965479 ] Kenneth Knowles commented on BEAM-8189: --- [~tvalentyn] any thoughts on this? > Pytho

[jira] [Updated] (BEAM-8529) Samza runner does not allow using Void as key in grouping operations

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8529: -- Priority: Critical (was: Major) > Samza runner does not allow using Void as key in grouping ope

[jira] [Updated] (BEAM-8529) Samza runner does not allow using Void as key in grouping operations

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8529: -- Status: Open (was: Triage Needed) > Samza runner does not allow using Void as key in grouping o

[jira] [Commented] (BEAM-8529) Samza runner does not allow using Void as key in grouping operations

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965481#comment-16965481 ] Kenneth Knowles commented on BEAM-8529: --- This will prevent {{Combine.globally}} from

[jira] [Updated] (BEAM-8526) Turn on metrics publishing in load tests on Flink

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8526: -- Status: Open (was: Triage Needed) > Turn on metrics publishing in load tests on Flink > ---

[jira] [Commented] (BEAM-8528) BigQuery bounded source does not work on DirectRunner

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965482#comment-16965482 ] Kenneth Knowles commented on BEAM-8528: --- [~robertwb] [~altay] is there a best point

[jira] [Commented] (BEAM-8527) Apache Beam with Python 3 module module error

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965484#comment-16965484 ] Kenneth Knowles commented on BEAM-8527: --- [~tvalentyn] any ideas? > Apache Beam with

[jira] [Updated] (BEAM-8511) Support for enhanced fan-out in KinesisIO

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8511: -- Status: Open (was: Triage Needed) > Support for enhanced fan-out in KinesisIO > ---

[jira] [Updated] (BEAM-8511) Support for enhanced fan-out in KinesisIO

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8511: -- Issue Type: New Feature (was: Improvement) > Support for enhanced fan-out in KinesisIO > --

[jira] [Updated] (BEAM-8511) Support for enhanced fan-out in KinesisIO

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8511: -- Affects Version/s: (was: 2.15.0) > Support for enhanced fan-out in KinesisIO > -

[jira] [Updated] (BEAM-8485) Python Beam job is successful regardless of the result of the BigQuery load job (for the BigQuery File Loads)

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8485: -- Component/s: io-py-gcp > Python Beam job is successful regardless of the result of the BigQuery

[jira] [Commented] (BEAM-8485) Python Beam job is successful regardless of the result of the BigQuery load job (for the BigQuery File Loads)

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965486#comment-16965486 ] Kenneth Knowles commented on BEAM-8485: --- CC [~chamikara] > Python Beam job is succ

[jira] [Updated] (BEAM-8428) [SQL] BigQuery should support project push-down in DIRECT_READ mode

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8428: -- Status: Open (was: Triage Needed) > [SQL] BigQuery should support project push-down in DIRECT_R

[jira] [Updated] (BEAM-7594) test_read_from_text_with_file_name_file_pattern is flaky

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-7594: -- Priority: Critical (was: Major) > test_read_from_text_with_file_name_file_pattern is flaky > --

[jira] [Commented] (BEAM-8428) [SQL] BigQuery should support project push-down in DIRECT_READ mode

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965487#comment-16965487 ] Kenneth Knowles commented on BEAM-8428: --- I see two merged PRs. Is this finished, the

[jira] [Updated] (BEAM-7594) test_read_from_text_with_file_name_file_pattern is flaky

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-7594: -- Status: Open (was: Triage Needed) > test_read_from_text_with_file_name_file_pattern is flaky >

[jira] [Updated] (BEAM-7594) test_read_from_text_with_file_name_file_pattern is flaky

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-7594: -- Labels: currently-failing flake (was: currently-failing) > test_read_from_text_with_file_name_f

[jira] [Commented] (BEAM-7594) test_read_from_text_with_file_name_file_pattern is flaky

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965488#comment-16965488 ] Kenneth Knowles commented on BEAM-7594: --- Flaking tests are Critical/P1 issues per h

[jira] [Updated] (BEAM-8520) Expansion of _CombinePerKeyWithHotKeyFanout has no typehints

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8520: -- Status: Open (was: Triage Needed) > Expansion of _CombinePerKeyWithHotKeyFanout has no typehint

[jira] [Updated] (BEAM-8381) Typehints on DoFn subclass are incorrectly set on superclass

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8381: -- Status: Open (was: Triage Needed) > Typehints on DoFn subclass are incorrectly set on superclas

[jira] [Updated] (BEAM-8520) Expansion of _CombinePerKeyWithHotKeyFanout has no typehints

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8520: -- Priority: Major (was: Minor) > Expansion of _CombinePerKeyWithHotKeyFanout has no typehints > -

[jira] [Commented] (BEAM-8381) Typehints on DoFn subclass are incorrectly set on superclass

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965489#comment-16965489 ] Kenneth Knowles commented on BEAM-8381: --- CC [~udim] > Typehints on DoFn subclass ar

[jira] [Commented] (BEAM-8520) Expansion of _CombinePerKeyWithHotKeyFanout has no typehints

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965490#comment-16965490 ] Kenneth Knowles commented on BEAM-8520: --- CC [~udim] > Expansion of _CombinePerKeyWi

[jira] [Updated] (BEAM-8510) SamzaJobServerDriver to extend JobServerDriver

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8510: -- Affects Version/s: (was: 2.15.0) > SamzaJobServerDriver to extend JobServerDriver >

[jira] [Updated] (BEAM-8510) SamzaJobServerDriver to extend JobServerDriver

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8510: -- Status: Open (was: Triage Needed) > SamzaJobServerDriver to extend JobServerDriver > --

[jira] [Updated] (BEAM-8505) Too many variations of FnApiRunnerTest are running

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8505: -- Status: Open (was: Triage Needed) > Too many variations of FnApiRunnerTest are running > --

[jira] [Updated] (BEAM-8519) Typehint for Python CombineFn Accumulator

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8519: -- Priority: Major (was: Minor) > Typehint for Python CombineFn Accumulator >

[jira] [Updated] (BEAM-8519) Typehint for Python CombineFn Accumulator

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8519: -- Status: Open (was: Triage Needed) > Typehint for Python CombineFn Accumulator > ---

[jira] [Updated] (BEAM-8422) Send emails to builds@ when job ends with state "ABORTED"

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8422: -- Component/s: build-system > Send emails to builds@ when job ends with state "ABORTED" >

[jira] [Updated] (BEAM-8422) Send emails to builds@ when job ends with state "ABORTED"

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8422: -- Issue Type: Bug (was: Improvement) > Send emails to builds@ when job ends with state "ABORTED"

[jira] [Updated] (BEAM-8422) Send emails to builds@ when job ends with state "ABORTED"

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8422: -- Status: Open (was: Triage Needed) > Send emails to builds@ when job ends with state "ABORTED" >

[jira] [Updated] (BEAM-8422) Send emails to builds@ when job ends with state "ABORTED"

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8422: -- Priority: Major (was: Minor) > Send emails to builds@ when job ends with state "ABORTED" >

[jira] [Updated] (BEAM-8422) Send emails to builds@ when job ends with state "ABORTED"

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8422: -- Component/s: (was: testing) > Send emails to builds@ when job ends with state "ABORTED" > --

[jira] [Updated] (BEAM-8506) Failing Dataflow job should explicitly state reason to be missing container.

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8506: -- Issue Type: Bug (was: Improvement) > Failing Dataflow job should explicitly state reason to be

[jira] [Updated] (BEAM-8506) Failing Dataflow job should explicitly state reason to be missing container.

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8506: -- Status: Open (was: Triage Needed) > Failing Dataflow job should explicitly state reason to be m

[jira] [Commented] (BEAM-8506) Failing Dataflow job should explicitly state reason to be missing container.

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965491#comment-16965491 ] Kenneth Knowles commented on BEAM-8506: --- Incorrect or non-actionable messages are bu

[jira] [Commented] (BEAM-8504) BigQueryIO DIRECT_READ is broken

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965492#comment-16965492 ] Kenneth Knowles commented on BEAM-8504: --- [~kirillkozlov] what do you think? I know y

[jira] [Updated] (BEAM-8500) PR Trigger Phrase of beam_PreCommit_Website_Stage_GCS listed in README is incorrect

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8500: -- Labels: easyfix starter (was: ) > PR Trigger Phrase of beam_PreCommit_Website_Stage_GCS listed

[jira] [Updated] (BEAM-8504) BigQueryIO DIRECT_READ is broken

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8504: -- Status: Open (was: Triage Needed) > BigQueryIO DIRECT_READ is broken >

[jira] [Updated] (BEAM-8500) PR Trigger Phrase of beam_PreCommit_Website_Stage_GCS listed in README is incorrect

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8500: -- Status: Open (was: Triage Needed) > PR Trigger Phrase of beam_PreCommit_Website_Stage_GCS liste

[jira] [Updated] (BEAM-8497) Vendor or shade the dependencies of beam-sdks-java-io-google-cloud-platform

2019-11-02 Thread Kenneth Knowles (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-8497: -- Status: Open (was: Triage Needed) > Vendor or shade the dependencies of beam-sdks-java-io-googl

  1   2   3   4   5   6   7   8   9   10   >