[jira] [Created] (BEAM-9559) Remove smoke load test for Java and Python dsk

2020-03-19 Thread Lukasz Gajowy (Jira)
Lukasz Gajowy created BEAM-9559: --- Summary: Remove smoke load test for Java and Python dsk Key: BEAM-9559 URL: https://issues.apache.org/jira/browse/BEAM-9559 Project: Beam Issue Type: Wish

[jira] [Assigned] (BEAM-8938) Tests end up leaving stale Dataflow jobs in apache-beam-testing project and exhaust GCP resources

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8938: --- Assignee: Kamil Wasilewski > Tests end up leaving stale Dataflow jobs in apache-beam-testing

[jira] [Commented] (BEAM-8938) Tests end up leaving stale Dataflow jobs in apache-beam-testing project and exhaust GCP resources

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000161#comment-17000161 ] Lukasz Gajowy commented on BEAM-8938: - [~kamilwu] I assigned you because this requires some care. Feel

[jira] [Commented] (BEAM-8424) Java Dataflow ValidatesRunner tests are timeouting

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000158#comment-17000158 ] Lukasz Gajowy commented on BEAM-8424: - There are still problem with Java11 tests (timeouting) > Java

[jira] [Assigned] (BEAM-8424) Java Dataflow ValidatesRunner tests are timeouting

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8424: --- Assignee: Michal Walenia > Java Dataflow ValidatesRunner tests are timeouting >

[jira] [Comment Edited] (BEAM-8424) Java Dataflow ValidatesRunner tests are timeouting

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000158#comment-17000158 ] Lukasz Gajowy edited comment on BEAM-8424 at 12/19/19 4:00 PM: --- There are

[jira] [Closed] (BEAM-7368) Run Python GBK load tests on portable Flink runner

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy closed BEAM-7368. --- Fix Version/s: Not applicable Resolution: Fixed > Run Python GBK load tests on portable Flink

[jira] [Commented] (BEAM-7245) Encapsulate supplier, monitor and metric naming logic in some common TestMetric type

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000153#comment-17000153 ] Lukasz Gajowy commented on BEAM-7245: - [~mwalenia] is this ticket finished? > Encapsulate supplier,

[jira] [Comment Edited] (BEAM-7245) Encapsulate supplier, monitor and metric naming logic in some common TestMetric type

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000153#comment-17000153 ] Lukasz Gajowy edited comment on BEAM-7245 at 12/19/19 3:58 PM: --- [~mwalenia] 

[jira] [Commented] (BEAM-7115) TFRecordIOIT write_time metrics are allways 0.0

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000151#comment-17000151 ] Lukasz Gajowy commented on BEAM-7115: - [~pawel.pasterz] do you think you could take a look? >

[jira] [Commented] (BEAM-6969) Provide way to collect start/end read/write time inside the IOs

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000150#comment-17000150 ] Lukasz Gajowy commented on BEAM-6969: - [~pawel.pasterz] [~mwalenia] you might find this (historical)

[jira] [Resolved] (BEAM-6448) Enable SDK log messages in test log output

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy resolved BEAM-6448. - Fix Version/s: Not applicable Resolution: Fixed > Enable SDK log messages in test log

[jira] [Closed] (BEAM-6408) beam_Java_LoadTests_GroupByKey_Dataflow_Small timeouts

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy closed BEAM-6408. --- Fix Version/s: Not applicable Resolution: Resolved >

[jira] [Closed] (BEAM-6349) Exceptions (IllegalArgumentException or NoClassDefFoundError) when running tests on Dataflow runner

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy closed BEAM-6349. --- Fix Version/s: Not applicable Resolution: Fixed > Exceptions (IllegalArgumentException or

[jira] [Closed] (BEAM-4367) Phrase-triggered job (IOIT) never stopped running.

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy closed BEAM-4367. --- Fix Version/s: Not applicable Resolution: Cannot Reproduce > Phrase-triggered job (IOIT) never

[jira] [Closed] (BEAM-3561) Provide kubernetes cluster instance for IOITs.

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy closed BEAM-3561. --- Fix Version/s: Not applicable Resolution: Fixed > Provide kubernetes cluster instance for

[jira] [Resolved] (BEAM-4041) Performance tests fail due to kubernetes load balancer problems

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy resolved BEAM-4041. - Fix Version/s: Not applicable Resolution: Fixed > Performance tests fail due to kubernetes

[jira] [Assigned] (BEAM-8940) Load dataflow jobs using java 11 in Java 11 Dataflow tests

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8940: --- Assignee: Michal Walenia > Load dataflow jobs using java 11 in Java 11 Dataflow tests >

[jira] [Assigned] (BEAM-4420) Add KafkaIO Integration Tests

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-4420: --- Assignee: (was: Lukasz Gajowy) > Add KafkaIO Integration Tests >

[jira] [Assigned] (BEAM-8319) Errorprone 0.0.13 fails during JDK11 build

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8319: --- Assignee: (was: Lukasz Gajowy) > Errorprone 0.0.13 fails during JDK11 build >

[jira] [Assigned] (BEAM-8940) Load dataflow jobs using java 11 in Java 11 Dataflow tests

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8940: --- Assignee: (was: Lukasz Gajowy) > Load dataflow jobs using java 11 in Java 11 Dataflow

[jira] [Assigned] (BEAM-8559) Run Dataflow Nexmark suites with Java 11

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8559: --- Assignee: Michal Walenia (was: Lukasz Gajowy) > Run Dataflow Nexmark suites with Java 11 >

[jira] [Resolved] (BEAM-8003) Remove all mentions of PKB on Confluence / website docs

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy resolved BEAM-8003. - Fix Version/s: Not applicable Resolution: Fixed > Remove all mentions of PKB on Confluence

[jira] [Assigned] (BEAM-7658) Synthetic unbounded source looses (duplicates?) data while splitting

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-7658: --- Assignee: (was: Lukasz Gajowy) > Synthetic unbounded source looses (duplicates?) data

[jira] [Assigned] (BEAM-7786) Clean up docker images in GCR after test on Portable Flink runner

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-7786: --- Assignee: (was: Lukasz Gajowy) > Clean up docker images in GCR after test on Portable

[jira] [Assigned] (BEAM-5980) Add load tests for Core Apache Beam operations

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-5980: --- Assignee: (was: Lukasz Gajowy) > Add load tests for Core Apache Beam operations >

[jira] [Assigned] (BEAM-8266) Run IOITs on Flink Runner

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8266: --- Assignee: (was: Lukasz Gajowy) > Run IOITs on Flink Runner > - >

[jira] [Assigned] (BEAM-7659) Create IO tests for synthetic sources

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-7659: --- Assignee: (was: Lukasz Gajowy) > Create IO tests for synthetic sources >

[jira] [Assigned] (BEAM-7368) Run Python GBK load tests on portable Flink runner

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-7368: --- Assignee: (was: Lukasz Gajowy) > Run Python GBK load tests on portable Flink runner >

[jira] [Assigned] (BEAM-7772) Stop using Perfkit Benchmarker tool in all tests

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-7772: --- Assignee: (was: Lukasz Gajowy) > Stop using Perfkit Benchmarker tool in all tests >

[jira] [Assigned] (BEAM-6394) Support for writing protobuf data to parquet

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-6394: --- Assignee: (was: Lukasz Gajowy) > Support for writing protobuf data to parquet >

[jira] [Resolved] (BEAM-7431) ObjectSizeCalculator causing regressions in load tests and IOITs

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy resolved BEAM-7431. - Fix Version/s: Not applicable Resolution: Fixed > ObjectSizeCalculator causing regressions

[jira] [Assigned] (BEAM-5222) Parquet IO position invalid when writing integers

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-5222: --- Assignee: (was: Lukasz Gajowy) > Parquet IO position invalid when writing integers >

[jira] [Assigned] (BEAM-6408) beam_Java_LoadTests_GroupByKey_Dataflow_Small timeouts

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-6408: --- Assignee: (was: Lukasz Gajowy) > beam_Java_LoadTests_GroupByKey_Dataflow_Small timeouts

[jira] [Assigned] (BEAM-5982) Create Side input load test for Java SDK

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-5982: --- Assignee: (was: Lukasz Gajowy) > Create Side input load test for Java SDK >

[jira] [Resolved] (BEAM-6351) OutOfMemoryError on DirectRunner while running load tests

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy resolved BEAM-6351. - Fix Version/s: Not applicable Resolution: Not A Bug That's actually a normal situation -

[jira] [Assigned] (BEAM-4508) Adapt old IOITs to current IO performance testing standards

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-4508: --- Assignee: (was: Lukasz Gajowy) > Adapt old IOITs to current IO performance testing

[jira] [Assigned] (BEAM-6449) Create PostCommit smoke test suite (besides phrase triggered one)

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-6449: --- Assignee: (was: Lukasz Gajowy) > Create PostCommit smoke test suite (besides phrase

[jira] [Assigned] (BEAM-6065) Provide standard configs to run load tests

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-6065: --- Assignee: (was: Lukasz Gajowy) > Provide standard configs to run load tests >

[jira] [Assigned] (BEAM-6278) Refactor Post Commit nexmark jobs to use the NexmarkBuilder

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-6278: --- Assignee: (was: Lukasz Gajowy) > Refactor Post Commit nexmark jobs to use the

[jira] [Assigned] (BEAM-4383) Enable block size support in ParquetIO

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-4383: --- Assignee: (was: Lukasz Gajowy) > Enable block size support in ParquetIO >

[jira] [Assigned] (BEAM-5559) Beam Dependency Update Request: com.google.guava:guava

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-5559: --- Assignee: (was: Lukasz Gajowy) > Beam Dependency Update Request: com.google.guava:guava

[jira] [Assigned] (BEAM-4298) Perfkit runs are always "official" while running them with Jenkins

2019-12-19 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-4298: --- Assignee: (was: Lukasz Gajowy) > Perfkit runs are always "official" while running them

[jira] [Comment Edited] (BEAM-5495) PipelineResources algorithm is not working in most environments

2019-12-17 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998297#comment-16998297 ] Lukasz Gajowy edited comment on BEAM-5495 at 12/17/19 3:03 PM: ---

[jira] [Commented] (BEAM-5495) PipelineResources algorithm is not working in most environments

2019-12-17 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998297#comment-16998297 ] Lukasz Gajowy commented on BEAM-5495: - [~romain.manni-bucau] well then, it seems that I was not

[jira] [Commented] (BEAM-5495) PipelineResources algorithm is not working in most environments

2019-12-17 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998160#comment-16998160 ] Lukasz Gajowy commented on BEAM-5495: - I did not consider xbean nor knew about it. Since classgraph

[jira] [Commented] (BEAM-5495) PipelineResources algorithm is not working in most environments

2019-12-17 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998042#comment-16998042 ] Lukasz Gajowy commented on BEAM-5495: - I'm not sure what you are asking about - what proposal do you

[jira] [Updated] (BEAM-8947) Change Jenkins jobs configuration to account for new Flink Docker image names

2019-12-13 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8947: Status: Open (was: Triage Needed) > Change Jenkins jobs configuration to account for new Flink

[jira] [Updated] (BEAM-8951) Stop using nose in load tests

2019-12-11 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8951: Status: Open (was: Triage Needed) > Stop using nose in load tests > -

[jira] [Created] (BEAM-8940) Load dataflow jobs using java 11 in Java 11 Dataflow tests

2019-12-10 Thread Lukasz Gajowy (Jira)
Lukasz Gajowy created BEAM-8940: --- Summary: Load dataflow jobs using java 11 in Java 11 Dataflow tests Key: BEAM-8940 URL: https://issues.apache.org/jira/browse/BEAM-8940 Project: Beam Issue

[jira] [Created] (BEAM-8939) beam_CancelStaleDataflowJobs is failing

2019-12-10 Thread Lukasz Gajowy (Jira)
Lukasz Gajowy created BEAM-8939: --- Summary: beam_CancelStaleDataflowJobs is failing Key: BEAM-8939 URL: https://issues.apache.org/jira/browse/BEAM-8939 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-8938) Tests end up leaving stale Dataflow jobs in apache-beam-testing project and exhaust GCP resources

2019-12-10 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8938: Description: Some tests (I'm not sure if this is the exhaustive list but they seem to appear in

[jira] [Updated] (BEAM-8938) Tests end up leaving stale Dataflow jobs in apache-beam-testing project and exhaust GCP resources

2019-12-10 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8938: Description: Some tests (I'm not sure if this is the exhaustive list but they seem to appear in

[jira] [Updated] (BEAM-8938) Tests end up leaving stale Dataflow jobs in apache-beam-testing project and exhaust GCP resources

2019-12-10 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8938: Summary: Tests end up leaving stale Dataflow jobs in apache-beam-testing project and exhaust GCP

[jira] [Updated] (BEAM-8938) Tests end up leaving stale Dataflow jobs in apache-beam-testing project

2019-12-10 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8938: Summary: Tests end up leaving stale Dataflow jobs in apache-beam-testing project (was: Tests

[jira] [Updated] (BEAM-8938) Tests result in stale dataflow jobs in apache-beam-testing project

2019-12-10 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8938: Description: Some tests (I'm not sure if this is the exhaustive list but they seem to appear in

[jira] [Created] (BEAM-8938) Tests result in stale dataflow jobs in apache-beam-testing project

2019-12-10 Thread Lukasz Gajowy (Jira)
Lukasz Gajowy created BEAM-8938: --- Summary: Tests result in stale dataflow jobs in apache-beam-testing project Key: BEAM-8938 URL: https://issues.apache.org/jira/browse/BEAM-8938 Project: Beam

[jira] [Updated] (BEAM-8918) Split BigQueryIOIT test into two tests for Avro and Json reads/writes

2019-12-09 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8918: Status: Open (was: Triage Needed) > Split BigQueryIOIT test into two tests for Avro and Json

[jira] [Created] (BEAM-8919) Move JAVA_11_HOME and JAVA_8_HOME variables to Jenkins envs.

2019-12-09 Thread Lukasz Gajowy (Jira)
Lukasz Gajowy created BEAM-8919: --- Summary: Move JAVA_11_HOME and JAVA_8_HOME variables to Jenkins envs. Key: BEAM-8919 URL: https://issues.apache.org/jira/browse/BEAM-8919 Project: Beam Issue

[jira] [Commented] (BEAM-8424) Java Dataflow ValidatesRunner tests are timeouting

2019-12-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988910#comment-16988910 ] Lukasz Gajowy commented on BEAM-8424: - I created a PR where I test if the only Java-related change

[jira] [Updated] (BEAM-8424) Java Dataflow ValidatesRunner tests are timeouting

2019-12-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8424: Description:

[jira] [Updated] (BEAM-8424) Java Dataflow ValidatesRunner tests are timeouting

2019-12-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8424: Summary: Java Dataflow ValidatesRunner tests are timeouting (was: java 11 dataflow validates

[jira] [Commented] (BEAM-8424) java 11 dataflow validates runner tests are timeouting

2019-12-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988847#comment-16988847 ] Lukasz Gajowy commented on BEAM-8424: - Moreover, when the Jenkins job is aborted due to timeout, we

[jira] [Assigned] (BEAM-8424) java 11 dataflow validates runner tests are timeouting

2019-12-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-8424: --- Assignee: (was: Lukasz Gajowy) > java 11 dataflow validates runner tests are timeouting

[jira] [Commented] (BEAM-8424) java 11 dataflow validates runner tests are timeouting

2019-12-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988846#comment-16988846 ] Lukasz Gajowy commented on BEAM-8424: - The previous fix (pr #9819) mitigated the issue and tests

[jira] [Reopened] (BEAM-8424) java 11 dataflow validates runner tests are timeouting

2019-12-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reopened BEAM-8424: - Assignee: Lukasz Gajowy > java 11 dataflow validates runner tests are timeouting >

[jira] [Closed] (BEAM-8424) java 11 dataflow validates runner tests are timeouting

2019-12-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy closed BEAM-8424. --- Fix Version/s: Not applicable Resolution: Fixed > java 11 dataflow validates runner tests are

[jira] [Updated] (BEAM-8424) java 11 dataflow validates runner tests are timeouting

2019-12-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8424: Status: Open (was: Triage Needed) > java 11 dataflow validates runner tests are timeouting >

[jira] [Updated] (BEAM-8424) java 11 dataflow validates runner tests are timeouting

2019-12-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8424: Status: Open (was: Triage Needed) > java 11 dataflow validates runner tests are timeouting >

[jira] [Updated] (BEAM-8895) BigQueryIO streaming test on Java is flaky

2019-12-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8895: Status: Open (was: Triage Needed) > BigQueryIO streaming test on Java is flaky >

[jira] [Commented] (BEAM-3708) Implement the portable lifted Combiner transforms in Java SDK

2019-12-03 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986987#comment-16986987 ] Lukasz Gajowy commented on BEAM-3708: - According to Portability Support matrix this issue is a blocker

[jira] [Created] (BEAM-8826) Investigate possibility of system metrics usage in portable performance tests

2019-11-26 Thread Lukasz Gajowy (Jira)
Lukasz Gajowy created BEAM-8826: --- Summary: Investigate possibility of system metrics usage in portable performance tests Key: BEAM-8826 URL: https://issues.apache.org/jira/browse/BEAM-8826 Project:

[jira] [Updated] (BEAM-8792) Bring back the names of the runtime metrics to "runtime"

2019-11-20 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8792: Status: Open (was: Triage Needed) > Bring back the names of the runtime metrics to "runtime" >

[jira] [Resolved] (BEAM-4775) JobService should support returning metrics

2019-11-18 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy resolved BEAM-4775. - Fix Version/s: Not applicable Resolution: Fixed the JobServer part is done - all kinds of

[jira] [Assigned] (BEAM-4775) JobService should support returning metrics

2019-11-18 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-4775: --- Assignee: Lukasz Gajowy (was: Kamil Wasilewski) > JobService should support returning

[jira] [Assigned] (BEAM-4777) Python PortableRunner should support metrics

2019-11-18 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-4777: --- Assignee: Kamil Wasilewski (was: Lukasz Gajowy) > Python PortableRunner should support

[jira] [Updated] (BEAM-7404) ObjectSizeCalculator not supported in Portable Java pipelines

2019-11-14 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-7404: Fix Version/s: (was: 2.16.0) Not applicable > ObjectSizeCalculator not

[jira] [Comment Edited] (BEAM-8616) ParquetIO should have Hadoop dependencies as provided

2019-11-13 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973499#comment-16973499 ] Lukasz Gajowy edited comment on BEAM-8616 at 11/13/19 4:39 PM: --- [~iemejia] I

[jira] [Commented] (BEAM-8616) ParquetIO should have Hadoop dependencies as provided

2019-11-13 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973499#comment-16973499 ] Lukasz Gajowy commented on BEAM-8616: - I agree, however, I can't find the label - which one do you

[jira] [Commented] (BEAM-8616) ParquetIO should have Hadoop dependencies as provided

2019-11-12 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972396#comment-16972396 ] Lukasz Gajowy commented on BEAM-8616: - ParquetIO is marked as experimental so I think it's safe to

[jira] [Commented] (BEAM-5495) PipelineResources algorithm is not working in most environments

2019-11-08 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970485#comment-16970485 ] Lukasz Gajowy commented on BEAM-5495: - I'd like to push things forward here so I assigned myself. I'm

[jira] [Assigned] (BEAM-5495) PipelineResources algorithm is not working in most environments

2019-11-08 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy reassigned BEAM-5495: --- Assignee: Lukasz Gajowy > PipelineResources algorithm is not working in most environments >

[jira] [Created] (BEAM-8559) Run Dataflow Nexmark suites with Java 11

2019-11-05 Thread Lukasz Gajowy (Jira)
Lukasz Gajowy created BEAM-8559: --- Summary: Run Dataflow Nexmark suites with Java 11 Key: BEAM-8559 URL: https://issues.apache.org/jira/browse/BEAM-8559 Project: Beam Issue Type: Sub-task

[jira] [Updated] (BEAM-8558) BigQueryIOIT Jenkins job flakes

2019-11-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8558: Status: Open (was: Triage Needed) > BigQueryIOIT Jenkins job flakes >

[jira] [Resolved] (BEAM-8432) Parametrize source & target compatibility for beam Java modules

2019-11-05 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy resolved BEAM-8432. - Resolution: Fixed > Parametrize source & target compatibility for beam Java modules >

[jira] [Commented] (BEAM-8432) Parametrize source & target compatibility for beam Java modules

2019-11-04 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966883#comment-16966883 ] Lukasz Gajowy commented on BEAM-8432: - I think you're right - I missed this one. Submitting PR... >

[jira] [Updated] (BEAM-8548) Provide separate Jenkins job instances for each triggering modes

2019-11-02 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8548: Description: Currently, there are several Jenkins job definitions that can be run in multiple ways

[jira] [Closed] (BEAM-8422) Send emails to builds@ when job ends with state "ABORTED"

2019-11-02 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy closed BEAM-8422. --- Fix Version/s: Not applicable Resolution: Fixed > Send emails to builds@ when job ends with

[jira] [Commented] (BEAM-8422) Send emails to builds@ when job ends with state "ABORTED"

2019-11-02 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965517#comment-16965517 ] Lukasz Gajowy commented on BEAM-8422: - [~kamilwu] created: 

[jira] [Commented] (BEAM-8548) Provide separate Jenkins job instances for each triggering modes

2019-11-02 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965516#comment-16965516 ] Lukasz Gajowy commented on BEAM-8548: - CC: [~kamilwu] > Provide separate Jenkins job instances for

[jira] [Created] (BEAM-8548) Provide separate Jenkins job instances for each triggering modes

2019-11-02 Thread Lukasz Gajowy (Jira)
Lukasz Gajowy created BEAM-8548: --- Summary: Provide separate Jenkins job instances for each triggering modes Key: BEAM-8548 URL: https://issues.apache.org/jira/browse/BEAM-8548 Project: Beam

[jira] [Commented] (BEAM-6303) Add .parquet extension to files in ParquetIO

2019-10-29 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961871#comment-16961871 ] Lukasz Gajowy commented on BEAM-6303: - I decided to improve the docs and do nothing else for this

[jira] [Comment Edited] (BEAM-6303) Add .parquet extension to files in ParquetIO

2019-10-29 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961871#comment-16961871 ] Lukasz Gajowy edited comment on BEAM-6303 at 10/29/19 10:31 AM: I decided

[jira] [Updated] (BEAM-8432) Parametrize source & target compatibility for beam Java modules

2019-10-29 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8432: Status: Open (was: Triage Needed) > Parametrize source & target compatibility for beam Java

[jira] [Commented] (BEAM-6303) Add .parquet extension to files in ParquetIO

2019-10-28 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961315#comment-16961315 ] Lukasz Gajowy commented on BEAM-6303: - There is an easy way to provide the extension right now:

[jira] [Resolved] (BEAM-8462) Upgrade supported Flink version to 1.9

2019-10-25 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy resolved BEAM-8462. - Fix Version/s: Not applicable Resolution: Fixed > Upgrade supported Flink version to 1.9 >

[jira] [Commented] (BEAM-8422) Send emails to builds@ when job ends with state "ABORTED"

2019-10-24 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959062#comment-16959062 ] Lukasz Gajowy commented on BEAM-8422: - I looked more into possibilities of turning off emails for

[jira] [Updated] (BEAM-8462) Upgrade supported Flink version to 1.9

2019-10-24 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8462: Status: Open (was: Triage Needed) > Upgrade supported Flink version to 1.9 >

[jira] [Updated] (BEAM-8207) KafkaIOITs generate different hashes each run, sometimes dropping records

2019-10-21 Thread Lukasz Gajowy (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Gajowy updated BEAM-8207: Status: Open (was: Triage Needed) > KafkaIOITs generate different hashes each run, sometimes

[jira] [Created] (BEAM-8432) Parametrize source & target compatibility for beam Java modules

2019-10-18 Thread Lukasz Gajowy (Jira)
Lukasz Gajowy created BEAM-8432: --- Summary: Parametrize source & target compatibility for beam Java modules Key: BEAM-8432 URL: https://issues.apache.org/jira/browse/BEAM-8432 Project: Beam

  1   2   3   4   >