[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=277230=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277230 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=277231=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277231 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=277228=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277228 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-6855) Side inputs are not supported when using the state API

2019-07-15 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885853#comment-16885853 ] Reuven Lax commented on BEAM-6855: -- [~kenn] it was never addressed. Can you confirm that the described

[jira] [Work logged] (BEAM-6675) The JdbcIO sink should accept schemas

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6675?focusedWorklogId=277187=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277187 ] ASF GitHub Bot logged work on BEAM-6675: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-6855) Side inputs are not supported when using the state API

2019-07-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885830#comment-16885830 ] Kenneth Knowles commented on BEAM-6855: --- This was definitely an issue at one time. I thought someone

[jira] [Work logged] (BEAM-7739) Add ValueState in Python sdk

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7739?focusedWorklogId=277173=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277173 ] ASF GitHub Bot logged work on BEAM-7739: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7530) Reading None value type BYTES from bigquery: AttributeError

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7530?focusedWorklogId=277100=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277100 ] ASF GitHub Bot logged work on BEAM-7530: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7018) Regex transform for Python SDK

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7018?focusedWorklogId=277094=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277094 ] ASF GitHub Bot logged work on BEAM-7018: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7018) Regex transform for Python SDK

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7018?focusedWorklogId=277093=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277093 ] ASF GitHub Bot logged work on BEAM-7018: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2264: --- Assignee: Udi Meiri > Re-use credential instead of generating a new one one each GCS call >

[jira] [Commented] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885720#comment-16885720 ] Luke Cwik commented on BEAM-2264: - Thanks for doing the investigation. > Re-use credential instead of

[jira] [Work logged] (BEAM-7696) Detect classpath resources contains directory cause exception

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7696?focusedWorklogId=277073=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277073 ] ASF GitHub Bot logged work on BEAM-7696: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7750) Pipeline instances are not garbage collected

2019-07-15 Thread Alexey Strokach (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Strokach updated BEAM-7750: -- Description: It seems that Apache Beam's Pipeline instances are not garbage collected, even if

[jira] [Updated] (BEAM-7750) Pipeline instances are not garbage collected

2019-07-15 Thread Alexey Strokach (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Strokach updated BEAM-7750: -- Description: It seems that Apache Beam's Pipeline instances are not garbage collected, even if

[jira] [Created] (BEAM-7750) Pipeline instances are not garbage collected

2019-07-15 Thread Alexey Strokach (JIRA)
Alexey Strokach created BEAM-7750: - Summary: Pipeline instances are not garbage collected Key: BEAM-7750 URL: https://issues.apache.org/jira/browse/BEAM-7750 Project: Beam Issue Type: Bug

[jira] [Comment Edited] (BEAM-7674) Define streaming ITs tests for direct runner in consistent way in Python 2 and Python 3 suites.

2019-07-15 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885697#comment-16885697 ] Pablo Estrada edited comment on BEAM-7674 at 7/15/19 11:30 PM: --- Sorry for

[jira] [Commented] (BEAM-7674) Define streaming ITs tests for direct runner in consistent way in Python 2 and Python 3 suites.

2019-07-15 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885697#comment-16885697 ] Pablo Estrada commented on BEAM-7674: - Sorry for the delay to answer. That test should be a pure

[jira] [Work logged] (BEAM-6611) A Python Sink for BigQuery with File Loads in Streaming

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6611?focusedWorklogId=277063=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277063 ] ASF GitHub Bot logged work on BEAM-6611: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885693#comment-16885693 ] Udi Meiri commented on BEAM-2264: - Migrating off of apitools-based clients (such as the one used for GCS)

[jira] [Work logged] (BEAM-4775) JobService should support returning metrics

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4775?focusedWorklogId=277060=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277060 ] ASF GitHub Bot logged work on BEAM-4775: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7463) BigQueryQueryToTableIT is flaky on Direct runner in PostCommit suites: incorrect checksum

2019-07-15 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885686#comment-16885686 ] Pablo Estrada commented on BEAM-7463: - FWIW I'm running with Py3.5 > BigQueryQueryToTableIT is flaky

[jira] [Commented] (BEAM-5874) Python BQ directRunnerIT test fails with half-empty assertion

2019-07-15 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885685#comment-16885685 ] Pablo Estrada commented on BEAM-5874: - I am also unable to repro this on my machine with Py3.5 >

[jira] [Work logged] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?focusedWorklogId=277040=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277040 ] ASF GitHub Bot logged work on BEAM-2264: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-6855) Side inputs are not supported when using the state API

2019-07-15 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885670#comment-16885670 ] Reuven Lax commented on BEAM-6855: -- I believe that the side-input code in 

[jira] [Commented] (BEAM-7463) BigQueryQueryToTableIT is flaky on Direct runner in PostCommit suites: incorrect checksum

2019-07-15 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885665#comment-16885665 ] Pablo Estrada commented on BEAM-7463: - This tests is running in 4s, but they do seem to perform all of

[jira] [Work logged] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?focusedWorklogId=277009=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277009 ] ASF GitHub Bot logged work on BEAM-2264: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-5874) Python BQ directRunnerIT test fails with half-empty assertion

2019-07-15 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885650#comment-16885650 ] Valentyn Tymofieiev commented on BEAM-5874: --- Assigning to Pablo who is investigating a similar

[jira] [Assigned] (BEAM-5874) Python BQ directRunnerIT test fails with half-empty assertion

2019-07-15 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev reassigned BEAM-5874: - Assignee: Pablo Estrada > Python BQ directRunnerIT test fails with half-empty

[jira] [Resolved] (BEAM-7656) Add sdk-worker-parallelism arg to flink job server shadow jar

2019-07-15 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-7656. --- Resolution: Fixed Fix Version/s: 2.15.0 > Add sdk-worker-parallelism arg to flink job server

[jira] [Updated] (BEAM-7058) Python SDK: Collect metrics in non-cython environment

2019-07-15 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-7058: -- Description: With the portable Flink runner, the metric is reported as 0, while the count metric works

[jira] [Updated] (BEAM-7058) Python SDK: Collect metrics in non-cython environment

2019-07-15 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-7058: -- Description: With the portable Flink runner, the metric is reported as 0, while the count metric works

[jira] [Commented] (BEAM-7058) Python SDK: Collect metrics in non-cython environment

2019-07-15 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885630#comment-16885630 ] Kyle Weaver commented on BEAM-7058: --- We will leave this open. I have updated the issue type and

[jira] [Updated] (BEAM-7058) Python SDK: Collect metrics in non-cython environment

2019-07-15 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-7058: -- Summary: Python SDK: Collect metrics in non-cython environment (was: Python SDK: Implement state

[jira] [Updated] (BEAM-7058) Python SDK: Implement state sampling for non-cython environment

2019-07-15 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-7058: -- Summary: Python SDK: Implement state sampling for non-cython environment (was: Python SDK metric

[jira] [Updated] (BEAM-7058) Python SDK metric process_bundle_msecs reported as zero

2019-07-15 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver updated BEAM-7058: -- Issue Type: New Feature (was: Bug) > Python SDK metric process_bundle_msecs reported as zero >

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=276996=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276996 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7749) Establish a strategy to prevent or mitigate quota-related flakes in Beam integration tests.

2019-07-15 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885617#comment-16885617 ] Valentyn Tymofieiev commented on BEAM-7749: --- In the mean time as a mitigation, maintainers of

[jira] [Comment Edited] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885611#comment-16885611 ] Luke Cwik edited comment on BEAM-2264 at 7/15/19 8:58 PM: -- It looks like Python

[jira] [Created] (BEAM-7749) Establish a strategy to prevent or mitigate quota-related flakes in Beam integration tests.

2019-07-15 Thread Valentyn Tymofieiev (JIRA)
Valentyn Tymofieiev created BEAM-7749: - Summary: Establish a strategy to prevent or mitigate quota-related flakes in Beam integration tests. Key: BEAM-7749 URL: https://issues.apache.org/jira/browse/BEAM-7749

[jira] [Commented] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885611#comment-16885611 ] Luke Cwik commented on BEAM-2264: - It looks like Python has the same issue where google.auth replaces

[jira] [Commented] (BEAM-7058) Python SDK metric process_bundle_msecs reported as zero

2019-07-15 Thread Rakesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885610#comment-16885610 ] Rakesh Kumar commented on BEAM-7058: After installing cython in the application environment, I can see

[jira] [Work logged] (BEAM-7666) Pipe memory thrashing signal to Dataflow

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7666?focusedWorklogId=276976=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276976 ] ASF GitHub Bot logged work on BEAM-7666: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7527) Python 3 test parallelization causes test flakines due to ModuleNotFoundError.

2019-07-15 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885597#comment-16885597 ] Valentyn Tymofieiev commented on BEAM-7527: --- I'll take a look at this while Mark is OOO. >

[jira] [Assigned] (BEAM-7527) Python 3 test parallelization causes test flakines due to ModuleNotFoundError.

2019-07-15 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev reassigned BEAM-7527: - Assignee: Valentyn Tymofieiev (was: Mark Liu) > Python 3 test parallelization

[jira] [Work logged] (BEAM-7656) Add sdk-worker-parallelism arg to flink job server shadow jar

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7656?focusedWorklogId=276974=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276974 ] ASF GitHub Bot logged work on BEAM-7656: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7656) Add sdk-worker-parallelism arg to flink job server shadow jar

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7656?focusedWorklogId=276975=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276975 ] ASF GitHub Bot logged work on BEAM-7656: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7733) Flaky tests on Dataflow because of not found information about job state

2019-07-15 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885596#comment-16885596 ] Valentyn Tymofieiev commented on BEAM-7733: --- This a Dataflow issue, and is being addressed

[jira] [Work logged] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?focusedWorklogId=276972=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276972 ] ASF GitHub Bot logged work on BEAM-2264: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7748) beam_PostCommit_Py_VR_Dataflow -> :sdks:python:test-suites:dataflow:py35:validatesRunnerBatchTests -> No module named 'endpoints_pb2'

2019-07-15 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885590#comment-16885590 ] Valentyn Tymofieiev commented on BEAM-7748: --- This is a duplicate of

[jira] [Closed] (BEAM-7748) beam_PostCommit_Py_VR_Dataflow -> :sdks:python:test-suites:dataflow:py35:validatesRunnerBatchTests -> No module named 'endpoints_pb2'

2019-07-15 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev closed BEAM-7748. - Resolution: Duplicate Fix Version/s: Not applicable >

[jira] [Created] (BEAM-7748) beam_PostCommit_Py_VR_Dataflow -> :sdks:python:test-suites:dataflow:py35:validatesRunnerBatchTests -> No module named 'endpoints_pb2'

2019-07-15 Thread Ankur Goenka (JIRA)
Ankur Goenka created BEAM-7748: -- Summary: beam_PostCommit_Py_VR_Dataflow -> :sdks:python:test-suites:dataflow:py35:validatesRunnerBatchTests -> No module named 'endpoints_pb2' Key: BEAM-7748 URL:

[jira] [Commented] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885587#comment-16885587 ] Udi Meiri commented on BEAM-2264: - I'm not sure. I added a test logging.error('wrapper!') entry to 

[jira] [Commented] (BEAM-7748) beam_PostCommit_Py_VR_Dataflow -> :sdks:python:test-suites:dataflow:py35:validatesRunnerBatchTests -> No module named 'endpoints_pb2'

2019-07-15 Thread Ankur Goenka (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885588#comment-16885588 ] Ankur Goenka commented on BEAM-7748: cc [~tvalentyn] > beam_PostCommit_Py_VR_Dataflow -> >

[jira] [Work logged] (BEAM-7546) Portable WordCount-on-Flink Precommit is flaky - temporary folder not found.

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7546?focusedWorklogId=276966=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276966 ] ASF GitHub Bot logged work on BEAM-7546: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=276964=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276964 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=276959=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276959 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=276957=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276957 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=276953=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276953 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=276946=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276946 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7747) ERROR: test_sink_transform (apache_beam.io.avroio_test.TestFastAvro) Fails on Windows

2019-07-15 Thread Valentyn Tymofieiev (JIRA)
Valentyn Tymofieiev created BEAM-7747: - Summary: ERROR: test_sink_transform (apache_beam.io.avroio_test.TestFastAvro) Fails on Windows Key: BEAM-7747 URL: https://issues.apache.org/jira/browse/BEAM-7747

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=276935=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276935 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=276932=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276932 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=276933=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276933 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7711) Support DATETIME as a logical type in BeamSQL

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7711?focusedWorklogId=276931=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276931 ] ASF GitHub Bot logged work on BEAM-7711: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7746) Add type hints to python code

2019-07-15 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-7746: Description: As a developer of the beam source code, I would like the code to use pep484 type

[jira] [Work logged] (BEAM-7746) Add type hints to python code

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7746?focusedWorklogId=276925=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276925 ] ASF GitHub Bot logged work on BEAM-7746: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7746) Add type hints to python code

2019-07-15 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7746: --- Summary: Add type hints to python code Key: BEAM-7746 URL: https://issues.apache.org/jira/browse/BEAM-7746 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-7463) BigQueryQueryToTableIT is flaky on Direct runner in PostCommit suites: incorrect checksum

2019-07-15 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885473#comment-16885473 ] Valentyn Tymofieiev commented on BEAM-7463: --- We don't need to pass SDK location. This is where

[jira] [Created] (BEAM-7745) StreamingSideInputDoFnRunner/StreamingSideInputFetcher have suboptimal state access pattern during normal operation

2019-07-15 Thread Steve Niemitz (JIRA)
Steve Niemitz created BEAM-7745: --- Summary: StreamingSideInputDoFnRunner/StreamingSideInputFetcher have suboptimal state access pattern during normal operation Key: BEAM-7745 URL:

[jira] [Work logged] (BEAM-7744) LTS backport: Temporary directory for WriteOperation may not be unique in FileBaseSink

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7744?focusedWorklogId=276905=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276905 ] ASF GitHub Bot logged work on BEAM-7744: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7463) BigQueryQueryToTableIT is flaky on Direct runner in PostCommit suites: incorrect checksum

2019-07-15 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885465#comment-16885465 ] Pablo Estrada commented on BEAM-7463: - gah - I was running on dataflow. What's the best command to

[jira] [Created] (BEAM-7744) LTS backport: Temporary directory for WriteOperation may not be unique in FileBaseSink

2019-07-15 Thread Heejong Lee (JIRA)
Heejong Lee created BEAM-7744: - Summary: LTS backport: Temporary directory for WriteOperation may not be unique in FileBaseSink Key: BEAM-7744 URL: https://issues.apache.org/jira/browse/BEAM-7744

[jira] [Updated] (BEAM-7689) Temporary directory for WriteOperation may not be unique in FileBaseSink

2019-07-15 Thread Heejong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heejong Lee updated BEAM-7689: -- Fix Version/s: (was: 2.7.1) > Temporary directory for WriteOperation may not be unique in

[jira] [Work logged] (BEAM-7689) Temporary directory for WriteOperation may not be unique in FileBaseSink

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7689?focusedWorklogId=276900=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276900 ] ASF GitHub Bot logged work on BEAM-7689: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7743) Stream position bug in BigQuery storage stream source can lead to data loss

2019-07-15 Thread Kenneth Jung (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885459#comment-16885459 ] Kenneth Jung commented on BEAM-7743: Update: this issue does not appear to be present in 2.14:

[jira] [Updated] (BEAM-7743) Stream position bug in BigQuery storage stream source can lead to data loss

2019-07-15 Thread Kenneth Jung (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Jung updated BEAM-7743: --- Affects Version/s: (was: 2.14.0) 2.15.0 > Stream position bug in BigQuery

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=276895=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276895 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7743) Stream position bug in BigQuery storage stream source can lead to data loss

2019-07-15 Thread Kenneth Jung (JIRA)
Kenneth Jung created BEAM-7743: -- Summary: Stream position bug in BigQuery storage stream source can lead to data loss Key: BEAM-7743 URL: https://issues.apache.org/jira/browse/BEAM-7743 Project: Beam

[jira] [Commented] (BEAM-1746) Include LICENSE and NOTICE in python dist files

2019-07-15 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885448#comment-16885448 ] Ahmet Altay commented on BEAM-1746: --- Not including these files is a bug. 2.4.0 distribution has these

[jira] [Reopened] (BEAM-1746) Include LICENSE and NOTICE in python dist files

2019-07-15 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reopened BEAM-1746: --- > Include LICENSE and NOTICE in python dist files > --- > >

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=276852=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276852 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=276847=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276847 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=276846=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276846 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=276844=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276844 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=276843=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276843 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3645) Support multi-process execution on the FnApiRunner

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3645?focusedWorklogId=276842=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276842 ] ASF GitHub Bot logged work on BEAM-3645: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7742) BigQuery File Loads to work well with load job size limits

2019-07-15 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-7742: --- Summary: BigQuery File Loads to work well with load job size limits Key: BEAM-7742 URL: https://issues.apache.org/jira/browse/BEAM-7742 Project: Beam Issue

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=276836=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276836 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=276835=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276835 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=276826=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276826 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7545) Row Count Estimation for CSV TextTable

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7545?focusedWorklogId=276825=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276825 ] ASF GitHub Bot logged work on BEAM-7545: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-6202) Gracefully handle exceptions when waiting for Dataflow job completion.

2019-07-15 Thread Kasia Kucharczyk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885369#comment-16885369 ] Kasia Kucharczyk commented on BEAM-6202: Here is an issue with same problems but in Load Tests

[jira] [Resolved] (BEAM-7733) Flaky tests on Dataflow because of not found information about job state

2019-07-15 Thread Kasia Kucharczyk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kasia Kucharczyk resolved BEAM-7733. Resolution: Duplicate Fix Version/s: Not applicable > Flaky tests on Dataflow

[jira] [Work logged] (BEAM-7630) Add ITs to check IO behavior with bytes and unicode strings

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7630?focusedWorklogId=276791=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276791 ] ASF GitHub Bot logged work on BEAM-7630: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7715) External / Cross language (via expansion) transforms / public API should be marked @Experimental

2019-07-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885331#comment-16885331 ] Ismaël Mejía commented on BEAM-7715: Yes definitely not a blocker but a really nice to have, however I

[jira] [Resolved] (BEAM-3061) BigtableIO writes should support emitting "done" notifications

2019-07-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-3061. Resolution: Fixed Fix Version/s: 2.15.0 > BigtableIO writes should support emitting "done"

[jira] [Work logged] (BEAM-3061) BigtableIO should support emitting a sentinel "done" value when a bundle completes

2019-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3061?focusedWorklogId=276780=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276780 ] ASF GitHub Bot logged work on BEAM-3061: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-3061) BigtableIO writes should support emitting "done" notifications

2019-07-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-3061: --- Summary: BigtableIO writes should support emitting "done" notifications (was: BigtableIO should

[jira] [Commented] (BEAM-6903) Go IT fails on quota issues frequently

2019-07-15 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885324#comment-16885324 ] Valentyn Tymofieiev commented on BEAM-6903: --- cc: [~alanmyrvold] for awareness as this is related

  1   2   3   >