[jira] [Work logged] (BEAM-7475) Add Python stateful processing example in blog

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7475?focusedWorklogId=262795=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262795 ] ASF GitHub Bot logged work on BEAM-7475: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7475) Add Python stateful processing example in blog

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7475?focusedWorklogId=262794=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262794 ] ASF GitHub Bot logged work on BEAM-7475: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7560) Python local filesystem match does not work without directory separator.

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7560: --- Status: Open (was: Triage Needed) > Python local filesystem match does not work without directory

[jira] [Updated] (BEAM-7562) Remove/Replace Sns's Writer turn type PCollectionTuple

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7562: --- Status: Open (was: Triage Needed) > Remove/Replace Sns's Writer turn type PCollectionTuple >

[jira] [Updated] (BEAM-7565) support Splittable DoFn in samza runner

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7565: --- Status: Open (was: Triage Needed) > support Splittable DoFn in samza runner >

[jira] [Updated] (BEAM-7564) feature complete for ParDo in Samza Portable Runner

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7564: --- Status: Open (was: Triage Needed) > feature complete for ParDo in Samza Portable Runner >

[jira] [Updated] (BEAM-7576) Automatically push flink job-server-container to hub.docker

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7576: --- Status: Open (was: Triage Needed) > Automatically push flink job-server-container to hub.docker >

[jira] [Updated] (BEAM-7572) Classes ApproximateUnique.Globally and ApproximateUnique.PerKey are inaccessible

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7572: --- Status: Open (was: Triage Needed) > Classes ApproximateUnique.Globally and ApproximateUnique.PerKey

[jira] [Updated] (BEAM-7569) filesystem_test is failing for Windows

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7569: --- Status: Open (was: Triage Needed) > filesystem_test is failing for Windows >

[jira] [Updated] (BEAM-7580) Split GroupingBuffer to N pieces

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7580: --- Status: Open (was: Triage Needed) > Split GroupingBuffer to N pieces >

[jira] [Updated] (BEAM-7570) withCustomGcsTempLocation should also be implemented for BigQueryIO.Read

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7570: --- Status: Open (was: Triage Needed) > withCustomGcsTempLocation should also be implemented for

[jira] [Work logged] (BEAM-3645) Support multi-process execution on the FnApiRunner

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3645?focusedWorklogId=262791=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262791 ] ASF GitHub Bot logged work on BEAM-3645: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7581) Multiplexing chunked GroupingBuffer

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7581: --- Status: Open (was: Triage Needed) > Multiplexing chunked GroupingBuffer >

[jira] [Updated] (BEAM-7575) Add Wordcount-on-Flink to Python 3.6 and 3.7 test suite

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7575: --- Status: Open (was: Triage Needed) > Add Wordcount-on-Flink to Python 3.6 and 3.7 test suite >

[jira] [Work logged] (BEAM-3645) Support multi-process execution on the FnApiRunner

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3645?focusedWorklogId=262789=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262789 ] ASF GitHub Bot logged work on BEAM-3645: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3645) Support multi-process execution on the FnApiRunner

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3645?focusedWorklogId=262787=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262787 ] ASF GitHub Bot logged work on BEAM-3645: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7587) Spark portable runner: Streaming mode

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7587: --- Status: Open (was: Triage Needed) > Spark portable runner: Streaming mode >

[jira] [Updated] (BEAM-7590) Convert PipelineOptionsMap to PipelineOption

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7590: --- Status: Open (was: Triage Needed) > Convert PipelineOptionsMap to PipelineOption >

[jira] [Updated] (BEAM-7561) HdfsFileSystem is unable to match a directory

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7561: --- Status: Open (was: Triage Needed) > HdfsFileSystem is unable to match a directory >

[jira] [Updated] (BEAM-7588) Python BigQuery sink should be able to handle 15TB load job quota

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7588: --- Status: Open (was: Triage Needed) > Python BigQuery sink should be able to handle 15TB load job

[jira] [Work logged] (BEAM-7130) convertAvroFieldStrict as public static function could handle more types of value for logical type timestamp-millis

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7130?focusedWorklogId=262786=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262786 ] ASF GitHub Bot logged work on BEAM-7130: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7589) Kinesis IO.write throws LimitExceededException

2019-06-18 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7589: --- Status: Open (was: Triage Needed) > Kinesis IO.write throws LimitExceededException >

[jira] [Work logged] (BEAM-6877) TypeHints Py3 Error: Type inference tests fail on Python 3.6 due to bytecode changes

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6877?focusedWorklogId=262778=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262778 ] ASF GitHub Bot logged work on BEAM-6877: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6955) Support Dataflow --sdk_location with modified version number

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6955?focusedWorklogId=262765=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262765 ] ASF GitHub Bot logged work on BEAM-6955: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7507) StreamingDataflowWorker attempts to decode non-utf8 binary data as utf8

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7507?focusedWorklogId=262721=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262721 ] ASF GitHub Bot logged work on BEAM-7507: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6877) TypeHints Py3 Error: Type inference tests fail on Python 3.6 due to bytecode changes

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6877?focusedWorklogId=262714=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262714 ] ASF GitHub Bot logged work on BEAM-6877: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7579) Tests fail with "Cannot create a default bucket when --dataflowKmsKey is set."

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7579?focusedWorklogId=262687=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262687 ] ASF GitHub Bot logged work on BEAM-7579: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7579) Tests fail with "Cannot create a default bucket when --dataflowKmsKey is set."

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7579?focusedWorklogId=262686=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262686 ] ASF GitHub Bot logged work on BEAM-7579: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7579) Tests fail with "Cannot create a default bucket when --dataflowKmsKey is set."

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7579?focusedWorklogId=262685=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262685 ] ASF GitHub Bot logged work on BEAM-7579: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7579) Tests fail with "Cannot create a default bucket when --dataflowKmsKey is set."

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7579?focusedWorklogId=262684=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262684 ] ASF GitHub Bot logged work on BEAM-7579: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7590) Convert PipelineOptionsMap to PipelineOption

2019-06-18 Thread Alireza Samadianzakaria (JIRA)
Alireza Samadianzakaria created BEAM-7590: - Summary: Convert PipelineOptionsMap to PipelineOption Key: BEAM-7590 URL: https://issues.apache.org/jira/browse/BEAM-7590 Project: Beam

[jira] [Resolved] (BEAM-4288) SplittableDoFn: splitAtFraction() API for Python

2019-06-18 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw resolved BEAM-4288. --- Resolution: Fixed Fix Version/s: 2.14.0 > SplittableDoFn: splitAtFraction() API for

[jira] [Commented] (BEAM-4288) SplittableDoFn: splitAtFraction() API for Python

2019-06-18 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867127#comment-16867127 ] Robert Bradshaw commented on BEAM-4288: --- This was resolved with 

[jira] [Commented] (BEAM-7424) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data

2019-06-18 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867126#comment-16867126 ] Chamikara Jayalath commented on BEAM-7424: -- I believe Python fix is still in development. >

[jira] [Work logged] (BEAM-6877) TypeHints Py3 Error: Type inference tests fail on Python 3.6 due to bytecode changes

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6877?focusedWorklogId=262674=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262674 ] ASF GitHub Bot logged work on BEAM-6877: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7357) Kinesis IO.write throws LimitExceededException

2019-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin resolved BEAM-7357. --- Resolution: Fixed > Kinesis IO.write throws LimitExceededException >

[jira] [Commented] (BEAM-7357) Kinesis IO.write throws LimitExceededException

2019-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867120#comment-16867120 ] Anton Kedin commented on BEAM-7357: --- [~aromanenko] cool, resolving this one in favor of BEAM-7589 then

[jira] [Updated] (BEAM-7589) Kinesis IO.write throws LimitExceededException

2019-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-7589: -- Summary: Kinesis IO.write throws LimitExceededException (was: []Kinesis IO.write throws

[jira] [Created] (BEAM-7589) []Kinesis IO.write throws LimitExceededException

2019-06-18 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-7589: - Summary: []Kinesis IO.write throws LimitExceededException Key: BEAM-7589 URL: https://issues.apache.org/jira/browse/BEAM-7589 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-7493) beam-sdks-testing-nexmark produces corrupt pom.xml

2019-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-7493. - Resolution: Fixed > beam-sdks-testing-nexmark produces corrupt pom.xml >

[jira] [Commented] (BEAM-7561) HdfsFileSystem is unable to match a directory

2019-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867104#comment-16867104 ] Anton Kedin commented on BEAM-7561: --- Awesome, thank you   > HdfsFileSystem is unable to match a

[jira] [Created] (BEAM-7588) Python BigQuery sink should be able to handle 15TB load job quota

2019-06-18 Thread Chamikara Jayalath (JIRA)
Chamikara Jayalath created BEAM-7588: Summary: Python BigQuery sink should be able to handle 15TB load job quota Key: BEAM-7588 URL: https://issues.apache.org/jira/browse/BEAM-7588 Project: Beam

[jira] [Updated] (BEAM-7586) Add Integration Test for MongoDbIO in python sdk

2019-06-18 Thread Yichi Zhang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yichi Zhang updated BEAM-7586: -- Status: Open (was: Triage Needed) > Add Integration Test for MongoDbIO in python sdk >

[jira] [Work started] (BEAM-7586) Add Integration Test for MongoDbIO in python sdk

2019-06-18 Thread Yichi Zhang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-7586 started by Yichi Zhang. - > Add Integration Test for MongoDbIO in python sdk >

[jira] [Work logged] (BEAM-5148) Implement MongoDB IO for Python SDK

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5148?focusedWorklogId=262625=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262625 ] ASF GitHub Bot logged work on BEAM-5148: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5148) Implement MongoDB IO for Python SDK

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5148?focusedWorklogId=262626=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262626 ] ASF GitHub Bot logged work on BEAM-5148: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6877) TypeHints Py3 Error: Type inference tests fail on Python 3.6 due to bytecode changes

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6877?focusedWorklogId=262620=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262620 ] ASF GitHub Bot logged work on BEAM-6877: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6877) TypeHints Py3 Error: Type inference tests fail on Python 3.6 due to bytecode changes

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6877?focusedWorklogId=262621=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262621 ] ASF GitHub Bot logged work on BEAM-6877: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6955) Support Dataflow --sdk_location with modified version number

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6955?focusedWorklogId=262619=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262619 ] ASF GitHub Bot logged work on BEAM-6955: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7357) Kinesis IO.write throws LimitExceededException

2019-06-18 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867028#comment-16867028 ] Alexey Romanenko commented on BEAM-7357: [~brachi_packter] Thank you for details, I'll get back to

[jira] [Work logged] (BEAM-2953) Timeseries processing extensions using state API

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2953?focusedWorklogId=262608=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262608 ] ASF GitHub Bot logged work on BEAM-2953: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4762) Add postCommit scripts and perfkit dashboards for nexmark on Gearpump runner

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4762?focusedWorklogId=262610=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262610 ] ASF GitHub Bot logged work on BEAM-4762: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-2953) Timeseries processing extensions using state API

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2953?focusedWorklogId=262611=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262611 ] ASF GitHub Bot logged work on BEAM-2953: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5806) Allow to change the PubsubClientFactory when using PubsubIO

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5806?focusedWorklogId=262609=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262609 ] ASF GitHub Bot logged work on BEAM-5806: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4762) Add postCommit scripts and perfkit dashboards for nexmark on Gearpump runner

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4762?focusedWorklogId=262607=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262607 ] ASF GitHub Bot logged work on BEAM-4762: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7547) StreamingDataflowWorker can observe inconsistent cache for stale work items

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7547?focusedWorklogId=262583=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262583 ] ASF GitHub Bot logged work on BEAM-7547: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7547) StreamingDataflowWorker can observe inconsistent cache for stale work items

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7547?focusedWorklogId=262582=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262582 ] ASF GitHub Bot logged work on BEAM-7547: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7587) Spark portable runner: Streaming mode

2019-06-18 Thread Kyle Weaver (JIRA)
Kyle Weaver created BEAM-7587: - Summary: Spark portable runner: Streaming mode Key: BEAM-7587 URL: https://issues.apache.org/jira/browse/BEAM-7587 Project: Beam Issue Type: Wish

[jira] [Work logged] (BEAM-7520) DirectRunner timers are not strictly time ordered

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7520?focusedWorklogId=262543=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262543 ] ASF GitHub Bot logged work on BEAM-7520: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7586) Add Integration Test for MongoDbIO in python sdk

2019-06-18 Thread Yichi Zhang (JIRA)
Yichi Zhang created BEAM-7586: - Summary: Add Integration Test for MongoDbIO in python sdk Key: BEAM-7586 URL: https://issues.apache.org/jira/browse/BEAM-7586 Project: Beam Issue Type: Sub-task

[jira] [Comment Edited] (BEAM-7527) Beam Python integration test suites are flaky: ModuleNotFoundError

2019-06-18 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866900#comment-16866900 ] Mark Liu edited comment on BEAM-7527 at 6/18/19 6:10 PM: - It makes

[jira] [Comment Edited] (BEAM-7527) Beam Python integration test suites are flaky: ModuleNotFoundError

2019-06-18 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866900#comment-16866900 ] Mark Liu edited comment on BEAM-7527 at 6/18/19 6:10 PM: - It makes

[jira] [Comment Edited] (BEAM-7527) Beam Python integration test suites are flaky: ModuleNotFoundError

2019-06-18 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866900#comment-16866900 ] Mark Liu edited comment on BEAM-7527 at 6/18/19 6:10 PM: - It makes

[jira] [Commented] (BEAM-7527) Beam Python integration test suites are flaky: ModuleNotFoundError

2019-06-18 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866900#comment-16866900 ] Mark Liu commented on BEAM-7527: It makes beam_PerformanceTests_WordCountIT_Py27 consistently failed. The

[jira] [Work logged] (BEAM-7223) Enable Python3 tests for Flink

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7223?focusedWorklogId=262540=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262540 ] ASF GitHub Bot logged work on BEAM-7223: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5148) Implement MongoDB IO for Python SDK

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5148?focusedWorklogId=262533=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262533 ] ASF GitHub Bot logged work on BEAM-5148: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6955) Support Dataflow --sdk_location with modified version number

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6955?focusedWorklogId=262517=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262517 ] ASF GitHub Bot logged work on BEAM-6955: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6955) Support Dataflow --sdk_location with modified version number

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6955?focusedWorklogId=262510=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262510 ] ASF GitHub Bot logged work on BEAM-6955: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7130) convertAvroFieldStrict as public static function could handle more types of value for logical type timestamp-millis

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7130?focusedWorklogId=262506=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262506 ] ASF GitHub Bot logged work on BEAM-7130: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7130) convertAvroFieldStrict as public static function could handle more types of value for logical type timestamp-millis

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7130?focusedWorklogId=262505=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262505 ] ASF GitHub Bot logged work on BEAM-7130: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7579) Tests fail with "Cannot create a default bucket when --dataflowKmsKey is set."

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7579?focusedWorklogId=262476=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262476 ] ASF GitHub Bot logged work on BEAM-7579: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5148) Implement MongoDB IO for Python SDK

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5148?focusedWorklogId=262438=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262438 ] ASF GitHub Bot logged work on BEAM-5148: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-4736) Support reading decimal from BigQuery in Beam SQL

2019-06-18 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang reassigned BEAM-4736: -- Assignee: (was: Rui Wang) > Support reading decimal from BigQuery in Beam SQL >

[jira] [Assigned] (BEAM-7142) Data Driven testing for BeamSQL

2019-06-18 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang reassigned BEAM-7142: -- Assignee: (was: Rui Wang) > Data Driven testing for BeamSQL > --- > >

[jira] [Assigned] (BEAM-6000) Support DATETIME type in BeamSQL

2019-06-18 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang reassigned BEAM-6000: -- Assignee: (was: Rui Wang) > Support DATETIME type in BeamSQL > >

[jira] [Closed] (BEAM-5046) Implement Missing Standard SQL functions in BeamSQL

2019-06-18 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang closed BEAM-5046. -- Resolution: Won't Do Fix Version/s: Not applicable > Implement Missing Standard SQL functions in BeamSQL

[jira] [Resolved] (BEAM-7461) [beam_PostCommit_SQL] [TestPubsub.checkIfAnySubscriptionExists] DEADLINE_EXCEEDED: PubsubGrpcClient.listSubscriptions

2019-06-18 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved BEAM-7461. Resolution: Fixed Fix Version/s: Not applicable > [beam_PostCommit_SQL]

[jira] [Work logged] (BEAM-7428) ReadAllViaFileBasedSource does not output the timestamps of the read elements

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7428?focusedWorklogId=262395=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262395 ] ASF GitHub Bot logged work on BEAM-7428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7499) ReifyTest.test_window fails in DirectRunner due to 'assign_context.window should not be None.'

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7499?focusedWorklogId=262365=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262365 ] ASF GitHub Bot logged work on BEAM-7499: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4046) Decouple gradle project names and maven artifact ids

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4046?focusedWorklogId=262358=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262358 ] ASF GitHub Bot logged work on BEAM-4046: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5519) Spark Streaming Duplicated Encoding/Decoding Effort

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5519?focusedWorklogId=262347=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262347 ] ASF GitHub Bot logged work on BEAM-5519: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7018) Regex transform for Python SDK

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7018?focusedWorklogId=262345=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262345 ] ASF GitHub Bot logged work on BEAM-7018: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7585) Ipython usage raises AttributeError

2019-06-18 Thread SBlackwell (JIRA)
SBlackwell created BEAM-7585: Summary: Ipython usage raises AttributeError Key: BEAM-7585 URL: https://issues.apache.org/jira/browse/BEAM-7585 Project: Beam Issue Type: Bug Components:

[jira] [Work logged] (BEAM-4046) Decouple gradle project names and maven artifact ids

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4046?focusedWorklogId=262321=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262321 ] ASF GitHub Bot logged work on BEAM-4046: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7018) Regex transform for Python SDK

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7018?focusedWorklogId=262257=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262257 ] ASF GitHub Bot logged work on BEAM-7018: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3645) Support multi-process execution on the FnApiRunner

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3645?focusedWorklogId=262204=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262204 ] ASF GitHub Bot logged work on BEAM-3645: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3645) Support multi-process execution on the FnApiRunner

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3645?focusedWorklogId=262205=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262205 ] ASF GitHub Bot logged work on BEAM-3645: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7561) HdfsFileSystem is unable to match a directory

2019-06-18 Thread David Moravek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866353#comment-16866353 ] David Moravek commented on BEAM-7561: - at the conference, but I’ll do my best to finish it tonight

[jira] [Updated] (BEAM-7577) Allow the use of ValueProviders in datastore.v1new.datastoreio.ReadFromDatastore query

2019-06-18 Thread EDjur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] EDjur updated BEAM-7577: Description: The current implementation of ReadFromDatastore does not support specifying the query parameter at

[jira] [Commented] (BEAM-7577) Allow the use of ValueProviders in datastore.v1new.datastoreio.ReadFromDatastore query

2019-06-18 Thread EDjur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866332#comment-16866332 ] EDjur commented on BEAM-7577: - I'd be happy to give a go att adding this functionality for the query filters

[jira] [Work logged] (BEAM-7579) Tests fail with "Cannot create a default bucket when --dataflowKmsKey is set."

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7579?focusedWorklogId=262070=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262070 ] ASF GitHub Bot logged work on BEAM-7579: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7579) Tests fail with "Cannot create a default bucket when --dataflowKmsKey is set."

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7579?focusedWorklogId=262069=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262069 ] ASF GitHub Bot logged work on BEAM-7579: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7579) Tests fail with "Cannot create a default bucket when --dataflowKmsKey is set."

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7579?focusedWorklogId=262068=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262068 ] ASF GitHub Bot logged work on BEAM-7579: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7579) Tests fail with "Cannot create a default bucket when --dataflowKmsKey is set."

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7579?focusedWorklogId=262060=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262060 ] ASF GitHub Bot logged work on BEAM-7579: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4046) Decouple gradle project names and maven artifact ids

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4046?focusedWorklogId=262058=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262058 ] ASF GitHub Bot logged work on BEAM-4046: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4046) Decouple gradle project names and maven artifact ids

2019-06-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4046?focusedWorklogId=262059=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262059 ] ASF GitHub Bot logged work on BEAM-4046: Author: ASF GitHub Bot