[jira] [Commented] (BEAM-8286) Python precommit (:sdks:python:test-suites:tox:py2:docs) failing

[ https://issues.apache.org/jira/browse/BEAM-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933891#comment-16933891 ] Chamikara Jayalath commented on BEAM-8286: -- Seems like Kyle's PR fixed the failur

[jira] [Resolved] (BEAM-8286) Python precommit (:sdks:python:test-suites:tox:py2:docs) failing

[ https://issues.apache.org/jira/browse/BEAM-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-8286. -- Fix Version/s: Not applicable Resolution: Fixed > Python precommit (:sdks:python:

[jira] [Commented] (BEAM-8286) Python precommit (:sdks:python:test-suites:tox:py2:docs) failing

[ https://issues.apache.org/jira/browse/BEAM-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933748#comment-16933748 ] Chamikara Jayalath commented on BEAM-8286: -- Hmm, looking at another Gradle build

[jira] [Commented] (BEAM-8286) Python precommit (:sdks:python:test-suites:tox:py2:docs) failing

[ https://issues.apache.org/jira/browse/BEAM-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933732#comment-16933732 ] Chamikara Jayalath commented on BEAM-8286: -- This seems to be the first PR for whi

[jira] [Commented] (BEAM-8240) SDK Harness

[ https://issues.apache.org/jira/browse/BEAM-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930826#comment-16930826 ] Chamikara Jayalath commented on BEAM-8240: -- Makes sense. BTW please fix the title

[jira] [Commented] (BEAM-8222) Consider making insertId optional in BigQuery.insertAll

[ https://issues.apache.org/jira/browse/BEAM-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930697#comment-16930697 ] Chamikara Jayalath commented on BEAM-8222: -- Based on some offline comments from [

[jira] [Commented] (BEAM-8240) SDK Harness

[ https://issues.apache.org/jira/browse/BEAM-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930682#comment-16930682 ] Chamikara Jayalath commented on BEAM-8240: -- In the cross-language path, there wil

[jira] [Closed] (BEAM-8231) State sampler is dropping stage-step names

[ https://issues.apache.org/jira/browse/BEAM-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath closed BEAM-8231. Fix Version/s: 2.17.0 Resolution: Fixed > State sampler is dropping stage-step names

[jira] [Created] (BEAM-8231) State sampler is dropping stage-step names

Chamikara Jayalath created BEAM-8231: Summary: State sampler is dropping stage-step names Key: BEAM-8231 URL: https://issues.apache.org/jira/browse/BEAM-8231 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-8215) Wordcount 1GB Python PKB benchmarks sometimes fail with uninformative error

[ https://issues.apache.org/jira/browse/BEAM-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928866#comment-16928866 ] Chamikara Jayalath commented on BEAM-8215: -- Seems like this is making Python 3 po

[jira] [Created] (BEAM-8219) crossLanguagePortableWordCount seems to be flaky for beam_PostCommit_Python2

Chamikara Jayalath created BEAM-8219: Summary: crossLanguagePortableWordCount seems to be flaky for beam_PostCommit_Python2 Key: BEAM-8219 URL: https://issues.apache.org/jira/browse/BEAM-8219 Pro

[jira] [Updated] (BEAM-7611) Python BigTableIO IT is not running in any test suites

[ https://issues.apache.org/jira/browse/BEAM-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-7611: - Priority: Critical (was: Blocker) > Python BigTableIO IT is not running in any test suite

[jira] [Commented] (BEAM-7611) Python BigTableIO IT is not running in any test suites

[ https://issues.apache.org/jira/browse/BEAM-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928763#comment-16928763 ] Chamikara Jayalath commented on BEAM-7611: -- Created cherry-pick [https://github.c

[jira] [Updated] (BEAM-7611) Python BigTableIO IT is not running in any test suites

[ https://issues.apache.org/jira/browse/BEAM-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-7611: - Fix Version/s: (was: 2.16.0) > Python BigTableIO IT is not running in any test suites

[jira] [Commented] (BEAM-7611) Python BigTableIO IT is not running in any test suites

[ https://issues.apache.org/jira/browse/BEAM-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928044#comment-16928044 ] Chamikara Jayalath commented on BEAM-7611: -- I believe [~udim] is trying to run a

[jira] [Commented] (BEAM-7611) Python BigTableIO IT is not running in any test suites

[ https://issues.apache.org/jira/browse/BEAM-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927627#comment-16927627 ] Chamikara Jayalath commented on BEAM-7611: -- Also, this is blocking a critical Dat

[jira] [Commented] (BEAM-7611) Python BigTableIO IT is not running in any test suites

[ https://issues.apache.org/jira/browse/BEAM-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927628#comment-16927628 ] Chamikara Jayalath commented on BEAM-7611: -- cc: [~altay] [~udim] > Python BigTab

[jira] [Updated] (BEAM-7611) Python BigTableIO IT is not running in any test suites

[ https://issues.apache.org/jira/browse/BEAM-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-7611: - Priority: Blocker (was: Critical) > Python BigTableIO IT is not running in any test suite

[jira] [Updated] (BEAM-7611) Python BigTableIO IT is not running in any test suites

[ https://issues.apache.org/jira/browse/BEAM-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-7611: - Fix Version/s: 2.16.0 > Python BigTableIO IT is not running in any test suites > -

[jira] [Commented] (BEAM-7611) Python BigTableIO IT is not running in any test suites

[ https://issues.apache.org/jira/browse/BEAM-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927161#comment-16927161 ] Chamikara Jayalath commented on BEAM-7611: -- [~sduskis] can you please look into t

[jira] [Updated] (BEAM-7611) Python BigTableIO IT is not running in any test suites

[ https://issues.apache.org/jira/browse/BEAM-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-7611: - Priority: Critical (was: Major) > Python BigTableIO IT is not running in any test suites

[jira] [Commented] (BEAM-8155) Add PubsubIO.readMessagesWithCoderAndParseFn method

[ https://issues.apache.org/jira/browse/BEAM-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926870#comment-16926870 ] Chamikara Jayalath commented on BEAM-8155: -- Closing since PR was merged. Thanks!

[jira] [Resolved] (BEAM-8155) Add PubsubIO.readMessagesWithCoderAndParseFn method

[ https://issues.apache.org/jira/browse/BEAM-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-8155. -- Resolution: Fixed > Add PubsubIO.readMessagesWithCoderAndParseFn method > --

[jira] [Created] (BEAM-8138) Fix code snippets in FileIO Java docs

Chamikara Jayalath created BEAM-8138: Summary: Fix code snippets in FileIO Java docs Key: BEAM-8138 URL: https://issues.apache.org/jira/browse/BEAM-8138 Project: Beam Issue Type: Improvem

[jira] [Commented] (BEAM-8046) Unable to read from bigquery and publish to pubsub using dataflow runner (python SDK)

[ https://issues.apache.org/jira/browse/BEAM-8046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16916973#comment-16916973 ] Chamikara Jayalath commented on BEAM-8046: -- I think the issue there is current Pu

[jira] [Commented] (BEAM-8046) Unable to read from bigquery and publish to pubsub using dataflow runner (python SDK)

[ https://issues.apache.org/jira/browse/BEAM-8046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16916899#comment-16916899 ] Chamikara Jayalath commented on BEAM-8046: -- BigQuery is an bounded source so we'l

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16916117#comment-16916117 ] Chamikara Jayalath commented on BEAM-8089: -- Have you tried running Dataflow in th

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16916052#comment-16916052 ] Chamikara Jayalath commented on BEAM-8089: -- BTW may I ask why you cannot use GCS

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16916051#comment-16916051 ] Chamikara Jayalath commented on BEAM-8089: -- I don't think we can fork Beam code f

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16916033#comment-16916033 ] Chamikara Jayalath commented on BEAM-8089: -- True, seems like this is supported in

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16915992#comment-16915992 ] Chamikara Jayalath commented on BEAM-8089: -- BQ cannot execute load jobs from loca

[jira] [Commented] (BEAM-8023) Allow specifying BigQuery Storage API readOptions at runtime

[ https://issues.apache.org/jira/browse/BEAM-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913647#comment-16913647 ] Chamikara Jayalath commented on BEAM-8023: -- Wow that was fast :) Thanks Ken. I'l

[jira] [Assigned] (BEAM-8023) Allow specifying BigQuery Storage API readOptions at runtime

[ https://issues.apache.org/jira/browse/BEAM-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-8023: Assignee: Kenneth Jung > Allow specifying BigQuery Storage API readOptions at runti

[jira] [Commented] (BEAM-8023) Allow specifying BigQuery Storage API readOptions at runtime

[ https://issues.apache.org/jira/browse/BEAM-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913488#comment-16913488 ] Chamikara Jayalath commented on BEAM-8023: -- Yeah, I believe this should be possib

[jira] [Created] (BEAM-8019) Support cross-language transforms for DataflowRunner

Chamikara Jayalath created BEAM-8019: Summary: Support cross-language transforms for DataflowRunner Key: BEAM-8019 URL: https://issues.apache.org/jira/browse/BEAM-8019 Project: Beam Issue

[jira] [Assigned] (BEAM-7978) ArithmeticExceptions on getting backlog bytes

[ https://issues.apache.org/jira/browse/BEAM-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-7978: Assignee: Alexey Romanenko > ArithmeticExceptions on getting backlog bytes > -

[jira] [Commented] (BEAM-7978) ArithmeticExceptions on getting backlog bytes

[ https://issues.apache.org/jira/browse/BEAM-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16911880#comment-16911880 ] Chamikara Jayalath commented on BEAM-7978: -- Thanks Alexey. Assigned the Jira to y

[jira] [Commented] (BEAM-7883) PubsubIO (Java) write batch size can exceed request payload limit

[ https://issues.apache.org/jira/browse/BEAM-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910649#comment-16910649 ] Chamikara Jayalath commented on BEAM-7883: -- Thanks. Batch sizing that is done at

[jira] [Commented] (BEAM-7978) ArithmeticExceptions on getting backlog bytes

[ https://issues.apache.org/jira/browse/BEAM-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907539#comment-16907539 ] Chamikara Jayalath commented on BEAM-7978: -- I guess this can occur for other runn

[jira] [Commented] (BEAM-7850) Make Environment a top level attribute of PTransform

[ https://issues.apache.org/jira/browse/BEAM-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900399#comment-16900399 ] Chamikara Jayalath commented on BEAM-7850: -- Thanks Luke. That makes sense. I ass

[jira] [Updated] (BEAM-7866) Python MongoDB IO performance and correctness issues

[ https://issues.apache.org/jira/browse/BEAM-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-7866: - Status: Open (was: Triage Needed) > Python MongoDB IO performance and correctness issues

[jira] [Updated] (BEAM-7866) Python MongoDB IO performance and correctness issues

[ https://issues.apache.org/jira/browse/BEAM-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-7866: - Fix Version/s: 2.15.0 > Python MongoDB IO performance and correctness issues > ---

[jira] [Commented] (BEAM-7866) Python MongoDB IO performance and correctness issues

[ https://issues.apache.org/jira/browse/BEAM-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897555#comment-16897555 ] Chamikara Jayalath commented on BEAM-7866: -- Thanks Eugene for pointing out these

[jira] [Commented] (BEAM-7850) Make Environment a top level attribute of PTransform

[ https://issues.apache.org/jira/browse/BEAM-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897400#comment-16897400 ] Chamikara Jayalath commented on BEAM-7850: -- Thanks Max. I understand that this wi

[jira] [Commented] (BEAM-7850) Make Environment a top level attribute of PTransform

[ https://issues.apache.org/jira/browse/BEAM-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896289#comment-16896289 ] Chamikara Jayalath commented on BEAM-7850: -- cc: [~robertwb] [~lcwik] [~mxm] [~ang

[jira] [Created] (BEAM-7850) Make Environment a top level attribute of PTransform

Chamikara Jayalath created BEAM-7850: Summary: Make Environment a top level attribute of PTransform Key: BEAM-7850 URL: https://issues.apache.org/jira/browse/BEAM-7850 Project: Beam Issue

[jira] [Commented] (BEAM-2572) Implement an S3 filesystem for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895698#comment-16895698 ] Chamikara Jayalath commented on BEAM-2572: -- [~cagatayk] and [~sacherus] contribut

[jira] [Created] (BEAM-7824) Set a default environment for Python SDK jobs for Dataflow runner

Chamikara Jayalath created BEAM-7824: Summary: Set a default environment for Python SDK jobs for Dataflow runner Key: BEAM-7824 URL: https://issues.apache.org/jira/browse/BEAM-7824 Project: Beam

[jira] [Commented] (BEAM-7680) synthetic_pipeline_test.py flaky

[ https://issues.apache.org/jira/browse/BEAM-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883424#comment-16883424 ] Chamikara Jayalath commented on BEAM-7680: -- Sorry, this is from code I wrote seve

[jira] [Commented] (BEAM-7424) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data

[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16876506#comment-16876506 ] Chamikara Jayalath commented on BEAM-7424: -- Please make sure to cherry-pick [http

[jira] [Commented] (BEAM-3788) Implement a Kafka IO for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16873560#comment-16873560 ] Chamikara Jayalath commented on BEAM-3788: -- Regarding Dataflow runner support for

[jira] [Commented] (BEAM-7631) Remove experimental annotation from stable transforms in Java BigTableIO connector

[ https://issues.apache.org/jira/browse/BEAM-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872586#comment-16872586 ] Chamikara Jayalath commented on BEAM-7631: -- cc: [~sduskis] [~igorbernstein] [~alt

[jira] [Assigned] (BEAM-7631) Remove experimental annotation from stable transforms in Java BigTableIO connector

[ https://issues.apache.org/jira/browse/BEAM-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-7631: Assignee: Chamikara Jayalath > Remove experimental annotation from stable transform

[jira] [Created] (BEAM-7631) Remove experimental annotation from stable transforms in Java BigTableIO connector

Chamikara Jayalath created BEAM-7631: Summary: Remove experimental annotation from stable transforms in Java BigTableIO connector Key: BEAM-7631 URL: https://issues.apache.org/jira/browse/BEAM-7631

[jira] [Created] (BEAM-7611) Python BigTableIO IT is not running in any test suites

Chamikara Jayalath created BEAM-7611: Summary: Python BigTableIO IT is not running in any test suites Key: BEAM-7611 URL: https://issues.apache.org/jira/browse/BEAM-7611 Project: Beam Iss

[jira] [Commented] (BEAM-6590) LTS backport: upgrade gcsio dependency to 1.9.13

[ https://issues.apache.org/jira/browse/BEAM-6590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868079#comment-16868079 ] Chamikara Jayalath commented on BEAM-6590: -- Sorry about the delay. I'll look into

[jira] [Commented] (BEAM-7501) concatenated compressed files bug with python sdk (2.7.1 merge)

[ https://issues.apache.org/jira/browse/BEAM-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868078#comment-16868078 ] Chamikara Jayalath commented on BEAM-7501: -- Sorry about the delay. I'll look into

[jira] [Resolved] (BEAM-7569) filesystem_test is failing for Windows

[ https://issues.apache.org/jira/browse/BEAM-7569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-7569. -- Resolution: Fixed Fix Version/s: Not applicable > filesystem_test is failing for

[jira] [Commented] (BEAM-7424) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data

[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867126#comment-16867126 ] Chamikara Jayalath commented on BEAM-7424: -- I believe Python fix is still in deve

[jira] [Created] (BEAM-7588) Python BigQuery sink should be able to handle 15TB load job quota

Chamikara Jayalath created BEAM-7588: Summary: Python BigQuery sink should be able to handle 15TB load job quota Key: BEAM-7588 URL: https://issues.apache.org/jira/browse/BEAM-7588 Project: Beam

[jira] [Created] (BEAM-7569) filesystem_test is failing for Windows

Chamikara Jayalath created BEAM-7569: Summary: filesystem_test is failing for Windows Key: BEAM-7569 URL: https://issues.apache.org/jira/browse/BEAM-7569 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-7549) Provide a better error message for 410 Gone errors from GCS

Chamikara Jayalath created BEAM-7549: Summary: Provide a better error message for 410 Gone errors from GCS Key: BEAM-7549 URL: https://issues.apache.org/jira/browse/BEAM-7549 Project: Beam

[jira] [Updated] (BEAM-6952) concatenated compressed files bug with python sdk

[ https://issues.apache.org/jira/browse/BEAM-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-6952: - Affects Version/s: (was: 2.13.0) Not applicable > concatenated

[jira] [Resolved] (BEAM-6952) concatenated compressed files bug with python sdk

[ https://issues.apache.org/jira/browse/BEAM-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-6952. -- Resolution: Fixed > concatenated compressed files bug with python sdk >

[jira] [Updated] (BEAM-6952) concatenated compressed files bug with python sdk

[ https://issues.apache.org/jira/browse/BEAM-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-6952: - Affects Version/s: (was: 2.11.0) 2.13.0 > concatenated compress

[jira] [Commented] (BEAM-6952) concatenated compressed files bug with python sdk

[ https://issues.apache.org/jira/browse/BEAM-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860455#comment-16860455 ] Chamikara Jayalath commented on BEAM-6952: -- Yeah. closing. > concatenated compre

[jira] [Commented] (BEAM-7424) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data

[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860421#comment-16860421 ] Chamikara Jayalath commented on BEAM-7424: -- There are few things that are planned

[jira] [Assigned] (BEAM-3788) Implement a Kafka IO for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-3788: Assignee: (was: Chamikara Jayalath) > Implement a Kafka IO for Python SDK > ---

[jira] [Commented] (BEAM-3788) Implement a Kafka IO for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860419#comment-16860419 ] Chamikara Jayalath commented on BEAM-3788: -- This is blocked till we have a stream

[jira] [Created] (BEAM-7501) concatenated compressed files bug with python sdk (2.7.1 merge)

Chamikara Jayalath created BEAM-7501: Summary: concatenated compressed files bug with python sdk (2.7.1 merge) Key: BEAM-7501 URL: https://issues.apache.org/jira/browse/BEAM-7501 Project: Beam

[jira] [Commented] (BEAM-6952) concatenated compressed files bug with python sdk

[ https://issues.apache.org/jira/browse/BEAM-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858203#comment-16858203 ] Chamikara Jayalath commented on BEAM-6952: -- Created https://issues.apache.org/jir

[jira] [Updated] (BEAM-6952) concatenated compressed files bug with python sdk

[ https://issues.apache.org/jira/browse/BEAM-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-6952: - Fix Version/s: 2.14.0 > concatenated compressed files bug with python sdk > --

[jira] [Updated] (BEAM-7424) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data

[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-7424: - Fix Version/s: (was: 2.7.1) > Retry HTTP 429 errors from GCS w/ exponential backoff wh

[jira] [Created] (BEAM-7500) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data (2.7.1 merge)

Chamikara Jayalath created BEAM-7500: Summary: Retry HTTP 429 errors from GCS w/ exponential backoff when reading data (2.7.1 merge) Key: BEAM-7500 URL: https://issues.apache.org/jira/browse/BEAM-7500

[jira] [Commented] (BEAM-7424) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data

[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858200#comment-16858200 ] Chamikara Jayalath commented on BEAM-7424: -- Created https://issues.apache.org/jir

[jira] [Updated] (BEAM-7500) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data (2.7.1 merge)

[ https://issues.apache.org/jira/browse/BEAM-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-7500: - Fix Version/s: 2.7.1 > Retry HTTP 429 errors from GCS w/ exponential backoff when reading

[jira] [Updated] (BEAM-7424) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data

[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-7424: - Fix Version/s: 2.14.0 2.7.1 > Retry HTTP 429 errors from GCS w/ exponen

[jira] [Updated] (BEAM-7424) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data

[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-7424: - Priority: Blocker (was: Major) > Retry HTTP 429 errors from GCS w/ exponential backoff wh

[jira] [Created] (BEAM-7483) Audit mis-uses of GCS client library API

Chamikara Jayalath created BEAM-7483: Summary: Audit mis-uses of GCS client library API Key: BEAM-7483 URL: https://issues.apache.org/jira/browse/BEAM-7483 Project: Beam Issue Type: Impro

[jira] [Commented] (BEAM-7455) Improve Avro IO integration test coverage on Python 3.

[ https://issues.apache.org/jira/browse/BEAM-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16853485#comment-16853485 ] Chamikara Jayalath commented on BEAM-7455: -- I think it's good if we can add an in

[jira] [Commented] (BEAM-7439) Bigquery Write with schema None: TypeError: 'NoneType' object has no attribute '__getitem__'

[ https://issues.apache.org/jira/browse/BEAM-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850115#comment-16850115 ] Chamikara Jayalath commented on BEAM-7439: -- Also, Ahmet pointed out that we seems

[jira] [Assigned] (BEAM-7424) Retry HTTP 429 errors from GCS when reading/writing data and when staging files

[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-7424: Assignee: Yueyang Qiu > Retry HTTP 429 errors from GCS when reading/writing data an

[jira] [Created] (BEAM-7424) Retry HTTP 429 errors from GCS when reading/writing data and when staging files

Chamikara Jayalath created BEAM-7424: Summary: Retry HTTP 429 errors from GCS when reading/writing data and when staging files Key: BEAM-7424 URL: https://issues.apache.org/jira/browse/BEAM-7424

[jira] [Commented] (BEAM-7246) Create a Spanner IO for Python

[ https://issues.apache.org/jira/browse/BEAM-7246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846256#comment-16846256 ] Chamikara Jayalath commented on BEAM-7246: -- Shehzaad, is this something you hope

[jira] [Commented] (BEAM-6951) Beam Dependency Update Request: com.github.spotbugs:spotbugs-annotations

[ https://issues.apache.org/jira/browse/BEAM-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844202#comment-16844202 ] Chamikara Jayalath commented on BEAM-6951: -- cc: [~kenn] > Beam Dependency Update

[jira] [Commented] (BEAM-5968) Beam Dependency Update Request: future

[ https://issues.apache.org/jira/browse/BEAM-5968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844197#comment-16844197 ] Chamikara Jayalath commented on BEAM-5968: -- cc: [~tvalentyn] > Beam Dependency U

[jira] [Commented] (BEAM-7365) apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive is very slow

[ https://issues.apache.org/jira/browse/BEAM-7365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844145#comment-16844145 ] Chamikara Jayalath commented on BEAM-7365: -- Talking a look. Seems like test works

[jira] [Updated] (BEAM-7063) Stage Dataflow runner harness in Dataflow FnApi Python test suites that run using an unreleased SDK.

[ https://issues.apache.org/jira/browse/BEAM-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-7063: - Priority: Major (was: Critical) > Stage Dataflow runner harness in Dataflow FnApi Python

[jira] [Commented] (BEAM-3055) Retry downloading required test artifacts with a backoff when download fails.

[ https://issues.apache.org/jira/browse/BEAM-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834215#comment-16834215 ] Chamikara Jayalath commented on BEAM-3055: -- Few more flakes due to this.   [htt

[jira] [Resolved] (BEAM-6894) ExternalTransform.expand() does not create the proper AppliedPTransform sub-graph

[ https://issues.apache.org/jira/browse/BEAM-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-6894. -- Resolution: Fixed Fix Version/s: 2.13.0 > ExternalTransform.expand() does not cre

[jira] [Created] (BEAM-7172) Support using SDFs as cross-language transforms using ExternalTransform

Chamikara Jayalath created BEAM-7172: Summary: Support using SDFs as cross-language transforms using ExternalTransform Key: BEAM-7172 URL: https://issues.apache.org/jira/browse/BEAM-7172 Project:

[jira] [Commented] (BEAM-6590) LTS backport: upgrade gcsio dependency to 1.9.13

[ https://issues.apache.org/jira/browse/BEAM-6590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16827207#comment-16827207 ] Chamikara Jayalath commented on BEAM-6590: -- Will look into this. Thanks. Is there

[jira] [Commented] (BEAM-7137) TypeError caused by using str variable as header argument in apache_beam.io.textio.WriteToText

[ https://issues.apache.org/jira/browse/BEAM-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16827174#comment-16827174 ] Chamikara Jayalath commented on BEAM-7137: -- [~pabloem] [~ŁukaszG] in case we alre

[jira] [Commented] (BEAM-7137) TypeError caused by using str variable as header argument in apache_beam.io.textio.WriteToText

[ https://issues.apache.org/jira/browse/BEAM-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16827173#comment-16827173 ] Chamikara Jayalath commented on BEAM-7137: -- Yes. I think we need more integration

[jira] [Commented] (BEAM-7137) TypeError caused by using str variable as header argument in apache_beam.io.textio.WriteToText

[ https://issues.apache.org/jira/browse/BEAM-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16826287#comment-16826287 ] Chamikara Jayalath commented on BEAM-7137: -- +1 for encoding header to bytes (usin

[jira] [Resolved] (BEAM-6962) Add wordcount_xlang to Python post-commit

[ https://issues.apache.org/jira/browse/BEAM-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-6962. -- Resolution: Fixed Fix Version/s: 2.13.0 > Add wordcount_xlang to Python post-comm

[jira] [Commented] (BEAM-7063) Stage Dataflow runner harness in Dataflow FnApi Python test suites that run using an unreleased SDK.

[ https://issues.apache.org/jira/browse/BEAM-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823559#comment-16823559 ] Chamikara Jayalath commented on BEAM-7063: -- Ah OK. Thanks. This bug was opened fo

[jira] [Resolved] (BEAM-7063) beam_PostCommit_Python_Verify is consistently failing due to a sideinput materialization related issue

[ https://issues.apache.org/jira/browse/BEAM-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-7063. -- Resolution: Fixed Seems like test suite is passing now. Resolving.   Thanks everyone.

[jira] [Commented] (BEAM-7063) beam_PostCommit_Python_Verify is consistently failing due to a sideinput materialization related issue

[ https://issues.apache.org/jira/browse/BEAM-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819448#comment-16819448 ] Chamikara Jayalath commented on BEAM-7063: -- [~tvalentyn] since failing tests seem

[jira] [Reopened] (BEAM-7063) beam_PostCommit_Python_Verify is consistently failing due to a sideinput materialization related issue

[ https://issues.apache.org/jira/browse/BEAM-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reopened BEAM-7063: -- > beam_PostCommit_Python_Verify is consistently failing due to a sideinput > materializatio

  1   2   3   4   >