[jira] [Work logged] (BEAM-5775) Make the spark runner not serialize data unless spark is spilling to disk

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5775?focusedWorklogId=208457=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208457 ] ASF GitHub Bot logged work on BEAM-5775: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5775) Make the spark runner not serialize data unless spark is spilling to disk

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5775?focusedWorklogId=208458=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208458 ] ASF GitHub Bot logged work on BEAM-5775: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?focusedWorklogId=208259=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208259 ] ASF GitHub Bot logged work on BEAM-6751: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6767) SamzaRunner: Add more parameters to SamzaPipelineOptions

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6767?focusedWorklogId=208250=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208250 ] ASF GitHub Bot logged work on BEAM-6767: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-6327) Don't attempt to fuse subtransforms of primitive/known transforms.

2019-03-05 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785154#comment-16785154 ] Kyle Weaver commented on BEAM-6327: --- Is it okay to move pipeline

[jira] [Work logged] (BEAM-6619) Add PostCommit suite for integration tests on DataflowRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6619?focusedWorklogId=208231=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208231 ] ASF GitHub Bot logged work on BEAM-6619: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6754) Support multi core machines for python pipeline on flink for loopback environment

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6754?focusedWorklogId=208174=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208174 ] ASF GitHub Bot logged work on BEAM-6754: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6754) Support multi core machines for python pipeline on flink for loopback environment

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6754?focusedWorklogId=208169=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208169 ] ASF GitHub Bot logged work on BEAM-6754: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6754) Support multi core machines for python pipeline on flink for loopback environment

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6754?focusedWorklogId=208168=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208168 ] ASF GitHub Bot logged work on BEAM-6754: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6749) Add BigQuery Storage API info to docs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6749?focusedWorklogId=208148=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208148 ] ASF GitHub Bot logged work on BEAM-6749: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?focusedWorklogId=208142=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208142 ] ASF GitHub Bot logged work on BEAM-6751: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6749) Add BigQuery Storage API info to docs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6749?focusedWorklogId=208141=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208141 ] ASF GitHub Bot logged work on BEAM-6749: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-562) DoFn Reuse: Add new methods to DoFn

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?focusedWorklogId=208132=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208132 ] ASF GitHub Bot logged work on BEAM-562: --- Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-562) DoFn Reuse: Add new methods to DoFn

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?focusedWorklogId=208121=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208121 ] ASF GitHub Bot logged work on BEAM-562: --- Author: ASF GitHub Bot

[jira] [Comment Edited] (BEAM-2857) Create FileIO in Python

2019-03-05 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784930#comment-16784930 ] Pablo Estrada edited comment on BEAM-2857 at 3/5/19 10:05 PM: -- The thing that

[jira] [Issue Comment Deleted] (BEAM-2857) Create FileIO in Python

2019-03-05 Thread Jing Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Chen updated BEAM-2857: Comment: was deleted (was: i want to take a stab at this ticket, can you please add me to contributor

[jira] [Work logged] (BEAM-6081) Create "Dataflow Reaper" infrastructure to periodically clean up stuck Dataflow jobs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6081?focusedWorklogId=208104=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208104 ] ASF GitHub Bot logged work on BEAM-6081: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6081) Create "Dataflow Reaper" infrastructure to periodically clean up stuck Dataflow jobs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6081?focusedWorklogId=208097=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208097 ] ASF GitHub Bot logged work on BEAM-6081: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6081) Create "Dataflow Reaper" infrastructure to periodically clean up stuck Dataflow jobs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6081?focusedWorklogId=208095=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208095 ] ASF GitHub Bot logged work on BEAM-6081: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6557) Add IPython notebooks for quickstarts and custom I/O

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6557?focusedWorklogId=208087=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208087 ] ASF GitHub Bot logged work on BEAM-6557: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-2857) Create FileIO in Python

2019-03-05 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784930#comment-16784930 ] Pablo Estrada commented on BEAM-2857: - The thing that has to be implemented are the `write` and

[jira] [Work logged] (BEAM-6557) Add IPython notebooks for quickstarts and custom I/O

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6557?focusedWorklogId=208090=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208090 ] ASF GitHub Bot logged work on BEAM-6557: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6557) Add IPython notebooks for quickstarts and custom I/O

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6557?focusedWorklogId=208086=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208086 ] ASF GitHub Bot logged work on BEAM-6557: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6767) SamzaRunner: Add more parameters to SamzaPipelineOptions

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6767?focusedWorklogId=208084=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208084 ] ASF GitHub Bot logged work on BEAM-6767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6767) SamzaRunner: Add more parameters to SamzaPipelineOptions

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6767?focusedWorklogId=208085=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208085 ] ASF GitHub Bot logged work on BEAM-6767: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-562) DoFn Reuse: Add new methods to DoFn

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?focusedWorklogId=208083=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208083 ] ASF GitHub Bot logged work on BEAM-562: --- Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-562) DoFn Reuse: Add new methods to DoFn

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?focusedWorklogId=208080=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208080 ] ASF GitHub Bot logged work on BEAM-562: --- Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-562) DoFn Reuse: Add new methods to DoFn

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?focusedWorklogId=208079=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208079 ] ASF GitHub Bot logged work on BEAM-562: --- Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-562) DoFn Reuse: Add new methods to DoFn

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?focusedWorklogId=208082=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208082 ] ASF GitHub Bot logged work on BEAM-562: --- Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-562) DoFn Reuse: Add new methods to DoFn

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?focusedWorklogId=208081=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208081 ] ASF GitHub Bot logged work on BEAM-562: --- Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6081) Create "Dataflow Reaper" infrastructure to periodically clean up stuck Dataflow jobs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6081?focusedWorklogId=208078=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208078 ] ASF GitHub Bot logged work on BEAM-6081: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6557) Add IPython notebooks for quickstarts and custom I/O

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6557?focusedWorklogId=208072=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208072 ] ASF GitHub Bot logged work on BEAM-6557: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6557) Add IPython notebooks for quickstarts and custom I/O

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6557?focusedWorklogId=208073=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208073 ] ASF GitHub Bot logged work on BEAM-6557: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-562) DoFn Reuse: Add new methods to DoFn

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?focusedWorklogId=208071=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208071 ] ASF GitHub Bot logged work on BEAM-562: --- Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-562) DoFn Reuse: Add new methods to DoFn

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?focusedWorklogId=208070=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208070 ] ASF GitHub Bot logged work on BEAM-562: --- Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?focusedWorklogId=208043=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208043 ] ASF GitHub Bot logged work on BEAM-6751: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?focusedWorklogId=208044=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208044 ] ASF GitHub Bot logged work on BEAM-6751: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?focusedWorklogId=208042=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208042 ] ASF GitHub Bot logged work on BEAM-6751: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?focusedWorklogId=208046=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208046 ] ASF GitHub Bot logged work on BEAM-6751: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?focusedWorklogId=208045=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208045 ] ASF GitHub Bot logged work on BEAM-6751: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?focusedWorklogId=208047=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208047 ] ASF GitHub Bot logged work on BEAM-6751: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?focusedWorklogId=208048=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208048 ] ASF GitHub Bot logged work on BEAM-6751: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-2857) Create FileIO in Python

2019-03-05 Thread Rohan Julka (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784883#comment-16784883 ] Rohan Julka commented on BEAM-2857: --- Thanks [~ttanay] > Create FileIO in Python >

[jira] [Commented] (BEAM-2857) Create FileIO in Python

2019-03-05 Thread Tanay Tummalapalli (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784871#comment-16784871 ] Tanay Tummalapalli commented on BEAM-2857: -- Hey [~rohanjulka19] You can get the Slack invite

[jira] [Commented] (BEAM-2857) Create FileIO in Python

2019-03-05 Thread Rohan Julka (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784844#comment-16784844 ] Rohan Julka commented on BEAM-2857: --- Noted. On a side note can we communicate through skype or any other

[jira] [Commented] (BEAM-2857) Create FileIO in Python

2019-03-05 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784832#comment-16784832 ] Eugene Kirpichov commented on BEAM-2857: The WriteFiles transform is a leftover of

[jira] [Work logged] (BEAM-6081) Create "Dataflow Reaper" infrastructure to periodically clean up stuck Dataflow jobs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6081?focusedWorklogId=207989=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207989 ] ASF GitHub Bot logged work on BEAM-6081: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6081) Create "Dataflow Reaper" infrastructure to periodically clean up stuck Dataflow jobs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6081?focusedWorklogId=207994=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207994 ] ASF GitHub Bot logged work on BEAM-6081: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-4567) Can't use mongo connector with Atlas MongoDB

2019-03-05 Thread Ahmed El.Hussaini (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784775#comment-16784775 ] Ahmed El.Hussaini commented on BEAM-4567: - [~jbonofre] Correct, as [~iemejia] mentioned, I'm

[jira] [Work logged] (BEAM-6762) Behavior requires documentation: Pipeline can't run before fusion

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6762?focusedWorklogId=207983=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207983 ] ASF GitHub Bot logged work on BEAM-6762: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6751) KafkaIO's EOS mode does not work with FlinkRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6751?focusedWorklogId=207967=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207967 ] ASF GitHub Bot logged work on BEAM-6751: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-3435) Python SDK examples should use beam.io.WriteToBigQuery transform rather than the BigQuerySink to interact with BQ.

2019-03-05 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-3435. --- Resolution: Fixed Fix Version/s: 2.11.0 > Python SDK examples should use

[jira] [Work logged] (BEAM-6755) Add integration and performance testing for BQ storage API sources.

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6755?focusedWorklogId=207934=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207934 ] ASF GitHub Bot logged work on BEAM-6755: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6713) FileIO and TextIO unable to alter WriteFiles maxNumWritersPerBundle

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6713?focusedWorklogId=207950=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207950 ] ASF GitHub Bot logged work on BEAM-6713: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6612) PerformanceRegression in QueueingBeamFnDataClient

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6612?focusedWorklogId=207936=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207936 ] ASF GitHub Bot logged work on BEAM-6612: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-3435) Python SDK examples should use beam.io.WriteToBigQuery transform rather than the BigQuerySink to interact with BQ.

2019-03-05 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784735#comment-16784735 ] Kyle Weaver commented on BEAM-3435: --- Sounds good to me > Python SDK examples should use

[jira] [Work logged] (BEAM-6612) PerformanceRegression in QueueingBeamFnDataClient

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6612?focusedWorklogId=207937=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207937 ] ASF GitHub Bot logged work on BEAM-6612: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6081) Create "Dataflow Reaper" infrastructure to periodically clean up stuck Dataflow jobs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6081?focusedWorklogId=207919=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207919 ] ASF GitHub Bot logged work on BEAM-6081: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6755) Add integration and performance testing for BQ storage API sources.

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6755?focusedWorklogId=207935=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207935 ] ASF GitHub Bot logged work on BEAM-6755: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6081) Create "Dataflow Reaper" infrastructure to periodically clean up stuck Dataflow jobs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6081?focusedWorklogId=207931=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207931 ] ASF GitHub Bot logged work on BEAM-6081: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6081) Create "Dataflow Reaper" infrastructure to periodically clean up stuck Dataflow jobs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6081?focusedWorklogId=207932=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207932 ] ASF GitHub Bot logged work on BEAM-6081: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-5785) Validates runner tests fail with: Cannot convert bytes value to JSON value

2019-03-05 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784729#comment-16784729 ] Valentyn Tymofieiev commented on BEAM-5785: --- Is this issue still happening? cc: [~Juta],

[jira] [Comment Edited] (BEAM-5785) Validates runner tests fail with: Cannot convert bytes value to JSON value

2019-03-05 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784729#comment-16784729 ] Valentyn Tymofieiev edited comment on BEAM-5785 at 3/5/19 6:08 PM: --- Is

[jira] [Commented] (BEAM-4567) Can't use mongo connector with Atlas MongoDB

2019-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-4567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784728#comment-16784728 ] Jean-Baptiste Onofré commented on BEAM-4567: Yes, it's what I saw, the partitioning is not

[jira] [Commented] (BEAM-4567) Can't use mongo connector with Atlas MongoDB

2019-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-4567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784724#comment-16784724 ] Ismaël Mejía commented on BEAM-4567: [~sandboxws]has already a fix in the other PR we are reviewing

[jira] [Resolved] (BEAM-6569) GCS IO tests are very flaky under Python 3.5

2019-03-05 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev resolved BEAM-6569. --- Resolution: Fixed Fix Version/s: Not applicable > GCS IO tests are very flaky

[jira] [Work logged] (BEAM-5995) Create Jenkins jobs to run the load tests

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5995?focusedWorklogId=207917=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207917 ] ASF GitHub Bot logged work on BEAM-5995: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5995) Create Jenkins jobs to run the load tests

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5995?focusedWorklogId=207907=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207907 ] ASF GitHub Bot logged work on BEAM-5995: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-4567) Can't use mongo connector with Atlas MongoDB

2019-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-4567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784713#comment-16784713 ] Jean-Baptiste Onofré commented on BEAM-4567: Interesting, let me take a look. > Can't use

[jira] [Work logged] (BEAM-5995) Create Jenkins jobs to run the load tests

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5995?focusedWorklogId=207914=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207914 ] ASF GitHub Bot logged work on BEAM-5995: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6760) [beam_PreCommit_Website_Cron] TestWebsite task failing

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6760?focusedWorklogId=207901=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207901 ] ASF GitHub Bot logged work on BEAM-6760: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5995) Create Jenkins jobs to run the load tests

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5995?focusedWorklogId=207905=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207905 ] ASF GitHub Bot logged work on BEAM-5995: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6081) Create "Dataflow Reaper" infrastructure to periodically clean up stuck Dataflow jobs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6081?focusedWorklogId=207899=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207899 ] ASF GitHub Bot logged work on BEAM-6081: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-6307) Nexmark Spark failed due to FileNotFoundException

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-6307. --- Resolution: Cannot Reproduce Fix Version/s: Not applicable > Nexmark Spark failed due

[jira] [Commented] (BEAM-6659) Executor Beam1: can't allocate memory

2019-03-05 Thread yifan zou (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784709#comment-16784709 ] yifan zou commented on BEAM-6659: - Beam1 is currently disconnected and stop accepting jobs. We are making

[jira] [Work logged] (BEAM-5995) Create Jenkins jobs to run the load tests

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5995?focusedWorklogId=207906=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207906 ] ASF GitHub Bot logged work on BEAM-5995: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5995) Create Jenkins jobs to run the load tests

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5995?focusedWorklogId=207904=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207904 ] ASF GitHub Bot logged work on BEAM-5995: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6702) GCP dependencies for the Python SDK are too restrictive

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6702?focusedWorklogId=207903=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207903 ] ASF GitHub Bot logged work on BEAM-6702: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5995) Create Jenkins jobs to run the load tests

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5995?focusedWorklogId=207902=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207902 ] ASF GitHub Bot logged work on BEAM-5995: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6768) Support for data-dependent destination for BQ streaming inserts in Python

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6768?focusedWorklogId=207893=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207893 ] ASF GitHub Bot logged work on BEAM-6768: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-5328) Java starter archetype does not contain dependency versions

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-5328: -- Labels: newbie starter triaged (was: newbie starter) > Java starter archetype does not contain

[jira] [Updated] (BEAM-4191) WatermarkManagerTest has had a masked failure (both copies)

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-4191: -- Labels: sickbay triaged (was: sickbay) > WatermarkManagerTest has had a masked failure (both

[jira] [Work logged] (BEAM-6081) Create "Dataflow Reaper" infrastructure to periodically clean up stuck Dataflow jobs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6081?focusedWorklogId=207900=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207900 ] ASF GitHub Bot logged work on BEAM-6081: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-6659) Executor Beam1: can't allocate memory

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-6659: -- Labels: currently-failing triaged (was: currently-failing) > Executor Beam1: can't allocate

[jira] [Commented] (BEAM-4567) Can't use mongo connector with Atlas MongoDB

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784701#comment-16784701 ] Kenneth Knowles commented on BEAM-4567: --- [~jbonofre] [~iemejia] [~Turkel] what do you think about

[jira] [Commented] (BEAM-3435) Python SDK examples should use beam.io.WriteToBigQuery transform rather than the BigQuerySink to interact with BQ.

2019-03-05 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784700#comment-16784700 ] Valentyn Tymofieiev commented on BEAM-3435: --- Hey [~ibzib], should we close this issue now? >

[jira] [Updated] (BEAM-2590) SparkRunner shim for Job API

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2590: -- Labels: portability triaged (was: portability) > SparkRunner shim for Job API >

[jira] [Assigned] (BEAM-3435) Python SDK examples should use beam.io.WriteToBigQuery transform rather than the BigQuerySink to interact with BQ.

2019-03-05 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev reassigned BEAM-3435: - Assignee: Kyle Weaver > Python SDK examples should use beam.io.WriteToBigQuery

[jira] [Work logged] (BEAM-6081) Create "Dataflow Reaper" infrastructure to periodically clean up stuck Dataflow jobs

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6081?focusedWorklogId=207895=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207895 ] ASF GitHub Bot logged work on BEAM-6081: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-4518) Errors when running Python Game stats with a low fixed_window_duration in the DirectRunner

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-4518: -- Labels: triaged (was: ) > Errors when running Python Game stats with a low

[jira] [Updated] (BEAM-562) DoFn Reuse: Add new methods to DoFn

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-562: - Labels: sdk-consistency triaged (was: sdk-consistency) > DoFn Reuse: Add new methods to DoFn >

[jira] [Commented] (BEAM-3885) Python SDK Read IO is expressed as Impulse -> ParDo

2019-03-05 Thread Tanay Tummalapalli (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784662#comment-16784662 ] Tanay Tummalapalli commented on BEAM-3885: -- [~robertwb] The PR for this was merged. Can this be

[jira] [Updated] (BEAM-1754) Will Dataflow ever support Node.js with an SDK similar to Java or Python?

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1754: -- Labels: node.js triaged (was: node.js) > Will Dataflow ever support Node.js with an SDK

[jira] [Work logged] (BEAM-6619) Add PostCommit suite for integration tests on DataflowRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6619?focusedWorklogId=207883=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207883 ] ASF GitHub Bot logged work on BEAM-6619: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-5305) Timeout handling in JdbcIO with Oracle java driver

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-5305: -- Labels: JdbcIO oracle triaged (was: JdbcIO oracle) > Timeout handling in JdbcIO with Oracle

[jira] [Work logged] (BEAM-6619) Add PostCommit suite for integration tests on DataflowRunner

2019-03-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6619?focusedWorklogId=207882=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-207882 ] ASF GitHub Bot logged work on BEAM-6619: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-5642) test_pardo_state_only flaky (times out)

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-5642: -- Labels: flake triaged (was: flake) > test_pardo_state_only flaky (times out) >

[jira] [Updated] (BEAM-5811) Timeout in Python datastore_write_it_test.DatastoreWriteIT

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-5811: -- Labels: flake triaged (was: flake) > Timeout in Python

[jira] [Resolved] (BEAM-4527) JMSIOTest testCheckpointMark flake

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-4527. --- Resolution: Cannot Reproduce Fix Version/s: Not applicable This is very old and has

[jira] [Updated] (BEAM-4518) Errors when running Python Game stats with a low fixed_window_duration in the DirectRunner

2019-03-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-4518: -- Labels: (was: flake) > Errors when running Python Game stats with a low fixed_window_duration

  1   2   >