[jira] [Comment Edited] (BEAM-2500) Add support for S3 as a Apache Beam FileSystem

[ https://issues.apache.org/jira/browse/BEAM-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165391#comment-16165391 ] Jacob Marble edited comment on BEAM-2500 at 9/14/17 4:57 AM: - I'm interested in

[jira] [Commented] (BEAM-2955) Create a Cloud Bigtable HBase connector

[ https://issues.apache.org/jira/browse/BEAM-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165523#comment-16165523 ] Solomon Duskis commented on BEAM-2955: -- Chamikra: HBaseIO will have to be extended or wrapped. Cloud

[jira] [Commented] (BEAM-2956) DataflowRunner incorrectly reports the user agent for the Dataflow distribution

[ https://issues.apache.org/jira/browse/BEAM-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165502#comment-16165502 ] ASF GitHub Bot commented on BEAM-2956: -- GitHub user lukecwik opened a pull request:

[GitHub] beam pull request #3849: [BEAM-2956] Attempt to correctly report the Dataflo...

GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3849 [BEAM-2956] Attempt to correctly report the Dataflow distribution in GCP related modules. Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make

[jira] [Updated] (BEAM-2956) DataflowRunner incorrectly reports the user agent for the Dataflow distribution

[ https://issues.apache.org/jira/browse/BEAM-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2956: Description: The DataflowRunner when distributed with the Dataflow SDK distribution may incorrectly submit

[jira] [Commented] (BEAM-2955) Create a Cloud Bigtable HBase connector

[ https://issues.apache.org/jira/browse/BEAM-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165431#comment-16165431 ] Solomon Duskis commented on BEAM-2955: -- It's awesome that you added the Dynamic rebalancing! I'm ok

[jira] [Created] (BEAM-2956) DataflowRunner incorrectly reports the user agent for the Dataflow distribution

Luke Cwik created BEAM-2956: --- Summary: DataflowRunner incorrectly reports the user agent for the Dataflow distribution Key: BEAM-2956 URL: https://issues.apache.org/jira/browse/BEAM-2956 Project: Beam

[jira] [Commented] (BEAM-2500) Add support for S3 as a Apache Beam FileSystem

[ https://issues.apache.org/jira/browse/BEAM-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165391#comment-16165391 ] Jacob Marble commented on BEAM-2500: I'm interested in implementing S3 support. Not being familiar Beam

[jira] [Assigned] (BEAM-2955) Create a Cloud Bigtable HBase connector

[ https://issues.apache.org/jira/browse/BEAM-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-2955: Assignee: Solomon Duskis (was: Chamikara Jayalath) > Create a Cloud Bigtable HBase

[jira] [Commented] (BEAM-2955) Create a Cloud Bigtable HBase connector

[ https://issues.apache.org/jira/browse/BEAM-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165347#comment-16165347 ] Chamikara Jayalath commented on BEAM-2955: -- I like approach (1) as well since seems like it'll

[jira] [Updated] (BEAM-2954) update shade configurations in extension/sql

[ https://issues.apache.org/jira/browse/BEAM-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2954: - Summary: update shade configurations in extension/sql (was: opt-out shade in extension/sql) > update

[jira] [Commented] (BEAM-2954) update shade configurations in extension/sql

[ https://issues.apache.org/jira/browse/BEAM-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165344#comment-16165344 ] ASF GitHub Bot commented on BEAM-2954: -- GitHub user XuMingmin opened a pull request:

[GitHub] beam pull request #3848: [BEAM-2954] update shade configurations in extensio...

GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3848 [BEAM-2954] update shade configurations in extension/sql Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Commented] (BEAM-2954) opt-out shade in extension/sql

[ https://issues.apache.org/jira/browse/BEAM-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165338#comment-16165338 ] Xu Mingmin commented on BEAM-2954: -- make sense to me, I'll turn to shade Calcite dependencies. > opt-out

[jira] [Comment Edited] (BEAM-2954) opt-out shade in extension/sql

[ https://issues.apache.org/jira/browse/BEAM-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165183#comment-16165183 ] Aviem Zur edited comment on BEAM-2954 at 9/13/17 8:25 PM: -- We cannot opt-out of

[jira] [Commented] (BEAM-2955) Create a Cloud Bigtable HBase connector

[ https://issues.apache.org/jira/browse/BEAM-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165196#comment-16165196 ] Ismaël Mejía commented on BEAM-2955: This is a great idea [~sduskis]. I will be pro (1) but I can

[jira] [Updated] (BEAM-2954) opt-out shade in extension/sql

[ https://issues.apache.org/jira/browse/BEAM-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2954: Description: {{guava}} is shaded by default in beam modules, while {{calcite}}(a dependency of SQL)

[jira] [Comment Edited] (BEAM-2954) opt-out shade in extension/sql

[ https://issues.apache.org/jira/browse/BEAM-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165183#comment-16165183 ] Aviem Zur edited comment on BEAM-2954 at 9/13/17 7:48 PM: -- We cannot opt-out of

[jira] [Commented] (BEAM-2954) opt-out shade in extension/sql

[ https://issues.apache.org/jira/browse/BEAM-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165183#comment-16165183 ] Aviem Zur commented on BEAM-2954: - We cannot opt-out of the shading rules in the SQL module as we cannot

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #3964

See

[jira] [Commented] (BEAM-2790) Error while reading from Amazon S3 via Hadoop File System

[ https://issues.apache.org/jira/browse/BEAM-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165153#comment-16165153 ] ASF GitHub Bot commented on BEAM-2790: -- Github user iemejia closed the pull request at:

[GitHub] beam pull request #3744: [BEAM-2790] Use byte[] instead of ByteBuffer to rea...

Github user iemejia closed the pull request at: https://github.com/apache/beam/pull/3744 ---

[jira] [Created] (BEAM-2955) Create a Cloud Bigtable HBase connector

Solomon Duskis created BEAM-2955: Summary: Create a Cloud Bigtable HBase connector Key: BEAM-2955 URL: https://issues.apache.org/jira/browse/BEAM-2955 Project: Beam Issue Type: New Feature

[GitHub] beam pull request #3830: Jenkins Test [DO NOT MERGE]

Github user robertwb closed the pull request at: https://github.com/apache/beam/pull/3830 ---

[GitHub] beam pull request #3847: Refactor fn api runner into universal local runner

GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3847 Refactor fn api runner into universal local runner Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Created] (BEAM-2954) opt-out shade in extension/sql

Xu Mingmin created BEAM-2954: Summary: opt-out shade in extension/sql Key: BEAM-2954 URL: https://issues.apache.org/jira/browse/BEAM-2954 Project: Beam Issue Type: Bug Components:

[jira] [Commented] (BEAM-2868) Allow FileSystems.copy() to copy between different scheme

[ https://issues.apache.org/jira/browse/BEAM-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164876#comment-16164876 ] Luke Cwik commented on BEAM-2868: - We want to stay away from methods which only take a single thing to do

[jira] [Created] (BEAM-2953) Create more advanced Timeseries processing examples using state API

Reza ardeshir rokni created BEAM-2953: - Summary: Create more advanced Timeseries processing examples using state API Key: BEAM-2953 URL: https://issues.apache.org/jira/browse/BEAM-2953 Project:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3963

See

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex #2383

See

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #3066

See

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #3832

See

[jira] [Commented] (BEAM-2868) Allow FileSystems.copy() to copy between different scheme

[ https://issues.apache.org/jira/browse/BEAM-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164440#comment-16164440 ] Reza ardeshir rokni commented on BEAM-2868: --- For this use case, the move is often going to be a

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3962

See

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #3065

See

[GitHub] beam pull request #3846: JStorm-runner: Remove unnecessary WARN log which mi...

GitHub user bastiliu opened a pull request: https://github.com/apache/beam/pull/3846 JStorm-runner: Remove unnecessary WARN log which might case confusion, when translating composite PTransform Follow this checklist to help us incorporate your contribution quickly and easily:

[jira] [Closed] (BEAM-2859) ProcessingTime based timers are not properly fired in case the watermark stays put

[ https://issues.apache.org/jira/browse/BEAM-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin closed BEAM-2859. Resolution: Fixed Fix Version/s: 2.2.0 > ProcessingTime based timers are not properly fired in case

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Apex #2382

See Changes: [staslevin] [BEAM-2859] Fixed processing timers not being properly fired when -- [...truncated 42.93 KB...] 2017-09-13T08:07:26.477

[jira] [Commented] (BEAM-2859) ProcessingTime based timers are not properly fired in case the watermark stays put

[ https://issues.apache.org/jira/browse/BEAM-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164283#comment-16164283 ] ASF GitHub Bot commented on BEAM-2859: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #3840

This closes #3840 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/50532f0a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/50532f0a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/50532f0a Branch:

[1/2] beam git commit: [BEAM-2859] Fixed processing timers not being properly fired when watermark stays put by tweaking the way spark-runner was delivering timers to reduceFnRunner in SparkGroupAlsoB

Repository: beam Updated Branches: refs/heads/master 8d71ebf82 -> 50532f0a9 [BEAM-2859] Fixed processing timers not being properly fired when watermark stays put by tweaking the way spark-runner was delivering timers to reduceFnRunner in SparkGroupAlsoByWindowViaWindowSet Project:

[GitHub] beam pull request #3840: [BEAM-2859] Fixed processing timers not being prope...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3840 ---

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #4786

See