[jira] [Commented] (BEAM-301) Add a Beam SQL DSL

[ https://issues.apache.org/jira/browse/BEAM-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962383#comment-15962383 ] ASF GitHub Bot commented on BEAM-301: - GitHub user XuMingmin opened a pull request:

[GitHub] beam pull request #2479: [BEAM-301] Add a Beam SQL DSL

GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2479 [BEAM-301] Add a Beam SQL DSL The initial PR to setup skeleton of Beam SQL. Pass `mvn verify` locally, a Jenkins job is required later for pre-commit check. You can merge this pull request

[GitHub] beam pull request #2478: Dsl sql init

Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/2478 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2478: Dsl sql init

GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2478 Dsl sql init Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-]

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #3232

See

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #1574

See

Build failed in Jenkins: beam_PerformanceTests_Dataflow #289

See Changes: [aviemzur] [BEAM-1294] Long running UnboundedSource Readers [jbonofre] [BEAM-1921] Expose connection properties in JdbcIO -- [...truncated

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3231

See

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #1573

See

[jira] [Resolved] (BEAM-1921) expose connectionProperties in JdbcIO

[ https://issues.apache.org/jira/browse/BEAM-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-1921. Resolution: Fixed Fix Version/s: First stable release > expose

[jira] [Commented] (BEAM-1921) expose connectionProperties in JdbcIO

[ https://issues.apache.org/jira/browse/BEAM-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962253#comment-15962253 ] ASF GitHub Bot commented on BEAM-1921: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2477: [BEAM-1921] expose connectionProperties in JdbcIO

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2477 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-1921] This closes #2477

[BEAM-1921] This closes #2477 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/713701dd Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/713701dd Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/713701dd Branch:

[1/2] beam git commit: [BEAM-1921] Expose connection properties in JdbcIO

Repository: beam Updated Branches: refs/heads/master efd785f88 -> 713701ddc [BEAM-1921] Expose connection properties in JdbcIO Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6da0b27a Tree:

[jira] [Resolved] (BEAM-1900) create feature branch 'dsls_sql' for Beam SQL

[ https://issues.apache.org/jira/browse/BEAM-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-1900. Resolution: Fixed Fix Version/s: Not applicable > create feature branch

[jira] [Commented] (BEAM-1900) create feature branch 'dsls_sql' for Beam SQL

[ https://issues.apache.org/jira/browse/BEAM-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962247#comment-15962247 ] Jean-Baptiste Onofré commented on BEAM-1900: I created the {{DSL_SQL}} branch, ready to receive

[jira] [Resolved] (BEAM-1294) Long running UnboundedSource Readers

[ https://issues.apache.org/jira/browse/BEAM-1294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1294. - Resolution: Implemented Fix Version/s: First stable release > Long running UnboundedSource Readers

[jira] [Commented] (BEAM-1294) Long running UnboundedSource Readers

[ https://issues.apache.org/jira/browse/BEAM-1294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962245#comment-15962245 ] ASF GitHub Bot commented on BEAM-1294: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2033: [BEAM-1294] Long running UnboundedSource Readers

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2033 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-1294] Long running UnboundedSource Readers

Repository: beam Updated Branches: refs/heads/master a0cfccda4 -> efd785f88 [BEAM-1294] Long running UnboundedSource Readers Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d958796b Tree:

[jira] [Assigned] (BEAM-1922) DataSource in JdbcIO is not closed

[ https://issues.apache.org/jira/browse/BEAM-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-1922: -- Assignee: Xu Mingmin (was: Jean-Baptiste Onofré) > DataSource in JdbcIO is not

[jira] [Commented] (BEAM-1922) DataSource in JdbcIO is not closed

[ https://issues.apache.org/jira/browse/BEAM-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962242#comment-15962242 ] Jean-Baptiste Onofré commented on BEAM-1922: Yes, it's the easiest path to start with. >

[jira] [Commented] (BEAM-1922) DataSource in JdbcIO is not closed

[ https://issues.apache.org/jira/browse/BEAM-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962241#comment-15962241 ] Xu Mingmin commented on BEAM-1922: -- would fix {{BasicDataSource}} first > DataSource in JdbcIO is not

[jira] [Assigned] (BEAM-1922) DataSource in JdbcIO is not closed

[ https://issues.apache.org/jira/browse/BEAM-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-1922: -- Assignee: Jean-Baptiste Onofré (was: Xu Mingmin) > DataSource in JdbcIO is not

[jira] [Created] (BEAM-1922) DataSource in JdbcIO is not closed

Xu Mingmin created BEAM-1922: Summary: DataSource in JdbcIO is not closed Key: BEAM-1922 URL: https://issues.apache.org/jira/browse/BEAM-1922 Project: Beam Issue Type: Bug Components:

beam git commit: Add DSLs module

Repository: beam Updated Branches: refs/heads/DSL_SQL [created] 870e42dec Add DSLs module Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/870e42de Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/870e42de Diff:

[jira] [Commented] (BEAM-1921) expose connectionProperties in JdbcIO

[ https://issues.apache.org/jira/browse/BEAM-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962236#comment-15962236 ] ASF GitHub Bot commented on BEAM-1921: -- GitHub user XuMingmin opened a pull request:

[GitHub] beam pull request #2477: [BEAM-1921] expose connectionProperties in JdbcIO

GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2477 [BEAM-1921] expose connectionProperties in JdbcIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Updated] (BEAM-1921) expose connectionProperties in JdbcIO

[ https://issues.apache.org/jira/browse/BEAM-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-1921: - Summary: expose connectionProperties in JdbcIO (was: expose `withConnectionProperties` in JdbcIO) >

[jira] [Created] (BEAM-1921) expose `withConnectionProperties` in JdbcIO

Xu Mingmin created BEAM-1921: Summary: expose `withConnectionProperties` in JdbcIO Key: BEAM-1921 URL: https://issues.apache.org/jira/browse/BEAM-1921 Project: Beam Issue Type: Improvement

Build failed in Jenkins: beam_PerformanceTests_Dataflow #288

See -- [...truncated 228.91 KB...] x [deleted] (none) -> origin/pr/971/head x [deleted] (none) -> origin/pr/971/merge x [deleted] (none)

[jira] [Assigned] (BEAM-1692) Convert to Codahale Metric interfaces where possible in WithMetricsSupport MetricRegistry

[ https://issues.apache.org/jira/browse/BEAM-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1692: --- Assignee: (was: Aviem Zur) > Convert to Codahale Metric interfaces where possible in

[jira] [Assigned] (BEAM-1482) Support SetState in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1482: --- Assignee: Aviem Zur > Support SetState in Spark runner > > >

[jira] [Assigned] (BEAM-1477) Support MapState in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1477: --- Assignee: Aviem Zur > Support MapState in Spark runner > > >

[jira] [Assigned] (BEAM-1035) Support for new State API in SparkRunner

[ https://issues.apache.org/jira/browse/BEAM-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1035: --- Assignee: Aviem Zur (was: Amit Sela) > Support for new State API in SparkRunner >

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Dataflow #2786

See

[jira] [Commented] (BEAM-1723) FlinkRunner should deduplicate when an UnboundedSource requires Deduping

[ https://issues.apache.org/jira/browse/BEAM-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962136#comment-15962136 ] ASF GitHub Bot commented on BEAM-1723: -- GitHub user JingsongLi opened a pull request:

[GitHub] beam pull request #2476: [BEAM-1723] deduplication of UnboundedSource in Fli...

GitHub user JingsongLi opened a pull request: https://github.com/apache/beam/pull/2476 [BEAM-1723] deduplication of UnboundedSource in Flink runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[jira] [Commented] (BEAM-1723) FlinkRunner should deduplicate when an UnboundedSource requires Deduping

[ https://issues.apache.org/jira/browse/BEAM-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962125#comment-15962125 ] Jingsong Lee commented on BEAM-1723: I think it is necessary to be configurable because the

Build failed in Jenkins: beam_PerformanceTests_Dataflow #287

See Changes: [amitsela33] [BEAM-1737] Implement a Single-output ParDo as a Multi-output ParDo with -- [...truncated 245.05 KB...] ! 40858af...437487e

[jira] [Commented] (BEAM-1920) Add Spark 2.x support in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962081#comment-15962081 ] Jean-Baptiste Onofré commented on BEAM-1920: Good idea (for now, I did the opposite: 1.6.3 as

[jira] [Commented] (BEAM-1723) FlinkRunner should deduplicate when an UnboundedSource requires Deduping

[ https://issues.apache.org/jira/browse/BEAM-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962077#comment-15962077 ] Jingsong Lee commented on BEAM-1723: I understand. The reason for the duplication is that {{PubSubIO}}

[jira] [Commented] (BEAM-1920) Add Spark 2.x support in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962076#comment-15962076 ] Amit Sela commented on BEAM-1920: - Sweet! I'm considering Spark 2.x as default and {{1.6.3}} as the

[jira] [Created] (BEAM-1920) Add Spark 2.x support in Spark runner

Jean-Baptiste Onofré created BEAM-1920: -- Summary: Add Spark 2.x support in Spark runner Key: BEAM-1920 URL: https://issues.apache.org/jira/browse/BEAM-1920 Project: Beam Issue Type:

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Dataflow #2785

See -- [...truncated 515.76 KB...] x [deleted] (none) -> origin/pr/913/merge x [deleted] (none) -> origin/pr/914/head x [deleted]

[jira] [Resolved] (BEAM-1737) Implement a Single-output ParDo as a Multi-output ParDo with a single output

[ https://issues.apache.org/jira/browse/BEAM-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-1737. - Resolution: Fixed Fix Version/s: First stable release > Implement a Single-output ParDo as a

[jira] [Commented] (BEAM-1737) Implement a Single-output ParDo as a Multi-output ParDo with a single output

[ https://issues.apache.org/jira/browse/BEAM-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962066#comment-15962066 ] ASF GitHub Bot commented on BEAM-1737: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2420: [BEAM-1737] Interpreting a Single-output ParDo as a...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2420 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2420

This closes #2420 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a0cfccda Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a0cfccda Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a0cfccda Branch:

[1/2] beam git commit: [BEAM-1737] Implement a Single-output ParDo as a Multi-output ParDo with a single output.

Repository: beam Updated Branches: refs/heads/master 810db7f99 -> a0cfccda4 [BEAM-1737] Implement a Single-output ParDo as a Multi-output ParDo with a single output. remove use of EvaluationContext in DStream lambda, it is not serializable and also redundant in this case. implement pardo

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #1567

See

[jira] [Commented] (BEAM-802) Support Dynamic PipelineOptions for python

[ https://issues.apache.org/jira/browse/BEAM-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962044#comment-15962044 ] ASF GitHub Bot commented on BEAM-802: - GitHub user mariapython opened a pull request:

[GitHub] beam pull request #2475: [BEAM-802] Skip query metrics for template creation

GitHub user mariapython opened a pull request: https://github.com/apache/beam/pull/2475 [BEAM-802] Skip query metrics for template creation Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

Build failed in Jenkins: beam_PerformanceTests_Dataflow #286

See -- [...truncated 249.00 KB...] ! aaf02a7...da67322 refs/pull/1925/merge -> origin/pr/1925/merge (unable to update local ref) error: unable to resolve reference