[jira] [Commented] (BEAM-52) KafkaIO - bounded/unbounded, source/sink

[ https://issues.apache.org/jira/browse/BEAM-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15265165#comment-15265165 ] Aljoscha Krettek commented on BEAM-52: -- Sure, I'll do that! > KafkaIO - bounded/unbounded, source/sink

[jira] [Closed] (BEAM-204) truncateStackTrace fails with empty stack trace

[ https://issues.apache.org/jira/browse/BEAM-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci closed BEAM-204. - Resolution: Fixed > truncateStackTrace fails with empty stack trace >

[jira] [Commented] (BEAM-52) KafkaIO - bounded/unbounded, source/sink

[ https://issues.apache.org/jira/browse/BEAM-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264971#comment-15264971 ] Raghu Angadi commented on BEAM-52: -- > Kafka producer uses the key for selecting a partition. correction :

[jira] [Commented] (BEAM-204) truncateStackTrace fails with empty stack trace

[ https://issues.apache.org/jira/browse/BEAM-204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264935#comment-15264935 ] Mark Shields commented on BEAM-204: --- Yes, but I can't seem to close it. > truncateStackTrace fails with

[jira] [Commented] (BEAM-52) KafkaIO - bounded/unbounded, source/sink

[ https://issues.apache.org/jira/browse/BEAM-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264860#comment-15264860 ] Raghu Angadi commented on BEAM-52: -- Ah, thanks. just skimmed through it. It looks pretty much on the same

[jira] [Commented] (BEAM-77) Reorganize Directory structure

[ https://issues.apache.org/jira/browse/BEAM-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264846#comment-15264846 ] ASF GitHub Bot commented on BEAM-77: Github user asfgit closed the pull request at:

[03/17] incubator-beam git commit: Move InProcessRunner to its own module

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e13cacb8/sdks/java/core/src/test/java/org/apache/beam/sdk/runners/inprocess/InMemoryWatermarkManagerTest.java -- diff --git

[12/17] incubator-beam git commit: Move InProcessRunner to its own module

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e13cacb8/runners/direct-java/src/test/java/org/apache/beam/runners/direct/BoundedReadEvaluatorFactoryTest.java -- diff --git

[15/17] incubator-beam git commit: Move InProcessRunner to its own module

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e13cacb8/runners/direct-java/src/main/java/org/apache/beam/runners/direct/FlattenEvaluatorFactory.java -- diff --git

[01/17] incubator-beam git commit: Move InProcessRunner to its own module

Repository: incubator-beam Updated Branches: refs/heads/master bba4c64d3 -> b9116ac42 http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e13cacb8/sdks/java/core/src/test/java/org/apache/beam/sdk/runners/inprocess/ParDoSingleEvaluatorFactoryTest.java

[GitHub] incubator-beam pull request: [BEAM-77] Move InProcessRunner to its...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/256 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[14/17] incubator-beam git commit: Move InProcessRunner to its own module

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e13cacb8/runners/direct-java/src/main/java/org/apache/beam/runners/direct/InProcessBundleOutputManager.java -- diff --git

[16/17] incubator-beam git commit: Move InProcessRunner to its own module

Move InProcessRunner to its own module Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e13cacb8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e13cacb8 Diff:

[05/17] incubator-beam git commit: Move InProcessRunner to its own module

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e13cacb8/sdks/java/core/src/main/java/org/apache/beam/sdk/runners/inprocess/TextIOShardedWriteFactory.java -- diff --git

[10/17] incubator-beam git commit: Move InProcessRunner to its own module

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e13cacb8/runners/direct-java/src/test/java/org/apache/beam/runners/direct/InProcessEvaluationContextTest.java -- diff --git

[13/17] incubator-beam git commit: Move InProcessRunner to its own module

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e13cacb8/runners/direct-java/src/main/java/org/apache/beam/runners/direct/ParDoInProcessEvaluator.java -- diff --git

[06/17] incubator-beam git commit: Move InProcessRunner to its own module

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e13cacb8/sdks/java/core/src/main/java/org/apache/beam/sdk/runners/inprocess/InProcessPipelineOptions.java -- diff --git

[09/17] incubator-beam git commit: Move InProcessRunner to its own module

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e13cacb8/runners/direct-java/src/test/java/org/apache/beam/runners/direct/ParDoSingleEvaluatorFactoryTest.java -- diff --git

[jira] [Commented] (BEAM-241) Not easy for runners to get late-data dropping

[ https://issues.apache.org/jira/browse/BEAM-241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264823#comment-15264823 ] Kenneth Knowles commented on BEAM-241: -- This is getting into the realm of providing a backend/worker

[jira] [Created] (BEAM-241) Not easy for runners to get late-data dropping

Mark Shields created BEAM-241: - Summary: Not easy for runners to get late-data dropping Key: BEAM-241 URL: https://issues.apache.org/jira/browse/BEAM-241 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-52) KafkaIO - bounded/unbounded, source/sink

[ https://issues.apache.org/jira/browse/BEAM-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264733#comment-15264733 ] Aljoscha Krettek commented on BEAM-52: -- Ah, I also implemented one here:

[jira] [Commented] (BEAM-52) KafkaIO - bounded/unbounded, source/sink

[ https://issues.apache.org/jira/browse/BEAM-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264663#comment-15264663 ] Raghu Angadi commented on BEAM-52: -- [~aljoscha], I am working on Sink, will send a PR very soon (hopefully

[GitHub] incubator-beam pull request: [BEAM-22] Remove redundant close in B...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/257 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264449#comment-15264449 ] ASF GitHub Bot commented on BEAM-22: Github user asfgit closed the pull request at:

[2/2] incubator-beam git commit: This closes #257

This closes #257 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bba4c64d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/bba4c64d Diff:

[1/2] incubator-beam git commit: Remove redundant close in BoundedReadEvaluatorFactory

Repository: incubator-beam Updated Branches: refs/heads/master 593bf0c53 -> bba4c64d3 Remove redundant close in BoundedReadEvaluatorFactory The reader is already closed by virtue of being the target of the try-with-resources block that encompasses all of #finishBundle(). Project:

[GitHub] incubator-beam pull request: Never trigger: fix broken link in Jav...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/251 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: This closes #251

This closes #251 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/593bf0c5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/593bf0c5 Diff:

[1/2] incubator-beam git commit: Never trigger: fix broken link in Javadoc

Repository: incubator-beam Updated Branches: refs/heads/master 661a4a893 -> 593bf0c53 Never trigger: fix broken link in Javadoc Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a18d6b93 Tree:

[jira] [Commented] (BEAM-115) Beam Runner API

[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264406#comment-15264406 ] ASF GitHub Bot commented on BEAM-115: - GitHub user kennknowles opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-115] Make in-process GroupByKey...

GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/268 [BEAM-115] Make in-process GroupByKey consistent with Beam model Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] incubator-beam pull request: Encapsulate cloning behavior of in-pr...

Github user kennknowles closed the pull request at: https://github.com/apache/incubator-beam/pull/263 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-238) Add link URLs for sources / sinks

[ https://issues.apache.org/jira/browse/BEAM-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264314#comment-15264314 ] Scott Wegner commented on BEAM-238: --- I meant to create this as a subtask to [BEAM-117] for adding links to

[jira] [Created] (BEAM-240) Add display data link URLs for sources / sinks

Scott Wegner created BEAM-240: - Summary: Add display data link URLs for sources / sinks Key: BEAM-240 URL: https://issues.apache.org/jira/browse/BEAM-240 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-238) Add link URLs for sources / sinks

[ https://issues.apache.org/jira/browse/BEAM-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264319#comment-15264319 ] Jean-Baptiste Onofré commented on BEAM-238: --- Oh ok, sorry [~swegner] I misunderstood the purpose

[2/4] incubator-beam git commit: fix Flink source coder handling

fix Flink source coder handling Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/aead96ff Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/aead96ff Diff:

[3/4] incubator-beam git commit: Flink sink implementation

Flink sink implementation Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bc847a95 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/bc847a95 Diff:

[GitHub] incubator-beam pull request: Add option to use Flink's Kafka Write...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/266 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[4/4] incubator-beam git commit: This closes #266

This closes #266 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/661a4a89 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/661a4a89 Diff:

[1/4] incubator-beam git commit: add Kafka IO examples

Repository: incubator-beam Updated Branches: refs/heads/master 4fd9d74df -> 661a4a893 add Kafka IO examples Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/63bce07d Tree:

[jira] [Commented] (BEAM-154) Provide Maven BOM

[ https://issues.apache.org/jira/browse/BEAM-154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264100#comment-15264100 ] ASF GitHub Bot commented on BEAM-154: - GitHub user jbonofre opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-154] Use dependencyManagement a...

GitHub user jbonofre opened a pull request: https://github.com/apache/incubator-beam/pull/267 [BEAM-154] Use dependencyManagement and pluginManagement to keep all … Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X]

[jira] [Commented] (BEAM-103) Make UnboundedSourceWrapper parallel

[ https://issues.apache.org/jira/browse/BEAM-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264040#comment-15264040 ] Aljoscha Krettek commented on BEAM-103: --- @mxm I don't now, thought so. :-) > Make

[jira] [Commented] (BEAM-52) KafkaIO - bounded/unbounded, source/sink

[ https://issues.apache.org/jira/browse/BEAM-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264037#comment-15264037 ] Aljoscha Krettek commented on BEAM-52: -- Ok, thanks! I'll get crackin' :-) > KafkaIO -

[jira] [Commented] (BEAM-52) KafkaIO - bounded/unbounded, source/sink

[ https://issues.apache.org/jira/browse/BEAM-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264022#comment-15264022 ] Jean-Baptiste Onofré commented on BEAM-52: -- [~aljoscha] I planned to work on it, but not yet

Jenkins build is back to normal : beam_PostCommit_MavenVerify #306

See

[jira] [Commented] (BEAM-103) Make UnboundedSourceWrapper parallel

[ https://issues.apache.org/jira/browse/BEAM-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264019#comment-15264019 ] Kostas Kloudas commented on BEAM-103: - I agree that this is pressing. I will be able to work on this

Jenkins build is back to normal : beam_PostCommit_MavenVerify » Apache Beam :: SDKs :: Java :: Core #306

See

[jira] [Commented] (BEAM-52) KafkaIO - bounded/unbounded, source/sink

[ https://issues.apache.org/jira/browse/BEAM-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264018#comment-15264018 ] Aljoscha Krettek commented on BEAM-52: -- [~rangadi], [~dhalp...@google.com] is anyone of you working on a

[jira] [Commented] (BEAM-103) Make UnboundedSourceWrapper parallel

[ https://issues.apache.org/jira/browse/BEAM-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264013#comment-15264013 ] Maximilian Michels commented on BEAM-103: - Curious to know where I have mentioned that :) I believe

[jira] [Updated] (BEAM-139) Print mode (batch/streaming) during translation

[ https://issues.apache.org/jira/browse/BEAM-139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-139: Component/s: (was: runner-core) > Print mode (batch/streaming) during translation >

[jira] [Commented] (BEAM-139) Print mode (batch/streaming) during translation

[ https://issues.apache.org/jira/browse/BEAM-139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264001#comment-15264001 ] Maximilian Michels commented on BEAM-139: - I agree with the direction. Runners may still announce

[jira] [Commented] (BEAM-139) Print mode (batch/streaming) during translation

[ https://issues.apache.org/jira/browse/BEAM-139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263979#comment-15263979 ] Aljoscha Krettek commented on BEAM-139: --- +1, this is rendered obsolete by BEAM-235. > Print mode

Build failed in Jenkins: beam_PostCommit_MavenVerify #305

See -- [...truncated 798 lines...] [INFO] Including io.grpc:grpc-protobuf:jar:0.12.0 in the shaded jar. [INFO] Including io.grpc:grpc-stub:jar:0.12.0 in the shaded jar. [INFO] Including

Build failed in Jenkins: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #240

See -- [...truncated 7688 lines...] [INFO] Including com.google.guava:guava:jar:19.0 in the shaded jar. [INFO] Excluding

[GitHub] incubator-beam pull request: Add option to use Flink's Kafka Write...

GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/266 Add option to use Flink's Kafka Write IO This pull request adds the counterpart of the UnboundedFlinkSource, the `UnboundedFlinkSink` which uses the `Write` API. Users have requested this

[jira] [Commented] (BEAM-238) Add link URLs for sources / sinks

[ https://issues.apache.org/jira/browse/BEAM-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263645#comment-15263645 ] Jean-Baptiste Onofré commented on BEAM-238: --- I plan to propose a PR with a complete overview of

[jira] [Updated] (BEAM-238) Add link URLs for sources / sinks

[ https://issues.apache.org/jira/browse/BEAM-238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-238: -- Component/s: website > Add link URLs for sources / sinks >

[jira] [Assigned] (BEAM-238) Add link URLs for sources / sinks

[ https://issues.apache.org/jira/browse/BEAM-238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-238: - Assignee: Jean-Baptiste Onofré > Add link URLs for sources / sinks >

Build failed in Jenkins: beam_PostCommit_MavenVerify » Apache Beam :: SDKs :: Java :: Core #304

See -- [...truncated 540 lines...] Running org.apache.beam.sdk.util.UserCodeExceptionTest Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002