[GitHub] beam pull request #3682: Refactor FnApiRunner to operate directly on the run...

2017-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3682 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Closes #3682

2017-08-03 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 9e6530adb -> 72bd73ab3 Closes #3682 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/72bd73ab Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/72bd73ab Diff: http://g

[2/2] beam git commit: Refactor FnApiRunner to operate directly on the runner API protos.

2017-08-03 Thread robertwb
Refactor FnApiRunner to operate directly on the runner API protos. This allows for optimization and execution of pipelines in other langauges over the Fn API (modulo aligning URNs and using the runner API for Coders). The only portions of the pipeline that are deserialized are the Coders. Proje

[jira] [Commented] (BEAM-2684) AmqpIOTest is flaky

2017-08-03 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16114009#comment-16114009 ] Jean-Baptiste Onofré commented on BEAM-2684: Yes, good idea, I will do a PR lik

[jira] [Commented] (BEAM-2684) AmqpIOTest is flaky

2017-08-03 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16114002#comment-16114002 ] Eugene Kirpichov commented on BEAM-2684: As an intermediate step, perhaps, add a bu

[jira] [Commented] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

2017-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113990#comment-16113990 ] ASF GitHub Bot commented on BEAM-2708: -- Github user asfgit closed the pull request at:

[jira] [Resolved] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

2017-08-03 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-2708. Resolution: Fixed > Decompressing bzip2 files with multiple "streams" only reads the

[2/2] beam git commit: [BEAM-2708] This closes #3681

2017-08-03 Thread jbonofre
[BEAM-2708] This closes #3681 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bad996bb Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bad996bb Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/bad996bb Branch: refs

[GitHub] beam pull request #3681: [BEAM-2708] Adds support for reading concatenated b...

2017-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3681 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Adds support for reading concatenated bzip2 files.

2017-08-03 Thread jbonofre
Repository: beam Updated Branches: refs/heads/release-2.1.0 58928b942 -> bad996bb4 Adds support for reading concatenated bzip2 files. Adds tests for concatenated gzip and bzip2 files. Removes test 'test_model_textio_gzip_concatenated' in 'snippets_test.py' since it's actually hitting 'DummyR

[jira] [Commented] (BEAM-2684) AmqpIOTest is flaky

2017-08-03 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113986#comment-16113986 ] Jean-Baptiste Onofré commented on BEAM-2684: As I said, it's not easy to reprod

[jira] [Commented] (BEAM-2684) AmqpIOTest is flaky

2017-08-03 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113959#comment-16113959 ] Robert Bradshaw commented on BEAM-2684: --- I've been hitting this nearly every PR (even

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3709

2017-08-03 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2769

2017-08-03 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2686) PTransform's should always set a Coder on their output PCollections

2017-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113756#comment-16113756 ] ASF GitHub Bot commented on BEAM-2686: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3649: [BEAM-2686] Towards deprecating PCollection.setCode...

2017-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3649 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/6] beam git commit: Removes all overrides of PTransform.getDefaultOutputCoder and deprecates it

2017-08-03 Thread jkff
Repository: beam Updated Branches: refs/heads/master 38f189063 -> 9e6530adb Removes all overrides of PTransform.getDefaultOutputCoder and deprecates it Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/95e2a00a Tree: http://gi

[2/6] beam git commit: Requires specifying a Coder on PCollection.createPrimitiveOutputInternal

2017-08-03 Thread jkff
http://git-wip-us.apache.org/repos/asf/beam/blob/bb1bf3c1/sdks/java/core/src/main/java/org/apache/beam/sdk/values/PCollection.java -- diff --git a/sdks/java/core/src/main/java/org/apache/beam/sdk/values/PCollection.java b/sdks/ja

[3/6] beam git commit: Requires specifying a Coder on PCollection.createPrimitiveOutputInternal

2017-08-03 Thread jkff
Requires specifying a Coder on PCollection.createPrimitiveOutputInternal The coder can still be null, in which case it is left unspecified. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bb1bf3c1 Tree: http://git-wip-us.apache

[5/6] beam git commit: Remembers the output coders of SplittableParDo

2017-08-03 Thread jkff
Remembers the output coders of SplittableParDo Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/48690bc6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/48690bc6 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/48690

[6/6] beam git commit: This closes #3649: [BEAM-2686] Towards deprecating PCollection.setCoder()

2017-08-03 Thread jkff
This closes #3649: [BEAM-2686] Towards deprecating PCollection.setCoder() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9e6530ad Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9e6530ad Diff: http://git-wip-us.apache.or

[4/6] beam git commit: Makes all Source classes override getOutputCoder instead of getDefaultOutputCoder

2017-08-03 Thread jkff
Makes all Source classes override getOutputCoder instead of getDefaultOutputCoder Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e017a0ec Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e017a0ec Diff: http://git-wip-us.

[jira] [Commented] (BEAM-2724) MSEC counters should support Structured Names in Dataflow

2017-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113748#comment-16113748 ] ASF GitHub Bot commented on BEAM-2724: -- GitHub user pabloem opened a pull request:

[GitHub] beam pull request #3684: [BEAM-2724] Preparing support for Structured Names ...

2017-08-03 Thread pabloem
GitHub user pabloem opened a pull request: https://github.com/apache/beam/pull/3684 [BEAM-2724] Preparing support for Structured Names in Dataflow counters Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA

[jira] [Updated] (BEAM-2722) Remove redundant windowing information from the BeamRecord itself

2017-08-03 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2722: - Labels: dsl_sql_merge (was: ) > Remove redundant windowing information from the BeamRecord itself > --

[jira] [Created] (BEAM-2725) remove nullFields in BeamRecord

2017-08-03 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2725: Summary: remove nullFields in BeamRecord Key: BEAM-2725 URL: https://issues.apache.org/jira/browse/BEAM-2725 Project: Beam Issue Type: Improvement Componen

[GitHub] beam pull request #3683: WIP - Bundle retry prototype

2017-08-03 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/3683 WIP - Bundle retry prototype Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org/jira/projec

[jira] [Closed] (BEAM-2723) remove windowInfo in BeamRecord

2017-08-03 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin closed BEAM-2723. Resolution: Duplicate Fix Version/s: Not applicable > remove windowInfo in BeamRecord > --

[jira] [Assigned] (BEAM-2722) Remove redundant windowing information from the BeamRecord itself

2017-08-03 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin reassigned BEAM-2722: Assignee: Xu Mingmin (was: Davor Bonaci) > Remove redundant windowing information from the BeamReco

[jira] [Created] (BEAM-2724) MSEC counters should support Structured Names in Dataflow

2017-08-03 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-2724: --- Summary: MSEC counters should support Structured Names in Dataflow Key: BEAM-2724 URL: https://issues.apache.org/jira/browse/BEAM-2724 Project: Beam Issue Type

[jira] [Created] (BEAM-2723) remove windowInfo in BeamRecord

2017-08-03 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2723: Summary: remove windowInfo in BeamRecord Key: BEAM-2723 URL: https://issues.apache.org/jira/browse/BEAM-2723 Project: Beam Issue Type: Improvement Componen

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3708

2017-08-03 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2722) Remove redundant windowing information from the BeamRecord itself

2017-08-03 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-2722: - Summary: Remove redundant windowing information from the BeamRecord itself Key: BEAM-2722 URL: https://issues.apache.org/jira/browse/BEAM-2722 Project: Beam

[jira] [Created] (BEAM-2721) Augment BeamRecordType to do slicing and concatenation.

2017-08-03 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-2721: - Summary: Augment BeamRecordType to do slicing and concatenation. Key: BEAM-2721 URL: https://issues.apache.org/jira/browse/BEAM-2721 Project: Beam Issue Ty

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2768

2017-08-03 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2709) Add TezRunner

2017-08-03 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113370#comment-16113370 ] Davor Bonaci commented on BEAM-2709: Welcome [~bdscheller], and thanks for your contrib

[jira] [Assigned] (BEAM-2709) Add TezRunner

2017-08-03 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2709: -- Assignee: Brandon Scheller (was: Davor Bonaci) > Add TezRunner > - > >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3707

2017-08-03 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1347) Basic Java harness capable of understanding process bundle tasks and sending data over the Fn Api

2017-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113336#comment-16113336 ] ASF GitHub Bot commented on BEAM-1347: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3638: [BEAM-1347] Add utility to be able to model inbound...

2017-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3638 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: [BEAM-1347] Add utility to be able to model inbound reading as a single input stream

2017-08-03 Thread lcwik
Repository: beam Updated Branches: refs/heads/master d4f9e9268 -> 38f189063 [BEAM-1347] Add utility to be able to model inbound reading as a single input stream Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ac7f9739 Tree:

[2/2] beam git commit: [BEAM-1347] Add utility to be able to model inbound reading as a single input stream

2017-08-03 Thread lcwik
[BEAM-1347] Add utility to be able to model inbound reading as a single input stream This closes #3638 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/38f18906 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/38f18906 Di

[jira] [Created] (BEAM-2720) Exact-once Kafka sink

2017-08-03 Thread Raghu Angadi (JIRA)
Raghu Angadi created BEAM-2720: -- Summary: Exact-once Kafka sink Key: BEAM-2720 URL: https://issues.apache.org/jira/browse/BEAM-2720 Project: Beam Issue Type: New Feature Components: sd

[GitHub] beam pull request #3682: Refactor FnApiRunner to operate directly on the run...

2017-08-03 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3682 Refactor FnApiRunner to operate directly on the runner API protos. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issu

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2767

2017-08-03 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

2017-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113225#comment-16113225 ] ASF GitHub Bot commented on BEAM-2708: -- GitHub user chamikaramj opened a pull request:

[GitHub] beam pull request #3681: [BEAM-2708] Adds support for reading concatenated b...

2017-08-03 Thread chamikaramj
GitHub user chamikaramj opened a pull request: https://github.com/apache/beam/pull/3681 [BEAM-2708] Adds support for reading concatenated bzip2 files Cherry-picking into 2.1.0 release branch. Corresponding fix for Java SDK was already cherry picked into 2.1.0 branch. I thin

[jira] [Commented] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

2017-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113208#comment-16113208 ] ASF GitHub Bot commented on BEAM-2708: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3678: [BEAM-2708] Adds support for reading concatenated b...

2017-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3678 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: This closes #3678

2017-08-03 Thread chamikara
This closes #3678 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d4f9e926 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d4f9e926 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d4f9e926 Branch: refs/heads/maste

[1/2] beam git commit: Adds support for reading concatenated bzip2 files.

2017-08-03 Thread chamikara
Repository: beam Updated Branches: refs/heads/master 55bb423d8 -> d4f9e9268 Adds support for reading concatenated bzip2 files. Adds tests for concatenated gzip and bzip2 files. Removes test 'test_model_textio_gzip_concatenated' in 'snippets_test.py' since it's actually hitting 'DummyReadTran

[GitHub] beam pull request #3659: [proposal] Improving naming of steps that consume s...

2017-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3659 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: Improving naming of steps that consume side inputs

2017-08-03 Thread robertwb
Improving naming of steps that consume side inputs Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1e582e6e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1e582e6e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/1

[1/2] beam git commit: Closes #3659

2017-08-03 Thread robertwb
Repository: beam Updated Branches: refs/heads/master d2133d34b -> 55bb423d8 Closes #3659 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/55bb423d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/55bb423d Diff: http://g

[jira] [Commented] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

2017-08-03 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113021#comment-16113021 ] Thomas Groh commented on BEAM-2714: --- Effectively, yes; a view is defined by a {{PCollecti

[jira] [Assigned] (BEAM-1874) Google Cloud Storage TextIO read fails with gz-files having Content-Encoding: gzip header

2017-08-03 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1874: - Assignee: Chamikara Jayalath (was: Charles Chen) > Google Cloud Storage TextIO read fails with gz

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3706

2017-08-03 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2766

2017-08-03 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3680: Fix inversion between namespace and doc arguments

2017-08-03 Thread chtefi
Github user chtefi closed the pull request at: https://github.com/apache/beam/pull/3680 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] beam pull request #3680: Fix inversion between namespace and doc arguments

2017-08-03 Thread chtefi
GitHub user chtefi opened a pull request: https://github.com/apache/beam/pull/3680 Fix inversion between namespace and doc arguments Hey, It seems the `doc` and `namespace` arguments are mixed up, the method signature being `public static Schema createRecord(String name, St

[GitHub] beam pull request #3521: [BEAM-2298] Making LocalFileSystem default and stri...

2017-08-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3521 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Add local filesystem as default and strip away prefix from local files in pipeline options.

2017-08-03 Thread lcwik
Repository: beam Updated Branches: refs/heads/master de0148c3e -> d2133d34b Add local filesystem as default and strip away prefix from local files in pipeline options. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b5017bf

[jira] [Commented] (BEAM-2298) Java WordCount doesn't work in Window OS for glob expressions or file: prefixed paths

2017-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16112707#comment-16112707 ] ASF GitHub Bot commented on BEAM-2298: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: [BEAM-2298] Making LocalFileSystem default and stripping file spec prefixes.

2017-08-03 Thread lcwik
[BEAM-2298] Making LocalFileSystem default and stripping file spec prefixes. This closes #3521 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d2133d34 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d2133d34 Diff: http:

[jira] [Commented] (BEAM-1874) Google Cloud Storage TextIO read fails with gz-files having Content-Encoding: gzip header

2017-08-03 Thread Samuli Holopainen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16112590#comment-16112590 ] Samuli Holopainen commented on BEAM-1874: - Well, I think the issue still persists,

[jira] [Updated] (BEAM-2719) Beam job hangs at Evaluating ParMultiDo when submitted via spark-runner

2017-08-03 Thread Sathish Jayaraman (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sathish Jayaraman updated BEAM-2719: Description: The Beam job submitted for execution via spark-submit does not get past the Eva

[jira] [Updated] (BEAM-2719) Beam job hangs at Evaluating ParMultiDo when submitted via spark-runner

2017-08-03 Thread Sathish Jayaraman (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sathish Jayaraman updated BEAM-2719: Description: Hi, The Beam job submitted for execution via spark-submit does not get past the

[jira] [Updated] (BEAM-2719) Beam job hangs at Evaluating ParMultiDo when submitted via spark-runner

2017-08-03 Thread Sathish Jayaraman (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sathish Jayaraman updated BEAM-2719: Description: The Beam job submitted for execution via spark-submit does not get past the Eva

[jira] [Updated] (BEAM-2719) Beam job hangs at Evaluating ParMultiDo when submitted via spark-runner

2017-08-03 Thread Sathish Jayaraman (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sathish Jayaraman updated BEAM-2719: Description: Hi, The Beam job submitted for execution via spark-submit does not get past the

[jira] [Assigned] (BEAM-2719) Beam job hangs at Evaluating ParMultiDo when submitted via spark-runner

2017-08-03 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-2719: -- Assignee: Jean-Baptiste Onofré (was: Amit Sela) > Beam job hangs at Evaluating

[jira] [Updated] (BEAM-2719) Beam job hangs at Evaluating ParMultiDo when submitted via spark-runner

2017-08-03 Thread Sathish Jayaraman (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sathish Jayaraman updated BEAM-2719: Description: Hi, The Beam job submitted for execution via spark-submit does not get past the

[jira] [Created] (BEAM-2719) Beam job hangs at Evaluating ParMultiDo when submitted via spark-runner

2017-08-03 Thread Sathish Jayaraman (JIRA)
Sathish Jayaraman created BEAM-2719: --- Summary: Beam job hangs at Evaluating ParMultiDo when submitted via spark-runner Key: BEAM-2719 URL: https://issues.apache.org/jira/browse/BEAM-2719 Project: B

[GitHub] beam pull request #3549: [BEAM-1820] Make Source.getDefaultOutputCoder() @Nu...

2017-08-03 Thread lgajowy
Github user lgajowy closed the pull request at: https://github.com/apache/beam/pull/3549 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (BEAM-1820) Source.getDefaultOutputCoder() should be @Nullable

2017-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16112397#comment-16112397 ] ASF GitHub Bot commented on BEAM-1820: -- Github user lgajowy closed the pull request at

[jira] [Commented] (BEAM-2718) Add bundle retry logic to the DirectRunner

2017-08-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16112341#comment-16112341 ] ASF GitHub Bot commented on BEAM-2718: -- GitHub user mariapython opened a pull request:

[GitHub] beam pull request #3679: [BEAM-2718] Add initial bundle retry code for the D...

2017-08-03 Thread mariapython
GitHub user mariapython opened a pull request: https://github.com/apache/beam/pull/3679 [BEAM-2718] Add initial bundle retry code for the DirectRunner (WIP) When processing of a bundle fails, the bundle should be retried 3 times (for a total of 4 attempts to process it). You can m

[jira] [Created] (BEAM-2717) Infer coders in SDK prior to handing off pipeline to Runner

2017-08-03 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-2717: - Summary: Infer coders in SDK prior to handing off pipeline to Runner Key: BEAM-2717 URL: https://issues.apache.org/jira/browse/BEAM-2717 Project: Beam Iss

[jira] [Created] (BEAM-2718) Add bundle retry logic to the DirectRunner

2017-08-03 Thread JIRA
María GH created BEAM-2718: -- Summary: Add bundle retry logic to the DirectRunner Key: BEAM-2718 URL: https://issues.apache.org/jira/browse/BEAM-2718 Project: Beam Issue Type: New Feature C

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3705

2017-08-03 Thread Apache Jenkins Server
See