[jira] [Updated] (BEAM-1303) Improve ToString Class

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1303: -- Fix Version/s: (was: 0.5.0) > Improve ToString Class > -- > >

[jira] [Commented] (BEAM-1303) Improve ToString Class

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15842336#comment-15842336 ] ASF GitHub Bot commented on BEAM-1303: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #1830

2017-01-26 Thread dhalperi
This closes #1830 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/47304d1f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/47304d1f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/47304d1f Branch: refs/heads/maste

[GitHub] beam pull request #1830: [BEAM-1303] ToString Improvements

2017-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1830 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Refactored existing code. Added iterable and KV. Changed from element to of.

2017-01-26 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 83f8c460c -> 47304d1fc Refactored existing code. Added iterable and KV. Changed from element to of. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e01ce864 Tree: http://g

[jira] [Commented] (BEAM-362) Move shared runner functionality out of SDK and into runners/core-java

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1584#comment-1584 ] ASF GitHub Bot commented on BEAM-362: - GitHub user kennknowles opened a pull request:

[GitHub] beam pull request #1858: [BEAM-362] Move state-oriented remnants of OldDoFn ...

2017-01-26 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1858 [BEAM-362] Move state-oriented remnants of OldDoFn to runners/core-java Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sur

[jira] [Resolved] (BEAM-1177) Input DStream "bundles" should be in serialized form and include relevant metadata.

2017-01-26 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-1177. Resolution: Fixed > Input DStream "bundles" should be in serialized form and include relevant > meta

[jira] [Reopened] (BEAM-1177) Input DStream "bundles" should be in serialized form and include relevant metadata.

2017-01-26 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reopened BEAM-1177: Reopening to correct the 'resolution' field. > Input DStream "bundles" should be in serialized form and

[jira] [Created] (BEAM-1329) Improve default resource allocation in ApexRunner

2017-01-26 Thread Thomas Weise (JIRA)
Thomas Weise created BEAM-1329: -- Summary: Improve default resource allocation in ApexRunner Key: BEAM-1329 URL: https://issues.apache.org/jira/browse/BEAM-1329 Project: Beam Issue Type: Improvem

[jira] [Updated] (BEAM-1327) Replace OutputTimeFn with enum

2017-01-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1327: -- Priority: Minor (was: Major) > Replace OutputTimeFn with enum > -- >

[jira] [Updated] (BEAM-1327) Replace OutputTimeFn with enum

2017-01-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1327: -- Issue Type: New Feature (was: Bug) > Replace OutputTimeFn with enum > --

[jira] [Created] (BEAM-1328) Serialize/deserialize WindowingStrategy in a language-agnostic manner

2017-01-26 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-1328: - Summary: Serialize/deserialize WindowingStrategy in a language-agnostic manner Key: BEAM-1328 URL: https://issues.apache.org/jira/browse/BEAM-1328 Project: Beam

[jira] [Created] (BEAM-1327) Replace OutputTimeFn with enum

2017-01-26 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-1327: - Summary: Replace OutputTimeFn with enum Key: BEAM-1327 URL: https://issues.apache.org/jira/browse/BEAM-1327 Project: Beam Issue Type: Bug Compone

[jira] [Resolved] (BEAM-1235) BigQueryIO doesn't show the load job error to the user

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1235. --- Resolution: Fixed > BigQueryIO doesn't show the load job error to the user > --

[jira] [Commented] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840885#comment-15840885 ] Daniel Halperin commented on BEAM-1315: --- I don't think this needs to be a blocker for

[jira] [Updated] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1315: -- Fix Version/s: (was: 0.5.0) > FileBasedSink could write tmp files above the output prefix. >

[GitHub] beam pull request #1857: Updating dataflow client protos

2017-01-26 Thread pabloem
GitHub user pabloem opened a pull request: https://github.com/apache/beam/pull/1857 Updating dataflow client protos Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[B

[jira] [Commented] (BEAM-1235) BigQueryIO doesn't show the load job error to the user

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840798#comment-15840798 ] ASF GitHub Bot commented on BEAM-1235: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #1823: [BEAM-1235] BigQueryIO.Write: log failed load/copy ...

2017-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1823 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: [BEAM-1235] BigQueryIO.Write: log failed load/copy jobs.

2017-01-26 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 2cbc08b58 -> 83f8c460c [BEAM-1235] BigQueryIO.Write: log failed load/copy jobs. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6531545e Tree: http://git-wip-us.apache.org

[2/2] beam git commit: This closes #1823

2017-01-26 Thread dhalperi
This closes #1823 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/83f8c460 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/83f8c460 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/83f8c460 Branch: refs/heads/maste

[jira] [Commented] (BEAM-1270) Display data for ReadFromText/WriteToText is not being shown

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840746#comment-15840746 ] ASF GitHub Bot commented on BEAM-1270: -- Github user pabloem closed the pull request at

[GitHub] beam pull request #1835: Refactoring metrics for cross-runner context switch...

2017-01-26 Thread pabloem
Github user pabloem closed the pull request at: https://github.com/apache/beam/pull/1835 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] beam pull request #1776: [BEAM-1270] Fix display data for ReadFromText and W...

2017-01-26 Thread pabloem
Github user pabloem closed the pull request at: https://github.com/apache/beam/pull/1776 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Jenkins build is back to normal : beam_PostCommit_Python_Verify #1095

2017-01-26 Thread Apache Jenkins Server
See

[1/2] beam git commit: Refactoring metrics infrastructure

2017-01-26 Thread robertwb
Repository: beam Updated Branches: refs/heads/python-sdk e3849af8c -> 3d6f20d67 Refactoring metrics infrastructure Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b148f5cc Tree: http://git-wip-us.apache.org/repos/asf/beam/tr

[2/2] beam git commit: Closes #1835

2017-01-26 Thread robertwb
Closes #1835 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3d6f20d6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3d6f20d6 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3d6f20d6 Branch: refs/heads/python-sdk

[1/2] beam git commit: Fix read/write display data

2017-01-26 Thread robertwb
Repository: beam Updated Branches: refs/heads/python-sdk c6420df97 -> e3849af8c Fix read/write display data Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e4eda3c3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e4ed

[2/2] beam git commit: Closes #1776

2017-01-26 Thread robertwb
Closes #1776 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e3849af8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e3849af8 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e3849af8 Branch: refs/heads/python-sdk

[jira] [Resolved] (BEAM-1326) WindowedWordCountIT generated output location can easily collide

2017-01-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-1326. --- Resolution: Fixed Fix Version/s: 0.5.0 > WindowedWordCountIT generated output location c

[jira] [Commented] (BEAM-1326) WindowedWordCountIT generated output location can easily collide

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840592#comment-15840592 ] ASF GitHub Bot commented on BEAM-1326: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #1856

2017-01-26 Thread dhalperi
This closes #1856 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2cbc08b5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2cbc08b5 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2cbc08b5 Branch: refs/heads/maste

[GitHub] beam pull request #1856: [BEAM-1326] Add prefix and suffix to WindowedWordCo...

2017-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1856 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Add prefix and suffix to WindowedWordCountIT output location

2017-01-26 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 963772414 -> 2cbc08b58 Add prefix and suffix to WindowedWordCountIT output location Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4d0225e8 Tree: http://git-wip-us.apache

[jira] [Commented] (BEAM-1326) WindowedWordCountIT generated output location can easily collide

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840528#comment-15840528 ] ASF GitHub Bot commented on BEAM-1326: -- GitHub user kennknowles opened a pull request:

[jira] [Created] (BEAM-1326) WindowedWordCountIT generated output location can easily collide

2017-01-26 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-1326: - Summary: WindowedWordCountIT generated output location can easily collide Key: BEAM-1326 URL: https://issues.apache.org/jira/browse/BEAM-1326 Project: Beam

[GitHub] beam pull request #1856: [BEAM-1326] Add prefix and suffix to WindowedWordCo...

2017-01-26 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1856 [BEAM-1326] Add prefix and suffix to WindowedWordCountIT output location Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make su

Build failed in Jenkins: beam_PostCommit_Python_Verify #1094

2017-01-26 Thread Apache Jenkins Server
See -- [...truncated 3756 lines...] { "key": "fn", "label": "Transform Function", "namespace": "apache_beam.transforms.core.CallableWrapperDoF

[jira] [Commented] (BEAM-1316) DoFn#startBundle and #finishBundle should not be able to output

2017-01-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840324#comment-15840324 ] Kenneth Knowles commented on BEAM-1316: --- That is a good example that breaks my false

[GitHub] beam pull request #1855: Add wrapping of lambda in a SimpleFunction

2017-01-26 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1855 Add wrapping of lambda in a SimpleFunction Here's a fun trick for getting a type descriptor attached to a lambda that seems nicer than `.withOutputType(...)`. For discussion. You can merge this

[jira] [Comment Edited] (BEAM-1317) Strategy around snippet versioning

2017-01-26 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840219#comment-15840219 ] Davor Bonaci edited comment on BEAM-1317 at 1/26/17 6:57 PM: - I

[jira] [Resolved] (BEAM-1317) Strategy around snippet versioning

2017-01-26 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-1317. Resolution: Done Fix Version/s: Not applicable > Strategy around snippet versioning >

[jira] [Commented] (BEAM-1317) Strategy around snippet versioning

2017-01-26 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840219#comment-15840219 ] Davor Bonaci commented on BEAM-1317: I think policy is the solution -- take snippets fr

[GitHub] beam pull request #1854: Some performance improvements to NewDoFn but moving...

2017-01-26 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1854 Some performance improvements to NewDoFn but moving common code The NewDoFN are still slower than the Old one but this improves the performance a bit. R: @robertwb PTAL Be sure to d

[jira] [Commented] (BEAM-886) Support new DoFn in Python SDK

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840204#comment-15840204 ] ASF GitHub Bot commented on BEAM-886: - Github user sb2nov closed the pull request at:

[GitHub] beam pull request #1842: [BEAM-886] Migrate CallableWrapperDoFn to extend Ne...

2017-01-26 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/1842 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] beam pull request #1852: Update the NOTICE year range

2017-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1852 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: This closes #1852

2017-01-26 Thread davor
This closes #1852 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/96377241 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/96377241 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/96377241 Branch: refs/heads/maste

[1/2] beam git commit: Update the NOTICE year range

2017-01-26 Thread davor
Repository: beam Updated Branches: refs/heads/master 717b415f1 -> 963772414 Update the NOTICE year range Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b97b3935 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b97b393

[jira] [Resolved] (BEAM-560) In JAXBCoder, use a pair of ThreadLocals to cache Marshaller/Unmarshaller

2017-01-26 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-560. --- Resolution: Fixed Assignee: Kai Jiang (was: Davor Bonaci) > In JAXBCoder, use a pair of ThreadLoc

[jira] [Resolved] (BEAM-974) Adds attributes support to PubsubIO

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-974. -- Resolution: Fixed Fix Version/s: 0.5.0 > Adds attributes support to PubsubIO >

[jira] [Updated] (BEAM-974) Adds attributes support to PubsubIO

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-974: - Affects Version/s: (was: 0.3.0-incubating) > Adds attributes support to PubsubIO > -

[jira] [Commented] (BEAM-974) Adds attributes support to PubsubIO

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840104#comment-15840104 ] ASF GitHub Bot commented on BEAM-974: - Github user asfgit closed the pull request at:

[GitHub] beam pull request #1853: [BEAM-974] DataflowRunner: upgrade worker with Pubs...

2017-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1853 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: DataflowRunner: upgrade worker with Pubsub attribute changes

2017-01-26 Thread dhalperi
oud-dataflow-java/pom.xml +++ b/runners/google-cloud-dataflow-java/pom.xml @@ -33,7 +33,7 @@ jar - beam-master-20170120 + beam-master-20170126 6

[2/2] beam git commit: This closes #1853

2017-01-26 Thread dhalperi
This closes #1853 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/717b415f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/717b415f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/717b415f Branch: refs/heads/maste

[jira] [Commented] (BEAM-1323) Add parallelism/splitting in JdbcIO

2017-01-26 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840015#comment-15840015 ] Eugene Kirpichov commented on BEAM-1323: I don't think there's a generic way to aut

[jira] [Commented] (BEAM-1316) DoFn#startBundle and #finishBundle should not be able to output

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840014#comment-15840014 ] Daniel Halperin commented on BEAM-1316: --- What if my output includes a list of filenam

[jira] [Commented] (BEAM-1316) DoFn#startBundle and #finishBundle should not be able to output

2017-01-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840002#comment-15840002 ] Kenneth Knowles commented on BEAM-1316: --- I suggest very explicitly distinguishing flu

[jira] [Resolved] (BEAM-1248) Combine with side inputs API should match ParDo

2017-01-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-1248. --- Resolution: Fixed > Combine with side inputs API should match ParDo > -

[jira] [Commented] (BEAM-1325) DataflowRunner support for Class-Path jars

2017-01-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839880#comment-15839880 ] Luke Cwik commented on BEAM-1325: - We can recursively look at the "Class-Path" manifest of

[jira] [Updated] (BEAM-1325) DataflowRunner support for Class-Path jars

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1325: -- Description: See https://github.com/GoogleCloudPlatform/DataflowJavaSDK/issues/538 The code that

[jira] [Commented] (BEAM-947) WindowedWordCountIT fails due to not setting "--output" pipeline options

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839847#comment-15839847 ] Daniel Halperin commented on BEAM-947: -- (ignore the above PR -- I tagged the wrong issu

[jira] [Commented] (BEAM-814) Improve performance when staging files

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839843#comment-15839843 ] ASF GitHub Bot commented on BEAM-814: - Github user asfgit closed the pull request at:

[GitHub] beam pull request #1849: [BEAM-814] Dataflow: parallelize staging of files

2017-01-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1849 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/3] beam git commit: PackageUtil: preserve classpath ordering when uploading

2017-01-26 Thread dhalperi
PackageUtil: preserve classpath ordering when uploading Also add a test Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b0b91c84 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b0b91c84 Diff: http://git-wip-us.apache.org

[1/3] beam git commit: Recommit "DataflowRunner: parallelize staging of files"

2017-01-26 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 1c6e66741 -> b4726d088 Recommit "DataflowRunner: parallelize staging of files" Revert "This closes #1847" This reverts commit 1c6e667414788fe99f583fac39d458a4984ae162, reversing changes made to 6413299a20be57de849684479134479fa1acee2d. Pr

[3/3] beam git commit: This closes #1849

2017-01-26 Thread dhalperi
This closes #1849 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b4726d08 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b4726d08 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b4726d08 Branch: refs/heads/maste

[jira] [Commented] (BEAM-1325) DataflowRunner support for Class-Path jars

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839835#comment-15839835 ] Daniel Halperin commented on BEAM-1325: --- Luke: yes, we'd have to detect that the user

[jira] [Commented] (BEAM-1325) DataflowRunner support for Class-Path jars

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839827#comment-15839827 ] Daniel Halperin commented on BEAM-1325: --- This SO post: http://stackoverflow.com/ques

[jira] [Comment Edited] (BEAM-1325) DataflowRunner support for Class-Path jars

2017-01-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839821#comment-15839821 ] Luke Cwik edited comment on BEAM-1325 at 1/26/17 3:07 PM: -- Its not

[jira] [Commented] (BEAM-1325) DataflowRunner support for Class-Path jars

2017-01-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839821#comment-15839821 ] Luke Cwik commented on BEAM-1325: - Its not just that the Class-Path should be understood an

[jira] [Commented] (BEAM-947) WindowedWordCountIT fails due to not setting "--output" pipeline options

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839803#comment-15839803 ] ASF GitHub Bot commented on BEAM-947: - GitHub user dhalperi opened a pull request:

[GitHub] beam pull request #1853: [BEAM-947] DataflowRunner: upgrade worker with Pubs...

2017-01-26 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/1853 [BEAM-947] DataflowRunner: upgrade worker with Pubsub attribute changes You can merge this pull request into a Git repository by running: $ git pull https://github.com/dhalperi/beam pubsub-wor

[jira] [Created] (BEAM-1325) DataflowRunner support for Class-Path jars

2017-01-26 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1325: - Summary: DataflowRunner support for Class-Path jars Key: BEAM-1325 URL: https://issues.apache.org/jira/browse/BEAM-1325 Project: Beam Issue Type: New Featu

[GitHub] beam pull request #1852: Update the NOTICE year range

2017-01-26 Thread jbonofre
GitHub user jbonofre opened a pull request: https://github.com/apache/beam/pull/1852 Update the NOTICE year range Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is formatted like: `[BEA

[jira] [Commented] (BEAM-214) Create Parquet IO

2017-01-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839674#comment-15839674 ] ASF GitHub Bot commented on BEAM-214: - GitHub user jbonofre opened a pull request:

[GitHub] beam pull request #1851: [BEAM-214] Add ParquetIO

2017-01-26 Thread jbonofre
GitHub user jbonofre opened a pull request: https://github.com/apache/beam/pull/1851 [BEAM-214] Add ParquetIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is formatted like: `[BEAM-]

[jira] [Created] (BEAM-1324) Able to define the thread count via PipelineOptions

2017-01-26 Thread JIRA
Jean-Baptiste Onofré created BEAM-1324: -- Summary: Able to define the thread count via PipelineOptions Key: BEAM-1324 URL: https://issues.apache.org/jira/browse/BEAM-1324 Project: Beam Is

[jira] [Assigned] (BEAM-1248) Combine with side inputs API should match ParDo

2017-01-26 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Jiang reassigned BEAM-1248: --- Assignee: Kai Jiang > Combine with side inputs API should match ParDo > --

[jira] [Updated] (BEAM-1248) Combine with side inputs API should match ParDo

2017-01-26 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Jiang updated BEAM-1248: Fix Version/s: 0.5.0 > Combine with side inputs API should match ParDo >

[jira] [Updated] (BEAM-560) In JAXBCoder, use a pair of ThreadLocals to cache Marshaller/Unmarshaller

2017-01-26 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Jiang updated BEAM-560: --- Fix Version/s: 0.5.0 > In JAXBCoder, use a pair of ThreadLocals to cache Marshaller/Unmarshaller > -

[jira] [Created] (BEAM-1323) Add parallelism/splitting in JdbcIO

2017-01-26 Thread JIRA
Jean-Baptiste Onofré created BEAM-1323: -- Summary: Add parallelism/splitting in JdbcIO Key: BEAM-1323 URL: https://issues.apache.org/jira/browse/BEAM-1323 Project: Beam Issue Type: Improv