[GitHub] beam pull request #2889: [BEAM-59] Remove IOChannelUtil/Factory from BigQuer...

2017-05-03 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2889 [BEAM-59] Remove IOChannelUtil/Factory from BigQueryIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Commented] (BEAM-1920) Add Spark 2.x support in Spark runner

2017-05-03 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996189#comment-15996189 ] Jean-Baptiste Onofré commented on BEAM-1920: Yes, it's part of the PR on which I'm working now

[jira] [Assigned] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions

2017-05-03 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-806: - Assignee: Davor Bonaci > Maven Release Plugin Does Not Set Archetype Versions >

[GitHub] beam pull request #2888: [BEAM-79] Merge master into gearpump-runner branch

2017-05-03 Thread manuzhang
GitHub user manuzhang opened a pull request: https://github.com/apache/beam/pull/2888 [BEAM-79] Merge master into gearpump-runner branch Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Commented] (BEAM-79) Gearpump runner

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996155#comment-15996155 ] ASF GitHub Bot commented on BEAM-79: GitHub user manuzhang opened a pull request:

[jira] [Comment Edited] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996153#comment-15996153 ] Daniel Halperin edited comment on BEAM-806 at 5/4/17 4:11 AM: -- [~davor] can we

[jira] [Commented] (BEAM-2093) Update Jackson version to 2.8.8 in archetype (or align with parent pom)

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996151#comment-15996151 ] Daniel Halperin commented on BEAM-2093: --- Thanks again, [~elek] -- this one is awesome and has been

[jira] [Commented] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996153#comment-15996153 ] Daniel Halperin commented on BEAM-806: -- [~davor] can we now close this after [~elek]'s awesome fix? >

[jira] [Closed] (BEAM-2093) Update Jackson version to 2.8.8 in archetype (or align with parent pom)

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2093. - Resolution: Fixed > Update Jackson version to 2.8.8 in archetype (or align with parent pom) >

[jira] [Closed] (BEAM-1642) Combine transformation evaluation fails on direct runner with Avro as a fallback coder

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1642. - Resolution: Fixed > Combine transformation evaluation fails on direct runner with Avro as a >

[jira] [Closed] (BEAM-775) Remove Aggregators from the Java SDK

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-775. Resolution: Fixed > Remove Aggregators from the Java SDK > > >

[jira] [Closed] (BEAM-1765) Remove Aggregators from Spark runner

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1765. - Resolution: Fixed Assignee: Pablo Estrada (was: Amit Sela) > Remove Aggregators from Spark

[jira] [Commented] (BEAM-59) Switch from IOChannelFactory to FileSystems

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996142#comment-15996142 ] ASF GitHub Bot commented on BEAM-59: GitHub user dhalperi opened a pull request:

[GitHub] beam pull request #2887: [BEAM-59] Swap IOChannel to FileSystems finishing t...

2017-05-03 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2887 [BEAM-59] Swap IOChannel to FileSystems finishing touches All these are small. After this, all I have left is BigQuery. You can merge this pull request into a Git repository by running:

[1/2] beam git commit: Inline TypedPValue

2017-05-03 Thread kenn
Repository: beam Updated Branches: refs/heads/master 34d25f406 -> ff6bb3530 Inline TypedPValue This has exactly one implementation, and this is not expected to change. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[GitHub] beam pull request #2867: Inline TypedPValue

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2867 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2867: Inline TypedPValue

2017-05-03 Thread kenn
This closes #2867: Inline TypedPValue Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ff6bb353 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ff6bb353 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ff6bb353

[GitHub] beam pull request #2851: [BEAM 775] Removal of Aggregator class. Also remova...

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2851 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Removal of Aggregator class. Also removal from comments.

2017-05-03 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master f3f881084 -> 34d25f406 Removal of Aggregator class. Also removal from comments. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/878981fd Tree:

[2/2] beam git commit: This closes #2851

2017-05-03 Thread dhalperi
This closes #2851 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/34d25f40 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/34d25f40 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/34d25f40 Branch:

[GitHub] beam pull request #2886: [BEAM-2151]Fix inconsistent mapping for SQL FLOAT

2017-05-03 Thread xumingming
GitHub user xumingming opened a pull request: https://github.com/apache/beam/pull/2886 [BEAM-2151]Fix inconsistent mapping for SQL FLOAT This pull request is mainly to fix the SQL FLOAT mapping, previously it is mapped to Float in `BeamSQLRow`, but mapped to `Double` in

[jira] [Commented] (BEAM-2151) Type mapping inconsistent in BeamSqlRow & BeamSqlRowCoder

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996139#comment-15996139 ] ASF GitHub Bot commented on BEAM-2151: -- GitHub user xumingming opened a pull request:

[2/2] beam git commit: This closes #2873: BigQueryIO: Remove tempLocation usage at pipeline construction time

2017-05-03 Thread kenn
This closes #2873: BigQueryIO: Remove tempLocation usage at pipeline construction time Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f3f88108 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f3f88108 Diff:

[jira] [Commented] (BEAM-828) Remove PipelineOptions from construction time in BigQueryIO

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996138#comment-15996138 ] ASF GitHub Bot commented on BEAM-828: - Github user asfgit closed the pull request at:

[GitHub] beam pull request #2873: [BEAM-828] BigQueryIO: Remove tempLocation usage at...

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2873 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: BigQueryIO: Remove tempLocation usage at pipeline construction time

2017-05-03 Thread kenn
Repository: beam Updated Branches: refs/heads/master ad12f6316 -> f3f881084 BigQueryIO: Remove tempLocation usage at pipeline construction time Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d0a2249f Tree:

[GitHub] beam pull request #1927: [BEAM-1402] Remove static Read/Write classes from T...

2017-05-03 Thread reuvenlax
Github user reuvenlax closed the pull request at: https://github.com/apache/beam/pull/1927 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2885: Provides a default coder for PubsubMessage

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2885 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[3/3] beam git commit: This closes #2885

2017-05-03 Thread jkff
This closes #2885 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ad12f631 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ad12f631 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ad12f631 Branch:

[1/3] beam git commit: Moves PubsubMessage to upper level and renames payload

2017-05-03 Thread jkff
Repository: beam Updated Branches: refs/heads/master 5b0a8684a -> ad12f6316 Moves PubsubMessage to upper level and renames payload Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/210e216d Tree:

[jira] [Resolved] (BEAM-2157) HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins

2017-05-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2157. - Resolution: Fixed Fix Version/s: First stable release > HadoopFileSystemModuleTest Failed in Some

[jira] [Commented] (BEAM-2157) HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996047#comment-15996047 ] ASF GitHub Bot commented on BEAM-2157: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2876: [BEAM-2157] Fix HDFS Test That Failed in Other JDK ...

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2876 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions

2017-05-03 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 1bc50d627 -> 5b0a8684a [BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8f3fbc06 Tree:

[2/2] beam git commit: [BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions

2017-05-03 Thread lcwik
[BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions This closes #2876 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5b0a8684 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5b0a8684 Diff:

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #3030

2017-05-03 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-2168) PubsubMessageWithAttributesCoder should be registered via CoderRegistrar

2017-05-03 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-2168: - Assignee: (was: Daniel Halperin) > PubsubMessageWithAttributesCoder should be registered via

[jira] [Created] (BEAM-2168) PubsubMessageWithAttributesCoder should be registered via CoderRegistrar

2017-05-03 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-2168: - Summary: PubsubMessageWithAttributesCoder should be registered via CoderRegistrar Key: BEAM-2168 URL: https://issues.apache.org/jira/browse/BEAM-2168 Project: Beam

[GitHub] beam pull request #2885: Provides a default coder for PubsubMessage

2017-05-03 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/2885 Provides a default coder for PubsubMessage Default coder is useful to avoid having to specify it when you use PubsubIO.writePubsubMessages, on its input PCollection. A couple more cosmetic

[jira] [Resolved] (BEAM-2051) Reduce scope of the PCollectionView interface

2017-05-03 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-2051. --- Resolution: Fixed > Reduce scope of the PCollectionView interface >

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #3626

2017-05-03 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-1199) Condense recordAsOutput, finishSpecifyingOutput from POutput

2017-05-03 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-1199: - Assignee: Thomas Groh (was: Kenneth Knowles) > Condense recordAsOutput, finishSpecifyingOutput

[jira] [Created] (BEAM-2167) Add appropriate display data to BigQueryIO and tests.

2017-05-03 Thread Vikas Kedigehalli (JIRA)
Vikas Kedigehalli created BEAM-2167: --- Summary: Add appropriate display data to BigQueryIO and tests. Key: BEAM-2167 URL: https://issues.apache.org/jira/browse/BEAM-2167 Project: Beam

[jira] [Updated] (BEAM-2167) Add appropriate display data to BigQueryIO and tests.

2017-05-03 Thread Vikas Kedigehalli (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-2167: Affects Version/s: First stable release > Add appropriate display data to BigQueryIO and

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3625

2017-05-03 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-59) Switch from IOChannelFactory to FileSystems

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995976#comment-15995976 ] ASF GitHub Bot commented on BEAM-59: Github user asfgit closed the pull request at:

[GitHub] beam pull request #2779: [BEAM-59] Convert WriteFiles/FileBasedSink from IOC...

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2779 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/4] beam git commit: Convert WriteFiles/FileBasedSink from IOChannelFactory to FileSystems

2017-05-03 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master b4bafd092 -> 1bc50d627 http://git-wip-us.apache.org/repos/asf/beam/blob/17358248/sdks/java/core/src/test/java/org/apache/beam/sdk/io/WriteFilesTest.java -- diff --git

[4/4] beam git commit: This closes #2779

2017-05-03 Thread dhalperi
This closes #2779 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1bc50d62 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1bc50d62 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/1bc50d62 Branch:

[2/4] beam git commit: Convert WriteFiles/FileBasedSink from IOChannelFactory to FileSystems

2017-05-03 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/beam/blob/17358248/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TFRecordIO.java -- diff --git a/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TFRecordIO.java

[3/4] beam git commit: Convert WriteFiles/FileBasedSink from IOChannelFactory to FileSystems

2017-05-03 Thread dhalperi
Convert WriteFiles/FileBasedSink from IOChannelFactory to FileSystems This converts FileBasedSink from IOChannelFactory to FileSystems, with fallout changes on all existing Transforms that use WriteFiles. We preserve the existing semantics of most transforms, simply adding the ability for users

[jira] [Assigned] (BEAM-2166) Remove Coder.Context from the public API

2017-05-03 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-2166: - Assignee: Robert Bradshaw (was: Davor Bonaci) > Remove Coder.Context from the public API

[GitHub] beam pull request #2884: One more TaggedOutput name change.

2017-05-03 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/2884 One more TaggedOutput name change. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #1926

2017-05-03 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #3624

2017-05-03 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2154) Writing to large numbers of BigQuery tables causes out-of-memory

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995960#comment-15995960 ] ASF GitHub Bot commented on BEAM-2154: -- GitHub user reuvenlax opened a pull request:

[GitHub] beam pull request #2883: [BEAM-2154] Make BigQuery's dynamic-destination sup...

2017-05-03 Thread reuvenlax
GitHub user reuvenlax opened a pull request: https://github.com/apache/beam/pull/2883 [BEAM-2154] Make BigQuery's dynamic-destination support scale to large numbers of destinations Generating hundreds or thousands of file write buffers in a single bundle was causing workers to

[jira] [Commented] (BEAM-2162) Add logging during and after long running BigQuery jobs

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995954#comment-15995954 ] ASF GitHub Bot commented on BEAM-2162: -- GitHub user bjchambers opened a pull request:

[GitHub] beam pull request #2882: [BEAM-2162] Add logging to long BigQuery jobs

2017-05-03 Thread bjchambers
GitHub user bjchambers opened a pull request: https://github.com/apache/beam/pull/2882 [BEAM-2162] Add logging to long BigQuery jobs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [*] Make sure the PR title is

[jira] [Commented] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995949#comment-15995949 ] ASF GitHub Bot commented on BEAM-2135: -- GitHub user lukecwik opened a pull request:

[GitHub] beam pull request #2881: [BEAM-2135] Update Dataflow to support serializing/...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2881 [BEAM-2135] Update Dataflow to support serializing/deserializing custom user types configured via Jackson modules This also updates the runner harness and existing tests to use a properly

[GitHub] beam pull request #2880: [BEAM-2165] Update Apex to support serializing/dese...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2880 [BEAM-2165] Update Apex to support serializing/deserializing custom user types configured via Jackson modules Be sure to do all of the following to help us incorporate your contribution quickly

[jira] [Commented] (BEAM-2165) Support custom user Jackson modules for PipelineOptions

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995947#comment-15995947 ] ASF GitHub Bot commented on BEAM-2165: -- GitHub user lukecwik opened a pull request:

[jira] [Commented] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995945#comment-15995945 ] ASF GitHub Bot commented on BEAM-2135: -- GitHub user lukecwik opened a pull request:

[GitHub] beam pull request #2879: [BEAM-2165] Update Flink to support serializing/des...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2879 [BEAM-2165] Update Flink to support serializing/deserializing custom user types configured via Jackson modules Be sure to do all of the following to help us incorporate your contribution

[GitHub] beam pull request #2878: Forward integrate from `master` to `DSL_SQL`

2017-05-03 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2878 Forward integrate from `master` to `DSL_SQL` To fix the unit test failure `org.apache.beam.examples.WordCountIT.testE2EWordCount` You can merge this pull request into a Git repository by running:

[GitHub] beam pull request #2877: [BEAM-2135] Update Spark to support serializing/des...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2877 [BEAM-2135] Update Spark to support serializing/deserializing custom user types configured via Jackson modules Be sure to do all of the following to help us incorporate your contribution

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3029

2017-05-03 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2166) Remove Coder.Context from the public API

2017-05-03 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-2166: - Summary: Remove Coder.Context from the public API Key: BEAM-2166 URL: https://issues.apache.org/jira/browse/BEAM-2166 Project: Beam Issue Type:

[jira] [Commented] (BEAM-2157) HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995934#comment-15995934 ] ASF GitHub Bot commented on BEAM-2157: -- GitHub user markflyhigh opened a pull request:

[GitHub] beam pull request #2851: [BEAM 775] Removal of Aggregator class. Also remova...

2017-05-03 Thread pabloem
Github user pabloem closed the pull request at: https://github.com/apache/beam/pull/2851 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2851: [BEAM 775] Removal of Aggregator class. Also remova...

2017-05-03 Thread pabloem
GitHub user pabloem reopened a pull request: https://github.com/apache/beam/pull/2851 [BEAM 775] Removal of Aggregator class. Also removal from comments. To be merged after the worker is rebuilt. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] beam pull request #2876: [BEAM-2157] Fix HDFS Test That Failed in Other JDK ...

2017-05-03 Thread markflyhigh
GitHub user markflyhigh opened a pull request: https://github.com/apache/beam/pull/2876 [BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[jira] [Created] (BEAM-2165) Support custom user Jackson modules for PipelineOptions

2017-05-03 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2165: --- Summary: Support custom user Jackson modules for PipelineOptions Key: BEAM-2165 URL: https://issues.apache.org/jira/browse/BEAM-2165 Project: Beam Issue Type:

[jira] [Commented] (BEAM-2157) HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins

2017-05-03 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995927#comment-15995927 ] Mark Liu commented on BEAM-2157: Thanks [~lcwik]. problem is solved. Will have a PR soon. >

[jira] [Created] (BEAM-2164) Build beam-sdks-java-maven-archetypes-examples Failed If Dir Contains Space

2017-05-03 Thread Mark Liu (JIRA)
Mark Liu created BEAM-2164: -- Summary: Build beam-sdks-java-maven-archetypes-examples Failed If Dir Contains Space Key: BEAM-2164 URL: https://issues.apache.org/jira/browse/BEAM-2164 Project: Beam

Build failed in Jenkins: beam_PerformanceTests_Dataflow #369

2017-05-03 Thread Apache Jenkins Server
See Changes: [klk] Use Thread context ClassLoader as parent in AvroCoderTest [tgroh] Mark all PCollectionView methods internal [lcwik] [BEAM-1871] Move GCP specific serialization CloudObject and

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #1925

2017-05-03 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2875: Fixes PubsubIO.Write translation in Dataflow runner

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2875 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2875

2017-05-03 Thread jkff
This closes #2875 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b4bafd09 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b4bafd09 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b4bafd09 Branch:

[1/2] beam git commit: Fixes PubsubIO.Write translation in Dataflow runner

2017-05-03 Thread jkff
Repository: beam Updated Branches: refs/heads/master a1d82c203 -> b4bafd092 Fixes PubsubIO.Write translation in Dataflow runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/415d4bb1 Tree:

[jira] [Updated] (BEAM-2163) Remove the dependency on examples from ptransform_test

2017-05-03 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-2163: -- Labels: newbie starter (was: newbie) > Remove the dependency on examples from ptransform_test >

[jira] [Assigned] (BEAM-2163) Remove the dependency on examples from ptransform_test

2017-05-03 Thread Sourabh Bajaj (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj reassigned BEAM-2163: --- Assignee: (was: Ahmet Altay) > Remove the dependency on examples from ptransform_test >

[GitHub] beam pull request #2875: Fixes PubsubIO.Write translation in Dataflow runner

2017-05-03 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/2875 Fixes PubsubIO.Write translation in Dataflow runner Accidentally deleted this line in the style PR. Still don't understand how this passed tests against prod Dataflow. R: @tgroh You can

[jira] [Created] (BEAM-2162) Add logging during and after long running BigQuery jobs

2017-05-03 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-2162: -- Summary: Add logging during and after long running BigQuery jobs Key: BEAM-2162 URL: https://issues.apache.org/jira/browse/BEAM-2162 Project: Beam Issue Type:

[jira] [Created] (BEAM-2163) Remove the dependency on examples from ptransform_test

2017-05-03 Thread Sourabh Bajaj (JIRA)
Sourabh Bajaj created BEAM-2163: --- Summary: Remove the dependency on examples from ptransform_test Key: BEAM-2163 URL: https://issues.apache.org/jira/browse/BEAM-2163 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-2151) Type mapping inconsistent in BeamSqlRow & BeamSqlRowCoder

2017-05-03 Thread James Xu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2151: -- Assignee: James Xu > Type mapping inconsistent in BeamSqlRow & BeamSqlRowCoder >

[jira] [Updated] (BEAM-2160) add support Math functions

2017-05-03 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2160: - Description: All Math functions listed as below: {code} POWER(numeric1, numeric2) ABS(numeric)

[jira] [Closed] (BEAM-2023) BigQueryIO.Write needs a way of dynamically specifying table schemas

2017-05-03 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2023. -- Resolution: Fixed > BigQueryIO.Write needs a way of dynamically specifying table schemas >

[jira] [Commented] (BEAM-2023) BigQueryIO.Write needs a way of dynamically specifying table schemas

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995898#comment-15995898 ] ASF GitHub Bot commented on BEAM-2023: -- Github user asfgit closed the pull request at:

[jira] [Created] (BEAM-2161) add support String functions

2017-05-03 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2161: Summary: add support String functions Key: BEAM-2161 URL: https://issues.apache.org/jira/browse/BEAM-2161 Project: Beam Issue Type: Task Components:

[3/3] beam git commit: This closes #2609

2017-05-03 Thread jkff
This closes #2609 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a1d82c20 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a1d82c20 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a1d82c20 Branch:

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3623

2017-05-03 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2609: [BEAM-2023] Support dynamic schemas

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2609 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/3] beam git commit: Fully general dynamic tables (including schemas) in BigQueryIO.

2017-05-03 Thread jkff
Repository: beam Updated Branches: refs/heads/master 17f0843eb -> a1d82c203 http://git-wip-us.apache.org/repos/asf/beam/blob/35db7457/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/PrepareWrite.java

[2/3] beam git commit: Fully general dynamic tables (including schemas) in BigQueryIO.

2017-05-03 Thread jkff
Fully general dynamic tables (including schemas) in BigQueryIO. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/35db7457 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/35db7457 Diff:

[jira] [Created] (BEAM-2160) add support Math functions

2017-05-03 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2160: Summary: add support Math functions Key: BEAM-2160 URL: https://issues.apache.org/jira/browse/BEAM-2160 Project: Beam Issue Type: Task Components:

Jenkins build is back to normal : beam_PostCommit_Python_Verify #2103

2017-05-03 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2159) CAST operator support

2017-05-03 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2159: Summary: CAST operator support Key: BEAM-2159 URL: https://issues.apache.org/jira/browse/BEAM-2159 Project: Beam Issue Type: Task Components: dsl-sql

[jira] [Created] (BEAM-2158) support Arithmetic Operator

2017-05-03 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2158: Summary: support Arithmetic Operator Key: BEAM-2158 URL: https://issues.apache.org/jira/browse/BEAM-2158 Project: Beam Issue Type: Task Components:

  1   2   3   >