GitHub user xumingming opened a pull request: https://github.com/apache/beam/pull/3246
rebasing DSL_SQL branch from master Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-<Jira issue #>] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/xumingming/beam DSL_SQL Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3246.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3246 ---- commit 6a90b9d164d98d916d0e0af2be39a740ce769076 Author: Aviem Zur <aviem...@gmail.com> Date: 2017-05-12T13:02:54Z [BEAM-2277] Fix URI_SCHEME_PATTERN in FileSystems commit 0acf3620d90a970f4024ae95b909c3bb4ef827ad Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-12T18:10:48Z This closes #3115 commit abe62feb16f6eb59e294c37abf408f84c9280616 Author: Aviem Zur <aviem...@gmail.com> Date: 2017-05-12T19:18:02Z [BEAM-2279] Add HDFS support to Spark runner profiles in archetypes and examples commit c2a36284b510461942205b627a019dfbe83f8b37 Author: Davor Bonaci <da...@google.com> Date: 2017-05-12T21:54:00Z This closes #3126 commit a6a5ff7be387ef295fc7f921de36a3ea77327bc1 Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-12T16:20:34Z [BEAM-2277] Add ResourceIdTester and test existing ResourceId implementations A first cut at some of the parts of the ResourceId spec. commit 15df211c758e7c8f05c3136f25bbe18e3f394321 Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-12T18:11:06Z [BEAM-2277] HadoopFileSystem: normalize implementation * Drop empty authority always * Resolve directories commit fbb0de129d881b6b6a1ae37fc8d75075c9d8df86 Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-12T18:13:00Z Remove '/' entirely from determining FileSystem scheme commit ec956c85efa16d00c5e218ee1257b8ee62a2013d Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-12T18:38:54Z Mark FileSystem and related as Experimental commit f3540d47f10c18859340a738a7e93643ee57f604 Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-12T18:46:16Z Rename FileSystems.setDefaultConfigInWorkers And document that it's not for users. commit 3921163829d2a99b0524bf3fa1b85a4cde826f3a Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-12T20:57:59Z Fix shading of guava testlib commit 9f81fd299bd32e0d6056a7da9fa994cf74db0ed9 Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-12T21:59:14Z This closes #3121 commit f53ceecfb18a52aeeab8f1869c189e4aa2f56d35 Author: Ahmet Altay <al...@google.com> Date: 2017-05-12T21:54:33Z internal comments commit 89289e498e71d6e9fbd24702032471fa13fbd46c Author: Ahmet Altay <al...@google.com> Date: 2017-05-12T22:08:16Z This closes #3128 commit 7bade36eb18a48e01a8401f97f10a70a492172c4 Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-12T22:52:51Z [BEAM-2279] Fix archetype breakages * Add version for hadoop-file-system dependency. * Add DirectRunner in test scope in java8, otherwise mvn package fails when another runner profile is enabled. commit 9a43da74a9005507acdc80524edc634c8318674d Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-12T22:57:21Z This closes #3132 commit 504bd6a8036946a796a7290853e45bf20d32d07d Author: Rune Fevang <fev...@exabel.com> Date: 2017-05-12T20:24:32Z [BEAM-2290] Fix issue where timestamps weren't set when using CompressedSource commit d4df9079039d57e37cdb1666c8c3120f2fa2909a Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-15T16:52:38Z This closes #3131 commit 8060d66083973cdab91f68085652ab68e3dee596 Author: Thomas Groh <tg...@google.com> Date: 2017-05-15T17:00:45Z Reduce Log Level of PubsubUnboundedSource commit 6e8d8d65708e3d5b0525a7b7f97597d4af71d51e Author: Thomas Groh <tg...@google.com> Date: 2017-05-15T17:07:14Z This closes #3145 commit de1adefda958ae152eae4b7b94b3b78563e130aa Author: Neville Li <neville....@gmail.com> Date: 2017-05-15T18:55:09Z readAvros should't have proto Message upper bound commit 88ec00860032078dcd33e07d94642912f6aa7bf7 Author: Eugene Kirpichov <kirpic...@google.com> Date: 2017-05-15T19:22:27Z This closes #3149 commit 15ec2cd83d4291957a75d9f2ac838ff867dcbe0c Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-15T17:57:24Z Fix GcsResourceIdTest in postcommits This test is not a @ValidatesRunner test, so it should not use TestPipelineOptions. commit 926157d42db572dacb9142665d5c922dcad589f0 Author: Luke Cwik <lc...@google.com> Date: 2017-05-15T20:16:05Z Fix GcsResourceIdTest in postcommits This closes #3147 commit 911128b287909e2e2240e0674223df7c66e952f8 Author: Ahmet Altay <al...@google.com> Date: 2017-05-15T16:59:29Z Moving the data file for trigger tests to testing/data commit 9b5a8e62ca695b0d0def27844084237102f0055a Author: Ahmet Altay <al...@google.com> Date: 2017-05-15T20:34:09Z This closes #3144 commit 96906aee9d0cdbb9fae67dd5bd2af0710a1b67bf Author: Charles Chen <c...@google.com> Date: 2017-05-15T18:26:59Z Remove "Dataflow" from apache_beam __init__.py file commit cd91eb298d48ba4ba51241eb7ba1c3d7c6efdbfa Author: Ahmet Altay <al...@google.com> Date: 2017-05-15T20:51:39Z This closes #3148 commit 044d1832f44394f2dc61172d4a2737157a4e2210 Author: Luke Cwik <lc...@google.com> Date: 2017-05-15T16:40:49Z [BEAM-2299] Run maven install on Windows machine for build/test coverage on Windows commit 13e1be2f0a280fc704616b9b89551281a561c374 Author: Luke Cwik <lc...@google.com> Date: 2017-05-15T21:30:44Z [BEAM-2299] Run maven install on Windows machine for build/test coverage on Windows. This closes #3143 commit b3f74044436f4b4a92f3135411b5d5093437ec3e Author: Sourabh Bajaj <sourabhba...@google.com> Date: 2017-05-15T21:34:45Z Fix documentation for the shard_template_name ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---