[jira] [Commented] (BEAM-2662) Quickstart for Spark Java not working
[ https://issues.apache.org/jira/browse/BEAM-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097949#comment-16097949 ] ASF GitHub Bot commented on BEAM-2662: -- Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3621 > Quickstart for Spark Java not working > - > > Key: BEAM-2662 > URL: https://issues.apache.org/jira/browse/BEAM-2662 > Project: Beam > Issue Type: Bug > Components: examples-java, runner-spark >Affects Versions: 2.1.0 >Reporter: Luke Cwik >Assignee: Luke Cwik >Priority: Blocker > > Spark version is missing in generated examples archetype pom.xml: > {code} > > org.apache.spark > spark-streaming_2.10 > ${spark.version} <--- Missing > runtime > > > org.slf4j > jul-to-slf4j > > > > {code} > Quickstart fails with: > {code} > lcwik@lcwik0:~/release/word-count-beam$ mvn compile exec:java > -Dexec.mainClass=org.apache.beam.examples.WordCount > -Dexec.args="--runner=SparkRunner --inputFile=pom.xml --output=counts" > -Pspark-runner > [INFO] Scanning for projects... > [ERROR] [ERROR] Some problems were encountered while processing the POMs: > [ERROR] 'dependencies.dependency.version' for > org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 > @ > [ERROR] The build could not read 1 project -> [Help 1] > [ERROR] > [ERROR] The project org.example:word-count-beam:0.1 > (/usr/local/google/home/lcwik/release/word-count-beam/pom.xml) has 1 error > [ERROR] 'dependencies.dependency.version' for > org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException > {code} > I generated the archetype pom.xml with: > {code} > mvn archetype:generate -DarchetypeGroupId=org.apache.beam > -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples > -DarchetypeVersion=2.1.0 -DgroupId=org.example > -DartifactId=word-count-beam -Dversion="0.1" > -Dpackage=org.apache.beam.examples -DinteractiveMode=false > {code} > after adding > https://repository.apache.org/content/repositories/orgapachebeam-1019/ as a > repo in my settings.xml -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2662) Quickstart for Spark Java not working
[ https://issues.apache.org/jira/browse/BEAM-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097948#comment-16097948 ] ASF GitHub Bot commented on BEAM-2662: -- Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3620 > Quickstart for Spark Java not working > - > > Key: BEAM-2662 > URL: https://issues.apache.org/jira/browse/BEAM-2662 > Project: Beam > Issue Type: Bug > Components: examples-java, runner-spark >Affects Versions: 2.1.0 >Reporter: Luke Cwik >Assignee: Luke Cwik >Priority: Blocker > > Spark version is missing in generated examples archetype pom.xml: > {code} > > org.apache.spark > spark-streaming_2.10 > ${spark.version} <--- Missing > runtime > > > org.slf4j > jul-to-slf4j > > > > {code} > Quickstart fails with: > {code} > lcwik@lcwik0:~/release/word-count-beam$ mvn compile exec:java > -Dexec.mainClass=org.apache.beam.examples.WordCount > -Dexec.args="--runner=SparkRunner --inputFile=pom.xml --output=counts" > -Pspark-runner > [INFO] Scanning for projects... > [ERROR] [ERROR] Some problems were encountered while processing the POMs: > [ERROR] 'dependencies.dependency.version' for > org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 > @ > [ERROR] The build could not read 1 project -> [Help 1] > [ERROR] > [ERROR] The project org.example:word-count-beam:0.1 > (/usr/local/google/home/lcwik/release/word-count-beam/pom.xml) has 1 error > [ERROR] 'dependencies.dependency.version' for > org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException > {code} > I generated the archetype pom.xml with: > {code} > mvn archetype:generate -DarchetypeGroupId=org.apache.beam > -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples > -DarchetypeVersion=2.1.0 -DgroupId=org.example > -DartifactId=word-count-beam -Dversion="0.1" > -Dpackage=org.apache.beam.examples -DinteractiveMode=false > {code} > after adding > https://repository.apache.org/content/repositories/orgapachebeam-1019/ as a > repo in my settings.xml -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2662) Quickstart for Spark Java not working
[ https://issues.apache.org/jira/browse/BEAM-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097803#comment-16097803 ] ASF GitHub Bot commented on BEAM-2662: -- GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3621 [BEAM-2662] Fix Java quickstart for Spark to include Spark version Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue](https://issues.apache.org/jira/projects/BEAM/issues/) filed for the change (usually before you start working on it). Trivial changes like typos do not require a JIRA issue. Your pull request should address just this issue, without pulling in other changes. - [x] Each commit in the pull request should have a meaningful subject line and body. - [x] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue. - [x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why. - [x] Run `mvn clean verify` to make sure basic checks pass. A more thorough check will be performed on your pull request automatically. - [x] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/lukecwik/incubator-beam beam2662release Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3621.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3621 commit 9ebda844f9366f8b242208b7bf0b95c68d0990b9 Author: Luke CwikDate: 2017-07-23T21:00:17Z [BEAM-2662] Fix Java quickstart for Spark to include Spark version > Quickstart for Spark Java not working > - > > Key: BEAM-2662 > URL: https://issues.apache.org/jira/browse/BEAM-2662 > Project: Beam > Issue Type: Bug > Components: examples-java, runner-spark >Affects Versions: 2.1.0 >Reporter: Luke Cwik >Assignee: Luke Cwik >Priority: Blocker > > Spark version is missing in generated examples archetype pom.xml: > {code} > > org.apache.spark > spark-streaming_2.10 > ${spark.version} <--- Missing > runtime > > > org.slf4j > jul-to-slf4j > > > > {code} > Quickstart fails with: > {code} > lcwik@lcwik0:~/release/word-count-beam$ mvn compile exec:java > -Dexec.mainClass=org.apache.beam.examples.WordCount > -Dexec.args="--runner=SparkRunner --inputFile=pom.xml --output=counts" > -Pspark-runner > [INFO] Scanning for projects... > [ERROR] [ERROR] Some problems were encountered while processing the POMs: > [ERROR] 'dependencies.dependency.version' for > org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 > @ > [ERROR] The build could not read 1 project -> [Help 1] > [ERROR] > [ERROR] The project org.example:word-count-beam:0.1 > (/usr/local/google/home/lcwik/release/word-count-beam/pom.xml) has 1 error > [ERROR] 'dependencies.dependency.version' for > org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException > {code} > I generated the archetype pom.xml with: > {code} > mvn archetype:generate -DarchetypeGroupId=org.apache.beam > -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples > -DarchetypeVersion=2.1.0 -DgroupId=org.example > -DartifactId=word-count-beam -Dversion="0.1" > -Dpackage=org.apache.beam.examples -DinteractiveMode=false > {code} > after adding > https://repository.apache.org/content/repositories/orgapachebeam-1019/ as a > repo in my settings.xml -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2662) Quickstart for Spark Java not working
[ https://issues.apache.org/jira/browse/BEAM-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097799#comment-16097799 ] ASF GitHub Bot commented on BEAM-2662: -- GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3620 [BEAM-2662] Fix Java quickstart for Spark to include Spark version Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue](https://issues.apache.org/jira/projects/BEAM/issues/) filed for the change (usually before you start working on it). Trivial changes like typos do not require a JIRA issue. Your pull request should address just this issue, without pulling in other changes. - [x] Each commit in the pull request should have a meaningful subject line and body. - [x] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue. - [x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why. - [x] Run `mvn clean verify` to make sure basic checks pass. A more thorough check will be performed on your pull request automatically. - [x] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/lukecwik/incubator-beam beam2662 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3620.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3620 commit a7c18495f91c9d7537271c9595b3ac4d24003ece Author: Luke CwikDate: 2017-07-23T21:00:17Z [BEAM-2662] Fix Java quickstart for Spark to include Spark version > Quickstart for Spark Java not working > - > > Key: BEAM-2662 > URL: https://issues.apache.org/jira/browse/BEAM-2662 > Project: Beam > Issue Type: Bug > Components: examples-java, runner-spark >Affects Versions: 2.1.0 >Reporter: Luke Cwik >Assignee: Luke Cwik >Priority: Blocker > > Spark version is missing in generated examples archetype pom.xml: > {code} > > org.apache.spark > spark-streaming_2.10 > ${spark.version} <--- Missing > runtime > > > org.slf4j > jul-to-slf4j > > > > {code} > Quickstart fails with: > {code} > lcwik@lcwik0:~/release/word-count-beam$ mvn compile exec:java > -Dexec.mainClass=org.apache.beam.examples.WordCount > -Dexec.args="--runner=SparkRunner --inputFile=pom.xml --output=counts" > -Pspark-runner > [INFO] Scanning for projects... > [ERROR] [ERROR] Some problems were encountered while processing the POMs: > [ERROR] 'dependencies.dependency.version' for > org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 > @ > [ERROR] The build could not read 1 project -> [Help 1] > [ERROR] > [ERROR] The project org.example:word-count-beam:0.1 > (/usr/local/google/home/lcwik/release/word-count-beam/pom.xml) has 1 error > [ERROR] 'dependencies.dependency.version' for > org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException > {code} > I generated the archetype pom.xml with: > {code} > mvn archetype:generate -DarchetypeGroupId=org.apache.beam > -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples > -DarchetypeVersion=2.1.0 -DgroupId=org.example > -DartifactId=word-count-beam -Dversion="0.1" > -Dpackage=org.apache.beam.examples -DinteractiveMode=false > {code} > after adding > https://repository.apache.org/content/repositories/orgapachebeam-1019/ as a > repo in my settings.xml -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2662) Quickstart for Spark Java not working
[ https://issues.apache.org/jira/browse/BEAM-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097794#comment-16097794 ] Luke Cwik commented on BEAM-2662: - https://github.com/apache/beam/commit/ce4e5174750ae2c4b1691c6994bd0f92e161 seemed to remove the required ${spark.version} > Quickstart for Spark Java not working > - > > Key: BEAM-2662 > URL: https://issues.apache.org/jira/browse/BEAM-2662 > Project: Beam > Issue Type: Bug > Components: examples-java, runner-spark >Affects Versions: 2.1.0 >Reporter: Luke Cwik >Assignee: Luke Cwik >Priority: Blocker > > Spark version is missing in generated examples archetype pom.xml: > {code} > > org.apache.spark > spark-streaming_2.10 > ${spark.version} <--- Missing > runtime > > > org.slf4j > jul-to-slf4j > > > > {code} > Quickstart fails with: > {code} > lcwik@lcwik0:~/release/word-count-beam$ mvn compile exec:java > -Dexec.mainClass=org.apache.beam.examples.WordCount > -Dexec.args="--runner=SparkRunner --inputFile=pom.xml --output=counts" > -Pspark-runner > [INFO] Scanning for projects... > [ERROR] [ERROR] Some problems were encountered while processing the POMs: > [ERROR] 'dependencies.dependency.version' for > org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 > @ > [ERROR] The build could not read 1 project -> [Help 1] > [ERROR] > [ERROR] The project org.example:word-count-beam:0.1 > (/usr/local/google/home/lcwik/release/word-count-beam/pom.xml) has 1 error > [ERROR] 'dependencies.dependency.version' for > org.apache.spark:spark-streaming_2.10:jar is missing. @ line 241, column 21 > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException > {code} > I generated the archetype pom.xml with: > {code} > mvn archetype:generate -DarchetypeGroupId=org.apache.beam > -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples > -DarchetypeVersion=2.1.0 -DgroupId=org.example > -DartifactId=word-count-beam -Dversion="0.1" > -Dpackage=org.apache.beam.examples -DinteractiveMode=false > {code} > after adding > https://repository.apache.org/content/repositories/orgapachebeam-1019/ as a > repo in my settings.xml -- This message was sent by Atlassian JIRA (v6.4.14#64029)