[incubator-heron] branch master updated: Strip old python requirements (#3569)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new cd42fa8 Strip old python requirements (#3569) cd42fa8 is described below commit cd42fa8573f8ff6d739f16a2bb7a4ee6637b64d8 Author: Oliver Bristow AuthorDate: Mon Jul 20 04:21:26 2020 +0100 Strip old python requirements (#3569) * Remove enum34+future+argparse * Remove six * DRY up zkstatemanager.py * Remove pycrypto * Remove external dependancies for unittest2+mock+py --- heron/common/tests/python/pex_loader/BUILD | 2 - heron/executor/tests/python/BUILD | 2 - .../tests/python/heron_executor_unittest.py| 2 +- heron/instance/src/python/BUILD| 1 - heron/instance/tests/python/BUILD | 4 - heron/instance/tests/python/network/BUILD | 17 --- .../tests/python/network/event_looper_unittest.py | 2 +- .../python/network/gateway_looper_unittest.py | 2 +- .../tests/python/network/heron_client_unittest.py | 2 +- .../tests/python/network/mock_generator.py | 4 +- .../tests/python/network/protocol_unittest.py | 2 +- heron/instance/tests/python/utils/BUILD| 20 heron/instance/tests/python/utils/log_unittest.py | 2 +- .../instance/tests/python/utils/mock_generator.py | 2 +- .../tests/python/utils/py_metrics_unittest.py | 2 +- heron/shell/src/python/BUILD | 1 - .../src/python/handlers/killexecutorhandler.py | 4 - heron/statemgrs/src/python/statemanager.py | 3 +- heron/statemgrs/src/python/zkstatemanager.py | 118 +++-- heron/statemgrs/tests/python/BUILD | 6 -- .../tests/python/configloader_unittest.py | 2 +- .../tests/python/statemanagerfactory_unittest.py | 2 +- .../tests/python/zkstatemanager_unittest.py| 2 +- heron/tools/admin/src/python/BUILD | 1 - heron/tools/admin/src/python/standalone.py | 1 - heron/tools/cli/src/python/BUILD | 2 - heron/tools/cli/src/python/result.py | 1 - heron/tools/cli/src/python/submit.py | 4 - heron/tools/cli/tests/python/BUILD | 5 - .../cli/tests/python/client_command_unittest.py| 5 +- heron/tools/cli/tests/python/opts_unittest.py | 2 +- heron/tools/explorer/tests/python/BUILD| 3 - .../explorer/tests/python/explorer_unittest.py | 4 +- heron/tools/tracker/src/python/BUILD | 1 - heron/tools/tracker/src/python/main.py | 2 - heron/tools/tracker/tests/python/BUILD | 12 --- .../tests/python/query_operator_unittest.py| 2 +- heron/tools/tracker/tests/python/query_unittest.py | 4 +- .../tracker/tests/python/topology_unittest.py | 2 +- .../tools/tracker/tests/python/tracker_unittest.py | 22 ++-- heron/tools/ui/src/python/BUILD| 1 - heron/tools/ui/src/python/main.py | 1 - heronpy/api/tests/python/BUILD | 10 -- heronpy/api/tests/python/serializer_unittest.py| 3 +- heronpy/api/topology.py| 4 +- .../src/python/integration_test/core/BUILD | 2 +- .../integration_test/core/aggregator_bolt.py | 3 - .../src/python/local_test_runner/BUILD | 2 - .../src/python/local_test_runner/test_template.py | 3 - integration_test/src/python/test_runner/BUILD | 2 - .../src/python/topology_test_runner/BUILD | 2 - scripts/packages/heronpy/requirements.txt | 1 - scripts/resources/idea/libraries/hp_dep.xml| 3 - 53 files changed, 78 insertions(+), 236 deletions(-) diff --git a/heron/common/tests/python/pex_loader/BUILD b/heron/common/tests/python/pex_loader/BUILD index 636b110..fe07190 100644 --- a/heron/common/tests/python/pex_loader/BUILD +++ b/heron/common/tests/python/pex_loader/BUILD @@ -8,9 +8,7 @@ pex_pytest( "pex_loader_unittest.py", ], reqs = [ -"py==1.4.34", "pytest==3.2.2", -"unittest2==1.1.0", ], deps = [ "//heron/common/src/python:common-py", diff --git a/heron/executor/tests/python/BUILD b/heron/executor/tests/python/BUILD index 688bc76..480ece6 100644 --- a/heron/executor/tests/python/BUILD +++ b/heron/executor/tests/python/BUILD @@ -5,9 +5,7 @@ pex_pytest( size = "small", srcs = ["heron_executor_unittest.py"], reqs = [ -"py==1.4.34", "pytest==3.2.2", -"unittest2==1.1.0", ], deps = [ "//heron/executor/src/python:executo
[incubator-heron] branch master updated: Adding missing baseUrl (#3553)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new 7544160 Adding missing baseUrl (#3553) 7544160 is described below commit 754416088bc040f2ea99e96f2c56580f807cd986 Author: Nicholas Nezis AuthorDate: Fri Jul 3 08:37:11 2020 -0400 Adding missing baseUrl (#3553) --- heron/tools/ui/resources/static/js/stat-trendlines.js | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/heron/tools/ui/resources/static/js/stat-trendlines.js b/heron/tools/ui/resources/static/js/stat-trendlines.js index 964f0cf..2f32229 100644 --- a/heron/tools/ui/resources/static/js/stat-trendlines.js +++ b/heron/tools/ui/resources/static/js/stat-trendlines.js @@ -215,9 +215,9 @@ function StatTrendlines(baseUrl, cluster, environ, toponame, physicalPlan, logic .append('div') .attr('class', 'text-center') .html([ - 'logs', - 'job', - 'exceptions', + 'logs', + 'job', + 'exceptions', '', ].join(' ')); }
[incubator-heron] branch master updated: Embedded Trykker font (#3541)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new 9377b10 Embedded Trykker font (#3541) 9377b10 is described below commit 9377b10d169f92aba106c7cd617d9a4c73b49966 Author: Nicholas Nezis AuthorDate: Thu Jun 18 07:53:48 2020 -0400 Embedded Trykker font (#3541) --- heron/tools/ui/resources/static/css/main.css | 18 +- .../fonts/trykker-v8-latin-ext_latin-regular.eot | Bin 0 -> 17504 bytes .../fonts/trykker-v8-latin-ext_latin-regular.svg | 447 + .../fonts/trykker-v8-latin-ext_latin-regular.ttf | Bin 0 -> 32708 bytes .../fonts/trykker-v8-latin-ext_latin-regular.woff | Bin 0 -> 20196 bytes .../fonts/trykker-v8-latin-ext_latin-regular.woff2 | Bin 0 -> 15912 bytes 6 files changed, 464 insertions(+), 1 deletion(-) diff --git a/heron/tools/ui/resources/static/css/main.css b/heron/tools/ui/resources/static/css/main.css index f13666d..c5f584c 100644 --- a/heron/tools/ui/resources/static/css/main.css +++ b/heron/tools/ui/resources/static/css/main.css @@ -17,7 +17,6 @@ * under the License. */ -@import url(//fonts.googleapis.com/css?family=Trykker); /* Mixins */ /* Gradients */ /* Transition */ @@ -26,6 +25,23 @@ /* Border Radius */ /* Opacity */ /* CSS */ + +/* trykker-regular - latin-ext_latin */ +/* Trykker SIL Open Font License, 1.1 */ +/* Trykker-Regular.ttf: Copyright (c) 2011, Sorkin Type Co (www.sorkintype.com) with Reserved Font Name "Trykker". */ +@font-face { + font-family: 'Trykker'; + font-style: normal; + font-weight: 400; + src: url('../fonts/trykker-v8-latin-ext_latin-regular.eot'); /* IE9 Compat Modes */ + src: local('Trykker Regular'), local('Trykker-Regular'), + url('../fonts/trykker-v8-latin-ext_latin-regular.eot?#iefix') format('embedded-opentype'), /* IE6-IE8 */ + url('../fonts/trykker-v8-latin-ext_latin-regular.woff2') format('woff2'), /* Super Modern Browsers */ + url('../fonts/trykker-v8-latin-ext_latin-regular.woff') format('woff'), /* Modern Browsers */ + url('../fonts/trykker-v8-latin-ext_latin-regular.ttf') format('truetype'), /* Safari, Android, iOS */ + url('../fonts/trykker-v8-latin-ext_latin-regular.svg#Trykker') format('svg'); /* Legacy iOS */ +} + body { margin: 0; font: normal 12px 'Open Sans', arial, sans-serif; diff --git a/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.eot b/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.eot new file mode 100644 index 000..0f24bed Binary files /dev/null and b/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.eot differ diff --git a/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.svg b/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.svg new file mode 100644 index 000..16b7771 --- /dev/null +++ b/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.svg @@ -0,0 +1,447 @@ + +http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd;> +http://www.w3.org/2000/svg;> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.ttf b/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.ttf new file mode 100644 index 000..dced63a Binary files /dev/null and b/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.ttf differ diff --git a/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.woff b/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.woff new file mode 100644 index 000..0ce79a6 Binary files /dev/null and b/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.woff differ diff --git a/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.woff2 b/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.woff2 new file mode 100644 index 000..2bf91c7 Binary files /dev/null and b/heron/tools/ui/resources/static/fonts/trykker-v8-latin-ext_latin-regular.woff2 differ
[incubator-heron] branch joshfischer/update-theme created (now 111a333)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/update-theme in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 111a333 change theme This branch includes the following new commits: new 111a333 change theme The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] 01/01: change theme
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/update-theme in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 111a8c9acef63c079358ac7394c8b4b8c592 Author: Josh Fischer AuthorDate: Tue Jun 16 08:53:54 2020 -0500 change theme --- website2/website/siteConfig.js | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website2/website/siteConfig.js b/website2/website/siteConfig.js index e8fa9c9..8c26136 100644 --- a/website2/website/siteConfig.js +++ b/website2/website/siteConfig.js @@ -104,7 +104,7 @@ const siteConfig = { highlight: { // Highlight.js theme to use for syntax highlighting in code blocks. -theme: 'default', +theme: 'atom-one-dark', }, // Add custom scripts here that would be placed in
[incubator-heron] branch joshfischer/fix-layout updated (9e25e06 -> 86a145c)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/fix-layout in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. from 9e25e06 fixing layout . add 86a145c final changes No new revisions were added by this update. Summary of changes: website2/website/pages/en/contact.js | 2 +- website2/website/pages/en/events.js| 2 +- website2/website/pages/en/help.js | 2 +- website2/website/pages/en/index.js | 2 +- website2/website/pages/en/release-notes.js | 2 +- website2/website/pages/en/resources.js | 2 +- website2/website/pages/en/team.js | 2 +- website2/website/pages/en/users.js | 2 +- website2/website/pages/en/versions.js | 2 +- website2/website/static/css/custom.css | 3 ++- 10 files changed, 11 insertions(+), 10 deletions(-)
[incubator-heron] 01/01: fixing layout .
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/fix-layout in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 9e25e061123e6d21b68429e84375f42b1b79fe67 Author: Josh Fischer AuthorDate: Sun Jun 14 22:26:31 2020 -0500 fixing layout . --- website2/website/pages/en/index.js | 2 +- website2/website/static/css/custom.css | 9 + 2 files changed, 10 insertions(+), 1 deletion(-) diff --git a/website2/website/pages/en/index.js b/website2/website/pages/en/index.js index 74760ce..e2954cc 100755 --- a/website2/website/pages/en/index.js +++ b/website2/website/pages/en/index.js @@ -139,7 +139,7 @@ class Index extends React.Component { return ( - + diff --git a/website2/website/static/css/custom.css b/website2/website/static/css/custom.css index 361c659..9a0e588 100755 --- a/website2/website/static/css/custom.css +++ b/website2/website/static/css/custom.css @@ -69,3 +69,12 @@ a { float: left; } +.feature-container { +margin: 0 auto; +padding: 0; +height: 100%; +width: 100%; +top: 0; +left: 0; +} +
[incubator-heron] branch joshfischer/fix-layout created (now 9e25e06)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/fix-layout in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 9e25e06 fixing layout . This branch includes the following new commits: new 9e25e06 fixing layout . The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] branch master updated: adjusting packages for javadocs (#3537)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new c666100 adjusting packages for javadocs (#3537) c666100 is described below commit c666100f642f5b2b06dfd69a170e12d2dc96bee3 Author: Josh Fischer AuthorDate: Wed Jun 10 05:21:19 2020 -0500 adjusting packages for javadocs (#3537) --- storm-compatibility/src/java/BUILD | 4 +--- 1 file changed, 1 insertion(+), 3 deletions(-) diff --git a/storm-compatibility/src/java/BUILD b/storm-compatibility/src/java/BUILD index bdb07ef..805da07 100644 --- a/storm-compatibility/src/java/BUILD +++ b/storm-compatibility/src/java/BUILD @@ -34,10 +34,8 @@ java_doc( name = "heron-storm-javadoc", libs = [":storm-compatibility-java"], pkgs = [ -"backtype", -"clojure", +"java", "org", -"storm", ], title = "Heron Storm Compatibility Api Documentation", )
[incubator-heron] branch master updated: fixing javadocs (#3536)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new d03c112 fixing javadocs (#3536) d03c112 is described below commit d03c1122f63faa7c045f6eb947065a239eb45221 Author: Josh Fischer AuthorDate: Sun Jun 7 07:56:36 2020 -0500 fixing javadocs (#3536) * fixing javadocs * Adding back Pulsar Streamlet example * Excluding examples folder from javadocs * clean up Co-authored-by: Nicholas Nezis --- WORKSPACE| 3 +-- examples/src/java/BUILD | 2 +- maven_install.json | 43 +--- website2/website/scripts/javadocs.sh | 13 ++- 4 files changed, 10 insertions(+), 51 deletions(-) diff --git a/WORKSPACE b/WORKSPACE index a00f7f8..41cb1db 100644 --- a/WORKSPACE +++ b/WORKSPACE @@ -73,7 +73,7 @@ maven_install( "org.apache.mesos:mesos:0.22.0", "com.hashicorp.nomad:nomad-sdk:0.7.0", "org.apache.hadoop:hadoop-core:0.20.2", -"org.apache.pulsar:pulsar-client:shaded:1.19.0-incubating", +"org.apache.pulsar:pulsar-client:1.19.0-incubating", "org.apache.kafka:kafka-clients:2.2.0", "com.google.apis:google-api-services-storage:v1-rev108-" + google_client_version, "org.apache.reef:reef-runtime-yarn:" + reef_version, @@ -81,7 +81,6 @@ maven_install( "org.apache.httpcomponents:httpclient:" + http_client_version, "org.apache.httpcomponents:httpmime:" + http_client_version, "com.google.apis:google-api-services-storage:v1-rev108-1.22.0", -"org.apache.pulsar:pulsar-client:jar:shaded:1.19.0-incubating", "io.kubernetes:client-java:7.0.0", "com.microsoft.dhalion:dhalion:0.2.3", "org.objenesis:objenesis:2.1", diff --git a/examples/src/java/BUILD b/examples/src/java/BUILD index 8d9e823..dc76ece 100644 --- a/examples/src/java/BUILD +++ b/examples/src/java/BUILD @@ -29,7 +29,7 @@ java_binary( "//heron/common/src/java:basics-java", "//heron/simulator/src/java:simulator-java", "//third_party/java:kryo", -"@maven//:org_apache_pulsar_pulsar_client_shaded", +"@maven//:org_apache_pulsar_pulsar_client", ], ) diff --git a/maven_install.json b/maven_install.json index d170548..699c990 100644 --- a/maven_install.json +++ b/maven_install.json @@ -1,6 +1,6 @@ { "dependency_tree": { -"__AUTOGENERATED_FILE_DO_NOT_MODIFY_THIS_FILE_MANUALLY": 607867898, +"__AUTOGENERATED_FILE_DO_NOT_MODIFY_THIS_FILE_MANUALLY": -512671146, "conflict_resolution": {}, "dependencies": [ { @@ -5021,47 +5021,6 @@ "url": "https://jcenter.bintray.com/org/apache/pulsar/pulsar-client/1.19.0-incubating/pulsar-client-1.19.0-incubating.jar; }, { -"coord": "org.apache.pulsar:pulsar-client:jar:shaded:1.19.0-incubating", -"dependencies": [ -"com.fasterxml.jackson.core:jackson-annotations:2.8.8", -"org.apache.pulsar:pulsar-checksum:1.19.0-incubating", -"org.asynchttpclient:netty-codec-dns:2.0.31", -"org.asynchttpclient:netty-resolver:2.0.31", -"org.slf4j:slf4j-api:1.7.30", -"commons-codec:commons-codec:1.11", -"org.reactivestreams:reactive-streams:1.0.0", -"org.apache.commons:commons-lang3:3.7", -"com.typesafe.netty:netty-reactive-streams:1.0.8", -"com.google.protobuf:protobuf-java:3.4.0", -"com.google.guava:guava:18.0", -"org.asynchttpclient:netty-resolver-dns:2.0.31", -"org.apache.pulsar:pulsar-common:1.19.0-incubating", -"com.fasterxml.jackson.core:jackson-databind:2.8.8", -"com.yahoo.datasketches:sketches-core:0.6.0", -"org.asynchttpclient:async-http-client:2.0.31", -"org.asynchttpclient:async-http-client-netty-utils:2.0.31", -"com.fasterxml.jackson.core:jackson-core:2.8.8", -"io.netty:netty-all:4.1.22.Final", -"net.jpountz.lz4:lz4:1.3.0"
[incubator-heron] branch joshfischer/java-docs-java11 updated (fff7165 -> eef2126)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/java-docs-java11 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. from fff7165 Excluding examples folder from javadocs add eef2126 clean up No new revisions were added by this update. Summary of changes: website2/website/scripts/javadocs.sh | 9 +++-- 1 file changed, 3 insertions(+), 6 deletions(-)
[incubator-heron] 01/01: fixing javadocs
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/java-docs-java11 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit ae043e13f53167acd68b3338e5eb302a9d66a605 Author: Josh Fischer AuthorDate: Fri Jun 5 15:59:24 2020 -0500 fixing javadocs --- .../streamlet/SimplePulsarSourceTopology.java | 131 - website2/website/scripts/javadocs.sh | 10 +- 2 files changed, 7 insertions(+), 134 deletions(-) diff --git a/examples/src/java/org/apache/heron/examples/streamlet/SimplePulsarSourceTopology.java b/examples/src/java/org/apache/heron/examples/streamlet/SimplePulsarSourceTopology.java deleted file mode 100644 index e2a852c..000 --- a/examples/src/java/org/apache/heron/examples/streamlet/SimplePulsarSourceTopology.java +++ /dev/null @@ -1,131 +0,0 @@ -/** - * Licensed to the Apache Software Foundation (ASF) under one - * or more contributor license agreements. See the NOTICE file - * distributed with this work for additional information - * regarding copyright ownership. The ASF licenses this file - * to you under the Apache License, Version 2.0 (the - * "License"); you may not use this file except in compliance - * with the License. You may obtain a copy of the License at - * - * http://www.apache.org/licenses/LICENSE-2.0 - * - * Unless required by applicable law or agreed to in writing, - * software distributed under the License is distributed on an - * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY - * KIND, either express or implied. See the License for the - * specific language governing permissions and limitations - * under the License. - */ - - -package org.apache.heron.examples.streamlet; - -import java.io.UnsupportedEncodingException; -import java.util.Collection; -import java.util.Collections; -import java.util.logging.Logger; - -import org.apache.heron.examples.streamlet.utils.StreamletUtils; -import org.apache.heron.streamlet.Builder; -import org.apache.heron.streamlet.Config; -import org.apache.heron.streamlet.Context; -import org.apache.heron.streamlet.Runner; -import org.apache.heron.streamlet.Source; -import org.apache.pulsar.client.api.Consumer; -import org.apache.pulsar.client.api.PulsarClient; -import org.apache.pulsar.client.api.PulsarClientException; - -/** - * This topology demonstrates how sources work in the Heron Streamlet API - * for Java. The example source here reads from an Apache Pulsar topic and - * injects incoming messages into the processing graph. - */ -public final class SimplePulsarSourceTopology { - private SimplePulsarSourceTopology() { - } - - private static final Logger LOG = - Logger.getLogger(SimplePulsarSourceTopology.class.getName()); - - private static class PulsarSource implements Source { -private static final long serialVersionUID = -3433804102901363106L; -private PulsarClient client; -private Consumer consumer; -private String pulsarConnectionUrl; -private String consumeTopic; -private String subscription; - -PulsarSource(String url, String topic, String subscription) { - this.pulsarConnectionUrl = url; - this.consumeTopic = topic; - this.subscription = subscription; -} - -/** - * The setup functions defines the instantiation logic for the source. - * Here, a Pulsar client and consumer are created that will listen on - * the Pulsar topic. - */ -public void setup(Context context) { - try { -client = PulsarClient.create(pulsarConnectionUrl); -consumer = client.subscribe(consumeTopic, subscription); - } catch (PulsarClientException e) { -throw new RuntimeException(e); - } -} - -/** - * The get function defines how elements for the source streamlet are - * "gotten." In this case, the Pulsar consumer for the specified topic - * listens for incoming messages. - */ -public Collection get() { - try { -String retval = new String(consumer.receive().getData(), "utf-8"); -return Collections.singletonList(retval); - } catch (PulsarClientException | UnsupportedEncodingException e) { -throw new RuntimeException(e); - } -} - -public void cleanup() { -} - } - - /** - * All Heron topologies require a main function that defines the topology's behavior - * at runtime - */ - public static void main(String[] args) throws Exception { -Builder processingGraphBuilder = Builder.newBuilder(); - -/** - * A Pulsar source is constructed for a specific Pulsar installation, topic, and - * subsecription. - */ -Source pulsarSource = new PulsarSource( -"pulsar://localhost:6650", // Pulsar connection URL -"persistent://sample/standalone/ns1/heron-pulsar-test-topic", // Pulsar topic -
[incubator-heron] branch joshfischer/java-docs-java11 created (now ae043e1)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/java-docs-java11 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at ae043e1 fixing javadocs This branch includes the following new commits: new ae043e1 fixing javadocs The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] branch master updated: correcting heron urls (#3532)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new b16853b correcting heron urls (#3532) b16853b is described below commit b16853beabf13e67de02796fa5d9f6830b676c2e Author: Josh Fischer AuthorDate: Sun May 31 11:34:50 2020 -0500 correcting heron urls (#3532) * correcting heron urls * clean up --- heron/tools/admin/src/python/main.py | 2 +- heron/tools/cli/src/python/main.py| 2 +- heron/tools/common/src/python/utils/heronparser.py| 2 +- heron/tools/explorer/src/python/main.py | 4 ++-- heron/tools/ui/src/python/args.py | 2 +- release/maven/heron-kafka.template.pom| 2 +- release/maven/heron-no-kryo.template.pom | 2 +- release/maven/heron-with-kryo.template.pom| 2 +- scripts/packages/template_bin.sh | 2 +- scripts/packages/tests_template_bin.sh| 2 +- website2/docs/getting-started-local-single-node.md| 2 +- website2/docs/user-manuals-heron-cli.md | 2 +- .../version-0.20.0-incubating/getting-started-local-single-node.md| 2 +- .../version-0.20.0-incubating/user-manuals-heron-cli.md | 2 +- 14 files changed, 15 insertions(+), 15 deletions(-) diff --git a/heron/tools/admin/src/python/main.py b/heron/tools/admin/src/python/main.py index 4986d30..9d01881 100644 --- a/heron/tools/admin/src/python/main.py +++ b/heron/tools/admin/src/python/main.py @@ -34,7 +34,7 @@ Log = log.Log HELP_EPILOG = '''Getting more help: heron help Prints help and options for -For detailed documentation, go to http://heronstreaming.io''' +For detailed documentation, go to https://heron.incubator.apache.org''' # pylint: disable=protected-access,superfluous-parens class _HelpAction(argparse._HelpAction): diff --git a/heron/tools/cli/src/python/main.py b/heron/tools/cli/src/python/main.py index c37ce09..ac43e8d 100644 --- a/heron/tools/cli/src/python/main.py +++ b/heron/tools/cli/src/python/main.py @@ -51,7 +51,7 @@ Log = log.Log HELP_EPILOG = '''Getting more help: heron help Prints help and options for -For detailed documentation, go to http://heronstreaming.io''' +For detailed documentation, go to https://heron.incubator.apache.org''' # pylint: disable=protected-access,superfluous-parens diff --git a/heron/tools/common/src/python/utils/heronparser.py b/heron/tools/common/src/python/utils/heronparser.py index 7a7acae..142e7e9 100755 --- a/heron/tools/common/src/python/utils/heronparser.py +++ b/heron/tools/common/src/python/utils/heronparser.py @@ -44,7 +44,7 @@ expressions = [re.compile(x) for x in filters] help_epilog = '''Getting more help: heron help Prints help and options for -For detailed documentation, go to http://heronstreaming.io''' +For detailed documentation, go to https://heron.incubator.apache.org''' class HeronArgumentParser(argparse.ArgumentParser): """ diff --git a/heron/tools/explorer/src/python/main.py b/heron/tools/explorer/src/python/main.py index 4147e04..3093ac9 100644 --- a/heron/tools/explorer/src/python/main.py +++ b/heron/tools/explorer/src/python/main.py @@ -54,8 +54,8 @@ class SubcommandHelpFormatter(argparse.RawDescriptionHelpFormatter): def create_parser(): """ create parser """ help_epilog = '''Getting more help: - heron-explorer help Disply help and options for \n - For detailed documentation, go to http://heronstreaming.io''' + heron-explorer help Display help and options for \n + For detailed documentation, go to https://heron.incubator.apache.org''' parser = argparse.ArgumentParser( prog='heron-explorer', diff --git a/heron/tools/ui/src/python/args.py b/heron/tools/ui/src/python/args.py index 14f996d..3fbf806 100644 --- a/heron/tools/ui/src/python/args.py +++ b/heron/tools/ui/src/python/args.py @@ -102,7 +102,7 @@ def create_parsers(): :return: ''' parser = argparse.ArgumentParser( - epilog='For detailed documentation, go to http://heronstreaming.io', + epilog='For detailed documentation, go to https://heron.incubator.apache.org', usage="%(prog)s [options] [help]", add_help=False) diff --git a/release/maven/heron-kafka.template.pom b/release/maven/heron-kafka.template.pom index 5e5e2ca..781d722 100644 --- a/release/maven/heron-kafka.template.pom +++ b/release/maven/heron-kafka.template.pom @@ -41,7 +41,7 @@ xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/ma jar
[incubator-heron] branch master updated: get javadocs generation script passing (#3533)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new a7291ce get javadocs generation script passing (#3533) a7291ce is described below commit a7291cef99aca9ee0b5c66b23247924838ff6941 Author: Oliver Bristow AuthorDate: Sun May 31 17:34:18 2020 +0100 get javadocs generation script passing (#3533) * add ./contrib/**/*.jar files to classpath * exclude ./tools/**/*.java from input (e.g. cppcheck+checkstyle) --- website2/website/scripts/javadocs.sh | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/website2/website/scripts/javadocs.sh b/website2/website/scripts/javadocs.sh index 7cdf4af..0d0770d 100755 --- a/website2/website/scripts/javadocs.sh +++ b/website2/website/scripts/javadocs.sh @@ -42,7 +42,7 @@ fi `bazel query 'kind("java_test", "heron/...")'` \ `bazel query 'kind("java_library", "integration_test/...")'`) -HERON_SRC_FILES=`find $HERON_ROOT_DIR -path "*/org/apache/*" -name "*.java"` +HERON_SRC_FILES=`find $HERON_ROOT_DIR -path "*/org/apache/*" -name "*.java" -not -path "$HERON_ROOT_DIR/tools/*"` BACKTYPE_SRC_FILES=`find $HERON_ROOT_DIR -path "*/backtype/storm/*" -name "*.java"` APACHE_SRC_FILES=`find $HERON_ROOT_DIR -path "*/org/apache/storm/*" -name "*.java"` GEN_FILES=`find $GEN_PROTO_DIR -name "*.java"` @@ -55,8 +55,9 @@ GEN_JARS=`find $HERON_ROOT_DIR/bazel-bin/external/. -name "*\.jar" | tr '\n' ':' SCRIBE_JARS=`find $HERON_ROOT_DIR/bazel-bin/. -name "libthrift_scribe_java.jar" | tr '\n' ':'` PROTO_JARS=`find $HERON_ROOT_DIR/bazel-bin/heron/proto/. -name "*\.jar" | tr '\n' ':'` CLOSURE_CLASSES="$HERON_ROOT_DIR/bazel-bin/storm-compatibility/src/java/_javac/storm-compatibility-java/libstorm-compatibility-java_classes/." +CONTRIB_JARS=`find $HERON_ROOT_DIR/bazel-bin/contrib/. -name "*\.jar" | tr '\n' ':'` -export CLASSPATH=$BIN_JARS:$GEN_JARS:$SCRIBE_JARS:$PROTO_JARS:$CLOSURE_CLASSES +export CLASSPATH=$BIN_JARS:$GEN_JARS:$SCRIBE_JARS:$PROTO_JARS:$CLOSURE_CLASSES:$CONTRIB_JARS $JAVADOC $FLAGS \ -encoding "UTF-8" \
[incubator-heron] branch master updated: Build python package in virtualenv (#3529)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new a651e90 Build python package in virtualenv (#3529) a651e90 is described below commit a651e90ae80c516deae677fafcda069fba35e4b8 Author: Oliver Bristow AuthorDate: Sat May 30 01:29:38 2020 +0100 Build python package in virtualenv (#3529) --- scripts/packages/BUILD | 3 +++ 1 file changed, 3 insertions(+) diff --git a/scripts/packages/BUILD b/scripts/packages/BUILD index 4f0f714..64cfb90 100644 --- a/scripts/packages/BUILD +++ b/scripts/packages/BUILD @@ -605,6 +605,8 @@ genrule( "export RELEASE_FILE_DIR=$$(pwd)", "export TMP_DIR=$$(mktemp -d -t heronpy.X)", "echo $$TMP_DIR", +"$(location @virtualenv//:virtualenv) --no-download --quiet --clear $$TMP_DIR/venv", +"PS1= source $$TMP_DIR/venv/bin/activate", "export HERONPY_DIR=$$TMP_DIR/heronpy", "export HERONPYAPI_UNZIP=$$TMP_DIR/heronapiunzip", "export HERONPYSTREAMLET_UNZIP=$$TMP_DIR/heronstreamletunzip", @@ -660,6 +662,7 @@ genrule( "//heronpy/connectors:heron-pythonconnectors-package", "//heronpy/proto:proto-py-package", "//heronpy/streamlet:heron-python-streamlet-api-package", +"@virtualenv", ], )
[incubator-heron] branch master updated: adding nostyle (#3527)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new 59a3c4a adding nostyle (#3527) 59a3c4a is described below commit 59a3c4aba5c1c3bc0ebc7b69b0ca66d72b3b2250 Author: Josh Fischer AuthorDate: Fri May 29 15:04:07 2020 -0500 adding nostyle (#3527) --- docker/scripts/compile-platform.sh | 16 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/docker/scripts/compile-platform.sh b/docker/scripts/compile-platform.sh index 69dd36f..34c4403 100755 --- a/docker/scripts/compile-platform.sh +++ b/docker/scripts/compile-platform.sh @@ -37,21 +37,21 @@ echo "Extracting source" tar -C . -xzf $SOURCE_TARBALL if [[ "$TARGET_PLATFORM" =~ "ubuntu" ]]; then - CONFIG_PLATFORM=ubuntu + CONFIG_PLATFORM=ubuntu_nostyle elif [[ "$TARGET_PLATFORM" =~ "centos" ]]; then - CONFIG_PLATFORM=centos + CONFIG_PLATFORM=centos_nostyle elif [[ "$TARGET_PLATFORM" =~ "darwin" ]]; then - CONFIG_PLATFORM=darwin + CONFIG_PLATFORM=darwin_nostyle elif [[ "$TARGET_PLATFORM" =~ "debian" ]]; then - CONFIG_PLATFORM=debian + CONFIG_PLATFORM=debian_nostyle elif [[ "$TARGET_PLATFORM" =~ "ubuntu_nostyle" ]]; then - CONFIG_PLATFORM=ubuntu + CONFIG_PLATFORM=ubuntu_nostyle elif [[ "$TARGET_PLATFORM" =~ "centos_nostyle" ]]; then - CONFIG_PLATFORM=centos + CONFIG_PLATFORM=centos_nostyle elif [[ "$TARGET_PLATFORM" =~ "darwin_nostyle" ]]; then - CONFIG_PLATFORM=darwin + CONFIG_PLATFORM=darwin_nostyle elif [[ "$TARGET_PLATFORM" =~ "debian_nostyle" ]]; then - CONFIG_PLATFORM=debian + CONFIG_PLATFORM=debian_nostyle else echo "Unknown platform: $TARGET_PLATFORM" exit 1
[incubator-heron] branch master updated: Update osx documentation (3453) (#3530)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new 89a1e50 Update osx documentation (3453) (#3530) 89a1e50 is described below commit 89a1e50010ecad27c84abdf3221bf054e53844b0 Author: Alper Tekinalp AuthorDate: Tue May 26 19:17:11 2020 +0300 Update osx documentation (3453) (#3530) As specified here: https://github.com/apache/incubator-heron/issues/3452#issuecomment-625435818, heron now requires bazel version 3.0.0 --- website2/docs/compiling-osx.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website2/docs/compiling-osx.md b/website2/docs/compiling-osx.md index 695a88a..57d88af 100644 --- a/website2/docs/compiling-osx.md +++ b/website2/docs/compiling-osx.md @@ -34,7 +34,7 @@ $ /usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/inst ### Step 2 -- Install Bazel ```bash -wget -O /tmp/bazel.sh https://github.com/bazelbuild/bazel/releases/download/0.26.0/bazel-0.26.0-installer-darwin-x86_64.sh +wget -O /tmp/bazel.sh https://github.com/bazelbuild/bazel/releases/download/3.0.0/bazel-3.0.0-installer-darwin-x86_64.sh chmod +x /tmp/bazel.sh /tmp/bazel.sh --user ```
[incubator-heron] branch joshfischer/fix-javadocs created (now 5b2828f)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/fix-javadocs in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 5b2828f correcting folder path This branch includes the following new commits: new 5b2828f correcting folder path The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] 01/01: correcting folder path
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/fix-javadocs in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 5b2828faf319e007760fe665bc2b9366e92e677f Author: Josh Fischer AuthorDate: Sun May 17 21:58:56 2020 -0500 correcting folder path --- website2/website/scripts/javadocs.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website2/website/scripts/javadocs.sh b/website2/website/scripts/javadocs.sh index 7cdf4af..80607e3 100755 --- a/website2/website/scripts/javadocs.sh +++ b/website2/website/scripts/javadocs.sh @@ -50,7 +50,7 @@ GEN_FILES=`find $GEN_PROTO_DIR -name "*.java"` rm -rf $JAVADOC_OUTPUT_DIR mkdir -p $JAVADOC_OUTPUT_DIR -BIN_JARS=`find $HERON_ROOT_DIR/bazel-incubator-heron/_bin/. -name "*\.jar" | tr '\n' ':'` +BIN_JARS=`find $HERON_ROOT_DIR/bazel-incubator-heron/. -name "*\.jar" | tr '\n' ':'` GEN_JARS=`find $HERON_ROOT_DIR/bazel-bin/external/. -name "*\.jar" | tr '\n' ':'` SCRIBE_JARS=`find $HERON_ROOT_DIR/bazel-bin/. -name "libthrift_scribe_java.jar" | tr '\n' ':'` PROTO_JARS=`find $HERON_ROOT_DIR/bazel-bin/heron/proto/. -name "*\.jar" | tr '\n' ':'`
[incubator-heron] branch master updated: Fix centos7 docker build (#3523)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new e065171 Fix centos7 docker build (#3523) e065171 is described below commit e0651719f39e9af1313057749df0553198baf2aa Author: Ning Wang AuthorDate: Sat May 9 18:17:44 2020 -0700 Fix centos7 docker build (#3523) --- docker/dist/Dockerfile.dist.centos7 | 6 -- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/docker/dist/Dockerfile.dist.centos7 b/docker/dist/Dockerfile.dist.centos7 index d548ff5..686a8fb 100644 --- a/docker/dist/Dockerfile.dist.centos7 +++ b/docker/dist/Dockerfile.dist.centos7 @@ -24,8 +24,10 @@ RUN yum -y install which; yum clean all RUN yum -y install curl; yum clean all RUN yum -y install nmap-ncat; yum clean all RUN yum -y install python python3-setuptools; yum clean all -RUN easy_install supervisor -RUN echo_supervisord_conf > /etc/supervisord.conf + +RUN yum install epel-release; yum clean all +RUN yum update -y +RUN yum install -y supervisor; yum clean all RUN yum -y install java-11-openjdk java-11-openjdk-devel; yum clean all
[incubator-heron] branch master updated: Update issue templates (#3379)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new ec7a87a Update issue templates (#3379) ec7a87a is described below commit ec7a87af4df3ad6431f9bc01b9b8328705fb3a7f Author: Ning Wang AuthorDate: Tue Apr 21 19:48:24 2020 -0700 Update issue templates (#3379) * Update issue templates * Update bug_report.md Co-authored-by: Josh Fischer --- .github/ISSUE_TEMPLATE/bug_report.md | 31 +++ .github/ISSUE_TEMPLATE/custom.md | 10 ++ .github/ISSUE_TEMPLATE/feature_request.md | 20 3 files changed, 61 insertions(+) diff --git a/.github/ISSUE_TEMPLATE/bug_report.md b/.github/ISSUE_TEMPLATE/bug_report.md new file mode 100644 index 000..a3aaf4a --- /dev/null +++ b/.github/ISSUE_TEMPLATE/bug_report.md @@ -0,0 +1,31 @@ +--- +name: Bug report +about: Create a report to help us improve +title: '' +labels: '' +assignees: '' + +--- + +**Describe the bug** +A clear and concise description of what the bug is. + +**To Reproduce** +Steps to reproduce the behavior: +1. Go to '...' +2. Click on '' +3. Scroll down to '' +4. See error + +**Expected behavior** +A clear and concise description of what you expected to happen. + +**Screenshots** +If applicable, add screenshots to help explain your problem. + +**Operating System** + - OS: [e.g. iOS] + - Version [e.g. 22] + +**Additional context** +Add any other context about the problem here. diff --git a/.github/ISSUE_TEMPLATE/custom.md b/.github/ISSUE_TEMPLATE/custom.md new file mode 100644 index 000..48d5f81 --- /dev/null +++ b/.github/ISSUE_TEMPLATE/custom.md @@ -0,0 +1,10 @@ +--- +name: Custom issue template +about: Describe this issue template's purpose here. +title: '' +labels: '' +assignees: '' + +--- + + diff --git a/.github/ISSUE_TEMPLATE/feature_request.md b/.github/ISSUE_TEMPLATE/feature_request.md new file mode 100644 index 000..bbcbbe7 --- /dev/null +++ b/.github/ISSUE_TEMPLATE/feature_request.md @@ -0,0 +1,20 @@ +--- +name: Feature request +about: Suggest an idea for this project +title: '' +labels: '' +assignees: '' + +--- + +**Is your feature request related to a problem? Please describe.** +A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] + +**Describe the solution you'd like** +A clear and concise description of what you want to happen. + +**Describe alternatives you've considered** +A clear and concise description of any alternative solutions or features you've considered. + +**Additional context** +Add any other context or screenshots about the feature request here.
[incubator-heron] branch nwangtw-patch-1 updated (09fd23e -> 9a172f0)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch nwangtw-patch-1 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. from 09fd23e Update bug_report.md add 7987f4a Avoid duplicated metrics requests in Heron UI (#3378) add c27d2c0 Fix max capacity timeline in Heron UI (#3383) add c51faf8 makemetricstriggerperiodic (#3384) add a65d330 fix base url and counters flag; combine metrics requests (#3385) add 1dbf1ce Refactor counters sections in Heron UI topology page (#3392) add 8045a30 Docker site (#3393) add 135fb76 Helm chart Bookkeeper fix (#3381) add 1f5f23d Add tables for component running info (#3394) add bd06dc8 Update the instruction for using the docker based development environment (#3395) add 06a55e9 Re-organize UI elements in Heorn UI topology page (#3397) add 909c7a0 Support Catalina for Mac (#3398) add ae2d1f7 Make topology details section scrollable in Heron UI (#3400) add d8db1c5 Add parallelism calculator in Heron UI (#3401) add 4bca2e5 BUG: bookie statefulset helm template specifies incorrect service name (#3410) add 06b5acc Update Kubernetes proxy URLs (#3405) add d8d811a Fix jQuery license and add missing license files (#3407) add de8b554 joshfischer/asf site (#3414) add dcd1b92 Joshfischer/finalize-ci-website (#3418) add 340e654 Update zk version to 3.4.14 in dist and install zk in ubuntu 16/18 di… (#3411) add 468aed1 Joshfischer/apache content (#3419) add 869c82e make python code compatible with both python2 and python3 (#3412) add 7ef2e15 Fix Helm values.yml typo (#3421) add a565a6b Updated compile docker images to include `tree` package (#3423) add 73f2487 Joshfischer/site build mods (#3422) add 367b44a Removing old com.twitter namespace references (#3415) add cb8212f update bazel_config for Mac OS 10.14 (#3420) add 5cd8ff9 Update getting-started-local-single-node.md (#3425) add a745e3e Updates to make Zookeeper work (#3424) add 2f0c1db update readme (#3429) add e51f265 Updated to support Kubernetes 1.16 (#3426) add 485b708 Updated Helm to 3.0.2 (#3430) add 257b1a4 Upgrade to Python3 for the whole repo (#3431) add b16973a Updated rules_scala to fix https issue (#3436) add 91dbabf Updated to use default Kubernetes client discovery logic (#3432) add 7927299 add downloader-core filegroup (#3439) add 0599224 Update license files for JSXTransformer.js (#3437) add b964cf4 explicitly making the site indexable (#3442) add 3b66e97 Improve docker dev env script (#3441) add f7371e1 Added execute permission to dev-env-create.sh (#3443) add d43f6bd Use netcat-bsd in Debian (#3447) add b22f442 remove old site (#3446) add c9d18e6 Add redirect from github pages to new apache site (#3448) add d179c83 Bump mixin-deep from 1.3.1 to 1.3.2 in /website2/website (#3391) add 783581b adding new committers (#3451) add db255f4 removing symlink. Adding contributing guidelines back (#3450) add 0a6cecb adding examples folder to classpath (#3458) add 1476076 Java 11 support (#3454) add 4379fe1 Update website for java 11 (#3462) add 1c59862 Update README for Java 11 (#3464) add f0b6e1b Make log/sink/consume Streamlet component support setName and setNumPartitions (#3459) add a6ec96e Patch to fix cppcheck with newer glibc (#3471) add 98a084a Add documents for setting up a docker based development environment (#3475) add ee1c44a Improve concurrency for needed parts. (#3107) add 6846f70 Revert "Upgrade to Python3 (#3431)" (#3478) add 576e0c7 Joshfischer/debian10 java11 (#3481) add 43c7c74 Update Debian docker build with JDK11 and correct debian version (#3487) add 9ddbeb6 updating docs for compiling (#3483) add f76f479 fixstmgrcrash (#3492) add c3d29a4 rolling back docusaurus version (#3501) add d2c5303 Fix copy Maven artifacts permission error (#3503) add a6a4bf8 Travis CI update to Ubuntu 18.04 (#3497) add b069e45 Support custom metrics rules for PrometheusSink (#3493) add 9d77767 Use safe constructor in yaml deserialization add 0f27ef4 Fix style add ed6fd81 Add an example with Streamlet API using component config (#3496) add f90784a remove gitmodule file (#3508) add c024da2 Fix snake yaml that caused unit test failures (#3506) add 32d3051 Joshfischer/update site build (#3509) add 2a4f112 Upgrading Bazel to 3.0.0 (#3510) add 923b8b9 Add cppunit-devel for Bazel 3 (#3513) add 78d7145 Adding missing pkg-config package to Debian 9 build (#3517) add d94c498 merge add 9a172f0 Merge branch 'nwangtw-patch-1' of github.com:apache/incubator-heron into nwangtw-patch-1 No new revisions
[incubator-heron] branch joshfischer/bazel-3-docs updated: updating for 0.20.3-incubating-rc2
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/bazel-3-docs in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/bazel-3-docs by this push: new e5a95df updating for 0.20.3-incubating-rc2 e5a95df is described below commit e5a95df574f811fb9d18c72b33e7c81ea5ec3219 Author: Josh Fischer AuthorDate: Sat Apr 18 09:20:54 2020 -0500 updating for 0.20.3-incubating-rc2 --- website2/website/scripts/build-site.sh | 2 +- website2/website/scripts/replace.js| 3 +- .../compiling-code-organization.md | 199 + .../compiling-docker.md| 253 +++ .../compiling-linux.md | 212 ++ .../version-0.20.3-incubating-rc2/compiling-osx.md | 87 +++ .../heron-streamlet-concepts.md| 811 + .../schedulers-k8s-with-helm.md| 304 website2/website/versions.json | 1 + 9 files changed, 1870 insertions(+), 2 deletions(-) diff --git a/website2/website/scripts/build-site.sh b/website2/website/scripts/build-site.sh index 2647259..a4d38e6 100755 --- a/website2/website/scripts/build-site.sh +++ b/website2/website/scripts/build-site.sh @@ -38,4 +38,4 @@ cp -R ${ROOT_DIR}/website2/website/public/api/java/* ${ROOT_DIR}/generated-site/ ## copy pydocs cp -R ${ROOT_DIR}/website2/website/static/api/python/* ${ROOT_DIR}/generated-site/content/api/python/ ## remove bazelrc for dockerfile -rm ${ROOT_DIR}/website2/website/scripts/bazelrc \ No newline at end of file +rm ${ROOT_DIR}/website2/website/scripts/bazelrc diff --git a/website2/website/scripts/replace.js b/website2/website/scripts/replace.js index 69bfec8..01c78cc 100755 --- a/website2/website/scripts/replace.js +++ b/website2/website/scripts/replace.js @@ -38,6 +38,7 @@ const bazelVersions = { '0.20.0-incubating': '0.14.1', '0.20.1-incubating': '0.26.0', '0.20.2-incubating': '0.26.0', +'0.20.3-incubating-rc2': '3.0.0', 'latest': '3.0.0', } @@ -102,4 +103,4 @@ for (v of versions) { dry: false }; doReplace(opts); -} \ No newline at end of file +} diff --git a/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-code-organization.md b/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-code-organization.md new file mode 100644 index 000..fd2844b --- /dev/null +++ b/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-code-organization.md @@ -0,0 +1,199 @@ +--- +id: version-0.20.3-incubating-rc2-compiling-code-organization +title: Code Organization +sidebar_label: Code Organization +original_id: compiling-code-organization +--- + + +This document contains information about the Heron codebase intended primarily +for developers who want to contribute to Heron. The Heron codebase lives on +[github]({{% githubMaster %}}). + +If you're looking for documentation about developing topologies for a Heron +cluster, see [Building Topologies](topology-development-topology-api-java) instead. + +## Languages + +The primary programming languages for Heron are C++, Java, and Python. + +* **C++ 11** is used for most of Heron's core components, including the +[Topology Master](heron-architecture#topology-master), and +[Stream Manager](heron-architecture#stream-manager). + +* **Java 11** is used primarily for Heron's [topology +API](heron-topology-concepts), and [Heron Instance](heron-architecture#heron-instance). +It is currently the only language in which topologies can be written. Instructions can be found +in [Building Topologies](../../developers/java/topologies), while documentation for the Java +API can be found [here](/api/org/apache/heron/api/topology/package-summary.html). Please note that Heron topologies do not require Java 11 and can be written in Java 7 or later. + +* **Python 2** (specifically 2.7) is used primarily for Heron's [CLI interface](user-manuals-heron-cli) and UI components such as [Heron UI](user-manuals-heron-ui) and the [Heron Tracker](user-manuals-heron-tracker-runbook). + +## Main Tools + +* **Build tool** --- Heron uses [Bazel](http://bazel.io/) as its build tool. +Information on setting up and using Bazel for Heron can be found in [Compiling Heron](compiling-overview). + +* **Inter-component communication** --- Heron uses [Protocol +Buffers](https://developers.google.com/protocol-buffers/?hl=en) for +communication between components. Most `.proto` definition files can be found in +[`heron/proto`]({{% githubMaster %}}/heron/proto). + +* **Cluster coordination** --- Heron relies heavily on ZooKeeper for cluster +coordination for distributed deployment, be it for [Aurora](schedulers-aurora-cluster) or for a [custom +scheduler](extending-heron-scheduler) that you build. More information
[incubator-heron] branch joshfischer/bazel-3-docs updated: removing release candidate docs
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/bazel-3-docs in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/bazel-3-docs by this push: new ad591d7 removing release candidate docs ad591d7 is described below commit ad591d7007e27b1118949202ac267f0db369476d Author: Josh Fischer AuthorDate: Sat Apr 18 08:20:30 2020 -0500 removing release candidate docs --- website2/website/scripts/replace.js| 8 +- .../compiling-code-organization.md | 199 - .../compiling-docker.md| 253 --- .../compiling-linux.md | 212 -- .../version-0.20.3-incubating-rc2/compiling-osx.md | 87 --- .../heron-streamlet-concepts.md| 811 - .../schedulers-k8s-with-helm.md| 304 website2/website/versions.json | 1 - 8 files changed, 4 insertions(+), 1871 deletions(-) diff --git a/website2/website/scripts/replace.js b/website2/website/scripts/replace.js index 8d08349..69bfec8 100755 --- a/website2/website/scripts/replace.js +++ b/website2/website/scripts/replace.js @@ -38,22 +38,22 @@ const bazelVersions = { '0.20.0-incubating': '0.14.1', '0.20.1-incubating': '0.26.0', '0.20.2-incubating': '0.26.0', -'0.20.2-incubating-rc2': '3.0.0', 'latest': '3.0.0', } function replaceBazel(version) { try { if (version in bazelVersions) { +console.log("replacing version: " + version) return bazelVersions[version] } else { -throw new Error('Unable to find bazel Version'); +throw new Error('Unable to find bazel Version for ' + version); } } catch (error) { -console.error('no versions found defaulting to 0.26') +console.error('no versions found for ' + version + ' defaulting to 3.0.0') } -return '0.26' +return '3.0.0' } console.log(latestVersion) diff --git a/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-code-organization.md b/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-code-organization.md deleted file mode 100644 index fd2844b..000 --- a/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-code-organization.md +++ /dev/null @@ -1,199 +0,0 @@ -id: version-0.20.3-incubating-rc2-compiling-code-organization -title: Code Organization -sidebar_label: Code Organization -original_id: compiling-code-organization - - -This document contains information about the Heron codebase intended primarily -for developers who want to contribute to Heron. The Heron codebase lives on -[github]({{% githubMaster %}}). - -If you're looking for documentation about developing topologies for a Heron -cluster, see [Building Topologies](topology-development-topology-api-java) instead. - -## Languages - -The primary programming languages for Heron are C++, Java, and Python. - -* **C++ 11** is used for most of Heron's core components, including the -[Topology Master](heron-architecture#topology-master), and -[Stream Manager](heron-architecture#stream-manager). - -* **Java 11** is used primarily for Heron's [topology -API](heron-topology-concepts), and [Heron Instance](heron-architecture#heron-instance). -It is currently the only language in which topologies can be written. Instructions can be found -in [Building Topologies](../../developers/java/topologies), while documentation for the Java -API can be found [here](/api/org/apache/heron/api/topology/package-summary.html). Please note that Heron topologies do not require Java 11 and can be written in Java 7 or later. - -* **Python 2** (specifically 2.7) is used primarily for Heron's [CLI interface](user-manuals-heron-cli) and UI components such as [Heron UI](user-manuals-heron-ui) and the [Heron Tracker](user-manuals-heron-tracker-runbook). - -## Main Tools - -* **Build tool** --- Heron uses [Bazel](http://bazel.io/) as its build tool. -Information on setting up and using Bazel for Heron can be found in [Compiling Heron](compiling-overview). - -* **Inter-component communication** --- Heron uses [Protocol -Buffers](https://developers.google.com/protocol-buffers/?hl=en) for -communication between components. Most `.proto` definition files can be found in -[`heron/proto`]({{% githubMaster %}}/heron/proto). - -* **Cluster coordination** --- Heron relies heavily on ZooKeeper for cluster -coordination for distributed deployment, be it for [Aurora](schedulers-aurora-cluster) or for a [custom -scheduler](extending-heron-scheduler) that you build. More information on ZooKeeper -components in the codebase can be found in the [State -Management](#state-management) section below. - -## Common Utilities - -The [`heron/common`]({{% gi
[incubator-heron] branch asf-site updated: git-site-role commit from publish_site.sh
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/asf-site by this push: new 837f2c8 git-site-role commit from publish_site.sh 837f2c8 is described below commit 837f2c8e64849dd9adc1a831479d6b102b30f881 Author: jenkins AuthorDate: Sat Apr 18 02:45:52 2020 + git-site-role commit from publish_site.sh --- .asf.yaml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.asf.yaml b/.asf.yaml index 5153eeb..2c440bc 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -24,7 +24,7 @@ publish: github: description: "Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter" - ghp_branch: joshfischer/bazel-3-docs + ghp_branch: master ghp_path: ~ homepage: https://heron.incubator.apache.org/ labels:
[incubator-heron] branch joshfischer/bazel-3-docs updated: correct version
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/bazel-3-docs in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/bazel-3-docs by this push: new 71bd31a correct version 71bd31a is described below commit 71bd31ac9092a75d25000252f64ab76334c03d2a Author: Josh Fischer AuthorDate: Fri Apr 17 21:36:28 2020 -0500 correct version --- .../compiling-code-organization.md | 2 +- .../compiling-docker.md | 2 +- .../compiling-linux.md | 2 +- .../compiling-osx.md| 2 +- .../heron-streamlet-concepts.md | 2 +- .../schedulers-k8s-with-helm.md | 2 +- website2/website/versions.json | 2 +- 7 files changed, 7 insertions(+), 7 deletions(-) diff --git a/website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-code-organization.md b/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-code-organization.md similarity index 99% rename from website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-code-organization.md rename to website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-code-organization.md index 4663779..fd2844b 100644 --- a/website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-code-organization.md +++ b/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-code-organization.md @@ -1,5 +1,5 @@ --- -id: version-0.20.2-incubating-rc2-compiling-code-organization +id: version-0.20.3-incubating-rc2-compiling-code-organization title: Code Organization sidebar_label: Code Organization original_id: compiling-code-organization diff --git a/website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-docker.md b/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-docker.md similarity index 99% rename from website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-docker.md rename to website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-docker.md index 8688ee9..4047223 100644 --- a/website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-docker.md +++ b/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-docker.md @@ -1,5 +1,5 @@ --- -id: version-0.20.2-incubating-rc2-compiling-docker +id: version-0.20.3-incubating-rc2-compiling-docker title: Compiling With Docker sidebar_label: Compiling With Docker original_id: compiling-docker diff --git a/website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-linux.md b/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-linux.md similarity index 99% rename from website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-linux.md rename to website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-linux.md index 03174a7..f13bd21 100644 --- a/website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-linux.md +++ b/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-linux.md @@ -1,5 +1,5 @@ --- -id: version-0.20.2-incubating-rc2-compiling-linux +id: version-0.20.3-incubating-rc2-compiling-linux title: Compiling on Linux sidebar_label: Compiling on Linux original_id: compiling-linux diff --git a/website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-osx.md b/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-osx.md similarity index 98% rename from website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-osx.md rename to website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-osx.md index 388575c..8b0553d 100644 --- a/website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-osx.md +++ b/website2/website/versioned_docs/version-0.20.3-incubating-rc2/compiling-osx.md @@ -1,5 +1,5 @@ --- -id: version-0.20.2-incubating-rc2-compiling-osx +id: version-0.20.3-incubating-rc2-compiling-osx title: Compiling on OS X sidebar_label: Compiling on OS X original_id: compiling-osx diff --git a/website2/website/versioned_docs/version-0.20.2-incubating-rc2/heron-streamlet-concepts.md b/website2/website/versioned_docs/version-0.20.3-incubating-rc2/heron-streamlet-concepts.md similarity index 99% rename from website2/website/versioned_docs/version-0.20.2-incubating-rc2/heron-streamlet-concepts.md rename to website2/website/versioned_docs/version-0.20.3-incubating-rc2/heron-streamlet-concepts.md index f427c7b..0eb5766 100644 --- a/website2/website/versioned_docs/version-0.20.2-incubating-rc2/heron-streamlet-concepts.md +++ b
[incubator-heron] branch joshfischer/bazel-3-docs updated: correcting gh pages
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/bazel-3-docs in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/bazel-3-docs by this push: new 872deb9 correcting gh pages 872deb9 is described below commit 872deb920092b29ce4c7c284b60de2bd716c0531 Author: Josh Fischer AuthorDate: Fri Apr 17 21:32:02 2020 -0500 correcting gh pages --- .asf.yaml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.asf.yaml b/.asf.yaml index 5153eeb..2c440bc 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -24,7 +24,7 @@ publish: github: description: "Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter" - ghp_branch: joshfischer/bazel-3-docs + ghp_branch: master ghp_path: ~ homepage: https://heron.incubator.apache.org/ labels:
[incubator-heron] branch asf-site updated: git-site-role commit from publish_site.sh
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/asf-site by this push: new e1880ac git-site-role commit from publish_site.sh e1880ac is described below commit e1880aced7841178e7a21372c51ba7b27a66b971 Author: jenkins AuthorDate: Sat Apr 18 02:15:49 2020 + git-site-role commit from publish_site.sh --- .asf.yaml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.asf.yaml b/.asf.yaml index 2c440bc..5153eeb 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -24,7 +24,7 @@ publish: github: description: "Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter" - ghp_branch: master + ghp_branch: joshfischer/bazel-3-docs ghp_path: ~ homepage: https://heron.incubator.apache.org/ labels:
[incubator-heron] branch joshfischer/bazel-3-docs updated: update gh pages branch
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/bazel-3-docs in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/bazel-3-docs by this push: new 92c46a7 update gh pages branch 92c46a7 is described below commit 92c46a741fa6a89f7a90f21c59837e8382d4b55c Author: Josh Fischer AuthorDate: Fri Apr 17 20:41:03 2020 -0500 update gh pages branch --- .asf.yaml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.asf.yaml b/.asf.yaml index 2c440bc..5153eeb 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -24,7 +24,7 @@ publish: github: description: "Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter" - ghp_branch: master + ghp_branch: joshfischer/bazel-3-docs ghp_path: ~ homepage: https://heron.incubator.apache.org/ labels:
[incubator-heron] branch joshfischer/bazel-3-docs updated: fix syntax
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/bazel-3-docs in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/bazel-3-docs by this push: new af7892d fix syntax af7892d is described below commit af7892d9129521ed4c5d745fb1ea036f759dada8 Author: Josh Fischer AuthorDate: Thu Apr 16 21:57:41 2020 -0500 fix syntax --- website2/website/scripts/replace.js | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website2/website/scripts/replace.js b/website2/website/scripts/replace.js index f9f7ace..8d08349 100755 --- a/website2/website/scripts/replace.js +++ b/website2/website/scripts/replace.js @@ -38,7 +38,7 @@ const bazelVersions = { '0.20.0-incubating': '0.14.1', '0.20.1-incubating': '0.26.0', '0.20.2-incubating': '0.26.0', -'0.20.2-incubating-rc2': '3.0.0'. +'0.20.2-incubating-rc2': '3.0.0', 'latest': '3.0.0', }
[incubator-heron] branch joshfischer/bazel-3-docs updated: adding temporary release candidate docs
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/bazel-3-docs in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/bazel-3-docs by this push: new 2e345c9 adding temporary release candidate docs 2e345c9 is described below commit 2e345c9e44c4c5335c41baaa880824f6713a5b3b Author: Josh Fischer AuthorDate: Thu Apr 16 21:42:55 2020 -0500 adding temporary release candidate docs --- website2/website/scripts/replace.js| 3 +- .../compiling-code-organization.md | 199 + .../compiling-docker.md| 253 +++ .../compiling-linux.md | 212 ++ .../version-0.20.2-incubating-rc2/compiling-osx.md | 87 +++ .../heron-streamlet-concepts.md| 811 + .../schedulers-k8s-with-helm.md| 304 website2/website/versions.json | 1 + 8 files changed, 1869 insertions(+), 1 deletion(-) diff --git a/website2/website/scripts/replace.js b/website2/website/scripts/replace.js index ea5a9b0..f9f7ace 100755 --- a/website2/website/scripts/replace.js +++ b/website2/website/scripts/replace.js @@ -38,7 +38,8 @@ const bazelVersions = { '0.20.0-incubating': '0.14.1', '0.20.1-incubating': '0.26.0', '0.20.2-incubating': '0.26.0', -'next': '3.0.0', +'0.20.2-incubating-rc2': '3.0.0'. +'latest': '3.0.0', } function replaceBazel(version) { diff --git a/website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-code-organization.md b/website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-code-organization.md new file mode 100644 index 000..4663779 --- /dev/null +++ b/website2/website/versioned_docs/version-0.20.2-incubating-rc2/compiling-code-organization.md @@ -0,0 +1,199 @@ +--- +id: version-0.20.2-incubating-rc2-compiling-code-organization +title: Code Organization +sidebar_label: Code Organization +original_id: compiling-code-organization +--- + + +This document contains information about the Heron codebase intended primarily +for developers who want to contribute to Heron. The Heron codebase lives on +[github]({{% githubMaster %}}). + +If you're looking for documentation about developing topologies for a Heron +cluster, see [Building Topologies](topology-development-topology-api-java) instead. + +## Languages + +The primary programming languages for Heron are C++, Java, and Python. + +* **C++ 11** is used for most of Heron's core components, including the +[Topology Master](heron-architecture#topology-master), and +[Stream Manager](heron-architecture#stream-manager). + +* **Java 11** is used primarily for Heron's [topology +API](heron-topology-concepts), and [Heron Instance](heron-architecture#heron-instance). +It is currently the only language in which topologies can be written. Instructions can be found +in [Building Topologies](../../developers/java/topologies), while documentation for the Java +API can be found [here](/api/org/apache/heron/api/topology/package-summary.html). Please note that Heron topologies do not require Java 11 and can be written in Java 7 or later. + +* **Python 2** (specifically 2.7) is used primarily for Heron's [CLI interface](user-manuals-heron-cli) and UI components such as [Heron UI](user-manuals-heron-ui) and the [Heron Tracker](user-manuals-heron-tracker-runbook). + +## Main Tools + +* **Build tool** --- Heron uses [Bazel](http://bazel.io/) as its build tool. +Information on setting up and using Bazel for Heron can be found in [Compiling Heron](compiling-overview). + +* **Inter-component communication** --- Heron uses [Protocol +Buffers](https://developers.google.com/protocol-buffers/?hl=en) for +communication between components. Most `.proto` definition files can be found in +[`heron/proto`]({{% githubMaster %}}/heron/proto). + +* **Cluster coordination** --- Heron relies heavily on ZooKeeper for cluster +coordination for distributed deployment, be it for [Aurora](schedulers-aurora-cluster) or for a [custom +scheduler](extending-heron-scheduler) that you build. More information on ZooKeeper +components in the codebase can be found in the [State +Management](#state-management) section below. + +## Common Utilities + +The [`heron/common`]({{% githubMaster %}}/heron/common) contains a variety of +utilities for each of Heron's languages, including useful constants, file +utilities, networking interfaces, and more. + +## Cluster Scheduling + +Heron supports two cluster schedulers out of the box: +[Aurora](schedulers-aurora-cluster) and a [local +scheduler](schedulers-local). The Java code for each of those +schedulers can be found in [`heron/schedulers`]({{% githubMaster %}}/heron/schedulers) +, while the underlying scheduler API can be found [here](/api/org/apache/heron/spi/scheduler
[incubator-heron] branch joshfischer/bazel-3-docs created (now d25a7b9)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/bazel-3-docs in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at d25a7b9 update version map This branch includes the following new commits: new d25a7b9 update version map The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] 01/01: update version map
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/bazel-3-docs in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit d25a7b9927c146a36a491a76cc202475799ee6c2 Author: Josh Fischer AuthorDate: Thu Apr 16 21:12:51 2020 -0500 update version map --- website2/website/scripts/replace.js | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website2/website/scripts/replace.js b/website2/website/scripts/replace.js index 1c58625..ea5a9b0 100755 --- a/website2/website/scripts/replace.js +++ b/website2/website/scripts/replace.js @@ -38,7 +38,7 @@ const bazelVersions = { '0.20.0-incubating': '0.14.1', '0.20.1-incubating': '0.26.0', '0.20.2-incubating': '0.26.0', -'latest': '3.0.0', +'next': '3.0.0', } function replaceBazel(version) {
svn commit: r39000 - in /dev/incubator/heron/heron-0.20.3-incubating-candidate-2: ./ heron-0.20.3-incubating-rc2.tar.gz heron-0.20.3-incubating-rc2.tar.gz.asc heron-0.20.3-incubating-rc2.tar.gz.sha1 h
Author: joshfischer Date: Fri Apr 17 01:43:06 2020 New Revision: 39000 Log: 0.20.3-incubating-candidate-2 Added: dev/incubator/heron/heron-0.20.3-incubating-candidate-2/ dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz (with props) dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz.asc dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz.sha1 dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz.sha512 Added: dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz == Binary file - no diff available. Propchange: dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz -- svn:mime-type = application/octet-stream Added: dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz.asc == --- dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz.asc (added) +++ dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz.asc Fri Apr 17 01:43:06 2020 @@ -0,0 +1,11 @@ +-BEGIN PGP SIGNATURE- + +iQEzBAABCAAdFiEEjrNmdNgui17bJY8nZDO577RSFSsFAl6ZCU8ACgkQZDO577RS +FSvsnwf/RURJ5QbkTlko34O14i/21gH3dXBTSC/XTlaEIePmpw2LpXP42cxNxChJ +FgEHt6li1Anlw87jmhR/OGTNPQc/OouBUWNFIrzlIMEyyzxf34oG3vugnSq5Yxk5 +WHdOd/Hy50eHb3PEw5BCsuPgVlw4wofo8nfv9ot861kUx6hPy95eoJuo/EJD9Q2C +T9J0Jgy04aq+1Q050DrKoaMTLk/M9/6GQ4bFYQYyqQtVT8FePFLYTi8HwtkgkPru +lYuVtlZDlfw1DnU9ek4bC2FIceMqc5YGLn/4yQVdvLPfkgERhXzBQZnHey/FpJDY +6v8L/dQRBYqizV7Ai1I+yGI6x1HUzw== +=65a1 +-END PGP SIGNATURE- Added: dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz.sha1 == --- dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz.sha1 (added) +++ dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz.sha1 Fri Apr 17 01:43:06 2020 @@ -0,0 +1 @@ +23b3c8f6b0df5fc1394727b05a5aa2806b75ff68 heron-0.20.3-incubating-rc2.tar.gz Added: dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz.sha512 == --- dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz.sha512 (added) +++ dev/incubator/heron/heron-0.20.3-incubating-candidate-2/heron-0.20.3-incubating-rc2.tar.gz.sha512 Fri Apr 17 01:43:06 2020 @@ -0,0 +1 @@ +84a94d0c68581e230033a04c4539e8dabbd14461f75319c9caaa1bcbec288599fffc98c2928b520eb320deb9184b594d0e23eeb0521452cd014f21dda1776413 heron-0.20.3-incubating-rc2.tar.gz
[incubator-heron] branch release/0.20.3_incubating_rc2 created (now 2a4f112)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch release/0.20.3_incubating_rc2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 2a4f112 Upgrading Bazel to 3.0.0 (#3510) No new revisions were added by this update.
svn commit: r38977 - in /dev/incubator/heron/heron-0.20.3-incubating-candidate-1: ./ heron-0.20.3-incubating-rc1.tar.gz heron-0.20.3-incubating-rc1.tar.gz.asc heron-0.20.3-incubating-rc1.tar.gz.sha1 h
Author: joshfischer Date: Thu Apr 16 03:44:40 2020 New Revision: 38977 Log: 0.20.3-incubating-candidate-1 Added: dev/incubator/heron/heron-0.20.3-incubating-candidate-1/ dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz (with props) dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz.asc dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz.sha1 dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz.sha512 Added: dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz == Binary file - no diff available. Propchange: dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz -- svn:mime-type = application/octet-stream Added: dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz.asc == --- dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz.asc (added) +++ dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz.asc Thu Apr 16 03:44:40 2020 @@ -0,0 +1,11 @@ +-BEGIN PGP SIGNATURE- + +iQEzBAABCAAdFiEEjrNmdNgui17bJY8nZDO577RSFSsFAl6Xz3cACgkQZDO577RS +FStyYggA0HEMRf4175ZiTMGqIjLu8GMynez/TD5Em1uVQBNVsPnIRLCLXgCYWn4s +R8y/FpGamSSGOBeMm5kJmfvNZjHX2xhEHSWCu0YHaQS8dtlPOR8ZVIWcd577dNxf +O8VJWJtojMfQu6Qo6Xo5N18uOC+Zs0orHtCk9FNm2kiJslwTuIg9uGjuqM0mwMMi +JARMxwBjBFHzTbPCU2BtZMhPT+zIx5rKjipED7TWcLfR7JlN/MkAjK62meG6jrH7 +TrvuwzdezmwnQXO0lAlgFquTPo31hXxVU9TpgUu4CUSLMSWZNZ8euuHxOFJL7GQn +pgZGZQLqqXRYdeP7xtdOezAKg9yCOw== +=aChL +-END PGP SIGNATURE- Added: dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz.sha1 == --- dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz.sha1 (added) +++ dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz.sha1 Thu Apr 16 03:44:40 2020 @@ -0,0 +1 @@ +09e4231736ec302cce80a5b1ad883f2b75a0ceba heron-0.20.3-incubating-rc1.tar.gz Added: dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz.sha512 == --- dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz.sha512 (added) +++ dev/incubator/heron/heron-0.20.3-incubating-candidate-1/heron-0.20.3-incubating-rc1.tar.gz.sha512 Thu Apr 16 03:44:40 2020 @@ -0,0 +1 @@ +c6fcfa177b1b7c72aa8802b66b360e958611efa8993c192086935826662ccef28f362f03021f91f64dbfe4be00a3a0b78e7ee4eed78d931ea124a456f33b heron-0.20.3-incubating-rc1.tar.gz
svn commit: r38976 - in /dev/incubator/heron/heron-0.20.3-incubating-rc1: ./ heron-0.20.3-incubating-rc1.tar.gz heron-0.20.3-incubating-rc1.tar.gz.asc heron-0.20.3-incubating-rc1.tar.gz.sha1 heron-0.2
Author: joshfischer Date: Thu Apr 16 03:40:25 2020 New Revision: 38976 Log: 0.20.3-incubating-rc1 Added: dev/incubator/heron/heron-0.20.3-incubating-rc1/ dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz (with props) dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz.asc dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz.sha1 dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz.sha512 Added: dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz == Binary file - no diff available. Propchange: dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz -- svn:mime-type = application/octet-stream Added: dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz.asc == --- dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz.asc (added) +++ dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz.asc Thu Apr 16 03:40:25 2020 @@ -0,0 +1,11 @@ +-BEGIN PGP SIGNATURE- + +iQEzBAABCAAdFiEEjrNmdNgui17bJY8nZDO577RSFSsFAl6Xz3cACgkQZDO577RS +FStyYggA0HEMRf4175ZiTMGqIjLu8GMynez/TD5Em1uVQBNVsPnIRLCLXgCYWn4s +R8y/FpGamSSGOBeMm5kJmfvNZjHX2xhEHSWCu0YHaQS8dtlPOR8ZVIWcd577dNxf +O8VJWJtojMfQu6Qo6Xo5N18uOC+Zs0orHtCk9FNm2kiJslwTuIg9uGjuqM0mwMMi +JARMxwBjBFHzTbPCU2BtZMhPT+zIx5rKjipED7TWcLfR7JlN/MkAjK62meG6jrH7 +TrvuwzdezmwnQXO0lAlgFquTPo31hXxVU9TpgUu4CUSLMSWZNZ8euuHxOFJL7GQn +pgZGZQLqqXRYdeP7xtdOezAKg9yCOw== +=aChL +-END PGP SIGNATURE- Added: dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz.sha1 == --- dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz.sha1 (added) +++ dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz.sha1 Thu Apr 16 03:40:25 2020 @@ -0,0 +1 @@ +09e4231736ec302cce80a5b1ad883f2b75a0ceba heron-0.20.3-incubating-rc1.tar.gz Added: dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz.sha512 == --- dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz.sha512 (added) +++ dev/incubator/heron/heron-0.20.3-incubating-rc1/heron-0.20.3-incubating-rc1.tar.gz.sha512 Thu Apr 16 03:40:25 2020 @@ -0,0 +1 @@ +c6fcfa177b1b7c72aa8802b66b360e958611efa8993c192086935826662ccef28f362f03021f91f64dbfe4be00a3a0b78e7ee4eed78d931ea124a456f33b heron-0.20.3-incubating-rc1.tar.gz
[incubator-heron] annotated tag 0.20.3-incubating-rc1 updated (32d3051 -> 3df47819)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to annotated tag 0.20.3-incubating-rc1 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. *** WARNING: tag 0.20.3-incubating-rc1 was modified! *** from 32d3051 (commit) to 3df47819 (tag) tagging 32d3051ae9fff10a5ed0838b57b13f3f23c29e34 (commit) replaces snapshot_2019_08_21 by Josh Fischer on Wed Apr 15 21:55:13 2020 -0500 - Log - Version 0.20.3-incubating release candidate 1 --- No new revisions were added by this update. Summary of changes:
[incubator-heron] branch release/0.20.3_incubating_rc1 created (now 32d3051)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch release/0.20.3_incubating_rc1 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 32d3051 Joshfischer/update site build (#3509) No new revisions were added by this update.
[incubator-heron] branch master updated: Joshfischer/update site build (#3509)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new 32d3051 Joshfischer/update site build (#3509) 32d3051 is described below commit 32d3051ae9fff10a5ed0838b57b13f3f23c29e34 Author: Josh Fischer AuthorDate: Mon Apr 13 16:35:47 2020 -0500 Joshfischer/update site build (#3509) * remove user params * adjust user settings * adjust user settings * adjust path * clean up whitespace --- website2/website/scripts/Dockerfile.ubuntu18.04 | 11 ++- website2/website/scripts/compile-docker.sh | 8 2 files changed, 2 insertions(+), 17 deletions(-) diff --git a/website2/website/scripts/Dockerfile.ubuntu18.04 b/website2/website/scripts/Dockerfile.ubuntu18.04 index 9d16f48..11aab58 100644 --- a/website2/website/scripts/Dockerfile.ubuntu18.04 +++ b/website2/website/scripts/Dockerfile.ubuntu18.04 @@ -52,17 +52,10 @@ RUN apt-get update && apt-get install -y nodejs ENV JAVA_HOME /usr/lib/jvm/java-11-openjdk-amd64 -ARG UNAME -ARG UID -ARG GID -RUN groupadd -g $GID -o $UNAME -RUN useradd -m -u $UID -g $GID -o -s /bin/bash $UNAME -USER $UNAME - RUN wget -O /tmp/bazel.sh https://github.com/bazelbuild/bazel/releases/download/$bazelVersion/bazel-$bazelVersion-installer-linux-x86_64.sh \ && chmod +x /tmp/bazel.sh \ && /tmp/bazel.sh --user -ADD bazelrc /home/$UNAME/.bazelrc -ENV PATH="/home/$UNAME/bin:${PATH}" +ADD bazelrc /root/.bazelrc +ENV PATH="/root/bin:${PATH}" diff --git a/website2/website/scripts/compile-docker.sh b/website2/website/scripts/compile-docker.sh index 2a63e91..b4ba2e3 100755 --- a/website2/website/scripts/compile-docker.sh +++ b/website2/website/scripts/compile-docker.sh @@ -42,8 +42,6 @@ copy_bazel_rc_to() { cp $PROJECT_DIR/../tools/docker/bazel.rc $1 } - - TARGET_PLATFORM="ubuntu18.04" DOCKER_FILE=$(dockerfile_path_for_platform $TARGET_PLATFORM) verify_dockerfile_exists $DOCKER_FILE @@ -54,16 +52,10 @@ echo $DOCKER_FILE echo "Building heron-compiler container" docker build \ - --build-arg UNAME=$USER \ - --build-arg UID=$(id -u ${USER}) \ - --build-arg GID=$(id -g ${USER}) \ -t heron-compiler:$TARGET_PLATFORM -f $DOCKER_FILE . - docker run \ --rm \ - -u `id -u`:`id -g` \ -v $PROJECT_DIR/..:/home/$USER/heron \ - -v /etc/passwd:/etc/passwd \ -t heron-compiler:$TARGET_PLATFORM make -C /home/$USER/heron/website2/website/ buildsite
[incubator-heron] branch joshfischer/update-site-build updated: clean up whitespace
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/update-site-build in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/update-site-build by this push: new 0981313 clean up whitespace 0981313 is described below commit 0981313385353437f90ebe162ade24faf7086149 Author: Josh Fischer AuthorDate: Sat Apr 11 21:08:57 2020 -0500 clean up whitespace --- website2/website/scripts/compile-docker.sh | 3 --- 1 file changed, 3 deletions(-) diff --git a/website2/website/scripts/compile-docker.sh b/website2/website/scripts/compile-docker.sh index 1e96fb3..b4ba2e3 100755 --- a/website2/website/scripts/compile-docker.sh +++ b/website2/website/scripts/compile-docker.sh @@ -42,8 +42,6 @@ copy_bazel_rc_to() { cp $PROJECT_DIR/../tools/docker/bazel.rc $1 } - - TARGET_PLATFORM="ubuntu18.04" DOCKER_FILE=$(dockerfile_path_for_platform $TARGET_PLATFORM) verify_dockerfile_exists $DOCKER_FILE @@ -56,7 +54,6 @@ echo "Building heron-compiler container" docker build \ -t heron-compiler:$TARGET_PLATFORM -f $DOCKER_FILE . - docker run \ --rm \ -v $PROJECT_DIR/..:/home/$USER/heron \
[incubator-heron] branch joshfischer/update-site-build updated: adjust path
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/update-site-build in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/update-site-build by this push: new d71289c adjust path d71289c is described below commit d71289c73ea5a2907591ead86fff19a0c457e04b Author: Josh Fischer AuthorDate: Sat Apr 11 20:48:39 2020 -0500 adjust path --- website2/website/scripts/Dockerfile.ubuntu18.04 | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) diff --git a/website2/website/scripts/Dockerfile.ubuntu18.04 b/website2/website/scripts/Dockerfile.ubuntu18.04 index 0ea84d6..11aab58 100644 --- a/website2/website/scripts/Dockerfile.ubuntu18.04 +++ b/website2/website/scripts/Dockerfile.ubuntu18.04 @@ -52,11 +52,10 @@ RUN apt-get update && apt-get install -y nodejs ENV JAVA_HOME /usr/lib/jvm/java-11-openjdk-amd64 - RUN wget -O /tmp/bazel.sh https://github.com/bazelbuild/bazel/releases/download/$bazelVersion/bazel-$bazelVersion-installer-linux-x86_64.sh \ && chmod +x /tmp/bazel.sh \ && /tmp/bazel.sh --user -ADD bazelrc /$USER/.bazelrc -ENV PATH="/$USER/bin:${PATH}" +ADD bazelrc /root/.bazelrc +ENV PATH="/root/bin:${PATH}"
[incubator-heron] branch joshfischer/update-site-build updated: adjust user settings
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/update-site-build in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/update-site-build by this push: new 91bad7b adjust user settings 91bad7b is described below commit 91bad7b7ab451f667a609969f7d99fc64e39296f Author: Josh Fischer AuthorDate: Sat Apr 11 20:31:13 2020 -0500 adjust user settings --- website2/website/scripts/Dockerfile.ubuntu18.04 | 10 ++ website2/website/scripts/compile-docker.sh | 3 --- 2 files changed, 2 insertions(+), 11 deletions(-) diff --git a/website2/website/scripts/Dockerfile.ubuntu18.04 b/website2/website/scripts/Dockerfile.ubuntu18.04 index 9d16f48..0ea84d6 100644 --- a/website2/website/scripts/Dockerfile.ubuntu18.04 +++ b/website2/website/scripts/Dockerfile.ubuntu18.04 @@ -52,17 +52,11 @@ RUN apt-get update && apt-get install -y nodejs ENV JAVA_HOME /usr/lib/jvm/java-11-openjdk-amd64 -ARG UNAME -ARG UID -ARG GID -RUN groupadd -g $GID -o $UNAME -RUN useradd -m -u $UID -g $GID -o -s /bin/bash $UNAME -USER $UNAME RUN wget -O /tmp/bazel.sh https://github.com/bazelbuild/bazel/releases/download/$bazelVersion/bazel-$bazelVersion-installer-linux-x86_64.sh \ && chmod +x /tmp/bazel.sh \ && /tmp/bazel.sh --user -ADD bazelrc /home/$UNAME/.bazelrc -ENV PATH="/home/$UNAME/bin:${PATH}" +ADD bazelrc /$USER/.bazelrc +ENV PATH="/$USER/bin:${PATH}" diff --git a/website2/website/scripts/compile-docker.sh b/website2/website/scripts/compile-docker.sh index 0c21211..1e96fb3 100755 --- a/website2/website/scripts/compile-docker.sh +++ b/website2/website/scripts/compile-docker.sh @@ -54,9 +54,6 @@ echo $DOCKER_FILE echo "Building heron-compiler container" docker build \ - --build-arg UNAME=$USER \ - --build-arg UID=$(id -u ${USER}) \ - --build-arg GID=$(id -g ${USER}) \ -t heron-compiler:$TARGET_PLATFORM -f $DOCKER_FILE .
[incubator-heron] branch joshfischer/update-site-build updated: adjust user settings
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/update-site-build in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/update-site-build by this push: new 04f8824 adjust user settings 04f8824 is described below commit 04f8824d5fb89618f93ef74debbd02c67feb1f0a Author: Josh Fischer AuthorDate: Sat Apr 11 20:24:02 2020 -0500 adjust user settings --- website2/website/scripts/Dockerfile.ubuntu18.04 | 10 -- website2/website/scripts/compile-docker.sh | 3 +++ 2 files changed, 11 insertions(+), 2 deletions(-) diff --git a/website2/website/scripts/Dockerfile.ubuntu18.04 b/website2/website/scripts/Dockerfile.ubuntu18.04 index 6e7f0b6..9d16f48 100644 --- a/website2/website/scripts/Dockerfile.ubuntu18.04 +++ b/website2/website/scripts/Dockerfile.ubuntu18.04 @@ -52,11 +52,17 @@ RUN apt-get update && apt-get install -y nodejs ENV JAVA_HOME /usr/lib/jvm/java-11-openjdk-amd64 +ARG UNAME +ARG UID +ARG GID +RUN groupadd -g $GID -o $UNAME +RUN useradd -m -u $UID -g $GID -o -s /bin/bash $UNAME +USER $UNAME RUN wget -O /tmp/bazel.sh https://github.com/bazelbuild/bazel/releases/download/$bazelVersion/bazel-$bazelVersion-installer-linux-x86_64.sh \ && chmod +x /tmp/bazel.sh \ && /tmp/bazel.sh --user -ADD bazelrc /home/$USER/.bazelrc -ENV PATH="/home/$USER/bin:${PATH}" +ADD bazelrc /home/$UNAME/.bazelrc +ENV PATH="/home/$UNAME/bin:${PATH}" diff --git a/website2/website/scripts/compile-docker.sh b/website2/website/scripts/compile-docker.sh index 1e96fb3..0c21211 100755 --- a/website2/website/scripts/compile-docker.sh +++ b/website2/website/scripts/compile-docker.sh @@ -54,6 +54,9 @@ echo $DOCKER_FILE echo "Building heron-compiler container" docker build \ + --build-arg UNAME=$USER \ + --build-arg UID=$(id -u ${USER}) \ + --build-arg GID=$(id -g ${USER}) \ -t heron-compiler:$TARGET_PLATFORM -f $DOCKER_FILE .
[incubator-heron] branch joshfischer/update-site-build created (now 7c292bd)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/update-site-build in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 7c292bd remove user params This branch includes the following new commits: new 7c292bd remove user params The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] 01/01: remove user params
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/update-site-build in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 7c292bd77fadabd77fcf04090510239c5a471f10 Author: Josh Fischer AuthorDate: Sat Apr 11 20:01:24 2020 -0500 remove user params --- website2/website/scripts/Dockerfile.ubuntu18.04 | 10 ++ website2/website/scripts/compile-docker.sh | 5 - 2 files changed, 2 insertions(+), 13 deletions(-) diff --git a/website2/website/scripts/Dockerfile.ubuntu18.04 b/website2/website/scripts/Dockerfile.ubuntu18.04 index 9d16f48..6e7f0b6 100644 --- a/website2/website/scripts/Dockerfile.ubuntu18.04 +++ b/website2/website/scripts/Dockerfile.ubuntu18.04 @@ -52,17 +52,11 @@ RUN apt-get update && apt-get install -y nodejs ENV JAVA_HOME /usr/lib/jvm/java-11-openjdk-amd64 -ARG UNAME -ARG UID -ARG GID -RUN groupadd -g $GID -o $UNAME -RUN useradd -m -u $UID -g $GID -o -s /bin/bash $UNAME -USER $UNAME RUN wget -O /tmp/bazel.sh https://github.com/bazelbuild/bazel/releases/download/$bazelVersion/bazel-$bazelVersion-installer-linux-x86_64.sh \ && chmod +x /tmp/bazel.sh \ && /tmp/bazel.sh --user -ADD bazelrc /home/$UNAME/.bazelrc -ENV PATH="/home/$UNAME/bin:${PATH}" +ADD bazelrc /home/$USER/.bazelrc +ENV PATH="/home/$USER/bin:${PATH}" diff --git a/website2/website/scripts/compile-docker.sh b/website2/website/scripts/compile-docker.sh index 2a63e91..1e96fb3 100755 --- a/website2/website/scripts/compile-docker.sh +++ b/website2/website/scripts/compile-docker.sh @@ -54,16 +54,11 @@ echo $DOCKER_FILE echo "Building heron-compiler container" docker build \ - --build-arg UNAME=$USER \ - --build-arg UID=$(id -u ${USER}) \ - --build-arg GID=$(id -g ${USER}) \ -t heron-compiler:$TARGET_PLATFORM -f $DOCKER_FILE . docker run \ --rm \ - -u `id -u`:`id -g` \ -v $PROJECT_DIR/..:/home/$USER/heron \ - -v /etc/passwd:/etc/passwd \ -t heron-compiler:$TARGET_PLATFORM make -C /home/$USER/heron/website2/website/ buildsite
[incubator-heron] branch joshfischer/rollback-fix-site-build created (now 3adce0b)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/rollback-fix-site-build in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 3adce0b rolling back docusaurus version This branch includes the following new commits: new 3adce0b rolling back docusaurus version The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] 01/02: adding additional packages
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/debian10-java11 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 2cd50324c1a7cf68e531ef66f094efa878241c93 Author: Josh Fischer AuthorDate: Sat Mar 7 20:26:22 2020 -0600 adding additional packages --- docker/dist/Dockerfile.dist.debian10 | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docker/dist/Dockerfile.dist.debian10 b/docker/dist/Dockerfile.dist.debian10 index c98412e..ed5f591 100644 --- a/docker/dist/Dockerfile.dist.debian10 +++ b/docker/dist/Dockerfile.dist.debian10 @@ -19,6 +19,7 @@ FROM openjdk:11.0.6-slim-buster RUN apt-get update && apt-get -y install \ automake \ + apt-utils \ build-essential \ cmake \ curl \ @@ -29,6 +30,7 @@ RUN apt-get update && apt-get -y install \ python \ python2.7-dev \ software-properties-common \ + supervisor \ python-setuptools \ tree \ zip \
[incubator-heron] branch joshfischer/debian10-java11 updated (a1368a4 -> 63c263c)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/debian10-java11 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. from a1368a4 move flags to bazel rule new 2cd5032 adding additional packages new 63c263c clean up dist dockerfile The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docker/dist/Dockerfile.dist.debian10 | 16 +++- 1 file changed, 3 insertions(+), 13 deletions(-)
[incubator-heron] 02/02: clean up dist dockerfile
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/debian10-java11 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 63c263cc4cd0ab259c7cd6e3872215eab2e1c4b0 Author: Josh Fischer AuthorDate: Sat Mar 7 21:31:02 2020 -0600 clean up dist dockerfile --- docker/dist/Dockerfile.dist.debian10 | 16 ++-- 1 file changed, 2 insertions(+), 14 deletions(-) diff --git a/docker/dist/Dockerfile.dist.debian10 b/docker/dist/Dockerfile.dist.debian10 index ed5f591..a78d6f9 100644 --- a/docker/dist/Dockerfile.dist.debian10 +++ b/docker/dist/Dockerfile.dist.debian10 @@ -18,24 +18,12 @@ FROM openjdk:11.0.6-slim-buster RUN apt-get update && apt-get -y install \ - automake \ - apt-utils \ - build-essential \ - cmake \ + netcat-openbsd \ curl \ - libssl-dev \ - git \ - libtool \ - libtool-bin \ python \ python2.7-dev \ - software-properties-common \ supervisor \ - python-setuptools \ - tree \ - zip \ - unzip \ - wget + unzip ADD artifacts /heron
[incubator-heron] branch joshfischer/debian10-java11 updated: move flags to bazel rule
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/debian10-java11 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/debian10-java11 by this push: new a1368a4 move flags to bazel rule a1368a4 is described below commit a1368a46b956f5387854e7adb35a5aec22681edc Author: Josh Fischer AuthorDate: Sat Mar 7 09:10:07 2020 -0600 move flags to bazel rule --- docker/compile/Dockerfile.debian10| 2 -- third_party/zookeeper/zookeeper.BUILD | 2 ++ 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/docker/compile/Dockerfile.debian10 b/docker/compile/Dockerfile.debian10 index 691937a..c240b98 100644 --- a/docker/compile/Dockerfile.debian10 +++ b/docker/compile/Dockerfile.debian10 @@ -20,8 +20,6 @@ FROM openjdk:11.0.6-slim-buster # This is passed to the heron build command via the --config flag ENV TARGET_PLATFORM debian ENV bazelVersion 0.26.0 -ENV CFLAGS -Wno-error -ENV CXXFLAGS -Wno-error RUN apt-get update && apt-get -y install \ automake \ diff --git a/third_party/zookeeper/zookeeper.BUILD b/third_party/zookeeper/zookeeper.BUILD index b59fdb1..008cb5b 100644 --- a/third_party/zookeeper/zookeeper.BUILD +++ b/third_party/zookeeper/zookeeper.BUILD @@ -24,6 +24,8 @@ genrule( cmd = "\n".join([ "export INSTALL_DIR=$$(pwd)/$(@D)", "export TMP_DIR=$$(mktemp -d -t zookeeper.X)", +"export CXXFLAGS=-Wno-error", +"export CFLAGS=-Wno-error", "mkdir -p $$TMP_DIR", "cp -R $$(pwd)/external/org_apache_zookeeper/* $$TMP_DIR", "cd $$TMP_DIR/zookeeper-client/zookeeper-client-c",
[incubator-heron] branch joshfischer/debian10-java11 updated: adding c flags
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/debian10-java11 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/debian10-java11 by this push: new ab35f72 adding c flags ab35f72 is described below commit ab35f72a981dd8fd8b950b472c4983c2651e5cc4 Author: Josh Fischer AuthorDate: Sat Mar 7 08:42:11 2020 -0600 adding c flags --- docker/compile/Dockerfile.debian10 | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docker/compile/Dockerfile.debian10 b/docker/compile/Dockerfile.debian10 index c240b98..691937a 100644 --- a/docker/compile/Dockerfile.debian10 +++ b/docker/compile/Dockerfile.debian10 @@ -20,6 +20,8 @@ FROM openjdk:11.0.6-slim-buster # This is passed to the heron build command via the --config flag ENV TARGET_PLATFORM debian ENV bazelVersion 0.26.0 +ENV CFLAGS -Wno-error +ENV CXXFLAGS -Wno-error RUN apt-get update && apt-get -y install \ automake \
[incubator-heron] 01/01: initial debian10 and jdk11
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/debian10-java11 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit c440c1db2276c8025fef4b910e191940c3230e72 Author: Josh Fischer AuthorDate: Sat Mar 7 07:57:49 2020 -0600 initial debian10 and jdk11 --- docker/compile/Dockerfile.debian10 | 47 docker/dist/Dockerfile.dist.debian10 | 69 2 files changed, 116 insertions(+) diff --git a/docker/compile/Dockerfile.debian10 b/docker/compile/Dockerfile.debian10 new file mode 100644 index 000..c240b98 --- /dev/null +++ b/docker/compile/Dockerfile.debian10 @@ -0,0 +1,47 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +#http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. + +FROM openjdk:11.0.6-slim-buster + +# This is passed to the heron build command via the --config flag +ENV TARGET_PLATFORM debian +ENV bazelVersion 0.26.0 + +RUN apt-get update && apt-get -y install \ + automake \ + build-essential \ + cmake \ + curl \ + libssl-dev \ + git \ + libtool \ + libtool-bin \ + python \ + python2.7-dev \ + software-properties-common \ + python-setuptools \ + tree \ + zip \ + unzip \ + wget + +RUN wget -O /tmp/bazel.sh https://github.com/bazelbuild/bazel/releases/download/$bazelVersion/bazel-$bazelVersion-installer-linux-x86_64.sh \ + && chmod +x /tmp/bazel.sh \ + && /tmp/bazel.sh + +ADD bazelrc /root/.bazelrc +ADD scripts/compile-platform.sh /compile-platform.sh diff --git a/docker/dist/Dockerfile.dist.debian10 b/docker/dist/Dockerfile.dist.debian10 new file mode 100644 index 000..c98412e --- /dev/null +++ b/docker/dist/Dockerfile.dist.debian10 @@ -0,0 +1,69 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +#http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. + +FROM openjdk:11.0.6-slim-buster + +RUN apt-get update && apt-get -y install \ + automake \ + build-essential \ + cmake \ + curl \ + libssl-dev \ + git \ + libtool \ + libtool-bin \ + python \ + python2.7-dev \ + software-properties-common \ + python-setuptools \ + tree \ + zip \ + unzip \ + wget + +ADD artifacts /heron + +WORKDIR /heron + +# run heron installer +RUN /heron/heron-install.sh && \ +rm -rf /heron/heron-install.sh && \ +rm -rf /opt/heron/heron-core/lib/scheduler/heron-local-scheduler.jar && \ +rm -rf /opt/heron/heron-core/lib/scheduler/heron-mesos-scheduler.jar && \ +rm -rf /opt/heron/heron-core/lib/scheduler/heron-slurm-scheduler.jar + +RUN ln -s /usr/local/heron/dist/heron-core /heron \ +&& mkdir -p /heron/heron-tools \ +&& ln -s /usr/local/heron/bin /heron/heron-tools \ +&& ln -s /usr/local/heron/conf /heron/heron-tools \ +&& ln -s /usr/local/heron/dist /heron/heron-tools \ +&& ln -s /usr/local/heron/lib /heron/heron-tools \ +&& ln -s /usr/local/heron/release.yaml /heron/heron-tools \ +&& ln -s /usr/local/heron/examples /heron \ +&& ln -s /usr/local/heron/release.yaml /heron + +ENV HERON_HOME /heron/heron-core/ +RUN export HERON_HOME + +# install zookeeper +ARG ZK_DIST=zookeeper-3.4.14 +ADD dist/scripts /opt/heron-docker/scripts + +RUN sh /opt/heron-docker/scripts/install-zookeeper.sh $ZK_DIST + +ADD dist/conf/zookeeper.conf /opt/zookeeper/conf/zookeeper.conf +ADD dist/conf/sandbox.conf /etc/supervisor/conf.d/
[incubator-heron] branch asf-site updated: git-site-role commit from publish_site.sh
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/asf-site by this push: new 8a1ef9b git-site-role commit from publish_site.sh 8a1ef9b is described below commit 8a1ef9bb32f0431e630d5c20cdbe76434a0658bc Author: jenkins AuthorDate: Thu Mar 5 05:32:38 2020 + git-site-role commit from publish_site.sh --- content/api/python/api/api_constants.m.html | 2 +- content/api/python/api/custom_grouping.m.html | 2 +- content/api/python/api/global_metrics.m.html | 2 +- content/api/python/api/metrics.m.html | 2 +- content/api/python/api/serializer.m.html | 2 +- content/api/python/api/state/state.m.html | 2 +- content/api/python/api/state/stateful_component.m.html| 2 +- content/api/python/api/task_hook.m.html | 2 +- content/api/python/api/topology_context.m.html| 2 +- content/api/python/api/tuple.m.html | 2 +- content/api/python/connectors/mock/arraylooper.m.html | 2 +- content/api/python/connectors/textfiles/textfilesgenerator.m.html | 2 +- content/api/python/streamlet/config.m.html| 2 +- content/api/python/streamlet/context.m.html | 2 +- content/api/python/streamlet/impl/contextimpl.m.html | 2 +- content/api/python/streamlet/keyedwindow.m.html | 2 +- content/api/python/streamlet/resources.m.html | 2 +- content/api/python/streamlet/window.m.html| 2 +- content/api/python/streamlet/windowconfig.m.html | 2 +- 19 files changed, 19 insertions(+), 19 deletions(-) diff --git a/content/api/python/api/api_constants.m.html b/content/api/python/api/api_constants.m.html index 3d21f03..b9b9823 100644 --- a/content/api/python/api/api_constants.m.html +++ b/content/api/python/api/api_constants.m.html @@ -1033,7 +1033,7 @@ table { Show source -#!/usr/bin/env python3 +#!/usr/bin/env python # -*- encoding: utf-8 -*- # Licensed to the Apache Software Foundation (ASF) under one diff --git a/content/api/python/api/custom_grouping.m.html b/content/api/python/api/custom_grouping.m.html index fb8da4f..05b4991 100644 --- a/content/api/python/api/custom_grouping.m.html +++ b/content/api/python/api/custom_grouping.m.html @@ -1002,7 +1002,7 @@ table { Show source -#!/usr/bin/env python3 +#!/usr/bin/env python # -*- encoding: utf-8 -*- # Licensed to the Apache Software Foundation (ASF) under one diff --git a/content/api/python/api/global_metrics.m.html b/content/api/python/api/global_metrics.m.html index 7719532..42aaf85 100644 --- a/content/api/python/api/global_metrics.m.html +++ b/content/api/python/api/global_metrics.m.html @@ -1010,7 +1010,7 @@ table { Show source -#!/usr/bin/env python3 +#!/usr/bin/env python # -*- encoding: utf-8 -*- # Licensed to the Apache Software Foundation (ASF) under one diff --git a/content/api/python/api/metrics.m.html b/content/api/python/api/metrics.m.html index 2545c19..481f963 100644 --- a/content/api/python/api/metrics.m.html +++ b/content/api/python/api/metrics.m.html @@ -1099,7 +1099,7 @@ table { Show source -#!/usr/bin/env python3 +#!/usr/bin/env python # -*- encoding: utf-8 -*- # Licensed to the Apache Software Foundation (ASF) under one diff --git a/content/api/python/api/serializer.m.html b/content/api/python/api/serializer.m.html index cfc6dd0..2c834ec 100644 --- a/content/api/python/api/serializer.m.html +++ b/content/api/python/api/serializer.m.html @@ -1021,7 +1021,7 @@ table { Show source -#!/usr/bin/env python3 +#!/usr/bin/env python # -*- encoding: utf-8 -*- # Licensed to the Apache Software Foundation (ASF) under one diff --git a/content/api/python/api/state/state.m.html b/content/api/python/api/state/state.m.html index 704f01d..e37f37a 100644 --- a/content/api/python/api/state/state.m.html +++ b/content/api/python/api/state/state.m.html @@ -1017,7 +1017,7 @@ table { Show source -#!/usr/bin/env python3 +#!/usr/bin/env python # -*- encoding: utf-8 -*- # Licensed to the Apache Software Foundation (ASF) under one diff --git a/content/api/python/api/state/stateful_component.m.html b/content/api/python/api/state/stateful_component.m.html index 20e9cbd..6f261db 100644 --- a/content/api/python/api/state/stateful_component.m.html +++ b/content/api/python/api/state/stateful_component.m.html @@ -1002,7 +1002,7 @@ table { Show source -#!/usr/bin/env python3 +#!/usr/bin/env python # -*- encoding: utf-8 -*- # Licensed to the Apache
[incubator-heron] branch master updated: Improve concurrency for needed parts. (#3107)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new ee1c44a Improve concurrency for needed parts. (#3107) ee1c44a is described below commit ee1c44aefa8a5a5dd4e1effcd736014af70ec3b6 Author: choi se AuthorDate: Thu Mar 5 00:21:08 2020 +0900 Improve concurrency for needed parts. (#3107) * Change concurrent Map * Change concurrent Map * HashMap changes for unneeded parts. * HashMap changes for unneeded parts. * Review changes * Changes HashMap for unneeded parts. * Improve concurrency for needed parts. * Remove unused imports. * Remove unused imports. * Remove unused imports. * Fix NPE (cherry picked from commit 545d3814b315c29d3e396309a2ededaad193ec32) * Fix WhitespaceAround * Add dummy Object * Fix ConstantName (cherry picked from commit 8d6d5067072e92d6e276f93e18297ddedc647c6c) --- .../apache/heron/api/metric/MultiAssignableMetric.java | 3 ++- .../org/apache/heron/api/metric/MultiCountMetric.java | 3 ++- .../apache/heron/api/metric/MultiReducedMetric.java| 3 ++- .../src/java/org/apache/heron/api/tuple/Fields.java| 4 ++-- .../org/apache/heron/common/network/HeronClient.java | 18 ++ .../org/apache/heron/common/network/HeronServer.java | 8 .../heron/common/utils/metrics/MetricsCollector.java | 6 +++--- .../heron/common/utils/misc/PhysicalPlanHelper.java| 3 ++- .../utils/topology/GeneralTopologyContextImpl.java | 5 +++-- .../backtype/storm/metric/api/MultiCountMetric.java| 3 ++- .../backtype/storm/metric/api/MultiReducedMetric.java | 3 ++- .../org/apache/storm/metric/api/MultiCountMetric.java | 3 ++- .../apache/storm/metric/api/MultiReducedMetric.java| 3 ++- 13 files changed, 38 insertions(+), 27 deletions(-) diff --git a/heron/api/src/java/org/apache/heron/api/metric/MultiAssignableMetric.java b/heron/api/src/java/org/apache/heron/api/metric/MultiAssignableMetric.java index d00a93c..c34bc28 100644 --- a/heron/api/src/java/org/apache/heron/api/metric/MultiAssignableMetric.java +++ b/heron/api/src/java/org/apache/heron/api/metric/MultiAssignableMetric.java @@ -21,9 +21,10 @@ package org.apache.heron.api.metric; import java.util.HashMap; import java.util.Map; +import java.util.concurrent.ConcurrentHashMap; public class MultiAssignableMetric implements IMetric> { - private final Map> value = new HashMap<>(); + private final Map> value = new ConcurrentHashMap<>(); private T initialValue; public MultiAssignableMetric(T initialValue) { diff --git a/heron/api/src/java/org/apache/heron/api/metric/MultiCountMetric.java b/heron/api/src/java/org/apache/heron/api/metric/MultiCountMetric.java index 2f2fee0..979037a 100644 --- a/heron/api/src/java/org/apache/heron/api/metric/MultiCountMetric.java +++ b/heron/api/src/java/org/apache/heron/api/metric/MultiCountMetric.java @@ -21,9 +21,10 @@ package org.apache.heron.api.metric; import java.util.HashMap; import java.util.Map; +import java.util.concurrent.ConcurrentHashMap; public class MultiCountMetric implements IMetric> { - private Map value = new HashMap<>(); + private Map value = new ConcurrentHashMap<>(); public MultiCountMetric() { } diff --git a/heron/api/src/java/org/apache/heron/api/metric/MultiReducedMetric.java b/heron/api/src/java/org/apache/heron/api/metric/MultiReducedMetric.java index 9512793..39ed090 100644 --- a/heron/api/src/java/org/apache/heron/api/metric/MultiReducedMetric.java +++ b/heron/api/src/java/org/apache/heron/api/metric/MultiReducedMetric.java @@ -21,6 +21,7 @@ package org.apache.heron.api.metric; import java.util.HashMap; import java.util.Map; +import java.util.concurrent.ConcurrentHashMap; /* * A reduce metric that can hold multiple scoped values. @@ -29,7 +30,7 @@ import java.util.Map; * @param type of reduced value */ public class MultiReducedMetric implements IMetric> { - private Map> value = new HashMap<>(); + private Map> value = new ConcurrentHashMap<>(); private IReducer reducer; public MultiReducedMetric(IReducer reducer) { diff --git a/heron/api/src/java/org/apache/heron/api/tuple/Fields.java b/heron/api/src/java/org/apache/heron/api/tuple/Fields.java index 50e9905..8526c14 100644 --- a/heron/api/src/java/org/apache/heron/api/tuple/Fields.java +++ b/heron/api/src/java/org/apache/heron/api/tuple/Fields.java @@ -22,16 +22,16 @@ package org.apache.heron.api.tuple; import java.io.Serializable; import java.util.ArrayList; import java.util.Arrays; -import java.util.HashMap; import java.util.Iterator; import java.util.List; import java.util.Map; +import java.util.concur
[incubator-heron] branch asf-site updated: git-site-role commit from publish_site.sh
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/asf-site by this push: new 5ccda9f git-site-role commit from publish_site.sh 5ccda9f is described below commit 5ccda9f0be1ab54e0d0af9ca55ac1d10fc078d54 Author: jenkins AuthorDate: Tue Mar 3 02:03:42 2020 + git-site-role commit from publish_site.sh --- .../docs/0.20.0-incubating/compiling-overview.html | 9 --- .../compiling-overview/index.html | 9 --- .../docs/0.20.1-incubating/compiling-overview.html | 9 --- .../compiling-overview/index.html | 9 --- content/docs/compiling-overview.html | 9 --- content/docs/compiling-overview/index.html | 9 --- content/docs/next/compiling-docker.html| 30 +++--- content/docs/next/compiling-docker/index.html | 30 +++--- content/docs/next/compiling-linux.html | 10 content/docs/next/compiling-linux/index.html | 10 content/docs/next/compiling-overview.html | 2 +- content/docs/next/compiling-overview/index.html| 2 +- 12 files changed, 96 insertions(+), 42 deletions(-) diff --git a/content/docs/0.20.0-incubating/compiling-overview.html b/content/docs/0.20.0-incubating/compiling-overview.html index abe151b..6a0e318 100644 --- a/content/docs/0.20.0-incubating/compiling-overview.html +++ b/content/docs/0.20.0-incubating/compiling-overview.html @@ -71,13 +71,14 @@ under the License. --> Heron is currently available for Mac OS X 10.14, -Ubuntu 14.04, and CentOS +Ubuntu 18.04, and CentOS 7. This guide describes the basics of the Heron build system. For step-by-step build instructions for a specific platform, the following guides are available: Building on Linux Platforms -Building on Mac OS X +Building on Mac OS X +Building in Docker Container Heron can be built either in its entirety, as individual components. Instructions on running unit tests for Heron can also be found in Testing Heron. @@ -127,8 +128,8 @@ OS-specific configuration using the --config flag. The following OS are supported: darwin (Mac OS X) -ubuntu (Ubuntu 14.04) -centos5 (CentOS 5) +ubuntu (Ubuntu) +centos (CentOS) For example, on Mac OS X (darwin), the following command will build all packages: diff --git a/content/docs/0.20.0-incubating/compiling-overview/index.html b/content/docs/0.20.0-incubating/compiling-overview/index.html index abe151b..6a0e318 100644 --- a/content/docs/0.20.0-incubating/compiling-overview/index.html +++ b/content/docs/0.20.0-incubating/compiling-overview/index.html @@ -71,13 +71,14 @@ under the License. --> Heron is currently available for Mac OS X 10.14, -Ubuntu 14.04, and CentOS +Ubuntu 18.04, and CentOS 7. This guide describes the basics of the Heron build system. For step-by-step build instructions for a specific platform, the following guides are available: Building on Linux Platforms -Building on Mac OS X +Building on Mac OS X +Building in Docker Container Heron can be built either in its entirety, as individual components. Instructions on running unit tests for Heron can also be found in Testing Heron. @@ -127,8 +128,8 @@ OS-specific configuration using the --config flag. The following OS are supported: darwin (Mac OS X) -ubuntu (Ubuntu 14.04) -centos5 (CentOS 5) +ubuntu (Ubuntu) +centos (CentOS) For example, on Mac OS X (darwin), the following command will build all packages: diff --git a/content/docs/0.20.1-incubating/compiling-overview.html b/content/docs/0.20.1-incubating/compiling-overview.html index 47d6913..b73928b 100644 --- a/content/docs/0.20.1-incubating/compiling-overview.html +++ b/content/docs/0.20.1-incubating/compiling-overview.html @@ -71,13 +71,14 @@ under the License. --> Heron is currently available for Mac OS X 10.14, -Ubuntu 14.04, and CentOS +Ubuntu 18.04, and CentOS 7. This guide describes the basics of the Heron build system. For step-by-step build instructions for a specific platform, the following guides are available: Building on Linux Platforms -Building on Mac OS X +Building on Mac OS X +Building in Docker Container Heron can be built either in its entirety, as individual components. Instructions on running unit tests for Heron can also be found in Testing Heron. @@ -127,8 +128,8 @@ OS-specific configuration using the --config flag. The following OS are supported: darwin (Mac OS X) -ubuntu (Ubuntu 14.04) -centos5 (CentOS 5) +ubuntu (Ubuntu) +centos (CentOS) For example, on Mac OS X (darwin), the following command will build all packages: diff --git a/content/docs/0.20.1-incubating/compiling-overview/index.html b/content/docs/0.20.1-incubating/compiling-overview/index.html index 47d6913..b73928b 100644 ---
[incubator-heron] branch master updated (db255f4 -> 0a6cecb)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. from db255f4 removing symlink. Adding contributing guidelines back (#3450) add 0a6cecb adding examples folder to classpath (#3458) No new revisions were added by this update. Summary of changes: scripts/get_all_heron_paths.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[incubator-heron] branch master updated: removing symlink. Adding contributing guidelines back (#3450)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new db255f4 removing symlink. Adding contributing guidelines back (#3450) db255f4 is described below commit db255f414babaac7b5acd551efd494d856b07bbd Author: Josh Fischer AuthorDate: Fri Feb 14 06:53:48 2020 -0600 removing symlink. Adding contributing guidelines back (#3450) * removing symlink. Adding contributing guidelines back * clean up --- CONTRIBUTING.md | 75 - 1 file changed, 74 insertions(+), 1 deletion(-) diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md deleted file mode 12 index d59cc78..000 --- a/CONTRIBUTING.md +++ /dev/null @@ -1 +0,0 @@ -website/content/docs/contributors/community.md \ No newline at end of file diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md new file mode 100644 index 000..0ed694b --- /dev/null +++ b/CONTRIBUTING.md @@ -0,0 +1,74 @@ + + +## Contributing to Heron + +Discussion about Heron happens on GitHub and over the mailing list. + +* GitHub: [apache/incubator-heron](https://github.com/apache/incubator-heron) +* Heron User Group: [u...@heron.incubator.apache.org](https://mail-archives.apache.org/mod_mbox/heron-user/) + +Community is critical to Heron. Contributions are welcomed! + + +## How Can I Contribute to Heron? + +You can first read the following pages to have a basic understanding +of Heron: + +* [Heron Architecture](https://heron.incubator.apache.org/docs/heron-architecture/) +* [Compiling Heron](https://heron.incubator.apache.org/docs/compiling-overview/) +* [Heron Codebase](https://heron.incubator.apache.org/docs/compiling-code-organization/) + +Heron includes a script to bootstrap an IntelliJ IDEA project. The project includes support for Heron +code styles and copyright headers. + +To bootstrap an IDEA project run the following from the root folder of the repo:: + +```bash +$ ./scripts/setup-intellij.sh +``` +To bootstrap an Eclipse project fun the following from the root folder of the repo: + +```bash +$ ./scripts/setup-eclipse.sh +``` + +In general, contributions that fix bugs or add features (as opposed to stylistic, refactoring, or +"cleanup" changes) are preferred. If you're looking for places to contribute, issues with label +[help-wanted](https://github.com/apache/incubator-heron/issues?q=is%3Aopen+is%3Aissue+label%3Ahelp-wanted) +are good candidates. Please check with the [mailing list](https://mail-archives.apache.org/mod_mbox/heron-dev/) +if your patch involves lots of changes. + +**If you have any question or issues about troubleshooting**, +you should post on [mailing list](https://mail-archives.apache.org/mod_mbox/heron-user/) instead +of opening GitHub issues. + +### Submitting a Patch +1. Discuss your plan and design, and get agreement on +[mailing list](https://mail-archives.apache.org/mod_mbox/heron-dev/). + +2. Implement proper unit tests along with your change. Verify that all tests can pass. + +3. Submit a GitHub pull request that includes your change and test cases. +Describe clearly in your pull request the changes made. Verify that Travis CI passes. + +4. Complete a code review by addressing the reviewer's comments. + +5. A project committer will merge the patch to the master branch. \ No newline at end of file
[incubator-heron] branch master updated: adding new committers (#3451)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new 783581b adding new committers (#3451) 783581b is described below commit 783581bb146a2334b124e57e285dfbdd3b0e4eeb Author: Josh Fischer AuthorDate: Thu Feb 13 21:40:18 2020 -0600 adding new committers (#3451) --- website2/website/data/team.js | 12 1 file changed, 12 insertions(+) diff --git a/website2/website/data/team.js b/website2/website/data/team.js index 7929339..52f59e9 100644 --- a/website2/website/data/team.js +++ b/website2/website/data/team.js @@ -21,6 +21,10 @@ module.exports = { apacheId: 'cckellogg', }, { +name: 'Dmitry Rusakov', +apacheId: 'dnrusakov', + }, + { name: 'Eren Avsarogullari', apacheId: 'erenavsar', }, @@ -53,6 +57,10 @@ module.exports = { apacheId: 'maosongfu', }, { +name: "Nick Nezis", +apacheId: "nicknezis" + }, + { name: 'Neng Lu', apacheId: 'nlu90', }, @@ -69,6 +77,10 @@ module.exports = { apacheId: 'ptgoetz', }, { +name: 'Simon Weng', +apacheId: 'simingweng', + }, + { name: 'Sree Vaddi', apacheId: 'sreev', },
[incubator-heron] branch gh-pages updated: remove broken symlink
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/gh-pages by this push: new 3401ac2 remove broken symlink 3401ac2 is described below commit 3401ac23b0f0a20326689324c05f3ee4a537c81e Author: Josh Fischer AuthorDate: Tue Feb 11 20:54:01 2020 -0600 remove broken symlink --- CONTRIBUTING.md | 1 - 1 file changed, 1 deletion(-) diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md deleted file mode 12 index d59cc78..000 --- a/CONTRIBUTING.md +++ /dev/null @@ -1 +0,0 @@ -website/content/docs/contributors/community.md \ No newline at end of file
[incubator-heron] branch gh-pages updated: change branch
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/gh-pages by this push: new 3284779 change branch 3284779 is described below commit 3284779709fc30d4b03ec8a596500666450d3732 Author: Josh Fischer AuthorDate: Tue Feb 11 18:47:49 2020 -0600 change branch --- .asf.yaml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.asf.yaml b/.asf.yaml index 2c440bc..6e2112a 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -24,7 +24,7 @@ publish: github: description: "Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter" - ghp_branch: master + ghp_branch: gh-pages ghp_path: ~ homepage: https://heron.incubator.apache.org/ labels:
[incubator-heron] branch gh-pages created (now d179c83)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch gh-pages in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at d179c83 Bump mixin-deep from 1.3.1 to 1.3.2 in /website2/website (#3391) No new revisions were added by this update.
[incubator-heron] branch master updated: Bump mixin-deep from 1.3.1 to 1.3.2 in /website2/website (#3391)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new d179c83 Bump mixin-deep from 1.3.1 to 1.3.2 in /website2/website (#3391) d179c83 is described below commit d179c838f0b7b0d4fb92c0166c80464836a16acb Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Mon Feb 10 12:38:24 2020 -0600 Bump mixin-deep from 1.3.1 to 1.3.2 in /website2/website (#3391) Bumps [mixin-deep](https://github.com/jonschlinkert/mixin-deep) from 1.3.1 to 1.3.2. - [Release notes](https://github.com/jonschlinkert/mixin-deep/releases) - [Commits](https://github.com/jonschlinkert/mixin-deep/compare/1.3.1...1.3.2) Signed-off-by: dependabot[bot] --- website2/website/package-lock.json | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/website2/website/package-lock.json b/website2/website/package-lock.json index 0b92916..d513d1e 100644 --- a/website2/website/package-lock.json +++ b/website2/website/package-lock.json @@ -5682,9 +5682,9 @@ "dev": true }, "mixin-deep": { - "version": "1.3.1", - "resolved": "https://registry.npmjs.org/mixin-deep/-/mixin-deep-1.3.1.tgz;, - "integrity": "sha512-8ZItLHeEgaqEvd5lYBXfm4EZSFCX29Jb9K+lAHhDKzReKBQKj3R+7NOF6tjqYi9t4oI8VUfaWITJQm86wnXGNQ==", + "version": "1.3.2", + "resolved": "https://registry.npmjs.org/mixin-deep/-/mixin-deep-1.3.2.tgz;, + "integrity": "sha512-WRoDn//mXBiJ1H40rqa3vH0toePwSsGb45iInWlTySa+Uu4k3tYUSxa2v1KqAiLtvlrSzaExqS1gtk96A9zvEA==", "dev": true, "requires": { "for-in": "^1.0.2",
[incubator-heron] 01/01: fixing sandbox properties
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/debian9 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 29328c6a3e16bfb9a6c448282bc156feba6d85b2 Author: Josh Fischer AuthorDate: Thu Feb 6 22:16:21 2020 -0600 fixing sandbox properties --- docker/dist/conf/sandbox.conf | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docker/dist/conf/sandbox.conf b/docker/dist/conf/sandbox.conf index 8c755f8..d5d99a2 100644 --- a/docker/dist/conf/sandbox.conf +++ b/docker/dist/conf/sandbox.conf @@ -1,10 +1,10 @@ [program:heron-tracker] -command = /usr/local/bin/heron-tracker --rootpath ~/.herondata/repository/state/sandbox +command = /usr/local/bin/heron-tracker --rootpath ~/.herondata/repository/state/local [program:heron-ui] command = /usr/local/bin/heron-ui [program:heron-api-server] -command = /usr/local/bin/heron-apiserver --base-template=local --cluster=sandbox -Dheron.directory.home=/usr/local/heron +command = /usr/local/bin/heron-apiserver --base-template=local --cluster=local -Dheron.directory.home=/usr/local/heron autorestart = false
[incubator-heron] branch joshfischer/debian9 created (now 29328c6)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/debian9 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 29328c6 fixing sandbox properties This branch includes the following new commits: new 29328c6 fixing sandbox properties The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] branch master updated: Add redirect from github pages to new apache site (#3448)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new c9d18e6 Add redirect from github pages to new apache site (#3448) c9d18e6 is described below commit c9d18e66a24aa82d89a11734104f2125dcc6305d Author: Josh Fischer AuthorDate: Mon Feb 10 06:15:15 2020 -0600 Add redirect from github pages to new apache site (#3448) * adding redirect for gh pages * updating asf.yaml to use redirect * correct page title. remove hostname * update index * update asf.yaml and index * removing theme --- .asf.yaml | 3 ++- index.html | 7 +++ 2 files changed, 9 insertions(+), 1 deletion(-) diff --git a/.asf.yaml b/.asf.yaml index 649d87a..2c440bc 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -21,10 +21,11 @@ staging: publish: whoami: asf-site - hostname: http://heronstreaming.io github: description: "Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter" + ghp_branch: master + ghp_path: ~ homepage: https://heron.incubator.apache.org/ labels: - heron diff --git a/index.html b/index.html index 8b4b942..4ca1b4e 100644 --- a/index.html +++ b/index.html @@ -18,5 +18,12 @@ under the License. --> + +https://heron.incubator.apache.org; /> +goto heron.incubator.apache.org + + +This is a landing page for the main heron.incubator.apache.org website. Click https://heron.incubator.apache.org;>here to go to the main site if it does not redirect you automatically. +
[incubator-heron] branch gh-pages updated: removing theme
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/gh-pages by this push: new e4bd92b removing theme e4bd92b is described below commit e4bd92b72e9136a55cc65a47e5dc1aede86a03ac Author: Josh Fischer AuthorDate: Fri Feb 7 13:32:27 2020 -0600 removing theme --- _config.yml | 1 - 1 file changed, 1 deletion(-) diff --git a/_config.yml b/_config.yml deleted file mode 100644 index 277f1f2..000 --- a/_config.yml +++ /dev/null @@ -1 +0,0 @@ -theme: jekyll-theme-cayman
[incubator-heron] branch gh-pages updated: update asf.yaml and index
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/gh-pages by this push: new 5eba82c update asf.yaml and index 5eba82c is described below commit 5eba82c8e3eaee02d1ef87fad0a51904255cb64a Author: Josh Fischer AuthorDate: Fri Feb 7 13:23:23 2020 -0600 update asf.yaml and index --- .asf.yaml | 3 ++- index.html | 2 +- 2 files changed, 3 insertions(+), 2 deletions(-) diff --git a/.asf.yaml b/.asf.yaml index 400c68e..2c440bc 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -24,7 +24,8 @@ publish: github: description: "Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter" - ghp_branch: gh-pages + ghp_branch: master + ghp_path: ~ homepage: https://heron.incubator.apache.org/ labels: - heron diff --git a/index.html b/index.html index 65f8d3e..4ca1b4e 100644 --- a/index.html +++ b/index.html @@ -23,7 +23,7 @@ under the License. goto heron.incubator.apache.org -this is a landing page for the main heron.incubator.apache.org website. Click https://heron.incubator.apache.org;>here to go to the main site. +This is a landing page for the main heron.incubator.apache.org website. Click https://heron.incubator.apache.org;>here to go to the main site if it does not redirect you automatically.
[incubator-heron] branch gh-pages updated: update index
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/gh-pages by this push: new 8ead429 update index 8ead429 is described below commit 8ead4292d0ccd899041f8ef7e2d6a462c0edcc03 Author: Josh Fischer AuthorDate: Fri Feb 7 13:17:35 2020 -0600 update index --- index.html | 11 +++ 1 file changed, 7 insertions(+), 4 deletions(-) diff --git a/index.html b/index.html index 3a05986..65f8d3e 100644 --- a/index.html +++ b/index.html @@ -18,9 +18,12 @@ under the License. --> - -Redirecting to https://heron.incubator.apache.org -https://heron.incubator.apache.org/;> -https://heron.incubator.apache.org;> + +https://heron.incubator.apache.org; /> +goto heron.incubator.apache.org + + +this is a landing page for the main heron.incubator.apache.org website. Click https://heron.incubator.apache.org;>here to go to the main site. +
[incubator-heron] branch master updated: Added execute permission to dev-env-create.sh (#3443)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new f7371e1 Added execute permission to dev-env-create.sh (#3443) f7371e1 is described below commit f7371e1d33390ede1bde471aca7085e92dc3e08b Author: Nicholas Nezis AuthorDate: Fri Feb 7 12:36:35 2020 -0500 Added execute permission to dev-env-create.sh (#3443) --- docker/scripts/dev-env-create.sh | 0 1 file changed, 0 insertions(+), 0 deletions(-) diff --git a/docker/scripts/dev-env-create.sh b/docker/scripts/dev-env-create.sh old mode 100644 new mode 100755
[incubator-heron] branch remove-old-site created (now 62a3ef9)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch remove-old-site in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 62a3ef9 remove old site This branch includes the following new commits: new 62a3ef9 remove old site The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] branch gh-pages updated: correct page title. remove hostname
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/gh-pages by this push: new 2505e39 correct page title. remove hostname 2505e39 is described below commit 2505e395aed302108322a355d0b2f25796a83f06 Author: Josh Fischer AuthorDate: Thu Feb 6 21:28:06 2020 -0600 correct page title. remove hostname --- .asf.yaml | 1 - index.html | 2 +- 2 files changed, 1 insertion(+), 2 deletions(-) diff --git a/.asf.yaml b/.asf.yaml index b5fc06e..400c68e 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -21,7 +21,6 @@ staging: publish: whoami: asf-site - hostname: http://heronstreaming.io github: description: "Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter" diff --git a/index.html b/index.html index 7f97cfe..3a05986 100644 --- a/index.html +++ b/index.html @@ -19,7 +19,7 @@ under the License. -Redirecting to https://example.com/ +Redirecting to https://heron.incubator.apache.org https://heron.incubator.apache.org/;> https://heron.incubator.apache.org;>
[incubator-heron] branch joshfischer/debian-container updated: adding flag for c
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/debian-container in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/debian-container by this push: new 5f8675f adding flag for c 5f8675f is described below commit 5f8675fd58302375c12f0c4ffdfb32b4b77b642d Author: Josh Fischer AuthorDate: Thu Feb 6 08:52:40 2020 -0600 adding flag for c --- third_party/zookeeper/zookeeper.BUILD | 1 + 1 file changed, 1 insertion(+) diff --git a/third_party/zookeeper/zookeeper.BUILD b/third_party/zookeeper/zookeeper.BUILD index 79c42b3..008cb5b 100644 --- a/third_party/zookeeper/zookeeper.BUILD +++ b/third_party/zookeeper/zookeeper.BUILD @@ -25,6 +25,7 @@ genrule( "export INSTALL_DIR=$$(pwd)/$(@D)", "export TMP_DIR=$$(mktemp -d -t zookeeper.X)", "export CXXFLAGS=-Wno-error", +"export CFLAGS=-Wno-error", "mkdir -p $$TMP_DIR", "cp -R $$(pwd)/external/org_apache_zookeeper/* $$TMP_DIR", "cd $$TMP_DIR/zookeeper-client/zookeeper-client-c",
[incubator-heron] branch joshfischer/debian-container updated: export
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/debian-container in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/debian-container by this push: new eeed867 export eeed867 is described below commit eeed86745079d94249dd9bd5a9ab6a2c130cf1ad Author: Josh Fischer AuthorDate: Thu Feb 6 07:21:13 2020 -0600 export --- third_party/zookeeper/zookeeper.BUILD | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/third_party/zookeeper/zookeeper.BUILD b/third_party/zookeeper/zookeeper.BUILD index 1700d0f..79c42b3 100644 --- a/third_party/zookeeper/zookeeper.BUILD +++ b/third_party/zookeeper/zookeeper.BUILD @@ -24,7 +24,7 @@ genrule( cmd = "\n".join([ "export INSTALL_DIR=$$(pwd)/$(@D)", "export TMP_DIR=$$(mktemp -d -t zookeeper.X)", -"export CXXFLAGS=\"-Wno-error\"", +"export CXXFLAGS=-Wno-error", "mkdir -p $$TMP_DIR", "cp -R $$(pwd)/external/org_apache_zookeeper/* $$TMP_DIR", "cd $$TMP_DIR/zookeeper-client/zookeeper-client-c",
[incubator-heron] branch joshfischer/debian-container updated: moving exports to rule
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/debian-container in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/debian-container by this push: new f835b67 moving exports to rule f835b67 is described below commit f835b677ca889498c51ebf8b82a7d6d484349847 Author: Josh Fischer AuthorDate: Thu Feb 6 07:02:15 2020 -0600 moving exports to rule --- docker/compile/Dockerfile.debian9 | 2 -- third_party/zookeeper/zookeeper.BUILD | 1 + 2 files changed, 1 insertion(+), 2 deletions(-) diff --git a/docker/compile/Dockerfile.debian9 b/docker/compile/Dockerfile.debian9 index 9ee2fac..2a3e70a 100644 --- a/docker/compile/Dockerfile.debian9 +++ b/docker/compile/Dockerfile.debian9 @@ -20,8 +20,6 @@ FROM openjdk:8-jdk-slim # This is passed to the heron build command via the --config flag ENV TARGET_PLATFORM debian ENV bazelVersion 0.26.0 -ENV CFLAGS -Wno-error -ENV CXXFLAGS -Wno-error RUN apt-get update && apt-get -y install \ automake \ diff --git a/third_party/zookeeper/zookeeper.BUILD b/third_party/zookeeper/zookeeper.BUILD index b59fdb1..1700d0f 100644 --- a/third_party/zookeeper/zookeeper.BUILD +++ b/third_party/zookeeper/zookeeper.BUILD @@ -24,6 +24,7 @@ genrule( cmd = "\n".join([ "export INSTALL_DIR=$$(pwd)/$(@D)", "export TMP_DIR=$$(mktemp -d -t zookeeper.X)", +"export CXXFLAGS=\"-Wno-error\"", "mkdir -p $$TMP_DIR", "cp -R $$(pwd)/external/org_apache_zookeeper/* $$TMP_DIR", "cd $$TMP_DIR/zookeeper-client/zookeeper-client-c",
[incubator-heron] branch joshfischer/debian-container created (now 6b8ac05)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/debian-container in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 6b8ac05 adding ignore warning flags This branch includes the following new commits: new 6b8ac05 adding ignore warning flags The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] 01/01: adding ignore warning flags
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/debian-container in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 6b8ac059c126b9a652a995c059a7ed993fa2bb68 Author: Josh Fischer AuthorDate: Wed Feb 5 22:40:20 2020 -0600 adding ignore warning flags --- docker/compile/Dockerfile.debian9 | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docker/compile/Dockerfile.debian9 b/docker/compile/Dockerfile.debian9 index 2a3e70a..9ee2fac 100644 --- a/docker/compile/Dockerfile.debian9 +++ b/docker/compile/Dockerfile.debian9 @@ -20,6 +20,8 @@ FROM openjdk:8-jdk-slim # This is passed to the heron build command via the --config flag ENV TARGET_PLATFORM debian ENV bazelVersion 0.26.0 +ENV CFLAGS -Wno-error +ENV CXXFLAGS -Wno-error RUN apt-get update && apt-get -y install \ automake \
[incubator-heron] branch gh-pages updated: updating asf.yaml to use redirect
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/gh-pages by this push: new 2307d96 updating asf.yaml to use redirect 2307d96 is described below commit 2307d96ca41c8d8d8842678647f2b77510590641 Author: Josh Fischer AuthorDate: Mon Feb 3 12:06:00 2020 -0600 updating asf.yaml to use redirect --- .asf.yaml | 1 + 1 file changed, 1 insertion(+) diff --git a/.asf.yaml b/.asf.yaml index 649d87a..b5fc06e 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -25,6 +25,7 @@ publish: github: description: "Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter" + ghp_branch: gh-pages homepage: https://heron.incubator.apache.org/ labels: - heron
[incubator-heron] branch gh-pages created (now 2db6366)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch gh-pages in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 2db6366 adding redirect for gh pages This branch includes the following new commits: new 2db6366 adding redirect for gh pages The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] 01/01: adding redirect for gh pages
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch gh-pages in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 2db6366bfcbd5e9b97665163732d206574c19883 Author: Josh Fischer AuthorDate: Mon Feb 3 11:52:34 2020 -0600 adding redirect for gh pages --- _config.yml | 1 + index.html | 4 2 files changed, 5 insertions(+) diff --git a/_config.yml b/_config.yml new file mode 100644 index 000..277f1f2 --- /dev/null +++ b/_config.yml @@ -0,0 +1 @@ +theme: jekyll-theme-cayman diff --git a/index.html b/index.html index 8b4b942..7f97cfe 100644 --- a/index.html +++ b/index.html @@ -18,5 +18,9 @@ under the License. --> + +Redirecting to https://example.com/ +https://heron.incubator.apache.org/;> +https://heron.incubator.apache.org;>
[incubator-heron] branch master updated: Updated to use default Kubernetes client discovery logic (#3432)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new 91dbabf Updated to use default Kubernetes client discovery logic (#3432) 91dbabf is described below commit 91dbabfd3bac627f0a1a537f35b007c6378874f5 Author: Nicholas Nezis AuthorDate: Thu Jan 16 21:34:11 2020 -0500 Updated to use default Kubernetes client discovery logic (#3432) * Updated to use default Kubernetes client discovery logic * Removed kubectl-proxy container * Remove kubectl-proxy image property * Syntax cleanup * Added missing kubernetes dependency --- deploy/kubernetes/general/apiserver.yaml | 11 ++ .../kubernetes/general/bookkeeper.statefulset.yaml | 3 ++- .../general/bookkeeper.statefulset_empty.yaml | 2 +- deploy/kubernetes/general/bookkeeper.yaml | 3 +-- deploy/kubernetes/general/tools.yaml | 2 +- deploy/kubernetes/general/zookeeper.yaml | 3 +-- deploy/kubernetes/gke/gcs-apiserver.yaml | 9 deploy/kubernetes/helm/templates/bookie.yaml | 4 ++-- deploy/kubernetes/helm/templates/tools.yaml| 9 ++-- deploy/kubernetes/helm/values.yaml.template| 1 - deploy/kubernetes/minikube/apiserver.yaml | 11 ++ .../scheduler/kubernetes/AppsV1Controller.java | 24 ++ .../scheduler/kubernetes/KubernetesCompat.java | 14 +++-- heron/schedulers/tests/java/BUILD | 1 + 14 files changed, 43 insertions(+), 54 deletions(-) diff --git a/deploy/kubernetes/general/apiserver.yaml b/deploy/kubernetes/general/apiserver.yaml index 470dff3..6e0cc97 100644 --- a/deploy/kubernetes/general/apiserver.yaml +++ b/deploy/kubernetes/general/apiserver.yaml @@ -27,7 +27,6 @@ metadata: namespace: default --- - apiVersion: rbac.authorization.k8s.io/v1beta1 kind: ClusterRoleBinding metadata: @@ -44,7 +43,6 @@ subjects: namespace: default --- - apiVersion: apps/v1 kind: Deployment metadata: @@ -97,13 +95,8 @@ spec: -D heron.uploader.dlog.topologies.namespace.uri=distributedlog://zookeeper:2181/heron -D heron.statefulstorage.classname=org.apache.heron.statefulstorage.dlog.DlogStorage -D heron.statefulstorage.dlog.namespace.uri=distributedlog://zookeeper:2181/heron -- name: kubectl-proxy - image: heron/kubectl:latest - command: ["sh", "-c"] - args: -- > - kubectl proxy -p 8001 + +--- apiVersion: v1 kind: Service metadata: diff --git a/deploy/kubernetes/general/bookkeeper.statefulset.yaml b/deploy/kubernetes/general/bookkeeper.statefulset.yaml index e5c9fe2..24d1ec2 100644 --- a/deploy/kubernetes/general/bookkeeper.statefulset.yaml +++ b/deploy/kubernetes/general/bookkeeper.statefulset.yaml @@ -34,8 +34,8 @@ data: #BK_statsProviderClass: org.apache.bookkeeper.stats.prometheus.PrometheusMetricsProvider # use hostname as bookie id for StatefulSets deployment BK_useHostNameAsBookieID: "true" +--- apiVersion: apps/v1 kind: StatefulSet metadata: @@ -122,6 +122,7 @@ spec: resources: requests: storage: 10Gi + --- # A headless service to create DNS records apiVersion: v1 diff --git a/deploy/kubernetes/general/bookkeeper.statefulset_empty.yaml b/deploy/kubernetes/general/bookkeeper.statefulset_empty.yaml index 90a158f..4c3fcb9 100644 --- a/deploy/kubernetes/general/bookkeeper.statefulset_empty.yaml +++ b/deploy/kubernetes/general/bookkeeper.statefulset_empty.yaml @@ -34,8 +34,8 @@ data: #BK_statsProviderClass: org.apache.bookkeeper.stats.prometheus.PrometheusMetricsProvider # use hostname as bookie id for StatefulSets deployment BK_useHostNameAsBookieID: "true" +--- apiVersion: apps/v1 kind: StatefulSet metadata: diff --git a/deploy/kubernetes/general/bookkeeper.yaml b/deploy/kubernetes/general/bookkeeper.yaml index 2ba4891..f757bf6 100644 --- a/deploy/kubernetes/general/bookkeeper.yaml +++ b/deploy/kubernetes/general/bookkeeper.yaml @@ -32,8 +32,8 @@ data: BK_zkServers: zookeeper # TODO: Issue 458: https://github.com/apache/bookkeeper/issues/458 #BK_statsProviderClass: org.apache.bookkeeper.stats.PrometheusMetricsProvider +--- ## BookKeeper servers need to access the local disks and the pods ## cannot be moved across different nodes. ## For this reason, we run BK as a daemon set, one for each node in the @@ -107,7 +107,6 @@ spec: path: /mnt/disks/ssd1 --- - ## ## Define the Bookie headless service ## In practice, in this case, it is only useful to have a view of diff --git a/deploy/kubernetes/general/tools.yaml b/deploy/kubernetes/gener
[incubator-heron] branch master updated: Updated Helm to 3.0.2 (#3430)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new 485b708 Updated Helm to 3.0.2 (#3430) 485b708 is described below commit 485b708797f47a3a2202aa152c024218e4e6992e Author: Nicholas Nezis AuthorDate: Fri Jan 10 09:28:50 2020 -0500 Updated Helm to 3.0.2 (#3430) --- WORKSPACE | 8 +-- scripts/packages/BUILD| 1 - website2/docs/schedulers-k8s-with-helm.md | 81 +++ 3 files changed, 43 insertions(+), 47 deletions(-) diff --git a/WORKSPACE b/WORKSPACE index 0c26015..e29118d 100644 --- a/WORKSPACE +++ b/WORKSPACE @@ -937,18 +937,18 @@ http_archive( # for helm http_archive( name = "helm_mac", -urls = ["https://storage.googleapis.com/kubernetes-helm/helm-v2.7.2-darwin-amd64.tar.gz;], +urls = ["https://get.helm.sh/helm-v3.0.2-darwin-amd64.tar.gz;], strip_prefix = "darwin-amd64", build_file = "@//:third_party/helm/helm.BUILD", -sha256 = "5058142bcd6e16b7e01695a8f258d27ae0b6469caf227ddf6aa2181405e6aa8e", +sha256 = "05c7748da0ea8d5f85576491cd3c615f94063f20986fd82a0f5658ddc286cdb1", ) http_archive( name = "helm_linux", -urls = ["https://storage.googleapis.com/kubernetes-helm/helm-v2.7.2-linux-amd64.tar.gz;], +urls = ["https://get.helm.sh/helm-v3.0.2-linux-amd64.tar.gz;], strip_prefix = "linux-amd64", build_file = "@//:third_party/helm/helm.BUILD", -sha256 = "9f04c4824fc751d6c932ae5b93f7336eae06e78315352aa80241066aa1d66c49", +sha256 = "c6b7aa7e4ffc66e8abb4be328f71d48c643cb8f398d95c74d075cfb348710e1d", ) # end helm diff --git a/scripts/packages/BUILD b/scripts/packages/BUILD index 2abf998..35bf265 100644 --- a/scripts/packages/BUILD +++ b/scripts/packages/BUILD @@ -693,7 +693,6 @@ genrule( 'mv $$HELM_DIR/*.txt $$HELM_DIR/*.tpl $$HELM_DIR/templates', 'rm $$HELM_DIR/Chart.yaml.template $$HELM_DIR/values.yaml.template $$HELM_DIR/release.yaml', 'tree $$HELM_DIR', -'$(location //third_party/helm:helm) init --client-only', '$(location //third_party/helm:helm) package $$HELM_DIR', 'mv *.tgz heron-charts', '$(location //third_party/helm:helm) repo index heron-charts --url https://storage.googleapis.com/heron-charts', diff --git a/website2/docs/schedulers-k8s-with-helm.md b/website2/docs/schedulers-k8s-with-helm.md index be499b1..61c315f 100644 --- a/website2/docs/schedulers-k8s-with-helm.md +++ b/website2/docs/schedulers-k8s-with-helm.md @@ -50,47 +50,43 @@ $ brew install kubernetes-helm You can install Helm on Linux using a simple installation script: ```bash -$ curl https://raw.githubusercontent.com/kubernetes/helm/master/scripts/get > install-helm.sh -$ chmod 700 install-helm.sh -$ ./install-helm.sh +$ curl -fsSL -o get_helm.sh https://raw.githubusercontent.com/helm/helm/master/scripts/get-helm-3 +$ chmod 700 get_helm.sh +$ ./get_helm.sh ``` -## Installing Helm in your Kubernetes cluster +## Installing Heron on Kubernetes -To run Helm on Kubernetes, you need to first make sure that [kubectl](https://kubernetes.io/docs/tasks/tools/install-kubectl) is using the right configuration context for your cluster. To check which context is being used: +To use Helm with Kubernetes, you need to first make sure that [kubectl](https://kubernetes.io/docs/tasks/tools/install-kubectl) is using the right configuration context for your cluster. To check which context is being used: ```bash $ kubectl config current-context ``` -If the context is correct, then you can get Helm running using just one command: +Once you've installed the Helm client on your machine and gotten Helm pointing to your Kubernetes cluster, you need to make your client aware of the `heron-charts` Helm repository, which houses the chart for Heron: ```bash -$ helm init +$ helm repo add heron-charts https://storage.googleapis.com/heron-charts +"heron-charts" has been added to your repositories ``` -If the output of that command includes `Happy Helming!` then Helm is ready to go. - -## Installing Heron on Kubernetes - -Once you've installed the Helm client on your machine and gotten Helm running in your Kubernetes cluster, you need to make your client aware of the `heron-charts` Helm repository, which houses the chart for Heron: +Create a namespace to install into: ```bash -$ helm repo add heron-charts https://storage.googleapis.com/heron-charts -"heron-charts" has been added to your repositories +$ kubectl create namespace heron ``` Now you can install the Heron package: ```bash -$ helm install heron-charts/heron +$ helm install heron-charts/heron
[incubator-heron] branch master updated (2f0c1db -> e51f265)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. from 2f0c1db update readme (#3429) add e51f265 Updated to support Kubernetes 1.16 (#3426) No new revisions were added by this update. Summary of changes: WORKSPACE | 18 +-- deploy/kubernetes/general/apiserver.yaml | 2 +- .../kubernetes/general/bookkeeper.statefulset.yaml | 12 +- .../general/bookkeeper.statefulset_empty.yaml | 12 +- deploy/kubernetes/general/bookkeeper.yaml | 13 +- deploy/kubernetes/general/tools.yaml | 19 ++- deploy/kubernetes/general/zookeeper.yaml | 8 +- deploy/kubernetes/gke/gcs-apiserver.yaml | 2 +- deploy/kubernetes/helm/templates/bookie.yaml | 9 +- deploy/kubernetes/helm/templates/tools.yaml| 14 +- deploy/kubernetes/helm/templates/zookeeper.yaml| 8 +- deploy/kubernetes/minikube/apiserver.yaml | 2 +- deploy/kubernetes/minikube/bookkeeper.yaml | 7 +- deploy/kubernetes/minikube/tools.yaml | 19 ++- deploy/kubernetes/minikube/zookeeper.yaml | 20 ++- ...1beta1Controller.java => AppsV1Controller.java} | 150 ++--- .../scheduler/kubernetes/KubernetesCompat.java | 28 ++-- .../scheduler/kubernetes/KubernetesScheduler.java | 2 +- .../scheduler/kubernetes/KubernetesUtils.java | 6 +- .../apache/heron/scheduler/kubernetes/Volumes.java | 8 +- .../heron/scheduler/kubernetes/VolumesTests.java | 2 +- third_party/java/BUILD | 4 +- 22 files changed, 229 insertions(+), 136 deletions(-) rename heron/schedulers/src/java/org/apache/heron/scheduler/kubernetes/{AppsV1beta1Controller.java => AppsV1Controller.java} (78%)
[incubator-heron] branch master updated: Update getting-started-local-single-node.md (#3425)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new 5cd8ff9 Update getting-started-local-single-node.md (#3425) 5cd8ff9 is described below commit 5cd8ff97507c25f7c69a265703453a419772b660 Author: Yeshvant Bhavnasi AuthorDate: Fri Dec 20 12:55:08 2019 -0800 Update getting-started-local-single-node.md (#3425) Wget link for macos --- website2/docs/getting-started-local-single-node.md | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/website2/docs/getting-started-local-single-node.md b/website2/docs/getting-started-local-single-node.md index 9a23a3e..5043a86 100644 --- a/website2/docs/getting-started-local-single-node.md +++ b/website2/docs/getting-started-local-single-node.md @@ -57,6 +57,10 @@ To install Heron binaries directly, using installation scripts, go to Heron's [r and see a full listing of Heron releases for each available platform. The installation script for macOS (`darwin`), for example, is named `heron-install-{{% heronVersion %}}-darwin.sh`. +```bash +$ wget https://github.com/apache/incubator-heron/releases/download/{{% heronVersion %}}/heron-install-{{% heronVersion %}}-darwin.sh +``` + Download the for your platform either from the releases page or using [`wget`](https://www.gnu.org/software/wget/). Here's a `wget` example for Ubuntu: ```bash @@ -282,4 +286,4 @@ In case of any issues, please refer to [Quick Start Troubleshooting](getting-sta * [Deploy topologies](deployment-overview) in clustered, scheduler-driven environments (such as on [Aurora](schedulers-aurora-cluster) and [locally](schedulers-local)) -* [Develop topologies](heron-architecture) for Heron \ No newline at end of file +* [Develop topologies](heron-architecture) for Heron
[incubator-heron] branch joshfischer/site-build-mods updated (a3bc66a -> d6ce516)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/site-build-mods in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. from a3bc66a correct folder path add ca2d028 add repo metadata configs to asf.yaml add d6ce516 Merge branch 'joshfischer/site-build-mods' into joshfischer/github-metadata No new revisions were added by this update. Summary of changes: .asf.yaml | 6 ++ 1 file changed, 6 insertions(+)
[incubator-heron] branch joshfischer/site-build-mods updated: correct folder path
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/site-build-mods in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/site-build-mods by this push: new a3bc66a correct folder path a3bc66a is described below commit a3bc66a54c165bb7be7a332d921287d910050ccf Author: Josh Fischer AuthorDate: Wed Dec 11 14:52:15 2019 -0600 correct folder path --- website2/website/scripts/publish_site.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website2/website/scripts/publish_site.sh b/website2/website/scripts/publish_site.sh index 22b5bcb..db13b89 100755 --- a/website2/website/scripts/publish_site.sh +++ b/website2/website/scripts/publish_site.sh @@ -47,7 +47,7 @@ HERON_SITE_TMP=/tmp/heron-site cp -r $WORK_DIR/* $HERON_SITE_TMP/content # copy the asf.yaml - cp $WORK_ROOT_DIR/.asf.yaml $HERON_SITE_TMP/ + cp $ROOT_DIR/.asf.yaml $HERON_SITE_TMP/ # push all of the results to asf-site branch git add -A .
[incubator-heron] branch asfsi created (now 468aed1)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch asfsi in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 468aed1 Joshfischer/apache content (#3419) No new revisions were added by this update.
[incubator-heron] branch joshfischer/site-build-mods created (now 88bda3d)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/site-build-mods in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 88bda3d moving .asf.yaml on each site build This branch includes the following new commits: new 88bda3d moving .asf.yaml on each site build The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] 01/01: moving .asf.yaml on each site build
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/site-build-mods in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 88bda3d1a50c91b3fdf61fab6491456e2f63b5f6 Author: Josh Fischer AuthorDate: Wed Dec 11 14:37:49 2019 -0600 moving .asf.yaml on each site build --- website2/website/scripts/publish_site.sh | 3 +++ 1 file changed, 3 insertions(+) diff --git a/website2/website/scripts/publish_site.sh b/website2/website/scripts/publish_site.sh index b3bb8ea..22b5bcb 100755 --- a/website2/website/scripts/publish_site.sh +++ b/website2/website/scripts/publish_site.sh @@ -46,6 +46,9 @@ HERON_SITE_TMP=/tmp/heron-site # copy the generated dir cp -r $WORK_DIR/* $HERON_SITE_TMP/content + # copy the asf.yaml + cp $WORK_ROOT_DIR/.asf.yaml $HERON_SITE_TMP/ + # push all of the results to asf-site branch git add -A . git diff-index --quiet HEAD || (git commit -m "git-site-role commit from $ME" && git push -q origin HEAD:asf-site)
[incubator-heron] branch master updated (340e654 -> 468aed1)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. from 340e654 Update zk version to 3.4.14 in dist and install zk in ubuntu 16/18 di… (#3411) add 468aed1 Joshfischer/apache content (#3419) No new revisions were added by this update. Summary of changes: website2/website/core/Footer.js| 32 ++-- website2/website/package-lock.json | 2 +- website2/website/scripts/replace.js| 1 + website2/website/static/css/custom.css | 17 - website2/website/versions.json | 1 + 5 files changed, 41 insertions(+), 12 deletions(-)
[incubator-heron] branch joshfischer/apache-content updated: adding back branch whoami block
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/apache-content in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/apache-content by this push: new 98f8aff adding back branch whoami block 98f8aff is described below commit 98f8aff2899be6f819d3652b728a8eecb14dc758 Author: Josh Fischer AuthorDate: Mon Dec 9 18:45:44 2019 -0600 adding back branch whoami block --- .asf.yaml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.asf.yaml b/.asf.yaml index db841e9..fef1a18 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -17,7 +17,7 @@ staging: profile: ~ - whoami: joshfischer/apache-content + whoami: asf-site publish: whoami: asf-site
[incubator-heron] 02/02: add version for 0.20.2-incubating
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/apache-content in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit dc4839db03970aff1c7e324c9e4c43ebdbd1b4b8 Author: Josh Fischer AuthorDate: Mon Dec 9 18:18:24 2019 -0600 add version for 0.20.2-incubating --- .asf.yaml | 2 +- website2/website/scripts/replace.js | 1 + website2/website/versions.json | 1 + 3 files changed, 3 insertions(+), 1 deletion(-) diff --git a/.asf.yaml b/.asf.yaml index fef1a18..db841e9 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -17,7 +17,7 @@ staging: profile: ~ - whoami: asf-site + whoami: joshfischer/apache-content publish: whoami: asf-site diff --git a/website2/website/scripts/replace.js b/website2/website/scripts/replace.js index 7fec8bc..08b2331 100755 --- a/website2/website/scripts/replace.js +++ b/website2/website/scripts/replace.js @@ -37,6 +37,7 @@ const latestVersion = versions[0]; const bazelVersions = { '0.20.0-incubating': '0.14.1', '0.20.1-incubating': '0.26.0', +'0.20.2-incubating': '0.26.0', 'latest': '0.26.0', } diff --git a/website2/website/versions.json b/website2/website/versions.json index 6a63039..858a64d 100644 --- a/website2/website/versions.json +++ b/website2/website/versions.json @@ -1,4 +1,5 @@ [ + "0.20.2-incubating", "0.20.1-incubating", "0.20.0-incubating" ]
[incubator-heron] 01/02: Merge branch 'master' of github.com:apache/incubator-heron into joshfischer/apache-content
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/apache-content in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit a380a581b9ca99cc8786af3149594ec2374aa3b0 Merge: 173c090 dcd1b92 Author: Josh Fischer AuthorDate: Mon Dec 9 18:16:40 2019 -0600 Merge branch 'master' of github.com:apache/incubator-heron into joshfischer/apache-content .asf.yaml| 24 .htaccess| 1 - website2/website/scripts/publish_site.sh | 7 ++- 3 files changed, 30 insertions(+), 2 deletions(-)
[incubator-heron] branch joshfischer/apache-content updated (173c090 -> dc4839d)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/apache-content in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. from 173c090 adding apache content to footer add dcd1b92 Joshfischer/finalize-ci-website (#3418) new a380a58 Merge branch 'master' of github.com:apache/incubator-heron into joshfischer/apache-content new dc4839d add version for 0.20.2-incubating The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../ui/src/python/handlers/common/consts.py => .asf.yaml | 12 +++- .htaccess| 1 - website2/website/scripts/publish_site.sh | 7 ++- website2/website/scripts/replace.js | 1 + website2/website/versions.json | 1 + 5 files changed, 15 insertions(+), 7 deletions(-) copy heron/tools/ui/src/python/handlers/common/consts.py => .asf.yaml (86%) delete mode 100644 .htaccess
[incubator-heron] branch master updated: Joshfischer/finalize-ci-website (#3418)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/master by this push: new dcd1b92 Joshfischer/finalize-ci-website (#3418) dcd1b92 is described below commit dcd1b924e0a9e9df31ba4188392f6a30e2b5017f Author: Josh Fischer AuthorDate: Mon Dec 9 11:23:45 2019 -0600 Joshfischer/finalize-ci-website (#3418) * adding asf.yaml * removing .htaccess during the CI site build * adding apache header * commenting out publish block for last test * ready to deploy for prod * removing incorrect rm command * clear all contents of content directory before republish * attemtpting to correct cp command * update asf yaml for prod * remove htaccess file * clean up. remove htaccess file --- .asf.yaml| 24 .htaccess| 1 - website2/website/scripts/publish_site.sh | 7 ++- 3 files changed, 30 insertions(+), 2 deletions(-) diff --git a/.asf.yaml b/.asf.yaml new file mode 100644 index 000..fef1a18 --- /dev/null +++ b/.asf.yaml @@ -0,0 +1,24 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +#http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. + +staging: + profile: ~ + whoami: asf-site + +publish: + whoami: asf-site + hostname: http://heronstreaming.io diff --git a/.htaccess b/.htaccess deleted file mode 100644 index bdcbac5..000 --- a/.htaccess +++ /dev/null @@ -1 +0,0 @@ -Redirect /index.html https://heron.incubator.apache.org diff --git a/website2/website/scripts/publish_site.sh b/website2/website/scripts/publish_site.sh index b313aba..b3bb8ea 100755 --- a/website2/website/scripts/publish_site.sh +++ b/website2/website/scripts/publish_site.sh @@ -38,9 +38,14 @@ HERON_SITE_TMP=/tmp/heron-site git config user.email "d...@heron.incubator.apache.org" git checkout asf-site + + # clean content directory + rm -rf $HERON_SITE_TMP/content/ + mkdir $HERON_SITE_TMP/content + # copy the generated dir cp -r $WORK_DIR/* $HERON_SITE_TMP/content - cp -a ${ROOT_DIR}/.htaccess ${ROOT_DIR}/content + # push all of the results to asf-site branch git add -A . git diff-index --quiet HEAD || (git commit -m "git-site-role commit from $ME" && git push -q origin HEAD:asf-site)
[incubator-heron] 01/01: adding apache content to footer
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/apache-content in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 173c090ec5b116ca49bc6aa25fa8ffbcc6f65da5 Author: Josh Fischer AuthorDate: Sun Dec 8 00:40:04 2019 -0600 adding apache content to footer --- website2/website/core/Footer.js| 32 ++-- website2/website/package-lock.json | 2 +- website2/website/static/css/custom.css | 17 - 3 files changed, 39 insertions(+), 12 deletions(-) diff --git a/website2/website/core/Footer.js b/website2/website/core/Footer.js index 739a7f0..53ae307 100755 --- a/website2/website/core/Footer.js +++ b/website2/website/core/Footer.js @@ -24,17 +24,29 @@ class Footer extends React.Component { render() { return ( - + -Disclaimer -Apache Heron (incubating) is an effort undergoing incubation at The Apache Software Foundation (ASF), -sponsored by Incubator. Incubation is required of all newly accepted projects until a further review indicates -that the infrastructure, communications, and decision making process have stabilized in a manner consistent with -other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, -it does indicate that the project has yet to be fully endorsed by the ASF. - - -{this.props.config.copyright} + Apache Heron is an effort undergoing incubation at https://apache.org/;>The Apache Software Foundation (ASF) sponsored by the Apache Incubator PMC. + Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. + While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF. + + + Apache®, the names of Apache projects, and the feather logo are either https://www.apache.org/foundation/marks/list/;>registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. + + + {this.props.config.copyright} + + + +https://incubator.apache.org/;>Apache Incubator +https://www.apache.org/;>About the ASF +https://www.apache.org/events/current-event;>Events +https://www.apache.org/foundation/thanks.html;>Thanks +https://www.apache.org/foundation/sponsorship.html;>Become a Sponsor +https://www.apache.org/security/;>Security +https://www.apache.org/licenses/;>License + + ); } diff --git a/website2/website/package-lock.json b/website2/website/package-lock.json index d71c815..0b92916 100644 --- a/website2/website/package-lock.json +++ b/website2/website/package-lock.json @@ -8382,7 +8382,7 @@ } }, "react-dev-utils": { - "version": "5.0.3", + "version": "5.0.2", "resolved": "https://registry.npmjs.org/react-dev-utils/-/react-dev-utils-5.0.2.tgz;, "integrity": "sha512-d2FbKvYe4XAQx5gjHBoWG+ADqC3fGZzjb7i9vxd/Y5xfLkBGtQyX7aOb8lBRQPYUhjngiD3d49LevjY1stUR0Q==", "dev": true, diff --git a/website2/website/static/css/custom.css b/website2/website/static/css/custom.css index d89b7b2..361c659 100755 --- a/website2/website/static/css/custom.css +++ b/website2/website/static/css/custom.css @@ -50,7 +50,22 @@ a { border-radius: 0.25rem; } + .apache-disclaimer { color: #ff; padding: 25px 25px 25px 25px; -} \ No newline at end of file + width: 80%; + float: left; +} + +.apache-links { + color: #ff; + padding: 25px 25px 25px 25px; + float: right; + width: 20%; +} + +.copywrite-box { + float: left; +} +
[incubator-heron] branch joshfischer/apache-content created (now 173c090)
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a change to branch joshfischer/apache-content in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. at 173c090 adding apache content to footer This branch includes the following new commits: new 173c090 adding apache content to footer The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[incubator-heron] branch joshfischer/site-tweaks updated: clean up. remove htaccess file
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/site-tweaks in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/site-tweaks by this push: new c4dedd5 clean up. remove htaccess file c4dedd5 is described below commit c4dedd55369d4fb1e35523e702f12976d7f99d45 Author: Josh Fischer AuthorDate: Sat Dec 7 22:43:29 2019 -0600 clean up. remove htaccess file --- .htaccess| 1 - website2/website/scripts/publish_site.sh | 4 ++-- 2 files changed, 2 insertions(+), 3 deletions(-) diff --git a/.htaccess b/.htaccess deleted file mode 100644 index bdcbac5..000 --- a/.htaccess +++ /dev/null @@ -1 +0,0 @@ -Redirect /index.html https://heron.incubator.apache.org diff --git a/website2/website/scripts/publish_site.sh b/website2/website/scripts/publish_site.sh index 286d78a..b3bb8ea 100755 --- a/website2/website/scripts/publish_site.sh +++ b/website2/website/scripts/publish_site.sh @@ -43,9 +43,9 @@ HERON_SITE_TMP=/tmp/heron-site rm -rf $HERON_SITE_TMP/content/ mkdir $HERON_SITE_TMP/content - # copy the generated dir + # copy the generated dir cp -r $WORK_DIR/* $HERON_SITE_TMP/content - #cp -a $ROOT_DIR/.htaccess $HERON_SITE_TMP/content + # push all of the results to asf-site branch git add -A . git diff-index --quiet HEAD || (git commit -m "git-site-role commit from $ME" && git push -q origin HEAD:asf-site)
[incubator-heron] branch joshfischer/site-tweaks updated: remove htaccess file
This is an automated email from the ASF dual-hosted git repository. joshfischer pushed a commit to branch joshfischer/site-tweaks in repository https://gitbox.apache.org/repos/asf/incubator-heron.git The following commit(s) were added to refs/heads/joshfischer/site-tweaks by this push: new 7fa235f remove htaccess file 7fa235f is described below commit 7fa235f1ef729bdd1afa87f2b106fdcb47be359f Author: Josh Fischer AuthorDate: Sat Dec 7 22:29:45 2019 -0600 remove htaccess file --- website2/website/scripts/publish_site.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website2/website/scripts/publish_site.sh b/website2/website/scripts/publish_site.sh index 1c203a8..286d78a 100755 --- a/website2/website/scripts/publish_site.sh +++ b/website2/website/scripts/publish_site.sh @@ -45,7 +45,7 @@ HERON_SITE_TMP=/tmp/heron-site # copy the generated dir cp -r $WORK_DIR/* $HERON_SITE_TMP/content - cp -a $ROOT_DIR/.htaccess $HERON_SITE_TMP/content + #cp -a $ROOT_DIR/.htaccess $HERON_SITE_TMP/content # push all of the results to asf-site branch git add -A . git diff-index --quiet HEAD || (git commit -m "git-site-role commit from $ME" && git push -q origin HEAD:asf-site)