[hadoop-ozone] branch master updated (571d4a3 -> a731eea)
This is an automated email from the ASF dual-hosted git repository. dineshc pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git. from 571d4a3 HDDS-2605. Use LongSupplier to avoid boxing (#256) add a731eea HDDS-2603. Avoid unnecessary boxing in XceiverClientReply (#255) No new revisions were added by this update. Summary of changes: .../org/apache/hadoop/hdds/scm/XceiverClientReply.java | 18 +- 1 file changed, 5 insertions(+), 13 deletions(-) - To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org
[hadoop-ozone] branch master updated (7d35218 -> 571d4a3)
This is an automated email from the ASF dual-hosted git repository. dineshc pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git. from 7d35218 HDDS-2394. Ozone S3 Gateway allows bucket name with underscore to be created (#243) add 571d4a3 HDDS-2605. Use LongSupplier to avoid boxing (#256) No new revisions were added by this update. Summary of changes: .../org/apache/hadoop/ozone/freon/ProgressBar.java | 33 -- .../hadoop/ozone/freon/RandomKeyGenerator.java | 4 +-- .../apache/hadoop/ozone/freon/TestProgressBar.java | 24 ++-- 3 files changed, 28 insertions(+), 33 deletions(-) - To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org
[hadoop-ozone] branch HDDS-2587 updated: Add build step (#252)
This is an automated email from the ASF dual-hosted git repository. bharat pushed a commit to branch HDDS-2587 in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git The following commit(s) were added to refs/heads/HDDS-2587 by this push: new ecdd884 Add build step (#252) ecdd884 is described below commit ecdd88420ce67edbadcdedc2f30f294df0093504 Author: Vivek Ratnavel Subramanian AuthorDate: Thu Nov 21 11:26:57 2019 -0800 Add build step (#252) --- .github/workflows/post-commit.yml | 8 .github/workflows/pr.yml | 8 2 files changed, 16 insertions(+) diff --git a/.github/workflows/post-commit.yml b/.github/workflows/post-commit.yml index ef6237f..b10d270 100644 --- a/.github/workflows/post-commit.yml +++ b/.github/workflows/post-commit.yml @@ -16,6 +16,14 @@ name: build-branch on: - push jobs: + build: +name: compile +runs-on: ubuntu-18.04 +steps: + - uses: actions/checkout@master + - uses: ./.github/buildenv +with: + args: ./hadoop-ozone/dev-support/checks/build.sh rat: name: rat runs-on: ubuntu-18.04 diff --git a/.github/workflows/pr.yml b/.github/workflows/pr.yml index 2662ee4..eb39fad 100644 --- a/.github/workflows/pr.yml +++ b/.github/workflows/pr.yml @@ -16,6 +16,14 @@ name: pr-check on: - pull_request jobs: + build: +name: compile +runs-on: ubuntu-18.04 +steps: + - uses: actions/checkout@master + - uses: ./.github/buildenv +with: + args: ./hadoop-ozone/dev-support/checks/build.sh rat: name: rat runs-on: ubuntu-18.04 - To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org
[hadoop-ozone] branch master updated (d29838b -> 7d35218)
This is an automated email from the ASF dual-hosted git repository. bharat pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git. from d29838b HDDS-2536. Add ozone.om.internal.service.id to OM HA configuration. (#218) add 7d35218 HDDS-2394. Ozone S3 Gateway allows bucket name with underscore to be created (#243) No new revisions were added by this update. Summary of changes: .../apache/hadoop/ozone/client/rpc/RpcClient.java| 7 +++ .../hadoop/ozone/om/exceptions/OMException.java | 4 +++- .../common/src/main/proto/OzoneManagerProtocol.proto | 1 + .../dist/src/main/smoketest/s3/bucketcreate.robot| 4 .../hadoop/ozone/s3/endpoint/BucketEndpoint.java | 20 ++-- .../hadoop/ozone/s3/exception/S3ErrorTable.java | 4 6 files changed, 33 insertions(+), 7 deletions(-) - To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org
[hadoop-ozone] branch HDDS-2587 updated (b42d9c2 -> 36bc4df)
This is an automated email from the ASF dual-hosted git repository. elek pushed a change to branch HDDS-2587 in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git. from b42d9c2 separate PR and main branch build definition new 9d3a845 coverage report is turned on new 0d9a830 Sonar is executed with maven batch mode new 36bc4df fix unit test The 3 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: hadoop-hdds/pom.xml | 3 ++- hadoop-ozone/dev-support/checks/sonar.sh | 2 +- hadoop-ozone/dev-support/checks/unit.sh | 2 +- hadoop-ozone/pom.xml | 3 ++- pom.xml | 20 +++- 5 files changed, 25 insertions(+), 5 deletions(-) - To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org
[hadoop-ozone] 03/03: fix unit test
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch HDDS-2587
in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git
commit 36bc4df6a9719c650a68a25b17feeec9ccde19f7
Author: Márton Elek
AuthorDate: Thu Nov 21 17:15:16 2019 +0100
fix unit test
---
hadoop-ozone/dev-support/checks/unit.sh | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/hadoop-ozone/dev-support/checks/unit.sh
b/hadoop-ozone/dev-support/checks/unit.sh
index 585375e..adfef53 100755
--- a/hadoop-ozone/dev-support/checks/unit.sh
+++ b/hadoop-ozone/dev-support/checks/unit.sh
@@ -17,7 +17,7 @@ DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" >/dev/null 2>&1
&& pwd )"
cd "$DIR/../../.." || exit 1
export MAVEN_OPTS="-Xmx4096m"
-mvn -B -DskipShade -Dskip.yarn -fn test -pl
\!:hadoop-ozone-integration-test,\!:hadoop-ozone-filesystem,\!:hadoop-ozone-tools
"$@"
+mvn -B -DskipShade -Dskip.yarn -fn test -pl
\!:hadoop-ozone-integration-test,\!:hadoop-ozone-tools "$@"
REPORT_DIR=${OUTPUT_DIR:-"$DIR/../../../target/unit"}
mkdir -p "$REPORT_DIR"
-
To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org
[hadoop-ozone] 01/03: coverage report is turned on
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch HDDS-2587
in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git
commit 9d3a84518a3e74dcd9598a7672e13ee20062313b
Author: Márton Elek
AuthorDate: Thu Nov 21 15:43:15 2019 +0100
coverage report is turned on
---
hadoop-hdds/pom.xml | 3 ++-
hadoop-ozone/dev-support/checks/unit.sh | 2 +-
hadoop-ozone/pom.xml| 3 ++-
pom.xml | 20 +++-
4 files changed, 24 insertions(+), 4 deletions(-)
diff --git a/hadoop-hdds/pom.xml b/hadoop-hdds/pom.xml
index 9cd5db3..882755a 100644
--- a/hadoop-hdds/pom.xml
+++ b/hadoop-hdds/pom.xml
@@ -369,7 +369,8 @@ https://maven.apache.org/xsd/maven-4.0.0.xsd";>
${testsThreadCount}
false
- ${maven-surefire-plugin.argLine}
-DminiClusterDedicatedDirs=true
+
+ ${maven-surefire-plugin.argLine} @{argLine}
-DminiClusterDedicatedDirs=true
${testsThreadCount}
${test.build.data}/${surefire.forkNumber}
diff --git a/hadoop-ozone/dev-support/checks/unit.sh
b/hadoop-ozone/dev-support/checks/unit.sh
index 44b6d0b..585375e 100755
--- a/hadoop-ozone/dev-support/checks/unit.sh
+++ b/hadoop-ozone/dev-support/checks/unit.sh
@@ -17,7 +17,7 @@ DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" >/dev/null 2>&1
&& pwd )"
cd "$DIR/../../.." || exit 1
export MAVEN_OPTS="-Xmx4096m"
-mvn -B -fn test -pl
\!:hadoop-ozone-integration-test,\!:hadoop-ozone-filesystem,\!:hadoop-ozone-tools
"$@"
+mvn -B -DskipShade -Dskip.yarn -fn test -pl
\!:hadoop-ozone-integration-test,\!:hadoop-ozone-filesystem,\!:hadoop-ozone-tools
"$@"
REPORT_DIR=${OUTPUT_DIR:-"$DIR/../../../target/unit"}
mkdir -p "$REPORT_DIR"
diff --git a/hadoop-ozone/pom.xml b/hadoop-ozone/pom.xml
index 6d8b465..8a19298 100644
--- a/hadoop-ozone/pom.xml
+++ b/hadoop-ozone/pom.xml
@@ -397,7 +397,8 @@
${testsThreadCount}
false
- ${maven-surefire-plugin.argLine}
-DminiClusterDedicatedDirs=true
+
+ ${maven-surefire-plugin.argLine} @{argLine}
-DminiClusterDedicatedDirs=true
${testsThreadCount}
${test.build.data}/${surefire.forkNumber}
diff --git a/pom.xml b/pom.xml
index d6e2da6..c8b16c1 100644
--- a/pom.xml
+++ b/pom.xml
@@ -1670,6 +1670,11 @@ xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
http://maven.apache.org/xs
apache-rat-plugin
${apache-rat-plugin.version}
+
+ org.jacoco
+ jacoco-maven-plugin
+ 0.8.3
+
@@ -1760,12 +1765,25 @@ xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
http://maven.apache.org/xs
+org.jacoco
+jacoco-maven-plugin
+
+
+default-prepare-agent
+
+ prepare-agent
+
+
+
+
+
org.apache.maven.plugins
maven-surefire-plugin
false
${surefire.fork.timeout}
- ${maven-surefire-plugin.argLine}
+
+ ${maven-surefire-plugin.argLine} @{argLine}
${hadoop.common.build.dir}
-
To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org
[hadoop-ozone] 02/03: Sonar is executed with maven batch mode
This is an automated email from the ASF dual-hosted git repository. elek pushed a commit to branch HDDS-2587 in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git commit 0d9a83087a00cf89c350178bb5a7c3154f4f1130 Author: Márton Elek AuthorDate: Thu Nov 21 15:43:51 2019 +0100 Sonar is executed with maven batch mode --- hadoop-ozone/dev-support/checks/sonar.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/hadoop-ozone/dev-support/checks/sonar.sh b/hadoop-ozone/dev-support/checks/sonar.sh index 0282b15..55f219b 100755 --- a/hadoop-ozone/dev-support/checks/sonar.sh +++ b/hadoop-ozone/dev-support/checks/sonar.sh @@ -20,4 +20,4 @@ if [ ! "$SONAR_TOKEN" ]; then echo "SONAR_TOKEN environment variable should be set" exit 1 fi -mvn verify -DskipShade -DskipTests -Dskip.yarn org.sonarsource.scanner.maven:sonar-maven-plugin:3.6.0.1398:sonar -Dsonar.host.url=https://sonarcloud.io -Dsonar.organization=apache -Dsonar.projectKey=hadoop-ozone +mvn -B verify -DskipShade -DskipTests -Dskip.yarn org.sonarsource.scanner.maven:sonar-maven-plugin:3.6.0.1398:sonar -Dsonar.host.url=https://sonarcloud.io -Dsonar.organization=apache -Dsonar.projectKey=hadoop-ozone - To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org
[hadoop-ozone] 01/02: revert files added by a merge to this branch
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch HDDS-2587
in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git
commit d1dfbc4cb3102b6687e97a527e9d67a13d0bda8c
Author: Márton Elek
AuthorDate: Thu Nov 21 15:23:37 2019 +0100
revert files added by a merge to this branch
---
.../hdds/scm/client/ContainerOperationClient.java | 2 +-
.../hadoop/hdds/scm/client/HddsClientUtils.java| 5 +
.../apache/hadoop/hdds/scm/storage/BufferPool.java | 2 +-
.../hadoop/hdds/scm/storage/CommitWatcher.java | 4 +-
.../hadoop/hdds/scm/net/NodeSchemaLoader.java | 27 +-
.../apache/hadoop/hdds/tracing/TraceAllMethod.java | 5 -
.../common/src/main/resources/ozone-default.xml| 11 +-
.../hadoop/hdds/scm/net/TestNodeSchemaLoader.java | 151
.../common/src/test/resources/log4j.properties | 23 --
.../networkTopologyTestFiles/external-entity.xml | 52 ---
.../hadoop/hdds/conf/ConfigFileAppender.java | 21 +-
.../hdds/scm/server/StorageContainerManager.java | 74 ++--
.../org/apache/hadoop/ozone/om/OMConfigKeys.java | 3 -
.../hadoop/ozone/om/exceptions/OMException.java| 6 +-
.../src/main/proto/OzoneManagerProtocol.proto | 1 -
.../hadoop/ozone/MiniOzoneHAClusterImpl.java | 6 +-
.../hadoop/ozone/TestSecureOzoneCluster.java | 399 -
.../hadoop/ozone/client/rpc/TestCommitWatcher.java | 9 +-
.../apache/hadoop/ozone/om/TestKeyManagerImpl.java | 133 +--
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 66 ++--
.../apache/hadoop/ozone/om/ha/OMHANodeDetails.java | 21 +-
.../ozone/web/ozShell/keys/GetKeyHandler.java | 44 +--
.../ozone/web/ozShell/keys/PutKeyHandler.java | 35 +-
.../endpoint/MultiDeleteRequestUnmarshaller.java | 8 +-
.../ozone/s3/util/RangeHeaderParserUtil.java | 4 +-
.../ozone/s3/util/TestRangeHeaderParserUtil.java | 6 +-
.../ozone/audit/parser/common/DatabaseHelper.java | 157
.../audit/parser/handler/LoadCommandHandler.java | 11 +-
.../audit/parser/handler/QueryCommandHandler.java | 11 +-
.../parser/handler/TemplateCommandHandler.java | 11 +-
30 files changed, 554 insertions(+), 754 deletions(-)
diff --git
a/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/ContainerOperationClient.java
b/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/ContainerOperationClient.java
index 6e2fd59..b1d4538 100644
---
a/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/ContainerOperationClient.java
+++
b/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/ContainerOperationClient.java
@@ -221,7 +221,7 @@ public class ContainerOperationClient implements ScmClient {
// That makes sense, but it is not needed for the client to work.
if (LOG.isDebugEnabled()) {
LOG.debug("Pipeline creation successful. Pipeline: {}",
- pipeline);
+ pipeline.toString());
}
}
diff --git
a/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/HddsClientUtils.java
b/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/HddsClientUtils.java
index d7e3f4d..8c9a11a 100644
---
a/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/HddsClientUtils.java
+++
b/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/HddsClientUtils.java
@@ -49,6 +49,8 @@ import org.apache.ratis.protocol.AlreadyClosedException;
import org.apache.ratis.protocol.GroupMismatchException;
import org.apache.ratis.protocol.NotReplicatedException;
import org.apache.ratis.protocol.RaftRetryFailureException;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
import java.io.IOException;
import java.net.InetSocketAddress;
@@ -74,6 +76,9 @@ import java.util.concurrent.TimeoutException;
@InterfaceStability.Unstable
public final class HddsClientUtils {
+ private static final Logger LOG = LoggerFactory.getLogger(
+ HddsClientUtils.class);
+
private HddsClientUtils() {
}
diff --git
a/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java
b/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java
index f57700e..f986fe3 100644
---
a/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java
+++
b/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java
@@ -94,7 +94,7 @@ public class BufferPool {
// always remove from head of the list and append at last
final ChunkBuffer buffer = bufferList.remove(0);
// Ensure the buffer to be removed is always at the head of the list.
-Preconditions.checkArgument(buffer == chunkBuffer);
+Preconditions.checkArgument(buffer.equals(chunkBuffer));
buffer.clear();
bufferList.add(buffer);
Preconditions.checkArgument(currentBufferIndex >= 0);
diff --git
a/hadoop-hdds/client/src/main/j
[hadoop-ozone] branch HDDS-2587 updated (2f27d93 -> b42d9c2)
This is an automated email from the ASF dual-hosted git repository. elek pushed a change to branch HDDS-2587 in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git. from 2f27d93 retrigger build new d1dfbc4 revert files added by a merge to this branch new b42d9c2 separate PR and main branch build definition The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/main.yml | 121 --- .github/workflows/post-commit.yml | 112 ++ .github/workflows/pr.yml | 106 ++ .../hdds/scm/client/ContainerOperationClient.java | 2 +- .../hadoop/hdds/scm/client/HddsClientUtils.java| 5 + .../apache/hadoop/hdds/scm/storage/BufferPool.java | 2 +- .../hadoop/hdds/scm/storage/CommitWatcher.java | 4 +- .../hadoop/hdds/scm/net/NodeSchemaLoader.java | 27 +- .../apache/hadoop/hdds/tracing/TraceAllMethod.java | 5 - .../common/src/main/resources/ozone-default.xml| 11 +- .../hadoop/hdds/scm/net/TestNodeSchemaLoader.java | 151 .../common/src/test/resources/log4j.properties | 23 -- .../networkTopologyTestFiles/external-entity.xml | 52 --- .../hadoop/hdds/conf/ConfigFileAppender.java | 21 +- .../hdds/scm/server/StorageContainerManager.java | 74 ++-- .../org/apache/hadoop/ozone/om/OMConfigKeys.java | 3 - .../hadoop/ozone/om/exceptions/OMException.java| 6 +- .../src/main/proto/OzoneManagerProtocol.proto | 1 - hadoop-ozone/dev-support/checks/sonar.sh | 2 +- .../hadoop/ozone/MiniOzoneHAClusterImpl.java | 6 +- .../hadoop/ozone/TestSecureOzoneCluster.java | 399 - .../hadoop/ozone/client/rpc/TestCommitWatcher.java | 9 +- .../apache/hadoop/ozone/om/TestKeyManagerImpl.java | 133 +-- .../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 66 ++-- .../apache/hadoop/ozone/om/ha/OMHANodeDetails.java | 21 +- .../ozone/web/ozShell/keys/GetKeyHandler.java | 44 +-- .../ozone/web/ozShell/keys/PutKeyHandler.java | 35 +- .../endpoint/MultiDeleteRequestUnmarshaller.java | 8 +- .../ozone/s3/util/RangeHeaderParserUtil.java | 4 +- .../ozone/s3/util/TestRangeHeaderParserUtil.java | 6 +- .../ozone/audit/parser/common/DatabaseHelper.java | 157 .../audit/parser/handler/LoadCommandHandler.java | 11 +- .../audit/parser/handler/QueryCommandHandler.java | 11 +- .../parser/handler/TemplateCommandHandler.java | 11 +- 34 files changed, 773 insertions(+), 876 deletions(-) delete mode 100644 .github/workflows/main.yml create mode 100644 .github/workflows/post-commit.yml create mode 100644 .github/workflows/pr.yml delete mode 100644 hadoop-hdds/common/src/test/resources/log4j.properties delete mode 100644 hadoop-hdds/common/src/test/resources/networkTopologyTestFiles/external-entity.xml - To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org
[hadoop-ozone] 02/02: separate PR and main branch build definition
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch HDDS-2587
in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git
commit b42d9c26080649596857941ed5372e1e5f4294aa
Author: Márton Elek
AuthorDate: Thu Nov 21 15:35:00 2019 +0100
separate PR and main branch build definition
---
.github/workflows/main.yml | 121 ---
.github/workflows/post-commit.yml| 112
.github/workflows/pr.yml | 106 +++
hadoop-ozone/dev-support/checks/sonar.sh | 2 +-
4 files changed, 219 insertions(+), 122 deletions(-)
diff --git a/.github/workflows/main.yml b/.github/workflows/main.yml
deleted file mode 100644
index 2b52480..000
--- a/.github/workflows/main.yml
+++ /dev/null
@@ -1,121 +0,0 @@
-# Licensed to the Apache Software Foundation (ASF) under one or more
-# contributor license agreements. See the NOTICE file distributed with
-# this work for additional information regarding copyright ownership.
-# The ASF licenses this file to You under the Apache License, Version 2.0
-# (the "License"); you may not use this file except in compliance with
-# the License. You may obtain a copy of the License at
-#
-# http://www.apache.org/licenses/LICENSE-2.0
-#
-# Unless required by applicable law or agreed to in writing, software
-# distributed under the License is distributed on an "AS IS" BASIS,
-# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-# See the License for the specific language governing permissions and
-# limitations under the License.
-name: Build
-on:
- - push
- - pull_request
-jobs:
-# build:
-#name: compile
-#runs-on: ubuntu-18.04
-#steps:
-#- uses: actions/checkout@master
-#- uses: ./.github/buildenv
-# with:
-# args: ./hadoop-ozone/dev-support/checks/build.sh
-# rat:
-#name: rat
-#runs-on: ubuntu-18.04
-#steps:
-#- uses: actions/checkout@master
-#- uses: ./.github/buildenv
-# with:
-# args: ./hadoop-ozone/dev-support/checks/rat.sh
-#- uses: actions/upload-artifact@master
-# if: always()
-# with:
-#name: rat
-#path: target/rat
-# author:
-#name: author
-#runs-on: ubuntu-18.04
-#steps:
-#- uses: actions/checkout@master
-#- uses: ./.github/buildenv
-# with:
-# args: ./hadoop-ozone/dev-support/checks/author.sh
-#- uses: actions/upload-artifact@master
-# if: always()
-# with:
-#name: author
-#path: target/author
- sonar:
-name: sonar
-runs-on: ubuntu-18.04
-steps:
-- uses: actions/checkout@master
-#- uses: ./.github/buildenv
-# with:
-# args: ./hadoop-ozone/dev-support/checks/build.sh
-- uses: ./.github/buildenv
- with:
-args: ./hadoop-ozone/dev-support/checks/sonar.sh
- env:
-SONAR_TOKEN: ${{ secrets.SONARCLOUD_TOKEN }}
-GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
-- uses: actions/upload-artifact@master
- if: always()
- with:
-name: sonar
-path: target/sonar
-# checkstyle:
-#name: checkstyle
-#runs-on: ubuntu-18.04
-#steps:
-#- uses: actions/checkout@master
-#- uses: ./.github/buildenv
-# with:
-# args: ./hadoop-ozone/dev-support/checks/checkstyle.sh
-#- uses: actions/upload-artifact@master
-# if: always()
-# with:
-#name: checkstyle
-#path: target/checkstyle
-# findbugs:
-#name: findbugs
-#runs-on: ubuntu-18.04
-#steps:
-#- uses: actions/checkout@master
-#- uses: ./.github/buildenv
-# with:
-# args: ./hadoop-ozone/dev-support/checks/findbugs.sh
-#- uses: actions/upload-artifact@master
-# if: always()
-# with:
-#name: findbugs
-#path: target/findbugs
-# acceptance:
-#name: acceptance
-#runs-on: ubuntu-18.04
-#needs:
-# - build
-# - rat
-# - checkstyle
-# - unit
-# - findbugs
-#steps:
-#- uses: actions/checkout@master
-#- uses: ./.github/buildenv
-# with:
-#args: ./hadoop-ozone/dev-support/checks/build.sh
-#- run: sudo pip install robotframework
-#- run: sudo chown runner -R .
-#- run: cd ./hadoop-ozone/dist/target/ozone-*-SNAPSHOT/ && mkdir .aws
&& sudo chown 1000 .aws
-#- run: ./hadoop-ozone/dev-support/checks/acceptance.sh
-#- uses: actions/upload-artifact@master
-# if: always()
-# with:
-#name: acceptance
-#path: target/acceptance
diff --git a/.github/workflows/post-commit.yml
b/.github/workflows/post-commit.yml
new file mode 100644
index 0
[hadoop-ozone] branch HDDS-2587 updated: retrigger build
This is an automated email from the ASF dual-hosted git repository. elek pushed a commit to branch HDDS-2587 in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git The following commit(s) were added to refs/heads/HDDS-2587 by this push: new 2f27d93 retrigger build 2f27d93 is described below commit 2f27d93b87dc73c229115c90cb14008c5df11e3b Author: Márton Elek AuthorDate: Thu Nov 21 11:03:10 2019 +0100 retrigger build - To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org
[hadoop-ozone] branch HDDS-2587 updated: skip tests
This is an automated email from the ASF dual-hosted git repository. elek pushed a commit to branch HDDS-2587 in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git The following commit(s) were added to refs/heads/HDDS-2587 by this push: new c0e1710 skip tests c0e1710 is described below commit c0e17103d80690b46cac402ea8325ef202986f8b Author: Márton Elek AuthorDate: Thu Nov 21 10:43:48 2019 +0100 skip tests --- hadoop-ozone/dev-support/checks/sonar.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/hadoop-ozone/dev-support/checks/sonar.sh b/hadoop-ozone/dev-support/checks/sonar.sh index 68edb7e..670a11d 100755 --- a/hadoop-ozone/dev-support/checks/sonar.sh +++ b/hadoop-ozone/dev-support/checks/sonar.sh @@ -20,4 +20,4 @@ if [ ! "$SONAR_TOKEN" ]; then echo "SONAR_TOKEN environment variable should be set" exit 1 fi -mvn install org.sonarsource.scanner.maven:sonar-maven-plugin:3.6.0.1398:sonar -Dsonar.host.url=https://sonarcloud.io -Dsonar.organization=apache -Dsonar.projectKey=hadoop-ozone +mvn install -DskipTests org.sonarsource.scanner.maven:sonar-maven-plugin:3.6.0.1398:sonar -Dsonar.host.url=https://sonarcloud.io -Dsonar.organization=apache -Dsonar.projectKey=hadoop-ozone - To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org
[hadoop-ozone] branch HDDS-2587 updated: install before sonar:sonar
This is an automated email from the ASF dual-hosted git repository. elek pushed a commit to branch HDDS-2587 in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git The following commit(s) were added to refs/heads/HDDS-2587 by this push: new 376856d install before sonar:sonar 376856d is described below commit 376856d9f430a3a4c5d13cc5ddfc325f1ceab139 Author: Márton Elek AuthorDate: Thu Nov 21 10:37:54 2019 +0100 install before sonar:sonar --- .github/workflows/main.yml | 6 +++--- hadoop-ozone/dev-support/checks/sonar.sh | 2 +- 2 files changed, 4 insertions(+), 4 deletions(-) diff --git a/.github/workflows/main.yml b/.github/workflows/main.yml index 0a1608a..2b52480 100644 --- a/.github/workflows/main.yml +++ b/.github/workflows/main.yml @@ -56,9 +56,9 @@ jobs: runs-on: ubuntu-18.04 steps: - uses: actions/checkout@master -- uses: ./.github/buildenv - with: - args: ./hadoop-ozone/dev-support/checks/build.sh +#- uses: ./.github/buildenv +# with: +# args: ./hadoop-ozone/dev-support/checks/build.sh - uses: ./.github/buildenv with: args: ./hadoop-ozone/dev-support/checks/sonar.sh diff --git a/hadoop-ozone/dev-support/checks/sonar.sh b/hadoop-ozone/dev-support/checks/sonar.sh index 135a47e..68edb7e 100755 --- a/hadoop-ozone/dev-support/checks/sonar.sh +++ b/hadoop-ozone/dev-support/checks/sonar.sh @@ -20,4 +20,4 @@ if [ ! "$SONAR_TOKEN" ]; then echo "SONAR_TOKEN environment variable should be set" exit 1 fi -mvn org.sonarsource.scanner.maven:sonar-maven-plugin:3.6.0.1398:sonar -Dsonar.host.url=https://sonarcloud.io -Dsonar.organization=apache -Dsonar.projectKey=hadoop-ozone +mvn install org.sonarsource.scanner.maven:sonar-maven-plugin:3.6.0.1398:sonar -Dsonar.host.url=https://sonarcloud.io -Dsonar.organization=apache -Dsonar.projectKey=hadoop-ozone - To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org
[hadoop-ozone] branch HDDS-2587 updated: Add sonar java classes property in pom.xml (#246)
This is an automated email from the ASF dual-hosted git repository.
bharat pushed a commit to branch HDDS-2587
in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git
The following commit(s) were added to refs/heads/HDDS-2587 by this push:
new ed8cbd4 Add sonar java classes property in pom.xml (#246)
ed8cbd4 is described below
commit ed8cbd4236f20981a9c60fbc803b8c181998fdd5
Author: Vivek Ratnavel Subramanian
AuthorDate: Thu Nov 21 00:54:09 2019 -0800
Add sonar java classes property in pom.xml (#246)
---
.../hdds/scm/client/ContainerOperationClient.java | 2 +-
.../hadoop/hdds/scm/client/HddsClientUtils.java| 5 -
.../apache/hadoop/hdds/scm/storage/BufferPool.java | 2 +-
.../hadoop/hdds/scm/storage/CommitWatcher.java | 4 +-
.../hadoop/hdds/scm/net/NodeSchemaLoader.java | 27 +-
.../apache/hadoop/hdds/tracing/TraceAllMethod.java | 5 +
.../common/src/main/resources/ozone-default.xml| 11 +-
.../hadoop/hdds/scm/net/TestNodeSchemaLoader.java | 151
.../common/src/test/resources/log4j.properties | 23 ++
.../networkTopologyTestFiles/external-entity.xml | 52 +++
.../hadoop/hdds/conf/ConfigFileAppender.java | 21 +-
.../hdds/scm/server/StorageContainerManager.java | 74 ++--
.../org/apache/hadoop/ozone/om/OMConfigKeys.java | 3 +
.../hadoop/ozone/om/exceptions/OMException.java| 6 +-
.../src/main/proto/OzoneManagerProtocol.proto | 1 +
hadoop-ozone/dev-support/checks/sonar.sh | 2 +-
.../hadoop/ozone/MiniOzoneHAClusterImpl.java | 6 +-
.../hadoop/ozone/TestSecureOzoneCluster.java | 399 +
.../hadoop/ozone/client/rpc/TestCommitWatcher.java | 9 +-
.../apache/hadoop/ozone/om/TestKeyManagerImpl.java | 133 ++-
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 66 ++--
.../apache/hadoop/ozone/om/ha/OMHANodeDetails.java | 21 +-
.../ozone/web/ozShell/keys/GetKeyHandler.java | 44 ++-
.../ozone/web/ozShell/keys/PutKeyHandler.java | 35 +-
.../endpoint/MultiDeleteRequestUnmarshaller.java | 8 +-
.../ozone/s3/util/RangeHeaderParserUtil.java | 4 +-
.../ozone/s3/util/TestRangeHeaderParserUtil.java | 6 +-
.../ozone/audit/parser/common/DatabaseHelper.java | 157
.../audit/parser/handler/LoadCommandHandler.java | 11 +-
.../audit/parser/handler/QueryCommandHandler.java | 11 +-
.../parser/handler/TemplateCommandHandler.java | 11 +-
pom.xml| 1 +
32 files changed, 756 insertions(+), 555 deletions(-)
diff --git
a/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/ContainerOperationClient.java
b/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/ContainerOperationClient.java
index b1d4538..6e2fd59 100644
---
a/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/ContainerOperationClient.java
+++
b/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/ContainerOperationClient.java
@@ -221,7 +221,7 @@ public class ContainerOperationClient implements ScmClient {
// That makes sense, but it is not needed for the client to work.
if (LOG.isDebugEnabled()) {
LOG.debug("Pipeline creation successful. Pipeline: {}",
- pipeline.toString());
+ pipeline);
}
}
diff --git
a/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/HddsClientUtils.java
b/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/HddsClientUtils.java
index 8c9a11a..d7e3f4d 100644
---
a/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/HddsClientUtils.java
+++
b/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/client/HddsClientUtils.java
@@ -49,8 +49,6 @@ import org.apache.ratis.protocol.AlreadyClosedException;
import org.apache.ratis.protocol.GroupMismatchException;
import org.apache.ratis.protocol.NotReplicatedException;
import org.apache.ratis.protocol.RaftRetryFailureException;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
import java.io.IOException;
import java.net.InetSocketAddress;
@@ -76,9 +74,6 @@ import java.util.concurrent.TimeoutException;
@InterfaceStability.Unstable
public final class HddsClientUtils {
- private static final Logger LOG = LoggerFactory.getLogger(
- HddsClientUtils.class);
-
private HddsClientUtils() {
}
diff --git
a/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java
b/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java
index f986fe3..f57700e 100644
---
a/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java
+++
b/hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BufferPool.java
@@ -94,7 +94,7 @@ public class BufferPool {
// always remove from head of the list and append at last
final ChunkBuffer buffer = bufferList.remove(0);
// Ensure the buffer to be r
