Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

2022-05-27 Thread Apache Jenkins Server
For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/309/

[May 25, 2022 8:31:18 AM] (noreply) HADOOP-18240. Upgrade Yetus to 0.14.0 
(#4328)
[May 26, 2022 3:23:30 AM] (noreply) HADOOP-18251. Fix failure of extracting 
JIRA id from commit message in git_jira_fix_version_check.py. (#4344)
[May 26, 2022 5:39:49 AM] (noreply) HDFS-16561. Handle error returned by strtol
[May 26, 2022 6:51:55 AM] (noreply) YARN-11128. Fix comments in 
TestProportionalCapacityPreemptionPolicy* (#4271)
[May 26, 2022 5:11:10 PM] (noreply) HDFS-16583. DatanodeAdminDefaultMonitor can 
get stuck in an infinite loop holding the write lock (#4332)
[May 26, 2022 9:18:15 PM] (noreply) HDFS-16585.Add @VisibleForTesting in 
Dispatcher.java (#4337)
[May 27, 2022 3:36:07 AM] (noreply) HDFS-15225. RBF: Add snapshot counts to 
content summary in router. (#4356). Contributed by Ayush Saxena.




-1 overall


The following subsystems voted -1:
blanks pathlen spotbugs unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml
 

spotbugs :

   module:hadoop-hdfs-project/hadoop-hdfs 
   Redundant nullcheck of oldLock, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.DataStorage.isPreUpgradableLayout(Storage$StorageDirectory)
 Redundant null check at DataStorage.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.DataStorage.isPreUpgradableLayout(Storage$StorageDirectory)
 Redundant null check at DataStorage.java:[line 695] 
   Redundant nullcheck of metaChannel, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MappableBlockLoader.verifyChecksum(long,
 FileInputStream, FileChannel, String) Redundant null check at 
MappableBlockLoader.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MappableBlockLoader.verifyChecksum(long,
 FileInputStream, FileChannel, String) Redundant null check at 
MappableBlockLoader.java:[line 138] 
   Redundant nullcheck of blockChannel, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MemoryMappableBlockLoader.load(long,
 FileInputStream, FileInputStream, String, ExtendedBlockId) Redundant null 
check at MemoryMappableBlockLoader.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MemoryMappableBlockLoader.load(long,
 FileInputStream, FileInputStream, String, ExtendedBlockId) Redundant null 
check at MemoryMappableBlockLoader.java:[line 75] 
   Redundant nullcheck of blockChannel, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.NativePmemMappableBlockLoader.load(long,
 FileInputStream, FileInputStream, String, ExtendedBlockId) Redundant null 
check at NativePmemMappableBlockLoader.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.NativePmemMappableBlockLoader.load(long,
 FileInputStream, FileInputStream, String, ExtendedBlockId) Redundant null 
check at NativePmemMappableBlockLoader.java:[line 85] 
   Redundant nullcheck of metaChannel, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.NativePmemMappableBlockLoader.verifyChecksumAndMapBlock(NativeIO$POSIX$PmemMappedRegion,
 long, FileInputStream, FileChannel, String) Redundant null check at 
NativePmemMappableBlockLoader.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.NativePmemMappableBlockLoader.verifyChecksumAndMapBlock(NativeIO$POSIX$PmemMappedRegion,
 long, FileInputStream, FileChannel, String) Redundant null check at 
NativePmemMappableBlockLoader.java:[line 130] 
   
org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager$UserCounts
 doesn't override java.util.ArrayList.equals(Object) At 
RollingWindowManager.java:At 

[jira] [Resolved] (HADOOP-18234) s3a access point xml examples are wrong

2022-05-27 Thread groot (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-18234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

groot resolved HADOOP-18234.

Resolution: Fixed

> s3a access point xml examples are wrong
> ---
>
> Key: HADOOP-18234
> URL: https://issues.apache.org/jira/browse/HADOOP-18234
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: documentation, fs/s3
>Affects Versions: 3.3.2
>Reporter: Steve Loughran
>Assignee: groot
>Priority: Minor
>  Labels: pull-request-available
> Fix For: 3.3.4
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> the examples of s3a access point bindings are wrong, as the .bucket prefix is 
> missing
> {code}
> 
> fs.s3a.sample-bucket.accesspoint.arn
>  {ACCESSPOINT_ARN_HERE} 
> Configure S3a traffic to use this AccessPoint
> 
> {code}
> the property should be fs.s3a.bucket.sample-bucket.accesspoint.arn



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-27 Thread Viraj Jasani
Sounds good, yes they both are not blocker issues for release anyways
(hence +0), just wanted to get more insights. Thanks for the detailed
clarifications Ayush!

Changing my vote to +1 (non-binding).


On Fri, May 27, 2022 at 1:24 PM Ayush Saxena  wrote:

> The checksum stuff was addressed in HADOOP-16985, so that filename stuff
> is sorted only post 3.3.x
> BTW it is a known issue:
>
> https://issues.apache.org/jira/browse/HADOOP-16494?focusedCommentId=16927236=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16927236
>
> Must not be a blocker for us
>
> The RAT check failing with dependency issue. That also should work post
> 3.3.x because there is no Hadoop-maven-plugin dependency in Hadoop-yarn-api
> module post 3.3.x, HADOOP-16560 removed it.
> Ref:
> https://github.com/apache/hadoop/pull/1496/files#diff-f5d219eaf211871f9527ae48da59586e7e9958ea7649de74a1393e599caa6dd6L121-R122
>
> So, that is why the RAT check passes for 3.3.x+ without the need of this
> module. Committing HADOOP-16663, should solve this though.(I haven't tried
> though, just by looking at the problem)
>
> Good to have patches, but doesn't look like blockers to me. kind of build
> related stuffs only, nothing bad with our core Hadoop code.
>
> -Ayush
>
> On Sat, 28 May 2022 at 01:04, Viraj Jasani  wrote:
>
>> +0 (non-binding),
>>
>> * Signature/Checksum looks good, though I am not sure where
>> "target/artifacts" is coming from for the tars, here is the diff (this was
>> the case for 2.10.1 as well but checksum was correct):
>>
>> 1c1
>> < SHA512 (hadoop-2.10.2-site.tar.gz) =
>>
>> 3055a830003f5012660d92da68a317e15da5b73301c2c73cf618e724c67b7d830551b16928e0c28c10b66f04567e4b6f0b564647015bacc4677e232c0011537f
>> ---
>> > SHA512 (target/artifacts/hadoop-2.10.2-site.tar.gz) =
>>
>> 3055a830003f5012660d92da68a317e15da5b73301c2c73cf618e724c67b7d830551b16928e0c28c10b66f04567e4b6f0b564647015bacc4677e232c0011537f
>> 1c1
>> < SHA512 (hadoop-2.10.2-src.tar.gz) =
>>
>> 483b6a4efd44234153e21ffb63a9f551530a1627f983a8837c655ce1b8ef13486d7178a7917ed3f35525c338e7df9b23404f4a1b0db186c49880448988b88600
>> ---
>> > SHA512 (target/artifacts/hadoop-2.10.2-src.tar.gz) =
>>
>> 483b6a4efd44234153e21ffb63a9f551530a1627f983a8837c655ce1b8ef13486d7178a7917ed3f35525c338e7df9b23404f4a1b0db186c49880448988b88600
>> 1c1
>> < SHA512 (hadoop-2.10.2.tar.gz) =
>>
>> 13e95907073d815e3f86cdcc24193bb5eec0374239c79151923561e863326988c7f32a05fb7a1e5bc962728deb417f546364c2149541d6234221b00459154576
>> ---
>> > SHA512 (target/artifacts/hadoop-2.10.2.tar.gz) =
>>
>> 13e95907073d815e3f86cdcc24193bb5eec0374239c79151923561e863326988c7f32a05fb7a1e5bc962728deb417f546364c2149541d6234221b00459154576
>>
>> However, checksums are correct.
>>
>> * Builds from source look good
>>  - mvn clean install  -DskipTests
>>  - mvn clean package  -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>>
>> * Rat check, if run before building from source locally, fails with error:
>>
>> [ERROR] Plugin org.apache.hadoop:hadoop-maven-plugins:2.10.2 or one of its
>> dependencies could not be resolved: Could not find artifact
>> org.apache.hadoop:hadoop-maven-plugins:jar:2.10.2 in central (
>> https://repo.maven.apache.org/maven2) -> [Help 1]
>> [ERROR]
>>
>> However, once we build locally, rat check passes (because
>> hadoop-maven-plugins 2.10.2 would be present in local .m2).
>> Also, hadoop-maven-plugins:2.10.2 is available here
>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1350/org/apache/hadoop/hadoop-maven-plugins/2.10.2/
>>
>> * Ran sample HDFS and MapReduce commands, look good.
>>
>> Until we release Hadoop artifacts, hadoop-maven-plugins for that release
>> would not be present in the central maven repository, hence I am still
>> wondering how rat check failed only for this RC and not for any of
>> previous
>> release RCs. hadoop-vote.sh always runs rat check before building from
>> source locally.
>>
>>
>> On Tue, May 24, 2022 at 7:41 PM Masatake Iwasaki <
>> iwasak...@oss.nttdata.co.jp> wrote:
>>
>> > Hi all,
>> >
>> > Here's Hadoop 2.10.2 release candidate #0:
>> >
>> > The RC is available at:
>> >https://home.apache.org/~iwasakims/hadoop-2.10.2-RC0/
>> >
>> > The RC tag is at:
>> >https://github.com/apache/hadoop/releases/tag/release-2.10.2-RC0
>> >
>> > The Maven artifacts are staged at:
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1350
>> >
>> > You can find my public key at:
>> >https://downloads.apache.org/hadoop/common/KEYS
>> >
>> > Please evaluate the RC and vote.
>> > The vote will be open for (at least) 5 days.
>> >
>> > Thanks,
>> > Masatake Iwasaki
>> >
>> > -
>> > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
>> > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>> >
>> >
>>
>


Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-27 Thread Ayush Saxena
The checksum stuff was addressed in HADOOP-16985, so that filename stuff is
sorted only post 3.3.x
BTW it is a known issue:
https://issues.apache.org/jira/browse/HADOOP-16494?focusedCommentId=16927236=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16927236

Must not be a blocker for us

The RAT check failing with dependency issue. That also should work post
3.3.x because there is no Hadoop-maven-plugin dependency in Hadoop-yarn-api
module post 3.3.x, HADOOP-16560 removed it.
Ref:
https://github.com/apache/hadoop/pull/1496/files#diff-f5d219eaf211871f9527ae48da59586e7e9958ea7649de74a1393e599caa6dd6L121-R122

So, that is why the RAT check passes for 3.3.x+ without the need of this
module. Committing HADOOP-16663, should solve this though.(I haven't tried
though, just by looking at the problem)

Good to have patches, but doesn't look like blockers to me. kind of build
related stuffs only, nothing bad with our core Hadoop code.

-Ayush

On Sat, 28 May 2022 at 01:04, Viraj Jasani  wrote:

> +0 (non-binding),
>
> * Signature/Checksum looks good, though I am not sure where
> "target/artifacts" is coming from for the tars, here is the diff (this was
> the case for 2.10.1 as well but checksum was correct):
>
> 1c1
> < SHA512 (hadoop-2.10.2-site.tar.gz) =
>
> 3055a830003f5012660d92da68a317e15da5b73301c2c73cf618e724c67b7d830551b16928e0c28c10b66f04567e4b6f0b564647015bacc4677e232c0011537f
> ---
> > SHA512 (target/artifacts/hadoop-2.10.2-site.tar.gz) =
>
> 3055a830003f5012660d92da68a317e15da5b73301c2c73cf618e724c67b7d830551b16928e0c28c10b66f04567e4b6f0b564647015bacc4677e232c0011537f
> 1c1
> < SHA512 (hadoop-2.10.2-src.tar.gz) =
>
> 483b6a4efd44234153e21ffb63a9f551530a1627f983a8837c655ce1b8ef13486d7178a7917ed3f35525c338e7df9b23404f4a1b0db186c49880448988b88600
> ---
> > SHA512 (target/artifacts/hadoop-2.10.2-src.tar.gz) =
>
> 483b6a4efd44234153e21ffb63a9f551530a1627f983a8837c655ce1b8ef13486d7178a7917ed3f35525c338e7df9b23404f4a1b0db186c49880448988b88600
> 1c1
> < SHA512 (hadoop-2.10.2.tar.gz) =
>
> 13e95907073d815e3f86cdcc24193bb5eec0374239c79151923561e863326988c7f32a05fb7a1e5bc962728deb417f546364c2149541d6234221b00459154576
> ---
> > SHA512 (target/artifacts/hadoop-2.10.2.tar.gz) =
>
> 13e95907073d815e3f86cdcc24193bb5eec0374239c79151923561e863326988c7f32a05fb7a1e5bc962728deb417f546364c2149541d6234221b00459154576
>
> However, checksums are correct.
>
> * Builds from source look good
>  - mvn clean install  -DskipTests
>  - mvn clean package  -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>
> * Rat check, if run before building from source locally, fails with error:
>
> [ERROR] Plugin org.apache.hadoop:hadoop-maven-plugins:2.10.2 or one of its
> dependencies could not be resolved: Could not find artifact
> org.apache.hadoop:hadoop-maven-plugins:jar:2.10.2 in central (
> https://repo.maven.apache.org/maven2) -> [Help 1]
> [ERROR]
>
> However, once we build locally, rat check passes (because
> hadoop-maven-plugins 2.10.2 would be present in local .m2).
> Also, hadoop-maven-plugins:2.10.2 is available here
>
> https://repository.apache.org/content/repositories/orgapachehadoop-1350/org/apache/hadoop/hadoop-maven-plugins/2.10.2/
>
> * Ran sample HDFS and MapReduce commands, look good.
>
> Until we release Hadoop artifacts, hadoop-maven-plugins for that release
> would not be present in the central maven repository, hence I am still
> wondering how rat check failed only for this RC and not for any of previous
> release RCs. hadoop-vote.sh always runs rat check before building from
> source locally.
>
>
> On Tue, May 24, 2022 at 7:41 PM Masatake Iwasaki <
> iwasak...@oss.nttdata.co.jp> wrote:
>
> > Hi all,
> >
> > Here's Hadoop 2.10.2 release candidate #0:
> >
> > The RC is available at:
> >https://home.apache.org/~iwasakims/hadoop-2.10.2-RC0/
> >
> > The RC tag is at:
> >https://github.com/apache/hadoop/releases/tag/release-2.10.2-RC0
> >
> > The Maven artifacts are staged at:
> >
> https://repository.apache.org/content/repositories/orgapachehadoop-1350
> >
> > You can find my public key at:
> >https://downloads.apache.org/hadoop/common/KEYS
> >
> > Please evaluate the RC and vote.
> > The vote will be open for (at least) 5 days.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > -
> > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
> >
> >
>


[jira] [Created] (HADOOP-18266) Replace with HashSet/TreeSet constructor in Hadoop-common-project

2022-05-27 Thread Samrat Deb (Jira)
Samrat Deb created HADOOP-18266:
---

 Summary: Replace with HashSet/TreeSet constructor in 
Hadoop-common-project
 Key: HADOOP-18266
 URL: https://issues.apache.org/jira/browse/HADOOP-18266
 Project: Hadoop Common
  Issue Type: Sub-task
Reporter: Samrat Deb






--
This message was sent by Atlassian Jira
(v8.20.7#820007)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-27 Thread Viraj Jasani
+0 (non-binding),

* Signature/Checksum looks good, though I am not sure where
"target/artifacts" is coming from for the tars, here is the diff (this was
the case for 2.10.1 as well but checksum was correct):

1c1
< SHA512 (hadoop-2.10.2-site.tar.gz) =
3055a830003f5012660d92da68a317e15da5b73301c2c73cf618e724c67b7d830551b16928e0c28c10b66f04567e4b6f0b564647015bacc4677e232c0011537f
---
> SHA512 (target/artifacts/hadoop-2.10.2-site.tar.gz) =
3055a830003f5012660d92da68a317e15da5b73301c2c73cf618e724c67b7d830551b16928e0c28c10b66f04567e4b6f0b564647015bacc4677e232c0011537f
1c1
< SHA512 (hadoop-2.10.2-src.tar.gz) =
483b6a4efd44234153e21ffb63a9f551530a1627f983a8837c655ce1b8ef13486d7178a7917ed3f35525c338e7df9b23404f4a1b0db186c49880448988b88600
---
> SHA512 (target/artifacts/hadoop-2.10.2-src.tar.gz) =
483b6a4efd44234153e21ffb63a9f551530a1627f983a8837c655ce1b8ef13486d7178a7917ed3f35525c338e7df9b23404f4a1b0db186c49880448988b88600
1c1
< SHA512 (hadoop-2.10.2.tar.gz) =
13e95907073d815e3f86cdcc24193bb5eec0374239c79151923561e863326988c7f32a05fb7a1e5bc962728deb417f546364c2149541d6234221b00459154576
---
> SHA512 (target/artifacts/hadoop-2.10.2.tar.gz) =
13e95907073d815e3f86cdcc24193bb5eec0374239c79151923561e863326988c7f32a05fb7a1e5bc962728deb417f546364c2149541d6234221b00459154576

However, checksums are correct.

* Builds from source look good
 - mvn clean install  -DskipTests
 - mvn clean package  -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true

* Rat check, if run before building from source locally, fails with error:

[ERROR] Plugin org.apache.hadoop:hadoop-maven-plugins:2.10.2 or one of its
dependencies could not be resolved: Could not find artifact
org.apache.hadoop:hadoop-maven-plugins:jar:2.10.2 in central (
https://repo.maven.apache.org/maven2) -> [Help 1]
[ERROR]

However, once we build locally, rat check passes (because
hadoop-maven-plugins 2.10.2 would be present in local .m2).
Also, hadoop-maven-plugins:2.10.2 is available here
https://repository.apache.org/content/repositories/orgapachehadoop-1350/org/apache/hadoop/hadoop-maven-plugins/2.10.2/

* Ran sample HDFS and MapReduce commands, look good.

Until we release Hadoop artifacts, hadoop-maven-plugins for that release
would not be present in the central maven repository, hence I am still
wondering how rat check failed only for this RC and not for any of previous
release RCs. hadoop-vote.sh always runs rat check before building from
source locally.


On Tue, May 24, 2022 at 7:41 PM Masatake Iwasaki <
iwasak...@oss.nttdata.co.jp> wrote:

> Hi all,
>
> Here's Hadoop 2.10.2 release candidate #0:
>
> The RC is available at:
>https://home.apache.org/~iwasakims/hadoop-2.10.2-RC0/
>
> The RC tag is at:
>https://github.com/apache/hadoop/releases/tag/release-2.10.2-RC0
>
> The Maven artifacts are staged at:
>https://repository.apache.org/content/repositories/orgapachehadoop-1350
>
> You can find my public key at:
>https://downloads.apache.org/hadoop/common/KEYS
>
> Please evaluate the RC and vote.
> The vote will be open for (at least) 5 days.
>
> Thanks,
> Masatake Iwasaki
>
> -
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>
>


[jira] [Created] (HADOOP-18265) replace with constructor directly in hadoop-hdfs-project

2022-05-27 Thread Samrat Deb (Jira)
Samrat Deb created HADOOP-18265:
---

 Summary: replace with constructor directly in hadoop-hdfs-project 
 Key: HADOOP-18265
 URL: https://issues.apache.org/jira/browse/HADOOP-18265
 Project: Hadoop Common
  Issue Type: Sub-task
Reporter: Samrat Deb
Assignee: Samrat Deb






--
This message was sent by Atlassian Jira
(v8.20.7#820007)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Created] (HADOOP-18264) ZKDelegationTokenSecretManager should handle duplicate Token sequenceNums

2022-05-27 Thread Hector Sandoval Chaverri (Jira)
Hector Sandoval Chaverri created HADOOP-18264:
-

 Summary: ZKDelegationTokenSecretManager should handle duplicate 
Token sequenceNums
 Key: HADOOP-18264
 URL: https://issues.apache.org/jira/browse/HADOOP-18264
 Project: Hadoop Common
  Issue Type: Bug
  Components: security
Reporter: Hector Sandoval Chaverri


The ZKDelegationTokenSecretManager relies on the TokenIdentifier sequenceNumber 
to identify each Token in the ZK Store. It's possible for multiple 
TokenIdentifiers to share the same sequenceNumber, as this is an int that can 
overflow. 

The AbstractDelegationTokenSecretManager uses a Map so all properties in the TokenIdentifier must 
match. ZKDelegationTokenSecretManager should follow the same logic.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

2022-05-27 Thread Masatake Iwasaki

+1 from myself.

* launched pseudo distributed cluster including kms and httpfs with Kerberos 
and SSL enabled.
  * created encryption zone, put and read files via httpfs.
  * ran example MR wordcount over encryption zone.

* skimmed the contents of site documentation.

* built HBase 1.5.0, Hive 2.3.6 and Spark 2.4.5 against Hadoop 2.10.2 RC0
  on CentOS 7 (x86_64) by using Bigtop branch-1.5 and ran smoke-tests.
  https://github.com/apache/bigtop/pull/906

Masatake Iwasaki

On 2022/05/25 11:40, Masatake Iwasaki wrote:

Hi all,

Here's Hadoop 2.10.2 release candidate #0:

The RC is available at:
   https://home.apache.org/~iwasakims/hadoop-2.10.2-RC0/

The RC tag is at:
   https://github.com/apache/hadoop/releases/tag/release-2.10.2-RC0

The Maven artifacts are staged at:
   https://repository.apache.org/content/repositories/orgapachehadoop-1350

You can find my public key at:
   https://downloads.apache.org/hadoop/common/KEYS

Please evaluate the RC and vote.
The vote will be open for (at least) 5 days.

Thanks,
Masatake Iwasaki

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2022-05-27 Thread Apache Jenkins Server
For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/

[May 26, 2022 3:31:46 AM] (Masatake Iwasaki) HADOOP-18251. Fix failure of 
extracting JIRA id from commit message in git_jira_fix_version_check.py. (#4344)




-1 overall


The following subsystems voted -1:
asflicense hadolint mvnsite pathlen unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.security.ssl.TestSSLFactory 
   hadoop.fs.TestFileUtil 
   hadoop.hdfs.server.datanode.TestDirectoryScanner 
   hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys 
   
hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat 
   hadoop.hdfs.server.federation.router.TestRouterQuota 
   hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver 
   hadoop.hdfs.server.federation.resolver.order.TestLocalResolver 
   hadoop.yarn.server.resourcemanager.TestClientRMService 
   
hadoop.yarn.server.resourcemanager.monitor.invariants.TestMetricsInvariantChecker
 
   hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter 
   hadoop.mapreduce.lib.input.TestLineRecordReader 
   hadoop.mapred.TestLineRecordReader 
   hadoop.tools.TestDistCpSystem 
   hadoop.yarn.sls.TestSLSRunner 
   hadoop.resourceestimator.solver.impl.TestLpSolver 
   hadoop.resourceestimator.service.TestResourceEstimatorService 
  

   cc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/diff-compile-javac-root.txt
  [488K]

   checkstyle:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/diff-checkstyle-root.txt
  [14M]

   hadolint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/diff-patch-hadolint.txt
  [4.0K]

   mvnsite:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/patch-mvnsite-root.txt
  [564K]

   pathlen:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/diff-patch-pylint.txt
  [20K]

   shellcheck:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/diff-patch-shellcheck.txt
  [72K]

   whitespace:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/whitespace-eol.txt
  [12M]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/whitespace-tabs.txt
  [1.3M]

   javadoc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/patch-javadoc-root.txt
  [40K]

   unit:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [224K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [432K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt
  [16K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt
  [36K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt
  [20K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
  [116K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
  [104K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/patch-unit-hadoop-tools_hadoop-distcp.txt
  [28K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/674/artifact/out/patch-unit-hadoop-tools_hadoop-azure.txt
  [20K]