Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

2023-04-25 Thread Apache Jenkins Server 
For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/479/

[Apr 23, 2023, 7:31:51 PM] (github) HADOOP-18712. Upgrade to jetty 9.4.51 due 
to cve (#5574). Contributed by PJ Fanning.
[Apr 23, 2023, 7:43:02 PM] (github) HDFS-16988. Improve NameServices info at 
JournalNode web UI (#5584). Contributed by Zhaohui Wang.
[Apr 24, 2023, 7:17:12 AM] (github) HADOOP-18714. Wrong StringUtils.join() 
called in AbstractContractRootDirectoryTest (#5578)
[Apr 24, 2023, 10:53:25 AM] (github) HDFS-16986. EC: Fix locationBudget in 
getListing(). (#5582). Contributed by Shuyan Zhang.
[Apr 24, 2023, 2:46:40 PM] (github) HADOOP-18705. ABFS should exclude 
incompatible credential providers. (#5560)
[Apr 24, 2023, 4:04:28 PM] (github) HDFS-16975. 
FileWithSnapshotFeature.isCurrentFileDeleted is not reloaded from FSImage. 
(#5546)
[Apr 24, 2023, 10:00:56 PM] (github) HDFS-16981. Support getFileLinkStatus API 
in WebHDFS (#5572). Contributed by Hualong Zhang.
[Apr 24, 2023, 10:22:49 PM] (github) HADOOP-18694. 
Client.Connection#updateAddress needs to ensure that address is resolved before 
updating (#5542). Contributed by dzcxzl.




-1 overall


The following subsystems voted -1:
blanks hadolint mvnsite pathlen spotbugs unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   
hadoop-common-project/hadoop-common/src/test/resources/xml/external-dtd.xml 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml
 

spotbugs :

   module:hadoop-hdfs-project/hadoop-hdfs 
   Redundant nullcheck of oldLock, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.DataStorage.isPreUpgradableLayout(Storage$StorageDirectory))
 Redundant null check at DataStorage.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.DataStorage.isPreUpgradableLayout(Storage$StorageDirectory))
 Redundant null check at DataStorage.java:[line 695] 
   Redundant nullcheck of metaChannel, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MappableBlockLoader.verifyChecksum(long,
 FileInputStream, FileChannel, String) Redundant null check at 
MappableBlockLoader.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MappableBlockLoader.verifyChecksum(long,
 FileInputStream, FileChannel, String) Redundant null check at 
MappableBlockLoader.java:[line 138] 
   Redundant nullcheck of blockChannel, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MemoryMappableBlockLoader.load(long,
 FileInputStream, FileInputStream, String, ExtendedBlockId) Redundant null 
check at MemoryMappableBlockLoader.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MemoryMappableBlockLoader.load(long,
 FileInputStream, FileInputStream, String, ExtendedBlockId) Redundant null 
check at MemoryMappableBlockLoader.java:[line 75] 
   Redundant nullcheck of blockChannel, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.NativePmemMappableBlockLoader.load(long,
 FileInputStream, FileInputStream, String, ExtendedBlockId) Redundant null 
check at NativePmemMappableBlockLoader.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.NativePmemMappableBlockLoader.load(long,
 FileInputStream, FileInputStream, String, ExtendedBlockId) Redundant null 
check at NativePmemMappableBlockLoader.java:[line 85] 
   Redundant nullcheck of metaChannel, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.NativePmemMappableBlockLoader.verifyChecksumAndMapBlock(NativeIO$POSIX$$PmemMappedRegion,,
 long, FileInputStream, FileChannel, String) Redundant null check at 
NativePmemMappableBlockLoader.java:is known to be non-null in

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2023-04-25 Thread Apache Jenkins Server 
For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1008/

No changes


ERROR: File 'out/email-report.txt' does not exist

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Resolved] (HDFS-16672) Fix lease interval comparison in BlockReportLeaseManager

2023-04-25 Thread Ayush Saxena (Jira) 


 [ 
https://issues.apache.org/jira/browse/HDFS-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ayush Saxena resolved HDFS-16672.
-
Fix Version/s: 3.4.0
 Hadoop Flags: Reviewed
   Resolution: Fixed

> Fix lease interval comparison in BlockReportLeaseManager
> 
>
> Key: HDFS-16672
> URL: https://issues.apache.org/jira/browse/HDFS-16672
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: namenode
>Reporter: dzcxzl
>Assignee: dzcxzl
>Priority: Trivial
>  Labels: pull-request-available
> Fix For: 3.4.0
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> monotonicNowMs is generated by System.nanoTime(), direct comparison is not 
> recommended.
>  
> org.apache.hadoop.hdfs.server.blockmanagement.BlockReportLeaseManager#pruneIfExpired
> {code:java}
> if (monotonicNowMs < node.leaseTimeMs + leaseExpiryMs) {
>   return false;
> } {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-16991) Fix testMkdirsRaceWithObserverRead

2023-04-25 Thread fanluo (Jira) 
fanluo created HDFS-16991:
-

 Summary: Fix testMkdirsRaceWithObserverRead
 Key: HDFS-16991
 URL: https://issues.apache.org/jira/browse/HDFS-16991
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: hdfs
Affects Versions: 3.3.4
Reporter: fanluo


The test case testMkdirsRaceWithObserverRead which in TestObserverNode 
sometimes failed like this:
{code:java}
java.lang.AssertionError: Client #1 lastSeenStateId=-9223372036854775808 
activStateId=5
null    at org.junit.Assert.fail(Assert.java:89)
    at org.junit.Assert.assertTrue(Assert.java:42)
    at 
org.apache.hadoop.hdfs.server.namenode.ha.TestObserverNode.testMkdirsRaceWithObserverRead(TestObserverNode.java:607)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
    at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
 {code}
i think the Thread.sleep() should move into the sub threads, like this:
{code:java}
public void run() {
  try {
    fs.mkdirs(DIR_PATH);
    Thread.sleep(150); // wait until mkdir is logged
    clientState.lastSeenStateId = HATestUtil.getLastSeenStateId(fs);
    assertSentTo(fs, 0);    FileStatus stat = fs.getFileStatus(DIR_PATH);
    assertSentTo(fs, 2);
    assertTrue("Should be a directory", stat.isDirectory());
  } catch (FileNotFoundException ioe) {
    clientState.fnfe = ioe;
  } catch (Exception e) {
    fail("Unexpected exception: " + e);
  }
} {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-16990) HttpFS: Add Support getFileLinkStatus API

2023-04-25 Thread Hualong Zhang (Jira) 
Hualong Zhang created HDFS-16990:


 Summary: HttpFS: Add Support getFileLinkStatus API
 Key: HDFS-16990
 URL: https://issues.apache.org/jira/browse/HDFS-16990
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: httpfs
Affects Versions: 3.4.0
Reporter: Hualong Zhang
Assignee: Hualong Zhang


HttpFS should implement the *getFileLinkStatus* API already implemented in 
WebHDFS.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org