[jira] [Resolved] (HBASE-26646) WALPlayer should obtain token from filesystem

2023-05-04 Thread Bryan Beaudreault (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-26646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bryan Beaudreault resolved HBASE-26646.
---
Fix Version/s: 2.5.5
   (was: 2.5.0)
   Resolution: Fixed

Backported to 2.5, and updated fix version to be 2.5.5 instead of 2.5.0

> WALPlayer should obtain token from filesystem
> -
>
> Key: HBASE-26646
> URL: https://issues.apache.org/jira/browse/HBASE-26646
> Project: HBase
>  Issue Type: Bug
>Reporter: Yi Mei
>Assignee: Bryan Beaudreault
>Priority: Minor
> Fix For: 2.5.5, 2.4.10, 3.0.0-alpha-3
>
>
> When we use WALPlayer, we got the following exceptions:
> {code:java}
> 2021-12-27 17:20:13,388 WARN [main] org.apache.hadoop.mapred.YarnChild: 
> Exception running child : java.io.IOException: Failed on local exception: 
> java.io.IOException: org.apache.hadoop.security.AccessControlException: 
> Client cannot authenticate via:[TOKEN, KERBEROS]; Host Details : local host 
> is: "c4-hadoop-tst-st95.bj/10.132.18.11"; destination host is: 
> "c4-hadoop-tst-ct01.bj":58300; 
>     at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:775)
>     at org.apache.hadoop.ipc.Client.call(Client.java:1488)
>     at org.apache.hadoop.ipc.Client.call(Client.java:1415)
>     at 
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
>     at com.sun.proxy.$Proxy13.getFileInfo(Unknown Source)
>     at 
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:807)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>     at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:498)
>     at 
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:249)
>     at 
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:107)
>     at com.sun.proxy.$Proxy14.getFileInfo(Unknown Source)
>     at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2115)
>     at 
> org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1221)
>     at 
> org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1217)
>     at 
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
>     at 
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1233)
>     at 
> org.apache.hadoop.hbase.regionserver.wal.ReaderBase.init(ReaderBase.java:64)
>     at 
> org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.init(ProtobufLogReader.java:168)
>     at 
> org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:332)
>     at 
> org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:314)
>     at 
> org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:302)
>     at 
> org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:444)
>     at 
> org.apache.hadoop.hbase.wal.AbstractFSWALProvider.openReader(AbstractFSWALProvider.java:497)
>     at 
> org.apache.hadoop.hbase.mapreduce.WALInputFormat$WALRecordReader.openReader(WALInputFormat.java:161)
>     at 
> org.apache.hadoop.hbase.mapreduce.WALInputFormat$WALRecordReader.initialize(WALInputFormat.java:154)
>     at 
> org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:552)
>     at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:790)
>     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
>     at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:422)
>     at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1885)
>     at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (HBASE-26646) WALPlayer should obtain token from filesystem

2022-01-07 Thread Yi Mei (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-26646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yi Mei resolved HBASE-26646.

Fix Version/s: 2.5.0
   3.0.0-alpha-3
   2.4.10
   Resolution: Fixed

> WALPlayer should obtain token from filesystem
> -
>
> Key: HBASE-26646
> URL: https://issues.apache.org/jira/browse/HBASE-26646
> Project: HBase
>  Issue Type: Bug
>Reporter: Yi Mei
>Assignee: Yi Mei
>Priority: Minor
> Fix For: 2.5.0, 3.0.0-alpha-3, 2.4.10
>
>
> When we use WALPlayer, we got the following exceptions:
> {code:java}
> 2021-12-27 17:20:13,388 WARN [main] org.apache.hadoop.mapred.YarnChild: 
> Exception running child : java.io.IOException: Failed on local exception: 
> java.io.IOException: org.apache.hadoop.security.AccessControlException: 
> Client cannot authenticate via:[TOKEN, KERBEROS]; Host Details : local host 
> is: "c4-hadoop-tst-st95.bj/10.132.18.11"; destination host is: 
> "c4-hadoop-tst-ct01.bj":58300; 
>     at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:775)
>     at org.apache.hadoop.ipc.Client.call(Client.java:1488)
>     at org.apache.hadoop.ipc.Client.call(Client.java:1415)
>     at 
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
>     at com.sun.proxy.$Proxy13.getFileInfo(Unknown Source)
>     at 
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:807)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>     at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:498)
>     at 
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:249)
>     at 
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:107)
>     at com.sun.proxy.$Proxy14.getFileInfo(Unknown Source)
>     at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2115)
>     at 
> org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1221)
>     at 
> org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1217)
>     at 
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
>     at 
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1233)
>     at 
> org.apache.hadoop.hbase.regionserver.wal.ReaderBase.init(ReaderBase.java:64)
>     at 
> org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.init(ProtobufLogReader.java:168)
>     at 
> org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:332)
>     at 
> org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:314)
>     at 
> org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:302)
>     at 
> org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:444)
>     at 
> org.apache.hadoop.hbase.wal.AbstractFSWALProvider.openReader(AbstractFSWALProvider.java:497)
>     at 
> org.apache.hadoop.hbase.mapreduce.WALInputFormat$WALRecordReader.openReader(WALInputFormat.java:161)
>     at 
> org.apache.hadoop.hbase.mapreduce.WALInputFormat$WALRecordReader.initialize(WALInputFormat.java:154)
>     at 
> org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:552)
>     at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:790)
>     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
>     at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:422)
>     at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1885)
>     at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) {code}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)