Nopes, that hasn’t been released yet
Sent from my iPhone
> On 16-Jun-2022, at 9:25 AM, Leon Xu wrote:
>
>
> Thanks. I tried setting "ipc.maximum.response.length" to 256 MB but still
> getting the same error.
> For HADOOP-17914, is there a patched hadoop library that I can try out? Our
> cluster is only like 50 nodes, which shouldn't be a problem.
>
> Thanks
> Leon
>
>> On Wed, Jun 15, 2022 at 8:20 PM Ayush Saxena wrote:
>> The first one: NoSuchMethodException isn't something to worry about, it is
>> just irrelevant noise, HADOOP-16453 fixed it in 3.3.0
>> The second one is due to the rpc response length only, if you can patch it
>> with HADOOP-17914 and try, it can give you the actual response length as
>> well in the exception message.
>> The RPC call seems to getNodeReports() from the trace, I think that might
>> return a huge response if the cluster size is big...
>>
>> -Ayush
>>
>>> On Thu, 16 Jun 2022 at 08:17, Leon Xu wrote:
>>> Thanks for the quick response. Overall I think 128M is pretty big and don't
>>> expect that to be the issue.
>>> There seems to be two errors:
>>> First one is
>>> java.lang.NoSuchMethodException:
>>> org.apache.hadoop.ipc.RpcException.(java.lang.String)
>>> at java.lang.Class.getConstructor0(Class.java:3349) ~[?:?]
>>> at java.lang.Class.getConstructor(Class.java:2151) ~[?:?]
>>> at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:830)
>>> [hadoop-common-3.1.0.jar!/:?]
>>> at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:806)
>>> [hadoop-common-3.1.0.jar!/:?]
>>> at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1495)
>>> [hadoop-common-3.1.0.jar!/:?]
>>> at org.apache.hadoop.ipc.Client.call(Client.java:1437)
>>> [hadoop-common-3.1.0.jar!/:?]
>>> at org.apache.hadoop.ipc.Client.call(Client.java:1347)
>>> [hadoop-common-3.1.0.jar!/:?]
>>> at
>>> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:228)
>>> [hadoop-common-3.1.0.jar!/:?]
>>> at
>>> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:116)
>>> [hadoop-common-3.1.0.jar!/:?]
>>> at com.sun.proxy.$Proxy188.getClusterNodes(Unknown Source) [?:?]
>>> at
>>> org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterNodes(ApplicationClientProtocolPBClientImpl.java:319)
>>> [hadoop-yarn-common-3.1.0.jar!/:?]
>>> at jdk.internal.reflect.GeneratedMethodAccessor141.invoke(Unknown Source)
>>> ~[?:?]
>>> at
>>> jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> ~[?:?]
>>> at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
>>> at
>>> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422)
>>> [hadoop-common-3.1.0.jar!/:?]
>>> at
>>> org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165)
>>> [hadoop-common-3.1.0.jar!/:?]
>>> at
>>> org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157)
>>> [hadoop-common-3.1.0.jar!/:?]
>>> at
>>> org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95)
>>> [hadoop-common-3.1.0.jar!/:?]
>>> at
>>> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359)
>>> [hadoop-common-3.1.0.jar!/:?]
>>> at com.sun.proxy.$Proxy189.getClusterNodes(Unknown Source) [?:?]
>>> at
>>> org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNodeReports(YarnClientImpl.java:614)
>>> [hadoop-yarn-client-3.1.0.jar!/:?]
>>> at
>>> org.apache.flink.yarn.YarnClientYarnClusterInformationRetriever.getMaxVcores(YarnClientYarnClusterInformationRetriever.java:44)
>>> [flink-yarn_2.12-1.12.7.jar!/:1.12.7]
>>> at
>>> org.apache.flink.yarn.YarnClusterDescriptor.isReadyForDeployment(YarnClusterDescriptor.java:321)
>>> [flink-yarn_2.12-1.12.7.jar!/:1.12.7]
>>> at
>>> org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:534)
>>> [flink-yarn_2.12-1.12.7.jar!/:1.12.7]
>>> at
>>> org.apache.flink.yarn.YarnClusterDescriptor.deployApplicationCluster(YarnClusterDescriptor.java:458)
>>> [flink-yarn_2.12-1.12.7.jar!/:1.12.7]
>>> at
>>> com.attentivemobile.eventplatformregistration.flinkappmode.YarnServiceImpl.deployFlinkCluster(YarnServiceImpl.java:91)
>>> [classes!/:?]
>>> at
>>> com.attentivemobile.eventplatformregistration.flinkappmode.FlinkServiceImpl.startJob(FlinkServiceImpl.java:79)
>>> [classes!/:?]
>>> at
>>> com.attentivemobile.eventplatformregistration.flinkappmode.api.FlinkDeploymentController.startJob(FlinkDeploymentController.java:29)
>>> [classes!/:?]
>>> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> ~[?:?]
>>> at
>>> jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>> ~[?:?]
>>> at
>>> jdk.internal.reflect.DelegatingMethodAccessorImpl.i
