Hi,
sorry that I did not answer for so long, I didn't have the time to
investigate further. Where in the logs would I typically find the linkage
error?
If I cancel the task in the Flink webinterface the log looks like this:
INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job
I have seen NoClassDefFoundErrors even when the class is there if there is
an issue loading the class (usually related to JNI failing to load or a
static block failing). Try to find the first linkage error
(ExceptionInInitializer / UnsatisifedLinkError / ...) in the logs as it
typically has more de
I suspected that io.grpc:grpc-netty-shaded:jar:1.27.2 was incorrectly
shaded, but the JAR file contains the
io/grpc/netty/shaded/io/netty/util/collection/IntObjectHashMap$2 which is
reported as missing. Strange.
suztomo-macbookpro44% jar tf grpc-netty-shaded-1.27.2.jar |grep
IntObjectHashMap
*io/g
No, that was not the case. I'm still seeing this message when canceling a
pipeline. Sorry the spam.
On Fri, Oct 2, 2020 at 12:22 PM Kaymak, Tobias
wrote:
> I think this was caused by having the flink-runner defined twice in my
> pom. Oo
> (one time as defined with scope runtime, and one time wit
I think this was caused by having the flink-runner defined twice in my pom.
Oo
(one time as defined with scope runtime, and one time without)
On Fri, Oct 2, 2020 at 9:38 AM Kaymak, Tobias
wrote:
> Sorry that I forgot to include the versions, currently I'm on Beam 2.23.0
> / Flink 1.10.2 - I hav
Sorry that I forgot to include the versions, currently I'm on Beam 2.23.0 /
Flink 1.10.2 - I have a test dependency for cassandra (archinnov) which
should *not *be available at runtime, refers to netty and is included in
this tree, but the other two places where I find netty is in Flink and the
bea
Can you provide your beam and flink versions as well?
On Thu, Oct 1, 2020 at 5:59 AM Tomo Suzuki wrote:
> To fix the problem we need to identify which JAR file contains
> io.grpc.netty.shaded.io.netty.util.collection.IntObjectHashMap. Can you
> check which version of which artifact (I suspect i
To fix the problem we need to identify which JAR file contains
io.grpc.netty.shaded.io.netty.util.collection.IntObjectHashMap. Can you
check which version of which artifact (I suspect io.grpc:grpc-netty) has
the class in your runtime?
As far as I know, Beam's vendored (shaded) class files have th
Hello,
when deploying a Beam streaming pipeline on Flink and canceling it after
some time, the following can be seen in the logs:
2020-10-01 07:36:47,605 WARN
io.grpc.netty.shaded.io.netty.channel.epoll.EpollEventLoop- Unexpected
exception in the selector loop.
flink-taskmanager-7695c66775-x
