Just a quick follow up on this upgrade - where we also switched to run
on openjdk-17 - with some small hitches it worked nicely.
Our testing hadn't revealed all the '--add-opens' options needed for
some of the services, so we had to add:
--add-opens=java.base/java.lang=ALL-UNNAMED to HADOOP_TASKTRACKER_OPTS
--add-opens=java.base/java.lang=ALL-UNNAMED to YARN_RESOURCEMANAGER_OPTS
and
YARN_NODEMANAGER_OPTS="--add-opens=java.base/java.lang=ALL-UNNAMED"
YARN_TIMELINESERVER_OPTS="--add-opens=java.base/java.lang=ALL-UNNAMED
--add-opens=java.base/java.math=ALL-UNNAMED
--add-opens=java.base/java.util=ALL-UNNAMED
--add-opens=java.base/java.util.concurrent=ALL-UNNAMED
--add-opens=java.base/java.net=ALL-UNNAMED
--add-opens=java.base/java.text=ALL-UNNAMED"
In the log4j.properties I hadn't removed references to 'EventCounter',
so we had this pop up a lot, until we did:
log4j:ERROR Could not instantiate appender named "EventCounter".
For openjdk-17 I had to make a symlink
/usr/lib/jvm/java-17-openjdk-amd64/lib/amd64 pointing to the lib/
folder to make the datanode daemons start, but I did find that in
testing.
For the yarn-nodemanager services I couldn't find a nice way to
resolve that they were looking for libcrypto1.1.so - we are running
Ubuntu 22.04, where openssl1.1 isn't available, so I resorted to
installing the package from Ubuntu 20.04. Not ideal, but not a
dealbreaker either.
I hope this is helpful to someone :-)
Best regards,
Adam
--
"No more than that, but very powerful all the Adam Sjøgren
same; simple things are good." [email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
