Re: Apache Spark

2021-08-12 Thread Aman Singh
Can you share the yarn logs? Spark version? Can enable debug mode for extra verbosity When you say localizing, few things to check: - Is there a firewall in between nodes? - Do we have disk space ? - What is the spark job trying to do? Is it working with large files? Looks like you are

Re: [Urgent] - CDH upgrade v5.4.5 to v5.8 - Cluster to different Cluster upgrade

2021-08-12 Thread Aman Singh
strangely, i see the question posting data as 2016, but this landed in my inbox a few minutes ago :) On Fri, Aug 13, 2021 at 2:11 PM Aman Singh wrote: > There are no issues moving within the same major versions. > > In Hbase the challenge is only if we move from Hbase 1.x to 2.x.

Re: [Urgent] - CDH upgrade v5.4.5 to v5.8 - Cluster to different Cluster upgrade

2021-08-12 Thread Aman Singh
There are no issues moving within the same major versions. In Hbase the challenge is only if we move from Hbase 1.x to 2.x. There we have to take care of MOB, coprocessors, Prefix etc. Anyway, moving/copying data across clusters does not cause issues. We only need to worry about in-place upgrades