Yan,
I have reached out to yarn-dev mailing list. I have not received any
response yet.
Wondering if there is any other channel where I can get some answers on
yarn.
- Shekar
On Tue, Jun 23, 2015 at 1:18 PM, Yan Fang yanfang...@gmail.com wrote:
Hi Shekar,
Cool. Let me know if it works.
Hi Shekar,
My guess is that, in order to get this property to take effect, you may
need to restart the yarn. Otherwise, send this question to the Yarn mailing
list, you may get more valuable answers.
Thanks,
Fang, Yan
yanfang...@gmail.com
On Mon, Jun 22, 2015 at 2:43 PM, Shekar Tippur
Yan,
I have restarted Yarn but I still see the same issue. I will post this
question on Yarn mailing list.
yarn-...@hadoop.apache.org
- Shekar
Hi Shekar,
Cool. Let me know if it works.
Thanks,
Fang, Yan
yanfang...@gmail.com
On Tue, Jun 23, 2015 at 12:40 PM, Shekar Tippur ctip...@gmail.com wrote:
Yan,
I have restarted Yarn but I still see the same issue. I will post this
question on Yarn mailing list.
yarn-...@hadoop.apache.org
This is what I see on Yarn monitoring page:
As we can see, there are 9998 apps pending. There is some 10k limit we are
hitting. I see only 1 app running.
Apps SubmittedApps PendingApps RunningApps CompletedContainers RunningMemory
UsedMemory TotalMemory ReservedVCores UsedVCores TotalVCores
Hi Shekar,
Ok. If there is only one application is running, if you kill this one, will
you still be able to see the processed messages coming? If not, I think the
code in your application maybe the cause of the problem. We can have a
further look at your code to see where the problem is.
Thanks,
Hi Shekar,
a. How do I detect it?
-- You can go to Yarn's monitoring page, usually, localhost:8088. May see
what are running.
b. How do I kill redundant jobs?
-- Just like what you do for any Yarn jobs. *yarn application -kill
applicationId* . If you are using the similar structure as the
Hello,
I have a scenario where for each incoming message, I see 3 corresponding
processed message.
I am suspecting that I may have submitted the same job multiple number of
times to Yarn.
If this is the case,
a. How do I detect it
b. How do I kill redundant jobs?
Could there be other reasons
