Re: Hadoop Community Sync Up Schedule

2019-08-20 Thread Matt Foley
Hi Wangda, thanks for this. A question about the schedule correction: > > 1) In the proposal, repeats are not properly. (I used bi-weekly instead of > 2nd/4th week as repeat frequency). I'd like to fix the frequency on Thu and > it will take effect starting next week. I understand that

Re: Hadoop Community Sync Up Schedule

2019-08-20 Thread Matt Foley
Hi Wangda, thanks for this. A question about the schedule correction: > > 1) In the proposal, repeats are not properly. (I used bi-weekly instead of > 2nd/4th week as repeat frequency). I'd like to fix the frequency on Thu and > it will take effect starting next week. I understand that

Re: What is the best way to analyze io latency in hdfs?

2019-08-20 Thread Julien Laurenceau
Hi, On Linux you can monitor système call of any process using: strace -p PIDofHDFSdatanode It can be very verbose but the information will be there. Did you try metrics available in ambari or cloudera manager ? Regards Le mar. 20 août 2019 à 02:47, Daegyu Han a écrit : > Hi all, > > I'm

Re: [DISCUSS] move storage community online sync schedule

2019-08-20 Thread Wei-Chiu Chuang
I don't see an objection so let's move to 10AM US Pacific Daylight Saving Time (UTC-7) starting this Wednesday. I'll update the relevant information. Further reminder, Konstantin will talk about NameNode Fine-Grained Locking. Please let me know if you have any feedbacks and ideas to share. Is

Re: Hadoop Community Sync Up Schedule

2019-08-20 Thread Wei-Chiu Chuang
+1 On Mon, Aug 19, 2019 at 8:32 PM Wangda Tan wrote: > Hi folks, > > We have run community sync up for 1.5 months. I spoke to folks offline and > got some feedback. Here's a summary of what I've observed from sync ups and > talked to organizers. > > Following sync ups have very good

Re: Hadoop Community Sync Up Schedule

2019-08-20 Thread Wei-Chiu Chuang
+1 On Mon, Aug 19, 2019 at 8:32 PM Wangda Tan wrote: > Hi folks, > > We have run community sync up for 1.5 months. I spoke to folks offline and > got some feedback. Here's a summary of what I've observed from sync ups and > talked to organizers. > > Following sync ups have very good

Re: Hadoop Community Sync Up Schedule

2019-08-20 Thread epa...@apache.org
Hi Wangda, Thank you for continuing to keep us moving forward and refining these vital sync-ups. > 3) Update the US [YARN/MapReduce] sync up time from 9AM to 10AM PDT. That puts it at noon central time, which is during our lunch hour. However, I am +1 for this if we are able to allow greater

Re: Hadoop Community Sync Up Schedule

2019-08-20 Thread epa...@apache.org
Hi Wangda, Thank you for continuing to keep us moving forward and refining these vital sync-ups. > 3) Update the US [YARN/MapReduce] sync up time from 9AM to 10AM PDT. That puts it at noon central time, which is during our lunch hour. However, I am +1 for this if we are able to allow greater

RE: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer

2019-08-20 Thread Bibinchundatt
Could you try the following 1. Switch to job user , Check “ ls - l ” to check access to jar . Check parent dir permissions too From: alex noure [mailto:hello123...@gmail.com] Sent: 20 August 2019 16:50 To: Prabhu Josephraj Cc: user@hadoop.apache.org;

Re: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer

2019-08-20 Thread alex noure
Hi Prabhu Thank you for your reply. I did the following: chmod 777 hadoop-yarn-server-nodemanager-.jar Restarted NodeManager, resourcemanager Still reporting an error Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer

Re: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer

2019-08-20 Thread Prabhu Josephraj
On Secure Cluster, The ContainerLocalizer JVM runs as job user. The below issue happens when the job user does not have access to the hadoop-yarn-server-nodemanager-.jar present on hadoop classpath of NodeManager machine. Could not find or load main class org.apache.hadoop.yarn.server.

Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer

2019-08-20 Thread alex noure
Hi all, When we configure kerberos to submit tasks, only the primary account can be submitted successfully, and other accounts cannot be submitted. Report Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer My question is

Re: Hadoop storage community online sync

2019-08-20 Thread Wei-Chiu Chuang
Great question! Currently Pacific Daylight Saving Time is UTC-7, and Pacific Standard Time, UTC-8 doesn't start until November 3rd. I am being too US-centric, but if the purpose is to invite more people, where many of them are US west coast based, we should do this following the US pacific time

Re: Hadoop storage community online sync

2019-08-20 Thread Akira Ajisaka
Thank you for the information. Now US pacific time is GMT-7, isn't it? -Akira On Tue, Aug 20, 2019 at 6:56 AM Wei-Chiu Chuang wrote: > > For this week, > We will have Konstantin and the LinkedIn folks to discuss a recent project > that's been baking for quite a while. This is an exciting