Re: I'm interested in working with HDFS-4680. Can somebody be a mentor?

2013-07-18 Thread Sreejith Ramakrishnan
Being a mentor, the duty is to introduce the candidate to open source development and guide him in aspects related to how open source works. Like how to make patches, how to ask for help in a mailing list etc. That's the essence. I'm ready to work on this anyway. But, if somebody could be my

I'm interested in working with HDFS-4680. Can somebody be a mentor?

2013-07-17 Thread Sreejith Ramakrishnan
Hey, I was originally researching options to work on ACCUMULO-1197. Basically, it was a bid to pass trace functionality through the DFSClient. I discussed with the guys over there on implementing a Google Dapper-style trace with HTrace. The guys at HBase are also trying to achieve the same HTrace

Re: I'm interested in working with HDFS-4680. Can somebody be a mentor?

2013-07-17 Thread Colin McCabe
Andrew Wang has been working on getting this kind of Dapper-style trace functionality in HDFS. He is on vacation this week, but next week he might have some ideas about how you could contribute and/or integrate with his patch. Doing this right with security, etc is a pretty big project and I

Re: I'm interested in working with HDFS-4680. Can somebody be a mentor?

2013-07-17 Thread Stack
Folks over at HBase would be interested in helping out. What does a mentor have to do? I poked around the icfoss link but didn't see list of duties (I've been know to be certified blind on occasion). I am not up on the malleability of hdfs RPC; is it just a matter of adding the trace info to a

Re: I'm interested in working with HDFS-4680. Can somebody be a mentor?

2013-07-17 Thread Todd Lipcon
I'm happy to help with this as well. I actually have a prototype patch that I built during a hackathon a few months ago, and was able to get a full stack trace including Client, NN, and DN. I'm on vacation this week but will try to post my prototype upstream when I get back. Feel free to ping me

Re: I'm interested in working with HDFS-4680. Can somebody be a mentor?

2013-07-17 Thread Suresh Srinivas
Please look at some of the work happening in HADOOP-9688, which is adding a unique UUID (16 bytes) for each RPC request. This is common to all Hadoop RPC, will be available in HDFS, YARN and MAPREDUCE. Please see the jira for more details. Reach out to me if you have any questions. On Wed, Jul