Hi Jai,
Thanks for your email. I suspect that its the Strings in tight loop reason
as you have suggested. I have a loop in my udf that does the following.
while((startInd = someLog.indexOf('[',startInd)) 0) {
endInd = someLog.indexOf(']', startInd);
That's a max of 3.3K single-character strings. Even with the java overhead
that shouldn't be more than a meg right?
none of these should make it out of young gen assuming the list cats
doesn't stick around outside the udf.
On Thu, Feb 24, 2011 at 3:49 PM, Aniket Mokashi
Thanks everyone for helping me out, I figured it was one of those logical
errors which lead to infinite loops. Actually indexof operation doesnt
always return -1 on failure which was causing this to get into infinite
loop (I should have thought about this). (ie. indexof('[', 187) would
return 187
