Mike Smith wrote: > Hi Dennis, > > But it doesn't make sense since the reducers' keys are URLs and the > heartbeat cannot be sent when the reduce task is called. Since I am > truncating my http content to be less than 100K and I don't get any file, > how come reducing a single record which is a single URL and writing its > parsed data into DFS takes more than 10 min!! Even if you load the > cluster > that should never happen. There should be another bug involved. >
Could you try to produce a thread dump of a task in such state? (kill -SIGQUIT pid) -- Best regards, Andrzej Bialecki <>< ___. ___ ___ ___ _ _ __________________________________ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
