MD5 sums b8217318a29ef69c58b921013eb019e5 /tmp/matrix8554072597307396201/A-000000000 41db088ff74c5efd5b766dba253efc03 /tmp/matrix8554072597307396201/A-000000200 b8217318a29ef69c58b921013eb019e5 /tmp/matrix8554072597307396201/A-000000400 41db088ff74c5efd5b766dba253efc03 /tmp/matrix8554072597307396201/A-000000600 c8dc2a7df82065b5c1e8284ff23aecc6 /tmp/matrix8554072597307396201/A-000000800 83bccdd2fa191e01d34646e2030f0e77 /tmp/matrix8554072597307396201/B-000000000 9d6878fb789d61d5453b994ea1a5c6db /tmp/matrix8554072597307396201/B-000000210 cbdf720b17ce25feb686effd1aa0ebef /tmp/matrix8554072597307396201/B-000000420 2f71d6ba6891b242575b5cc6ba1c4358 /tmp/matrix8554072597307396201/B-000000630 f50b76bb48c8f6a791a6d8206d980492 /tmp/matrix8554072597307396201/B-000000840 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-0 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-200 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-400 b84e4b01ffb9d691c87b496f8b4d84ec /tmp/matrix8554072597307396201/U-600 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-770
On Thu, Dec 29, 2011 at 12:52 AM, Ted Dunning <ted.dunn...@gmail.com> wrote: > Thanks. Good hints. > > I will take a look on a linux machine in the next few days. > > On Thu, Dec 29, 2011 at 12:42 AM, Dmitriy Lyubimov <dlie...@gmail.com>wrote: > >> yes. i would venture to say that U computation (or restoration) is >> somehow corrupted starting with 2nd block. at least it looks this way. >> >> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <dlie...@gmail.com> >> wrote: >> > A-reconstructed difference looks good up to row 399 but starting at >> > row 400 differences do not add up to 0 anymore (although both inputs >> > are not 0). >> > >> > So it doesn't look like trivial case of something is not initialized >> > on top of it. It does seem something to do with blocking mechanism >> > though since apparently 400th row is a boundary of some blocking >> > somewhere, but it is hard for me to see where it fails at this point. >> > >> > On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <dlie...@gmail.com> >> wrote: >> >> oh. it's because the synthetic input has only 4 singular values. >> >> >> >> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <dlie...@gmail.com> >> wrote: >> >>> But it is not a problem reading U or V files, that's indeed what U and >> >>> V contain. >> >>> >> >>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dlie...@gmail.com> >> wrote: >> >>>> U and V look suspect, degenerate (only 4 first columns are nonzero, >> >>>> the rest of matrices are zeros. >> >>>> >> >>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dlie...@gmail.com> >> wrote: >> >>>>> Yeah, fails for me on ubuntu without any special environment issues. >> >>>>> Which makes it easier, i can step thru. >> >>>>> >> >>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <ted.dunn...@gmail.com> >> wrote: >> >>>>>> What do checksums look like? >> >>>>>> >> >>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll < >> gsing...@apache.org>wrote: >> >>>>>> >> >>>>>>> I commented out the deletion of the dir in the tearDown. Not sure >> if that >> >>>>>>> looks reasonable or not, but on the surface they look equivalent. >> >>>>>>> >> >>>>>>> Here's the contents of the dir on Ubuntu: >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3 >> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4 >> >>>>>>> >> >>>>>>> Here's what my Mac looks like: >> >>>>>>> total 20296 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3 >> >>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4 >> >>>>>>> >> >>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote: >> >>>>>>> >> >>>>>>> > Yeah.. but this is a difference from the correct answer. I am >> moderately >> >>>>>>> > sure that this is a problem writing to the temp directory. >> >>>>>>> > >> >>>>>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll < >> gsing...@apache.org >> >>>>>>> >wrote: >> >>>>>>> > >> >>>>>>> >> It's expecting the answer to be 0, but it's some really large >> value. >> >>>>>>> >> >> >>>>>>> >> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest): >> >>>>>>> >> expected:<0.0> but was:<4131200.0000000037> >> >>>>>>> >> >> >>>>>>> >> >> >>>>>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote: >> >>>>>>> >> >> >>>>>>> >>> I think that the answer is 0 because the model is not being >> read and we >> >>>>>>> >> are >> >>>>>>> >>> swallowing an exception somewhere. This is what an >> uninitialized >> >>>>>>> matrix >> >>>>>>> >>> would give as a result. >> >>>>>>> >>> >> >>>>>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll < >> gsing...@apache.org >> >>>>>>> >>> wrote: >> >>>>>>> >>> >> >>>>>>> >>>> I can reproduce outside of Jenkins. It really seems odd that >> the >> >>>>>>> answer >> >>>>>>> >>>> is off by so much. >> >>>>>>> >>>> >> >>>>>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote: >> >>>>>>> >>>> >> >>>>>>> >>>>> I vaguely remember Jenkins had problems with creating stuff >> in Java >> >>>>>>> tmp >> >>>>>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks >> in local >> >>>>>>> >> mr >> >>>>>>> >>>>> mode legitimately using boxed task temporary space. >> >>>>>>> >>>>> >> >>>>>>> >>>>> OK I'll try to scan for the problem tomorrow. >> >>>>>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" < >> ted.dunn...@gmail.com> >> >>>>>>> wrote: >> >>>>>>> >>>>> >> >>>>>>> >>>>>> So I am like everybody else. The test works for me. >> >>>>>>> >>>>>> >> >>>>>>> >>>>>> My suspicion is that there is something going on with the >> temporary >> >>>>>>> >>>>>> directory that I am trying to use and that the environment >> that >> >>>>>>> >> Jenkins >> >>>>>>> >>>> is >> >>>>>>> >>>>>> using is somehow strange. >> >>>>>>> >>>>>> >> >>>>>>> >>>>>> The only slightly surprising idiom I am using is to create a >> >>>>>>> temporary >> >>>>>>> >>>>>> file, delete it and recreate it as a directory. I even >> check the >> >>>>>>> >> return >> >>>>>>> >>>>>> values from the delete and the mkdir. >> >>>>>>> >>>>>> >> >>>>>>> >>>>>> I will keep looking. >> >>>>>>> >>>>>> >> >>>>>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning < >> >>>>>>> ted.dunn...@gmail.com> >> >>>>>>> >>>>>> wrote: >> >>>>>>> >>>>>> >> >>>>>>> >>>>>>> Indeed it does. Thanks for pointing that out. >> >>>>>>> >>>>>>> >> >>>>>>> >>>>>>> This error is very strange. >> >>>>>>> >>>>>>> >> >>>>>>> >>>>>>> >> >>>>>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov < >> >>>>>>> >> dlie...@gmail.com >> >>>>>>> >>>>>>> wrote: >> >>>>>>> >>>>>>> >> >>>>>>> >>>>>>>> Ted, >> >>>>>>> >>>>>>>> >> >>>>>>> >>>>>>>> do you have an idea why this test may be failing? I think >> this >> >>>>>>> test >> >>>>>>> >>>>>> comes >> >>>>>>> >>>>>>>> with M-792 commit. >> >>>>>>> >>>>>>>> >> >>>>>>> >>>>>>>> I can take a look at it, I suspect something in the >> environment >> >>>>>>> can >> >>>>>>> >> be >> >>>>>>> >>>>>>>> tripping it. >> >>>>>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sro...@gmail.com> >> wrote: >> >>>>>>> >>>>>>>> >> >>>>>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather >> than a real >> >>>>>>> >> test >> >>>>>>> >>>>>>>>> failure. At least, stuff passes for me locally, and >> that's what's >> >>>>>>> >>>>>>>>> important. >> >>>>>>> >>>>>>>>> So I'm ignoring these. >> >>>>>>> >>>>>>>>> >> >>>>>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman >> >>>>>>> >>>>>>>>> <jeast...@windwardsolutions.com> wrote: >> >>>>>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run >> locally >> >>>>>>> >> for >> >>>>>>> >>>>>>>> me. >> >>>>>>> >>>>>>>>> Does >> >>>>>>> >>>>>>>>>> anybody have an idea what the problem is? This close to >> a >> >>>>>>> release >> >>>>>>> >> it >> >>>>>>> >>>>>>>>> would >> >>>>>>> >>>>>>>>>> be really nice to have Jenkins on our side. >> >>>>>>> >>>>>>>>>> Jeff >> >>>>>>> >>>>>>>>>> >> >>>>>>> >>>>>>>>> >> >>>>>>> >>>>>>>> >> >>>>>>> >>>>>>> >> >>>>>>> >>>>>>> >> >>>>>>> >>>>>> >> >>>>>>> >>>> >> >>>>>>> >>>> -------------------------------------------- >> >>>>>>> >>>> Grant Ingersoll >> >>>>>>> >>>> http://www.lucidimagination.com >> >>>>>>> >>>> >> >>>>>>> >>>> >> >>>>>>> >>>> >> >>>>>>> >>>> >> >>>>>>> >> >> >>>>>>> >> -------------------------------------------- >> >>>>>>> >> Grant Ingersoll >> >>>>>>> >> http://www.lucidimagination.com >> >>>>>>> >> >> >>>>>>> >> >> >>>>>>> >> >> >>>>>>> >> >> >>>>>>> >> >>>>>>> -------------------------------------------- >> >>>>>>> Grant Ingersoll >> >>>>>>> http://www.lucidimagination.com >> >>>>>>> >> >>>>>>> >> >>>>>>> >> >>>>>>> >>
