A-0 and A-400 match, and A-200 and A-600 match. Bs are all unique. U-200 matches U-400
On Thu, Dec 29, 2011 at 12:58 AM, Dmitriy Lyubimov <dlie...@gmail.com> wrote: > note identical md5 for u200 and u400. > > On Thu, Dec 29, 2011 at 12:57 AM, Dmitriy Lyubimov <dlie...@gmail.com> wrote: >> MD5 sums >> >> b8217318a29ef69c58b921013eb019e5 /tmp/matrix8554072597307396201/A-000000000 >> 41db088ff74c5efd5b766dba253efc03 /tmp/matrix8554072597307396201/A-000000200 >> b8217318a29ef69c58b921013eb019e5 /tmp/matrix8554072597307396201/A-000000400 >> 41db088ff74c5efd5b766dba253efc03 /tmp/matrix8554072597307396201/A-000000600 >> c8dc2a7df82065b5c1e8284ff23aecc6 /tmp/matrix8554072597307396201/A-000000800 >> 83bccdd2fa191e01d34646e2030f0e77 /tmp/matrix8554072597307396201/B-000000000 >> 9d6878fb789d61d5453b994ea1a5c6db /tmp/matrix8554072597307396201/B-000000210 >> cbdf720b17ce25feb686effd1aa0ebef /tmp/matrix8554072597307396201/B-000000420 >> 2f71d6ba6891b242575b5cc6ba1c4358 /tmp/matrix8554072597307396201/B-000000630 >> f50b76bb48c8f6a791a6d8206d980492 /tmp/matrix8554072597307396201/B-000000840 >> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-0 >> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-200 >> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-400 >> b84e4b01ffb9d691c87b496f8b4d84ec /tmp/matrix8554072597307396201/U-600 >> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-770 >> >> >> On Thu, Dec 29, 2011 at 12:52 AM, Ted Dunning <ted.dunn...@gmail.com> wrote: >>> Thanks. Good hints. >>> >>> I will take a look on a linux machine in the next few days. >>> >>> On Thu, Dec 29, 2011 at 12:42 AM, Dmitriy Lyubimov <dlie...@gmail.com>wrote: >>> >>>> yes. i would venture to say that U computation (or restoration) is >>>> somehow corrupted starting with 2nd block. at least it looks this way. >>>> >>>> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <dlie...@gmail.com> >>>> wrote: >>>> > A-reconstructed difference looks good up to row 399 but starting at >>>> > row 400 differences do not add up to 0 anymore (although both inputs >>>> > are not 0). >>>> > >>>> > So it doesn't look like trivial case of something is not initialized >>>> > on top of it. It does seem something to do with blocking mechanism >>>> > though since apparently 400th row is a boundary of some blocking >>>> > somewhere, but it is hard for me to see where it fails at this point. >>>> > >>>> > On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <dlie...@gmail.com> >>>> wrote: >>>> >> oh. it's because the synthetic input has only 4 singular values. >>>> >> >>>> >> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <dlie...@gmail.com> >>>> wrote: >>>> >>> But it is not a problem reading U or V files, that's indeed what U and >>>> >>> V contain. >>>> >>> >>>> >>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dlie...@gmail.com> >>>> wrote: >>>> >>>> U and V look suspect, degenerate (only 4 first columns are nonzero, >>>> >>>> the rest of matrices are zeros. >>>> >>>> >>>> >>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dlie...@gmail.com> >>>> wrote: >>>> >>>>> Yeah, fails for me on ubuntu without any special environment issues. >>>> >>>>> Which makes it easier, i can step thru. >>>> >>>>> >>>> >>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <ted.dunn...@gmail.com> >>>> wrote: >>>> >>>>>> What do checksums look like? >>>> >>>>>> >>>> >>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll < >>>> gsing...@apache.org>wrote: >>>> >>>>>> >>>> >>>>>>> I commented out the deletion of the dir in the tearDown. Not sure >>>> if that >>>> >>>>>>> looks reasonable or not, but on the surface they look equivalent. >>>> >>>>>>> >>>> >>>>>>> Here's the contents of the dir on Ubuntu: >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3 >>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4 >>>> >>>>>>> >>>> >>>>>>> Here's what my Mac looks like: >>>> >>>>>>> total 20296 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3 >>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4 >>>> >>>>>>> >>>> >>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote: >>>> >>>>>>> >>>> >>>>>>> > Yeah.. but this is a difference from the correct answer. I am >>>> moderately >>>> >>>>>>> > sure that this is a problem writing to the temp directory. >>>> >>>>>>> > >>>> >>>>>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll < >>>> gsing...@apache.org >>>> >>>>>>> >wrote: >>>> >>>>>>> > >>>> >>>>>>> >> It's expecting the answer to be 0, but it's some really large >>>> value. >>>> >>>>>>> >> >>>> >>>>>>> >>>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest): >>>> >>>>>>> >> expected:<0.0> but was:<4131200.0000000037> >>>> >>>>>>> >> >>>> >>>>>>> >> >>>> >>>>>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote: >>>> >>>>>>> >> >>>> >>>>>>> >>> I think that the answer is 0 because the model is not being >>>> read and we >>>> >>>>>>> >> are >>>> >>>>>>> >>> swallowing an exception somewhere. This is what an >>>> uninitialized >>>> >>>>>>> matrix >>>> >>>>>>> >>> would give as a result. >>>> >>>>>>> >>> >>>> >>>>>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll < >>>> gsing...@apache.org >>>> >>>>>>> >>> wrote: >>>> >>>>>>> >>> >>>> >>>>>>> >>>> I can reproduce outside of Jenkins. It really seems odd that >>>> the >>>> >>>>>>> answer >>>> >>>>>>> >>>> is off by so much. >>>> >>>>>>> >>>> >>>> >>>>>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote: >>>> >>>>>>> >>>> >>>> >>>>>>> >>>>> I vaguely remember Jenkins had problems with creating stuff >>>> in Java >>>> >>>>>>> tmp >>>> >>>>>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks >>>> in local >>>> >>>>>>> >> mr >>>> >>>>>>> >>>>> mode legitimately using boxed task temporary space. >>>> >>>>>>> >>>>> >>>> >>>>>>> >>>>> OK I'll try to scan for the problem tomorrow. >>>> >>>>>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" < >>>> ted.dunn...@gmail.com> >>>> >>>>>>> wrote: >>>> >>>>>>> >>>>> >>>> >>>>>>> >>>>>> So I am like everybody else. The test works for me. >>>> >>>>>>> >>>>>> >>>> >>>>>>> >>>>>> My suspicion is that there is something going on with the >>>> temporary >>>> >>>>>>> >>>>>> directory that I am trying to use and that the environment >>>> that >>>> >>>>>>> >> Jenkins >>>> >>>>>>> >>>> is >>>> >>>>>>> >>>>>> using is somehow strange. >>>> >>>>>>> >>>>>> >>>> >>>>>>> >>>>>> The only slightly surprising idiom I am using is to create a >>>> >>>>>>> temporary >>>> >>>>>>> >>>>>> file, delete it and recreate it as a directory. I even >>>> check the >>>> >>>>>>> >> return >>>> >>>>>>> >>>>>> values from the delete and the mkdir. >>>> >>>>>>> >>>>>> >>>> >>>>>>> >>>>>> I will keep looking. >>>> >>>>>>> >>>>>> >>>> >>>>>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning < >>>> >>>>>>> ted.dunn...@gmail.com> >>>> >>>>>>> >>>>>> wrote: >>>> >>>>>>> >>>>>> >>>> >>>>>>> >>>>>>> Indeed it does. Thanks for pointing that out. >>>> >>>>>>> >>>>>>> >>>> >>>>>>> >>>>>>> This error is very strange. >>>> >>>>>>> >>>>>>> >>>> >>>>>>> >>>>>>> >>>> >>>>>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov < >>>> >>>>>>> >> dlie...@gmail.com >>>> >>>>>>> >>>>>>> wrote: >>>> >>>>>>> >>>>>>> >>>> >>>>>>> >>>>>>>> Ted, >>>> >>>>>>> >>>>>>>> >>>> >>>>>>> >>>>>>>> do you have an idea why this test may be failing? I think >>>> this >>>> >>>>>>> test >>>> >>>>>>> >>>>>> comes >>>> >>>>>>> >>>>>>>> with M-792 commit. >>>> >>>>>>> >>>>>>>> >>>> >>>>>>> >>>>>>>> I can take a look at it, I suspect something in the >>>> environment >>>> >>>>>>> can >>>> >>>>>>> >> be >>>> >>>>>>> >>>>>>>> tripping it. >>>> >>>>>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sro...@gmail.com> >>>> wrote: >>>> >>>>>>> >>>>>>>> >>>> >>>>>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather >>>> than a real >>>> >>>>>>> >> test >>>> >>>>>>> >>>>>>>>> failure. At least, stuff passes for me locally, and >>>> that's what's >>>> >>>>>>> >>>>>>>>> important. >>>> >>>>>>> >>>>>>>>> So I'm ignoring these. >>>> >>>>>>> >>>>>>>>> >>>> >>>>>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman >>>> >>>>>>> >>>>>>>>> <jeast...@windwardsolutions.com> wrote: >>>> >>>>>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run >>>> locally >>>> >>>>>>> >> for >>>> >>>>>>> >>>>>>>> me. >>>> >>>>>>> >>>>>>>>> Does >>>> >>>>>>> >>>>>>>>>> anybody have an idea what the problem is? This close to >>>> a >>>> >>>>>>> release >>>> >>>>>>> >> it >>>> >>>>>>> >>>>>>>>> would >>>> >>>>>>> >>>>>>>>>> be really nice to have Jenkins on our side. >>>> >>>>>>> >>>>>>>>>> Jeff >>>> >>>>>>> >>>>>>>>>> >>>> >>>>>>> >>>>>>>>> >>>> >>>>>>> >>>>>>>> >>>> >>>>>>> >>>>>>> >>>> >>>>>>> >>>>>>> >>>> >>>>>>> >>>>>> >>>> >>>>>>> >>>> >>>> >>>>>>> >>>> -------------------------------------------- >>>> >>>>>>> >>>> Grant Ingersoll >>>> >>>>>>> >>>> http://www.lucidimagination.com >>>> >>>>>>> >>>> >>>> >>>>>>> >>>> >>>> >>>>>>> >>>> >>>> >>>>>>> >>>> >>>> >>>>>>> >> >>>> >>>>>>> >> -------------------------------------------- >>>> >>>>>>> >> Grant Ingersoll >>>> >>>>>>> >> http://www.lucidimagination.com >>>> >>>>>>> >> >>>> >>>>>>> >> >>>> >>>>>>> >> >>>> >>>>>>> >> >>>> >>>>>>> >>>> >>>>>>> -------------------------------------------- >>>> >>>>>>> Grant Ingersoll >>>> >>>>>>> http://www.lucidimagination.com >>>> >>>>>>> >>>> >>>>>>> >>>> >>>>>>> >>>> >>>>>>> >>>> -- Lance Norskog goks...@gmail.com
