[jira] [Reopened] (MAHOUT-1284) DummyRecordWriter's bug with reused Writables

2013-07-28 Thread Sebastian Schelter (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sebastian Schelter reopened MAHOUT-1284:



The committed patch causes TestCanopyCreation to fail.

> DummyRecordWriter's bug with reused Writables
> -
>
> Key: MAHOUT-1284
> URL: https://issues.apache.org/jira/browse/MAHOUT-1284
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.7, 0.8
>Reporter: Maysam Yabandeh
>Assignee: Suneel Marthi
>Priority: Minor
>  Labels: test
> Fix For: 0.9
>
> Attachments: MAHOUT-1284.patch, MAHOUT-1284.patch
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> It is a recommended practice to reuse the Writable objects. 
> DummyRecordWriter, which is used for testing in Mahout, however keeps the 
> same Writable instance in a map: next time that the user reuses the Writable 
> object, the internal map of DummyRecordWriter changes as well. This makes 
> DummyRecordWriter fail for testing the MapReduce jobs that reuse the 
> Writables.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (MAHOUT-1283) Matrix multiplication problem in mahout-math-0.6.jar. Details can be seen in the Carrot2's forum discussion whose link is given in the description.

2013-07-28 Thread Ted Dunning (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Dunning resolved MAHOUT-1283.
-

Resolution: Won't Fix

This applies to Mahout 0.6 and to classes that don't even exist in Mahout since 
0.7.

The fix is to upgrade to the current release.

> Matrix multiplication problem in mahout-math-0.6.jar. Details can be seen in 
> the Carrot2's forum discussion whose link is given in the description.
> ---
>
> Key: MAHOUT-1283
> URL: https://issues.apache.org/jira/browse/MAHOUT-1283
> Project: Mahout
>  Issue Type: Bug
>Reporter: Seyfullah Demir
>
> http://carrot2-users-and-developers-forum.607571.n2.nabble.com/A-question-about-Apache-Mahout-API-td7578181.html

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Mahout-Quality #2167

2013-07-28 Thread Apache Jenkins Server 
See 

Changes:

[smarthi] MAHOUT-1284: DummyRecordWriter's bug with reused Writables

--
[...truncated 197753 lines...]
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in 
org.apache.mahout.cf.taste.impl.model.GenericItemPreferenceArrayTest
Running org.apache.mahout.cf.taste.impl.neighborhood.ThresholdNeighborhoodTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.08 sec - in 
org.apache.mahout.cf.taste.impl.neighborhood.ThresholdNeighborhoodTest
Running org.apache.mahout.cf.taste.impl.neighborhood.NearestNNeighborhoodTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.084 sec - in 
org.apache.mahout.cf.taste.impl.neighborhood.NearestNNeighborhoodTest
Running org.apache.mahout.cf.taste.impl.transforms.CaseAmplificationTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.034 sec - in 
org.apache.mahout.cf.taste.impl.transforms.CaseAmplificationTest
Running org.apache.mahout.cf.taste.impl.transforms.InverseUserFrequencyTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.094 sec - in 
org.apache.mahout.cf.taste.impl.transforms.InverseUserFrequencyTest
Running org.apache.mahout.cf.taste.impl.transforms.ZScoreTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.101 sec - in 
org.apache.mahout.cf.taste.impl.transforms.ZScoreTest
Running org.apache.mahout.common.iterator.CountingIteratorTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.mahout.common.iterator.CountingIteratorTest
Running org.apache.mahout.common.iterator.TestSamplingIterator
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.956 sec - in 
org.apache.mahout.common.iterator.TestSamplingIterator
Running org.apache.mahout.common.iterator.TestFixedSizeSampler
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.04 sec - in 
org.apache.mahout.common.iterator.TestFixedSizeSampler
Running org.apache.mahout.common.iterator.TestStableFixedSizeSampler
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.046 sec - in 
org.apache.mahout.common.iterator.TestStableFixedSizeSampler
Running org.apache.mahout.common.AbstractJobTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.438 sec - in 
org.apache.mahout.common.AbstractJobTest
Running org.apache.mahout.common.lucene.AnalyzerUtilsTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec - in 
org.apache.mahout.common.lucene.AnalyzerUtilsTest
Running org.apache.mahout.common.IntPairWritableTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.mahout.common.IntPairWritableTest
Running 
org.apache.mahout.common.distance.TestWeightedEuclideanDistanceMeasureTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec - in 
org.apache.mahout.common.distance.TestWeightedEuclideanDistanceMeasureTest
Running org.apache.mahout.common.distance.TestChebyshevMeasure
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.043 sec - in 
org.apache.mahout.common.distance.TestChebyshevMeasure
Running org.apache.mahout.common.distance.TestWeightedManhattanDistanceMeasure
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec - in 
org.apache.mahout.common.distance.TestWeightedManhattanDistanceMeasure
Running org.apache.mahout.common.distance.TestEuclideanDistanceMeasure
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.061 sec - in 
org.apache.mahout.common.distance.TestEuclideanDistanceMeasure
Running org.apache.mahout.common.distance.CosineDistanceMeasureTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.043 sec - in 
org.apache.mahout.common.distance.CosineDistanceMeasureTest
Running org.apache.mahout.common.distance.TestTanimotoDistanceMeasure
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.062 sec - in 
org.apache.mahout.common.distance.TestTanimotoDistanceMeasure
Running org.apache.mahout.common.distance.TestMinkowskiMeasure
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.045 sec - in 
org.apache.mahout.common.distance.TestMinkowskiMeasure
Running org.apache.mahout.common.distance.TestManhattanDistanceMeasure
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec - in 
org.apache.mahout.common.distance.TestManhattanDistanceMeasure
Running org.apache.mahout.common.distance.TestMahalanobisDistanceMeasure
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.05 sec - in 
org.apache.mahout.common.distance.TestMahalanobisDistanceMeasure
Running org.apache.mahout.common.StringUtilsTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.182 sec - in 
org.apache.mahout.common.StringUtilsTest
Running org.apache.mahout.common.DummyRecordWriterTest
Tests run: 1, Failures: 0, Errors: 0, Skipped:

[jira] [Commented] (MAHOUT-1283) Matrix multiplication problem in mahout-math-0.6.jar. Details can be seen in the Carrot2's forum discussion whose link is given in the description.

2013-07-28 Thread Suneel Marthi (JIRA) 

[ 
https://issues.apache.org/jira/browse/MAHOUT-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13722152#comment-13722152
 ] 

Suneel Marthi commented on MAHOUT-1283:
---

[~seyfullahdemir] Given that there's been a Mahout 0.8 release, is this JIRA 
still relevent?

> Matrix multiplication problem in mahout-math-0.6.jar. Details can be seen in 
> the Carrot2's forum discussion whose link is given in the description.
> ---
>
> Key: MAHOUT-1283
> URL: https://issues.apache.org/jira/browse/MAHOUT-1283
> Project: Mahout
>  Issue Type: Bug
>Reporter: Seyfullah Demir
>
> http://carrot2-users-and-developers-forum.607571.n2.nabble.com/A-question-about-Apache-Mahout-API-td7578181.html

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (MAHOUT-1296) Remove deprecated algorithms

2013-07-28 Thread Sebastian Schelter (JIRA) 
Sebastian Schelter created MAHOUT-1296:
--

 Summary: Remove deprecated algorithms
 Key: MAHOUT-1296
 URL: https://issues.apache.org/jira/browse/MAHOUT-1296
 Project: Mahout
  Issue Type: Improvement
Reporter: Sebastian Schelter
Assignee: Sebastian Schelter
 Fix For: 0.9


Remove the algorithms we chose to deprecate in MAHOUT-1250

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (MAHOUT-1284) DummyRecordWriter's bug with reused Writables

2013-07-28 Thread Suneel Marthi (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi resolved MAHOUT-1284.
---

Resolution: Fixed

> DummyRecordWriter's bug with reused Writables
> -
>
> Key: MAHOUT-1284
> URL: https://issues.apache.org/jira/browse/MAHOUT-1284
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.7, 0.8
>Reporter: Maysam Yabandeh
>Assignee: Suneel Marthi
>Priority: Minor
>  Labels: test
> Fix For: 0.9
>
> Attachments: MAHOUT-1284.patch, MAHOUT-1284.patch
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> It is a recommended practice to reuse the Writable objects. 
> DummyRecordWriter, which is used for testing in Mahout, however keeps the 
> same Writable instance in a map: next time that the user reuses the Writable 
> object, the internal map of DummyRecordWriter changes as well. This makes 
> DummyRecordWriter fail for testing the MapReduce jobs that reuse the 
> Writables.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Closed] (MAHOUT-833) Make conversion to sequence files map-reduce

2013-07-28 Thread Suneel Marthi (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAHOUT-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi closed MAHOUT-833.



> Make conversion to sequence files map-reduce
> 
>
> Key: MAHOUT-833
> URL: https://issues.apache.org/jira/browse/MAHOUT-833
> Project: Mahout
>  Issue Type: Improvement
>  Components: Integration
>Affects Versions: 0.7
>Reporter: Grant Ingersoll
>Assignee: Suneel Marthi
>  Labels: MAHOUT_INTRO_CONTRIBUTE
> Fix For: 0.8
>
> Attachments: MAHOUT-833-final.patch, MAHOUT-833.patch, 
> MAHOUT-833.patch
>
>
> Given input that is on HDFS, the SequenceFilesFrom.java classes should be 
> able to do their work in parallel.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: Proposal: scala DSL module for Mahout linear algebra.

2013-07-28 Thread Ted Dunning 
After letting this soak for a bit, I would tend to prefer either full-on R
(less preferred) or Matlab with defects (more preferred).  Matlab with
defects would use * for matrix multiplication and have a method name for
element by element product.

It is fine to have special syntax modules, but I think that this isn't all
that big a deal.


On Sun, Jul 28, 2013 at 11:17 AM, Dmitriy Lyubimov wrote:

> yeah. we are out of luck with matlab syntax.
>
> *&, *|, *^, *%, *#, *@, *~, *?, *!, *>, *<, *\ all work . '*.' or '*,' will
> not work. "*:" or ":*" have special meaning.
>
>
> On Sun, Jul 28, 2013 at 10:58 AM, Dmitriy Lyubimov  >wrote:
>
> > FWIW,
> >
> > one approach might be to separate DSL into several. E.g. RLikeOps and
> > MatlabLikeOps or WhateverOps, none of which is imported by default. and
> > then the code would have to say "import RLikeOps._" to enalbe R-like DSL,
> > and vice versa.
> >
> > But matlab style '*.' symbol unfortunately doesn't seem to work in scala
> > without backquotes. apparently scala treats '.' 'as a keyword and can't
> > reduce it as a part of anything else.
> >
> >
> > On Sat, Jul 27, 2013 at 6:43 PM, Dmitriy Lyubimov  >wrote:
> >
> >>
> >>
> >>
> >> On Sat, Jul 27, 2013 at 6:31 PM, Dmitriy Lyubimov  >wrote:
> >>
> >>>
> >>>
> >>>
> >>> >
>  > diagv(1 /: s)
>  >
> 
>  But since this is just the inverse of the matrix, and I imagine it's
>  actually
>  clearer to do just diagv(s).inverse instead of diagv(1 /: s)
> 
> 
> >>> Well. DSL is just the icing. Nobody's taking the cake away.
> >>>
> >>> in a sense that, once/if/when Mahout supports inverse(), it would be
> >>> exactly how one might use it. DSL is not about implementation, it is
> about
> >>> semantic sugar only. It only maps to what exists.
> >>>
> >>> On a side note, it never actually occurred to me to call pinv() or
> >>> solve() on a diagonal matrix. Or orthonormal for that matter. Their
> >>> identities are so appealing it kind of becomes second nature after some
> >>> time. the only use for solve() i had is actually for solving linear
> >>> equations. In my R prototype for SSVD [1] one will find exactly the
> same
> >>> style code, i.e.  diag(1/e$values) .
> >>>
> >>> pardon, this should read "non-signular" of course, an honest typo.
> >>
> >>
> >>> Even then you probably actually want leftInverse() and rightInverse(),
> >>> not just inverse, which is only defined for *non *singular square
> >>> matrices and would be equal right and left inverses in that case. Which
> >>> oddly enough brings us back to left-associative and right-associative
> >>> operations.
> >>>
> >>> [1]
> >>>
> https://cwiki.apache.org/confluence/download/attachments/27832158/ssvd.R?version=1&modificationDate=1323358453000
> >>>
> >>>
> >>
> >
>

Re: Jenkins build is back to normal : Mahout-Quality #2166

2013-07-28 Thread Stevo Slavić 
Mahout build is oscillating because test SearchSanityTest.testRemoval is
oscillating. When it fails, it fails for LocalitySensitiveHashSearch
searcher only.

I've run this test couple of times in IDE, most of the time it's
successful, but occasionally it fails.
With breakpoint on line 166, and breakpoint condition
Math.abs(r.get(0).getValue().minus(r0.get(1).getValue()).norm (1) - 0) >
1.0e-8

one of the failures had following variable state:

x =
[{0:0.8709558437987425,1:-0.5375954118626808,2:-1.2425196954788476,3:-0.5963352681084106,4:1.0979837347756136,5:2.304185373890536,6:0.25793628051644957,7:-1.134330442919324,8:1.597646398122005,9:0.8298520595445593,10:0.6261553451858568,11:-1.1887039545363631,12:0.5869327492264573,13:0.28388860533192856,14:-1.3022503895547264,15:0.6010871637821463,16:0.746145422813361,17:1.1176489418882314,18:0.12290804380398342,19:-0.7023943607753743},
{0:-0.1273613082447137,1:0.5212805226355095,2:-1.3441436944174596,3:0.726170066826851,4:0.771368418859047,5:0.01430669137394401,6:-1.0322788220328099,7:0.9800796113367815,8:1.0860923051790574,9:-0.5343931502079539,10:-0.8687519451795613,11:-0.4882818867652608,12:0.5763217636362794,13:-1.5319064044424902,14:1.5805638933745385,15:1.1042306701927427,16:0.8039127800857652,17:0.06535662950296073,18:0.16616159580914874,19:0.547757546046}]

r0 =
[0]=>{0:0.8709558437987425,1:-0.5375954118626808,2:-1.2425196954788476,3:-0.5963352681084106,4:1.0979837347756136,5:2.304185373890536,6:0.25793628051644957,7:-1.134330442919324,8:1.597646398122005,9:0.8298520595445593,10:0.6261553451858568,11:-1.1887039545363631,12:0.5869327492264573,13:0.28388860533192856,14:-1.3022503895547264,15:0.6010871637821463,16:0.746145422813361,17:1.1176489418882314,18:0.12290804380398342,19:-0.7023943607753743}
weight 0

[1]=>
{0:-0.20483940907349352,1:0.11976413233109141,2:-0.446414355106293,3:-1.7367952330678786,4:0.38238934234736355,5:0.6975417327142289,6:0.3373969986394851,7:-1.4185380951449957,8:0.9265441416353332,9:-0.025206163271980428,10:0.4669637747091974,11:-0.5737988084119644,12:0.41358433275511775,13:0.177386844272387,14:-1.346843287707939,15:0.3409985498083112,16:0.273396568351321,17:0.535280502127145,18:-0.903059026848925,19:-0.8379568998394694}
weight 3.1676437428926834

[2]=>
{0:0.8249102943426255,1:-1.3029973079099118,2:-0.6637757770704698,3:-0.6872922698053289,4:0.8694850261953001,5:2.0098551642810314,6:0.6329036548247581,7:-0.7020002439436349,8:1.1002127917459246,9:0.9940539101040394,10:1.2930352335192057,11:1.2969741235560996,12:0.5655788109525552,13:0.3352483698563293,14:-0.07778210967771995,15:0.21446631032850147,16:0.19873363445983003,17:-0.299301008269592,18:-0.3475216337380752,19:-0.6413611008146741}
weight 3.5326455510724935

[3]=>
{0:1.0213160889001143,1:-0.16764174017854278,2:-0.8248105102044536,3:0.548181150451324,4:1.2389184164722173,5:0.2894603912982171,6:0.4878734279209343,7:-0.880556725985863,8:1.82674712512,9:-0.4546221613342545,10:0.3506596412191718,11:-0.6414730833164245,12:-0.13282164842381447,13:0.45057016018778245,14:-1.5111928535925796,15:0.06638106718301788,16:0.08281114228255751,17:-0.6421195739702901,18:-0.5493966162085773,19:-0.007304932871986156}
weight 3.642139801900397
...

r =
[0]=>
{0:0.8249102943426255,1:-1.3029973079099118,2:-0.6637757770704698,3:-0.6872922698053289,4:0.8694850261953001,5:2.0098551642810314,6:0.6329036548247581,7:-0.7020002439436349,8:1.1002127917459246,9:0.9940539101040394,10:1.2930352335192057,11:1.2969741235560996,12:0.5655788109525552,13:0.3352483698563293,14:-0.07778210967771995,15:0.21446631032850147,16:0.19873363445983003,17:-0.299301008269592,18:-0.3475216337380752,19:-0.6413611008146741}
weight 3.5326455510724935

[1]=>
{0:1.0213160889001143,1:-0.16764174017854278,2:-0.8248105102044536,3:0.548181150451324,4:1.2389184164722173,5:0.2894603912982171,6:0.4878734279209343,7:-0.880556725985863,8:1.82674712512,9:-0.4546221613342545,10:0.3506596412191718,11:-0.6414730833164245,12:-0.13282164842381447,13:0.45057016018778245,14:-1.5111928535925796,15:0.06638106718301788,16:0.08281114228255751,17:-0.6421195739702901,18:-0.5493966162085773,19:-0.007304932871986156}
weight 3.642139801900397

[2]=>
{0:1.6656465845840556,1:0.6717244738768022,2:-0.11589200853467475,3:-1.505832511237,4:-0.6229838627352531,5:0.9744547121420478,6:0.5863699160394856,7:-1.2460776338162076,8:1.7748095928030267,9:0.7468726003405439,10:0.6084109063104702,11:-1.8578009892923697,12:-0.8413781857292507,13:0.6656257410413803,14:-0.6330806168110932,15:0.095425316213816,16:1.208742880515909,17:0.6308515482408196,18:0.8135753619367572,19:0.2227766502790239}
weight 3.7683177596914277

[3]=>
{0:1.0178665512250946,1:-0.6883855950038557,2:-0.04178788478187503,3:-0.538402076928077,4:0.6054117921440514,5:0.3977226709629301,6:-0.9347093442045187,7:-0.30351297076438905,8:1.443995518669909,9:0.5206899006395286,10:0.6910907561625238,11:-0.9735926881509751,12:0.03088350548161232,13:1.9198317061992651,14:-0.023091788306616047,15:-0.64677

Build failed in Jenkins: mahout-nightly » Mahout Integration #1305

2013-07-28 Thread Apache Jenkins Server 
See 


--
Jul 28, 2013 11:25:05 PM org.apache.maven.cli.event.ExecutionEventLogger 
projectStarted
INFO: 
Jul 28, 2013 11:25:05 PM org.apache.maven.cli.event.ExecutionEventLogger 
projectStarted
INFO: 
Jul 28, 2013 11:25:05 PM org.apache.maven.cli.event.ExecutionEventLogger 
projectStarted
INFO: Building Mahout Integration 0.9-SNAPSHOT
Jul 28, 2013 11:25:05 PM org.apache.maven.cli.event.ExecutionEventLogger 
projectStarted
INFO: 
Jul 28, 2013 11:25:06 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: 
Jul 28, 2013 11:25:06 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: --- maven-clean-plugin:2.4.1:clean (default-clean) @ mahout-integration 
---
[INFO] Deleting 

Jul 28, 2013 11:25:06 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: 
Jul 28, 2013 11:25:06 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: --- maven-resources-plugin:2.6:resources (default-resources) @ 
mahout-integration ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 0 resource
Jul 28, 2013 11:25:06 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: 
Jul 28, 2013 11:25:06 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: --- maven-compiler-plugin:3.1:compile (default-compile) @ 
mahout-integration ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 131 source files to 

[WARNING] Note: Some input files use or override a deprecated API.
[WARNING] Note: Recompile with -Xlint:deprecation for details.
[WARNING] Note: 

 uses unchecked or unsafe operations.
[WARNING] Note: Recompile with -Xlint:unchecked for details.
Jul 28, 2013 11:25:09 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: 
Jul 28, 2013 11:25:09 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: --- maven-resources-plugin:2.6:testResources (default-testResources) @ 
mahout-integration ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 10 resources
Jul 28, 2013 11:25:09 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: 
Jul 28, 2013 11:25:09 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ 
mahout-integration ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 39 source files to 

[WARNING] Note: Some input files use or override a deprecated API.
[WARNING] Note: Recompile with -Xlint:deprecation for details.
Jul 28, 2013 11:25:09 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: 
Jul 28, 2013 11:25:09 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: --- maven-surefire-plugin:2.15:test (default-test) @ mahout-integration 
---
[INFO] Surefire report directory: 

[INFO] parallel='classes', perCoreThreadCount=false, threadCount=1, 
useUnlimitedThreads=false

---
 T E S T S
---

---
 T E S T S
---
Running 
org.apache.mahout.cf.taste.impl.similarity.jdbc.MySQLJDBCInMemoryItemSimilarityTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.191 sec - in 
org.apache.mahout.cf.taste.impl.similarity.jdbc.MySQLJDBCInMemoryItemSimilarityTest
Running org.apache.mahout.clustering.TestClusterEvaluator
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.874 sec - 
in org.apache.mahout.clustering.TestClusterEvaluator
Running org.apache.mahout.clustering.TestClusterDumper
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.003 sec - in 
org.apache.mahout.clustering.TestClusterDumper
Running org.apache.mahout.clustering.dirichlet.TestL1ModelClustering
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.016 sec - in 
org.apache.mahout.clustering.dirichlet.TestL1ModelClustering
Running org.apache.mahout.clustering.cdbw.TestCDbwEvaluator
Test

Build failed in Jenkins: mahout-nightly #1305

2013-07-28 Thread Apache Jenkins Server 
See 

--
[...truncated 1937 lines...]
Uploading: 
https://repository.apache.org/content/repositories/snapshots/org/apache/mahout/mahout-core/0.9-SNAPSHOT/mahout-core-0.9-20130728.232503-15-job.jar
Uploaded: 
https://repository.apache.org/content/repositories/snapshots/org/apache/mahout/mahout-core/0.9-SNAPSHOT/mahout-core-0.9-20130728.232503-15-job.jar
 (19483 KB at 22733.3 KB/sec)
Uploading: 
https://repository.apache.org/content/repositories/snapshots/org/apache/mahout/mahout-core/0.9-SNAPSHOT/maven-metadata.xml
Uploaded: 
https://repository.apache.org/content/repositories/snapshots/org/apache/mahout/mahout-core/0.9-SNAPSHOT/maven-metadata.xml
 (2 KB at 23.7 KB/sec)
Uploading: 
https://repository.apache.org/content/repositories/snapshots/org/apache/mahout/mahout-core/0.9-SNAPSHOT/mahout-core-0.9-20130728.232503-15-sources.jar
Uploaded: 
https://repository.apache.org/content/repositories/snapshots/org/apache/mahout/mahout-core/0.9-SNAPSHOT/mahout-core-0.9-20130728.232503-15-sources.jar
 (1154 KB at 9772.5 KB/sec)
Uploading: 
https://repository.apache.org/content/repositories/snapshots/org/apache/mahout/mahout-core/0.9-SNAPSHOT/maven-metadata.xml
Uploaded: 
https://repository.apache.org/content/repositories/snapshots/org/apache/mahout/mahout-core/0.9-SNAPSHOT/maven-metadata.xml
 (2 KB at 21.8 KB/sec)
Jul 28, 2013 11:25:05 PM org.apache.maven.cli.event.ExecutionEventLogger 
projectStarted
INFO: 
Jul 28, 2013 11:25:05 PM org.apache.maven.cli.event.ExecutionEventLogger 
projectStarted
INFO: 
Jul 28, 2013 11:25:05 PM org.apache.maven.cli.event.ExecutionEventLogger 
projectStarted
INFO: Building Mahout Integration 0.9-SNAPSHOT
Jul 28, 2013 11:25:05 PM org.apache.maven.cli.event.ExecutionEventLogger 
projectStarted
INFO: 
Jul 28, 2013 11:25:06 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: 
Jul 28, 2013 11:25:06 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: --- maven-clean-plugin:2.4.1:clean (default-clean) @ mahout-integration 
---
[INFO] Deleting 

Jul 28, 2013 11:25:06 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: 
Jul 28, 2013 11:25:06 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: --- maven-resources-plugin:2.6:resources (default-resources) @ 
mahout-integration ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 0 resource
Jul 28, 2013 11:25:06 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: 
Jul 28, 2013 11:25:06 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: --- maven-compiler-plugin:3.1:compile (default-compile) @ 
mahout-integration ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 131 source files to 

[WARNING] Note: Some input files use or override a deprecated API.
[WARNING] Note: Recompile with -Xlint:deprecation for details.
[WARNING] Note: 

 uses unchecked or unsafe operations.
[WARNING] Note: Recompile with -Xlint:unchecked for details.
Jul 28, 2013 11:25:09 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: 
Jul 28, 2013 11:25:09 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: --- maven-resources-plugin:2.6:testResources (default-testResources) @ 
mahout-integration ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 10 resources
Jul 28, 2013 11:25:09 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: 
Jul 28, 2013 11:25:09 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ 
mahout-integration ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 39 source files to 

[WARNING] Note: Some input files use or override a deprecated API.
[WARNING] Note: Recompile with -Xlint:deprecation for details.
Jul 28, 2013 11:25:09 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: 
Jul 28, 2013 11:25:09 PM org.apache.maven.cli.event.ExecutionEventLogger 
mojoStarted
INFO: --- maven-surefire-plugin:2.15:test (default-test) @ mahout-integration 
---
[INFO] Surefire report directory: 

[INFO] parallel='classes', perCoreThreadCount=false, threadCount=1

Jenkins build is back to normal : Mahout-Quality #2166

2013-07-28 Thread Apache Jenkins Server 
See

Re: Proposal: scala DSL module for Mahout linear algebra.

2013-07-28 Thread Dmitriy Lyubimov 
yeah. we are out of luck with matlab syntax.

*&, *|, *^, *%, *#, *@, *~, *?, *!, *>, *<, *\ all work . '*.' or '*,' will
not work. "*:" or ":*" have special meaning.


On Sun, Jul 28, 2013 at 10:58 AM, Dmitriy Lyubimov wrote:

> FWIW,
>
> one approach might be to separate DSL into several. E.g. RLikeOps and
> MatlabLikeOps or WhateverOps, none of which is imported by default. and
> then the code would have to say "import RLikeOps._" to enalbe R-like DSL,
> and vice versa.
>
> But matlab style '*.' symbol unfortunately doesn't seem to work in scala
> without backquotes. apparently scala treats '.' 'as a keyword and can't
> reduce it as a part of anything else.
>
>
> On Sat, Jul 27, 2013 at 6:43 PM, Dmitriy Lyubimov wrote:
>
>>
>>
>>
>> On Sat, Jul 27, 2013 at 6:31 PM, Dmitriy Lyubimov wrote:
>>
>>>
>>>
>>>
>>> >
 > diagv(1 /: s)
 >

 But since this is just the inverse of the matrix, and I imagine it's
 actually
 clearer to do just diagv(s).inverse instead of diagv(1 /: s)


>>> Well. DSL is just the icing. Nobody's taking the cake away.
>>>
>>> in a sense that, once/if/when Mahout supports inverse(), it would be
>>> exactly how one might use it. DSL is not about implementation, it is about
>>> semantic sugar only. It only maps to what exists.
>>>
>>> On a side note, it never actually occurred to me to call pinv() or
>>> solve() on a diagonal matrix. Or orthonormal for that matter. Their
>>> identities are so appealing it kind of becomes second nature after some
>>> time. the only use for solve() i had is actually for solving linear
>>> equations. In my R prototype for SSVD [1] one will find exactly the same
>>> style code, i.e.  diag(1/e$values) .
>>>
>>> pardon, this should read "non-signular" of course, an honest typo.
>>
>>
>>> Even then you probably actually want leftInverse() and rightInverse(),
>>> not just inverse, which is only defined for *non *singular square
>>> matrices and would be equal right and left inverses in that case. Which
>>> oddly enough brings us back to left-associative and right-associative
>>> operations.
>>>
>>> [1]
>>> https://cwiki.apache.org/confluence/download/attachments/27832158/ssvd.R?version=1&modificationDate=1323358453000
>>>
>>>
>>
>

Re: Proposal: scala DSL module for Mahout linear algebra.

2013-07-28 Thread Dmitriy Lyubimov 
FWIW,

one approach might be to separate DSL into several. E.g. RLikeOps and
MatlabLikeOps or WhateverOps, none of which is imported by default. and
then the code would have to say "import RLikeOps._" to enalbe R-like DSL,
and vice versa.

But matlab style '*.' symbol unfortunately doesn't seem to work in scala
without backquotes. apparently scala treats '.' 'as a keyword and can't
reduce it as a part of anything else.


On Sat, Jul 27, 2013 at 6:43 PM, Dmitriy Lyubimov  wrote:

>
>
>
> On Sat, Jul 27, 2013 at 6:31 PM, Dmitriy Lyubimov wrote:
>
>>
>>
>>
>> >
>>> > diagv(1 /: s)
>>> >
>>>
>>> But since this is just the inverse of the matrix, and I imagine it's
>>> actually
>>> clearer to do just diagv(s).inverse instead of diagv(1 /: s)
>>>
>>>
>> Well. DSL is just the icing. Nobody's taking the cake away.
>>
>> in a sense that, once/if/when Mahout supports inverse(), it would be
>> exactly how one might use it. DSL is not about implementation, it is about
>> semantic sugar only. It only maps to what exists.
>>
>> On a side note, it never actually occurred to me to call pinv() or
>> solve() on a diagonal matrix. Or orthonormal for that matter. Their
>> identities are so appealing it kind of becomes second nature after some
>> time. the only use for solve() i had is actually for solving linear
>> equations. In my R prototype for SSVD [1] one will find exactly the same
>> style code, i.e.  diag(1/e$values) .
>>
>> pardon, this should read "non-signular" of course, an honest typo.
>
>
>> Even then you probably actually want leftInverse() and rightInverse(),
>> not just inverse, which is only defined for *non *singular square
>> matrices and would be equal right and left inverses in that case. Which
>> oddly enough brings us back to left-associative and right-associative
>> operations.
>>
>> [1]
>> https://cwiki.apache.org/confluence/download/attachments/27832158/ssvd.R?version=1&modificationDate=1323358453000
>>
>>
>

[jira] [Work started] (MAHOUT-1284) DummyRecordWriter's bug with reused Writables

2013-07-28 Thread Suneel Marthi (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on MAHOUT-1284 started by Suneel Marthi.

> DummyRecordWriter's bug with reused Writables
> -
>
> Key: MAHOUT-1284
> URL: https://issues.apache.org/jira/browse/MAHOUT-1284
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.7, 0.8
>Reporter: Maysam Yabandeh
>Assignee: Suneel Marthi
>Priority: Minor
>  Labels: test
> Fix For: 0.9
>
> Attachments: MAHOUT-1284.patch, MAHOUT-1284.patch
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> It is a recommended practice to reuse the Writable objects. 
> DummyRecordWriter, which is used for testing in Mahout, however keeps the 
> same Writable instance in a map: next time that the user reuses the Writable 
> object, the internal map of DummyRecordWriter changes as well. This makes 
> DummyRecordWriter fail for testing the MapReduce jobs that reuse the 
> Writables.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-1284) DummyRecordWriter's bug with reused Writables

2013-07-28 Thread Suneel Marthi (JIRA) 

[ 
https://issues.apache.org/jira/browse/MAHOUT-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13721907#comment-13721907
 ] 

Suneel Marthi commented on MAHOUT-1284:
---

[~maysamyabandeh] I just did a clean project build and the tests pass now. 
Sorry about the false alarm and thanks for the patch. I'll commit this tomorrow.

> DummyRecordWriter's bug with reused Writables
> -
>
> Key: MAHOUT-1284
> URL: https://issues.apache.org/jira/browse/MAHOUT-1284
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.7, 0.8
>Reporter: Maysam Yabandeh
>Assignee: Suneel Marthi
>Priority: Minor
>  Labels: test
> Fix For: 0.9
>
> Attachments: MAHOUT-1284.patch, MAHOUT-1284.patch
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> It is a recommended practice to reuse the Writable objects. 
> DummyRecordWriter, which is used for testing in Mahout, however keeps the 
> same Writable instance in a map: next time that the user reuses the Writable 
> object, the internal map of DummyRecordWriter changes as well. This makes 
> DummyRecordWriter fail for testing the MapReduce jobs that reuse the 
> Writables.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira