[
https://issues.apache.org/jira/browse/HAMA-142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12660730#action_12660730
]
Edward J. Yoon commented on HAMA-142:
-------------------------------------
5000 * 5000 :
[d8g053:/root/hama-trunk]# bin/hama examples mult fiveA fiveB 100
09/01/05 20:02:21 INFO hama.AbstractMatrix: Initializing the matrix storage.
09/01/05 20:02:29 INFO hama.AbstractMatrix: Create Matrix DenseMatrix_randkomid
09/01/05 20:02:30 WARN mapred.JobClient: Use GenericOptionsParser for parsing th
e arguments. Applications should implement Tool for the same.
09/01/05 20:02:30 WARN mapred.JobClient: Use genericOptions for the option -libj
ars
09/01/05 20:02:30 WARN mapred.JobClient: No job jar file set. User classes may
not be found. See JobConf(Class) or JobConf#setJar(String).
09/01/05 20:02:30 INFO mapred.TableInputFormatBase: split: 0->d8g054.nhncorp.com
:,000000000001114
09/01/05 20:02:30 INFO mapred.TableInputFormatBase: split: 1->d8g054.nhncorp.com
:000000000001114,000000000003423
09/01/05 20:02:30 INFO mapred.TableInputFormatBase: split: 2->d8g053.nhncorp.com
:000000000003423,
09/01/05 20:02:30 INFO mapred.JobClient: Running job: job_200901051951_0003
09/01/05 20:02:31 INFO mapred.JobClient: map 0% reduce 0%
09/01/05 20:04:44 INFO mapred.JobClient: map 33% reduce 0%
09/01/05 20:04:59 INFO mapred.JobClient: map 33% reduce 7%
09/01/05 20:05:02 INFO mapred.JobClient: map 33% reduce 11%
09/01/05 20:05:16 INFO mapred.JobClient: map 66% reduce 11%
09/01/05 20:05:26 INFO mapred.JobClient: map 66% reduce 14%
09/01/05 20:05:27 INFO mapred.JobClient: map 66% reduce 18%
09/01/05 20:05:29 INFO mapred.JobClient: map 66% reduce 22%
09/01/05 20:06:42 INFO mapred.JobClient: map 100% reduce 22%
09/01/05 20:06:56 INFO mapred.JobClient: map 100% reduce 39%
09/01/05 20:06:57 INFO mapred.JobClient: map 100% reduce 60%
09/01/05 20:06:59 INFO mapred.JobClient: map 100% reduce 78%
09/01/05 20:07:01 INFO mapred.JobClient: map 100% reduce 80%
09/01/05 20:07:02 INFO mapred.JobClient: map 100% reduce 86%
09/01/05 20:07:04 INFO mapred.JobClient: map 100% reduce 96%
09/01/05 20:07:07 INFO mapred.JobClient: map 100% reduce 100%
09/01/05 20:07:08 INFO mapred.JobClient: Job complete: job_200901051951_0003
09/01/05 20:07:08 INFO mapred.JobClient: Counters: 15
09/01/05 20:07:08 INFO mapred.JobClient: File Systems
09/01/05 20:07:08 INFO mapred.JobClient: Local bytes read=1692057369
09/01/05 20:07:08 INFO mapred.JobClient: Local bytes written=2537967252
09/01/05 20:07:08 INFO mapred.JobClient: Job Counters
09/01/05 20:07:08 INFO mapred.JobClient: Launched reduce tasks=3
09/01/05 20:07:08 INFO mapred.JobClient: Rack-local map tasks=1
09/01/05 20:07:08 INFO mapred.JobClient: Launched map tasks=4
09/01/05 20:07:08 INFO mapred.JobClient: Data-local map tasks=3
09/01/05 20:07:08 INFO mapred.JobClient: Map-Reduce Framework
09/01/05 20:07:08 INFO mapred.JobClient: Reduce input groups=100
09/01/05 20:07:08 INFO mapred.JobClient: Combine output records=0
09/01/05 20:07:08 INFO mapred.JobClient: Map input records=5000
09/01/05 20:07:08 INFO mapred.JobClient: Reduce output records=0
09/01/05 20:07:08 INFO mapred.JobClient: Map output bytes=845788900
09/01/05 20:07:08 INFO mapred.JobClient: Map input bytes=0
09/01/05 20:07:08 INFO mapred.JobClient: Combine input records=0
09/01/05 20:07:08 INFO mapred.JobClient: Map output records=50000
09/01/05 20:07:08 INFO mapred.JobClient: Reduce input records=50000
09/01/05 20:07:08 INFO hama.AbstractMatrix: Initializing the matrix storage.
09/01/05 20:07:12 INFO hama.AbstractMatrix: Create Matrix DenseMatrix_randfzuky
09/01/05 20:07:12 WARN mapred.JobClient: Use GenericOptionsParser for parsing th
e arguments. Applications should implement Tool for the same.
09/01/05 20:07:12 WARN mapred.JobClient: Use genericOptions for the option -libj
ars
09/01/05 20:07:13 WARN mapred.JobClient: No job jar file set. User classes may
not be found. See JobConf(Class) or JobConf#setJar(String).
09/01/05 20:07:13 INFO mapred.TableInputFormatBase: split: 0->d8g055.nhncorp.com
:,000000000002007
09/01/05 20:07:13 INFO mapred.TableInputFormatBase: split: 1->d8g053.nhncorp.com
:000000000002007,000000000003138
09/01/05 20:07:13 INFO mapred.TableInputFormatBase: split: 2->d8g055.nhncorp.com
:000000000003138,
09/01/05 20:07:13 INFO mapred.JobClient: Running job: job_200901051951_0004
09/01/05 20:07:14 INFO mapred.JobClient: map 0% reduce 0%
09/01/05 20:09:10 INFO mapred.JobClient: map 33% reduce 0%
09/01/05 20:09:25 INFO mapred.JobClient: map 33% reduce 3%
09/01/05 20:09:28 INFO mapred.JobClient: map 33% reduce 11%
09/01/05 20:10:50 INFO mapred.JobClient: map 66% reduce 11%
09/01/05 20:10:55 INFO mapred.JobClient: map 66% reduce 14%
09/01/05 20:10:58 INFO mapred.JobClient: map 66% reduce 18%
09/01/05 20:11:04 INFO mapred.JobClient: map 100% reduce 18%
09/01/05 20:11:05 INFO mapred.JobClient: map 100% reduce 22%
09/01/05 20:11:15 INFO mapred.JobClient: map 100% reduce 38%
09/01/05 20:11:19 INFO mapred.JobClient: map 100% reduce 56%
09/01/05 20:11:20 INFO mapred.JobClient: map 100% reduce 79%
09/01/05 20:11:24 INFO mapred.JobClient: map 100% reduce 89%
09/01/05 20:11:25 INFO mapred.JobClient: map 100% reduce 91%
09/01/05 20:11:26 INFO mapred.JobClient: map 100% reduce 95%
09/01/05 20:11:28 INFO mapred.JobClient: map 100% reduce 100%
09/01/05 20:11:30 INFO mapred.JobClient: Job complete: job_200901051951_0004
09/01/05 20:11:30 INFO mapred.JobClient: Counters: 15
09/01/05 20:11:30 INFO mapred.JobClient: File Systems
09/01/05 20:11:30 INFO mapred.JobClient: Local bytes read=1692057149
09/01/05 20:11:30 INFO mapred.JobClient: Local bytes written=2537967252
09/01/05 20:11:30 INFO mapred.JobClient: Job Counters
09/01/05 20:11:30 INFO mapred.JobClient: Launched reduce tasks=3
09/01/05 20:11:30 INFO mapred.JobClient: Rack-local map tasks=2
09/01/05 20:11:30 INFO mapred.JobClient: Launched map tasks=4
09/01/05 20:11:30 INFO mapred.JobClient: Data-local map tasks=2
09/01/05 20:11:30 INFO mapred.JobClient: Map-Reduce Framework
09/01/05 20:11:30 INFO mapred.JobClient: Reduce input groups=100
09/01/05 20:11:30 INFO mapred.JobClient: Combine output records=0
09/01/05 20:11:30 INFO mapred.JobClient: Map input records=5000
09/01/05 20:11:30 INFO mapred.JobClient: Reduce output records=0
09/01/05 20:11:30 INFO mapred.JobClient: Map output bytes=845788900
09/01/05 20:11:30 INFO mapred.JobClient: Map input bytes=0
09/01/05 20:11:30 INFO mapred.JobClient: Combine input records=0
09/01/05 20:11:30 INFO mapred.JobClient: Map output records=50000
09/01/05 20:11:30 INFO mapred.JobClient: Reduce input records=50000
09/01/05 20:11:30 INFO hama.AbstractMatrix: Initializing the matrix storage.
09/01/05 20:11:36 INFO hama.AbstractMatrix: Create Matrix DenseMatrix_randtcacd
09/01/05 20:11:36 WARN mapred.JobClient: Use GenericOptionsParser for parsing th
e arguments. Applications should implement Tool for the same.
09/01/05 20:11:36 WARN mapred.JobClient: Use genericOptions for the option -libj
ars
09/01/05 20:11:36 WARN mapred.JobClient: No job jar file set. User classes may
not be found. See JobConf(Class) or JobConf#setJar(String).
09/01/05 20:11:36 INFO mapred.TableInputFormatBase: split: 0->d8g053.nhncorp.com
:,
09/01/05 20:11:36 INFO mapred.JobClient: Running job: job_200901051951_0005
09/01/05 20:11:37 INFO mapred.JobClient: map 0% reduce 0%
09/01/05 20:30:12 INFO mapred.JobClient: map 100% reduce 0%
09/01/05 20:30:27 INFO mapred.JobClient: map 100% reduce 22%
09/01/05 20:30:31 INFO mapred.JobClient: map 100% reduce 44%
09/01/05 20:30:32 INFO mapred.JobClient: map 100% reduce 66%
09/01/05 20:30:37 INFO mapred.JobClient: map 100% reduce 67%
09/01/05 20:30:41 INFO mapred.JobClient: map 100% reduce 68%
09/01/05 20:30:51 INFO mapred.JobClient: map 100% reduce 69%
09/01/05 20:30:56 INFO mapred.JobClient: map 100% reduce 70%
09/01/05 20:31:02 INFO mapred.JobClient: map 100% reduce 71%
09/01/05 20:31:07 INFO mapred.JobClient: map 100% reduce 72%
09/01/05 20:31:18 INFO mapred.JobClient: map 100% reduce 73%
09/01/05 20:31:26 INFO mapred.JobClient: map 100% reduce 74%
09/01/05 20:31:32 INFO mapred.JobClient: map 100% reduce 75%
09/01/05 20:31:37 INFO mapred.JobClient: map 100% reduce 76%
09/01/05 20:31:47 INFO mapred.JobClient: map 100% reduce 77%
09/01/05 20:31:52 INFO mapred.JobClient: map 100% reduce 78%
09/01/05 20:32:07 INFO mapred.JobClient: map 100% reduce 79%
09/01/05 20:32:12 INFO mapred.JobClient: map 100% reduce 80%
09/01/05 20:32:22 INFO mapred.JobClient: map 100% reduce 81%
09/01/05 20:32:32 INFO mapred.JobClient: map 100% reduce 82%
09/01/05 20:32:37 INFO mapred.JobClient: map 100% reduce 83%
09/01/05 20:32:47 INFO mapred.JobClient: map 100% reduce 84%
09/01/05 20:32:52 INFO mapred.JobClient: map 100% reduce 85%
09/01/05 20:32:57 INFO mapred.JobClient: map 100% reduce 86%
09/01/05 20:33:02 INFO mapred.JobClient: map 100% reduce 87%
09/01/05 20:33:12 INFO mapred.JobClient: map 100% reduce 88%
09/01/05 20:33:18 INFO mapred.JobClient: map 100% reduce 89%
09/01/05 20:33:23 INFO mapred.JobClient: map 100% reduce 90%
09/01/05 20:33:51 INFO mapred.JobClient: map 100% reduce 91%
09/01/05 20:35:01 INFO mapred.JobClient: map 100% reduce 92%
09/01/05 20:36:01 INFO mapred.JobClient: map 100% reduce 93%
09/01/05 20:36:51 INFO mapred.JobClient: map 100% reduce 94%
09/01/05 20:37:37 INFO mapred.JobClient: map 100% reduce 95%
09/01/05 20:38:42 INFO mapred.JobClient: map 100% reduce 96%
09/01/05 20:39:51 INFO mapred.JobClient: map 100% reduce 97%
09/01/05 20:41:01 INFO mapred.JobClient: map 100% reduce 98%
09/01/05 20:42:12 INFO mapred.JobClient: map 100% reduce 99%
09/01/05 20:43:16 INFO mapred.JobClient: map 100% reduce 100%
09/01/05 20:43:18 INFO mapred.JobClient: Job complete: job_200901051951_0005
09/01/05 20:43:18 INFO mapred.JobClient: Counters: 14
09/01/05 20:43:18 INFO mapred.JobClient: File Systems
09/01/05 20:43:18 INFO mapred.JobClient: Local bytes read=5230294007
09/01/05 20:43:18 INFO mapred.JobClient: Local bytes written=7230112681
09/01/05 20:43:18 INFO mapred.JobClient: Job Counters
09/01/05 20:43:18 INFO mapred.JobClient: Launched reduce tasks=3
09/01/05 20:43:18 INFO mapred.JobClient: Rack-local map tasks=1
09/01/05 20:43:18 INFO mapred.JobClient: Launched map tasks=1
09/01/05 20:43:18 INFO mapred.JobClient: Map-Reduce Framework
09/01/05 20:43:18 INFO mapred.JobClient: Reduce input groups=100
09/01/05 20:43:18 INFO mapred.JobClient: Combine output records=0
09/01/05 20:43:18 INFO mapred.JobClient: Map input records=1000
09/01/05 20:43:18 INFO mapred.JobClient: Reduce output records=50000
09/01/05 20:43:18 INFO mapred.JobClient: Map output bytes=2000026000
09/01/05 20:43:18 INFO mapred.JobClient: Map input bytes=0
09/01/05 20:43:18 INFO mapred.JobClient: Combine input records=0
09/01/05 20:43:18 INFO mapred.JobClient: Map output records=1000
09/01/05 20:43:18 INFO mapred.JobClient: Reduce input records=1000
c (0, 0) : 1239.0794918823926
09/01/05 20:45:11 INFO client.HBaseAdmin: Disabled DenseMatrix_randtcacd
09/01/05 20:45:11 INFO client.HBaseAdmin: Deleted DenseMatrix_randtcacd
[d8g053:/root/hama-trunk]#
> Trunk doesn't work for large matrices
> -------------------------------------
>
> Key: HAMA-142
> URL: https://issues.apache.org/jira/browse/HAMA-142
> Project: Hama
> Issue Type: Sub-task
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Attachments: HAMA-142.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
