[jira] Updated: (MAPREDUCE-1425) archive throws OutOfMemoryError

2010-02-08 Thread Tsz Wo (Nicholas), SZE (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo (Nicholas), SZE updated MAPREDUCE-1425:
--

Status: Patch Available  (was: Open)

 archive throws OutOfMemoryError
 ---

 Key: MAPREDUCE-1425
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1425
 Project: Hadoop Map/Reduce
  Issue Type: Improvement
  Components: harchive
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
 Fix For: 0.22.0

 Attachments: har.sh, m1425_20100129TextFileGenerator.patch, 
 MAPREDUCE-1425.patch, MAPREDUCE-1425.patch, MAPREDUCE-1425.patch, 
 MAPREDUCE-1425_y_0.20.patch


 {noformat}
 -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
 Exception in thread main java.lang.OutOfMemoryError: Java heap space
 at java.util.regex.Pattern.compile(Pattern.java:1432)
 at java.util.regex.Pattern.init(Pattern.java:1133)
 at java.util.regex.Pattern.compile(Pattern.java:847)
 at java.lang.String.replace(String.java:2208)
 at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
 at org.apache.hadoop.fs.Path.initialize(Path.java:137)
 at org.apache.hadoop.fs.Path.init(Path.java:126)
 at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
 at 
 org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
 at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
 at 
 org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
 {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (MAPREDUCE-1425) archive throws OutOfMemoryError

2010-02-08 Thread Tsz Wo (Nicholas), SZE (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo (Nicholas), SZE updated MAPREDUCE-1425:
--

Status: Open  (was: Patch Available)

Hudson is not picking up, re-submitting ...

 archive throws OutOfMemoryError
 ---

 Key: MAPREDUCE-1425
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1425
 Project: Hadoop Map/Reduce
  Issue Type: Improvement
  Components: harchive
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
 Fix For: 0.22.0

 Attachments: har.sh, m1425_20100129TextFileGenerator.patch, 
 MAPREDUCE-1425.patch, MAPREDUCE-1425.patch, MAPREDUCE-1425.patch, 
 MAPREDUCE-1425_y_0.20.patch


 {noformat}
 -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
 Exception in thread main java.lang.OutOfMemoryError: Java heap space
 at java.util.regex.Pattern.compile(Pattern.java:1432)
 at java.util.regex.Pattern.init(Pattern.java:1133)
 at java.util.regex.Pattern.compile(Pattern.java:847)
 at java.lang.String.replace(String.java:2208)
 at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
 at org.apache.hadoop.fs.Path.initialize(Path.java:137)
 at org.apache.hadoop.fs.Path.init(Path.java:126)
 at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
 at 
 org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
 at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
 at 
 org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
 {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (MAPREDUCE-1425) archive throws OutOfMemoryError

2010-02-05 Thread Mahadev konar (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mahadev konar updated MAPREDUCE-1425:
-

Attachment: ZOOKEEPER-1425.patch

can you try this patch nicholas? It fixes the issue for me.. can you also try 
it out?

 archive throws OutOfMemoryError
 ---

 Key: MAPREDUCE-1425
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1425
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: harchive
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
 Fix For: 0.22.0

 Attachments: har.sh, m1425_20100129TextFileGenerator.patch, 
 MAPREDUCE-1425.patch, ZOOKEEPER-1425.patch


 {noformat}
 -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
 Exception in thread main java.lang.OutOfMemoryError: Java heap space
 at java.util.regex.Pattern.compile(Pattern.java:1432)
 at java.util.regex.Pattern.init(Pattern.java:1133)
 at java.util.regex.Pattern.compile(Pattern.java:847)
 at java.lang.String.replace(String.java:2208)
 at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
 at org.apache.hadoop.fs.Path.initialize(Path.java:137)
 at org.apache.hadoop.fs.Path.init(Path.java:126)
 at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
 at 
 org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
 at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
 at 
 org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
 {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (MAPREDUCE-1425) archive throws OutOfMemoryError

2010-02-05 Thread Mahadev konar (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mahadev konar updated MAPREDUCE-1425:
-

Attachment: (was: ZOOKEEPER-1425.patch)

 archive throws OutOfMemoryError
 ---

 Key: MAPREDUCE-1425
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1425
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: harchive
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
 Fix For: 0.22.0

 Attachments: har.sh, m1425_20100129TextFileGenerator.patch, 
 MAPREDUCE-1425.patch


 {noformat}
 -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
 Exception in thread main java.lang.OutOfMemoryError: Java heap space
 at java.util.regex.Pattern.compile(Pattern.java:1432)
 at java.util.regex.Pattern.init(Pattern.java:1133)
 at java.util.regex.Pattern.compile(Pattern.java:847)
 at java.lang.String.replace(String.java:2208)
 at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
 at org.apache.hadoop.fs.Path.initialize(Path.java:137)
 at org.apache.hadoop.fs.Path.init(Path.java:126)
 at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
 at 
 org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
 at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
 at 
 org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
 {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (MAPREDUCE-1425) archive throws OutOfMemoryError

2010-02-05 Thread Mahadev konar (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mahadev konar updated MAPREDUCE-1425:
-

Attachment: MAPREDUCE-1425.patch

sorry the name of the file should have been mapreduce and not zookeeper patch!! 
Looks like I am not good at multi tasking!

 archive throws OutOfMemoryError
 ---

 Key: MAPREDUCE-1425
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1425
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: harchive
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
 Fix For: 0.22.0

 Attachments: har.sh, m1425_20100129TextFileGenerator.patch, 
 MAPREDUCE-1425.patch, MAPREDUCE-1425.patch


 {noformat}
 -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
 Exception in thread main java.lang.OutOfMemoryError: Java heap space
 at java.util.regex.Pattern.compile(Pattern.java:1432)
 at java.util.regex.Pattern.init(Pattern.java:1133)
 at java.util.regex.Pattern.compile(Pattern.java:847)
 at java.lang.String.replace(String.java:2208)
 at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
 at org.apache.hadoop.fs.Path.initialize(Path.java:137)
 at org.apache.hadoop.fs.Path.init(Path.java:126)
 at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
 at 
 org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
 at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
 at 
 org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
 {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (MAPREDUCE-1425) archive throws OutOfMemoryError

2010-02-05 Thread Mahadev konar (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mahadev konar updated MAPREDUCE-1425:
-

Attachment: MAPREDUCE-1425_y_0.20.patch

here is a clean patch for y-0.20 branch. I tested the performance issues, and 
it fixes them. I will upload a patch for the trunk next.

 archive throws OutOfMemoryError
 ---

 Key: MAPREDUCE-1425
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1425
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: harchive
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
 Fix For: 0.22.0

 Attachments: har.sh, m1425_20100129TextFileGenerator.patch, 
 MAPREDUCE-1425.patch, MAPREDUCE-1425.patch, MAPREDUCE-1425_y_0.20.patch


 {noformat}
 -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
 Exception in thread main java.lang.OutOfMemoryError: Java heap space
 at java.util.regex.Pattern.compile(Pattern.java:1432)
 at java.util.regex.Pattern.init(Pattern.java:1133)
 at java.util.regex.Pattern.compile(Pattern.java:847)
 at java.lang.String.replace(String.java:2208)
 at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
 at org.apache.hadoop.fs.Path.initialize(Path.java:137)
 at org.apache.hadoop.fs.Path.init(Path.java:126)
 at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
 at 
 org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
 at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
 at 
 org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
 {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (MAPREDUCE-1425) archive throws OutOfMemoryError

2010-02-05 Thread Mahadev konar (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mahadev konar updated MAPREDUCE-1425:
-

Attachment: MAPREDUCE-1425.patch

a patch for trunk. 

 archive throws OutOfMemoryError
 ---

 Key: MAPREDUCE-1425
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1425
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: harchive
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
 Fix For: 0.22.0

 Attachments: har.sh, m1425_20100129TextFileGenerator.patch, 
 MAPREDUCE-1425.patch, MAPREDUCE-1425.patch, MAPREDUCE-1425.patch, 
 MAPREDUCE-1425_y_0.20.patch


 {noformat}
 -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
 Exception in thread main java.lang.OutOfMemoryError: Java heap space
 at java.util.regex.Pattern.compile(Pattern.java:1432)
 at java.util.regex.Pattern.init(Pattern.java:1133)
 at java.util.regex.Pattern.compile(Pattern.java:847)
 at java.lang.String.replace(String.java:2208)
 at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
 at org.apache.hadoop.fs.Path.initialize(Path.java:137)
 at org.apache.hadoop.fs.Path.init(Path.java:126)
 at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
 at 
 org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
 at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
 at 
 org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
 {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (MAPREDUCE-1425) archive throws OutOfMemoryError

2010-02-05 Thread Mahadev konar (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mahadev konar updated MAPREDUCE-1425:
-

Status: Patch Available  (was: Open)

 archive throws OutOfMemoryError
 ---

 Key: MAPREDUCE-1425
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1425
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: harchive
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
 Fix For: 0.22.0

 Attachments: har.sh, m1425_20100129TextFileGenerator.patch, 
 MAPREDUCE-1425.patch, MAPREDUCE-1425.patch, MAPREDUCE-1425.patch, 
 MAPREDUCE-1425_y_0.20.patch


 {noformat}
 -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
 Exception in thread main java.lang.OutOfMemoryError: Java heap space
 at java.util.regex.Pattern.compile(Pattern.java:1432)
 at java.util.regex.Pattern.init(Pattern.java:1133)
 at java.util.regex.Pattern.compile(Pattern.java:847)
 at java.lang.String.replace(String.java:2208)
 at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
 at org.apache.hadoop.fs.Path.initialize(Path.java:137)
 at org.apache.hadoop.fs.Path.init(Path.java:126)
 at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
 at 
 org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
 at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
 at 
 org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
 {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (MAPREDUCE-1425) archive throws OutOfMemoryError

2010-02-05 Thread Tsz Wo (Nicholas), SZE (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo (Nicholas), SZE updated MAPREDUCE-1425:
--

  Issue Type: Improvement  (was: Bug)
Hadoop Flags: [Reviewed]

+1 patch looks good.

 archive throws OutOfMemoryError
 ---

 Key: MAPREDUCE-1425
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1425
 Project: Hadoop Map/Reduce
  Issue Type: Improvement
  Components: harchive
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
 Fix For: 0.22.0

 Attachments: har.sh, m1425_20100129TextFileGenerator.patch, 
 MAPREDUCE-1425.patch, MAPREDUCE-1425.patch, MAPREDUCE-1425.patch, 
 MAPREDUCE-1425_y_0.20.patch


 {noformat}
 -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
 Exception in thread main java.lang.OutOfMemoryError: Java heap space
 at java.util.regex.Pattern.compile(Pattern.java:1432)
 at java.util.regex.Pattern.init(Pattern.java:1133)
 at java.util.regex.Pattern.compile(Pattern.java:847)
 at java.lang.String.replace(String.java:2208)
 at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
 at org.apache.hadoop.fs.Path.initialize(Path.java:137)
 at org.apache.hadoop.fs.Path.init(Path.java:126)
 at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
 at 
 org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
 at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
 at 
 org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
 {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (MAPREDUCE-1425) archive throws OutOfMemoryError

2010-02-02 Thread Mahadev konar (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mahadev konar updated MAPREDUCE-1425:
-

Attachment: MAPREDUCE-1425.patch

this patch fixes the problem of too many filestatus objects while creating 
archvies. Nicholas, can you test this out?

 archive throws OutOfMemoryError
 ---

 Key: MAPREDUCE-1425
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1425
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: harchive
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
 Fix For: 0.22.0

 Attachments: har.sh, m1425_20100129TextFileGenerator.patch, 
 MAPREDUCE-1425.patch


 {noformat}
 -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
 Exception in thread main java.lang.OutOfMemoryError: Java heap space
 at java.util.regex.Pattern.compile(Pattern.java:1432)
 at java.util.regex.Pattern.init(Pattern.java:1133)
 at java.util.regex.Pattern.compile(Pattern.java:847)
 at java.lang.String.replace(String.java:2208)
 at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
 at org.apache.hadoop.fs.Path.initialize(Path.java:137)
 at org.apache.hadoop.fs.Path.init(Path.java:126)
 at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
 at 
 org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
 at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
 at 
 org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
 {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (MAPREDUCE-1425) archive throws OutOfMemoryError

2010-01-29 Thread Tsz Wo (Nicholas), SZE (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo (Nicholas), SZE updated MAPREDUCE-1425:
--

Attachment: har.sh
m1425_20100129TextFileGenerator.patch

m1425_20100129TextFileGenerator.patch: a program to generate text files.

har.sh: useful commands for testing archive.

 archive throws OutOfMemoryError
 ---

 Key: MAPREDUCE-1425
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1425
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: harchive
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
 Fix For: 0.22.0

 Attachments: har.sh, m1425_20100129TextFileGenerator.patch


 {noformat}
 -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
 Exception in thread main java.lang.OutOfMemoryError: Java heap space
 at java.util.regex.Pattern.compile(Pattern.java:1432)
 at java.util.regex.Pattern.init(Pattern.java:1133)
 at java.util.regex.Pattern.compile(Pattern.java:847)
 at java.lang.String.replace(String.java:2208)
 at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
 at org.apache.hadoop.fs.Path.initialize(Path.java:137)
 at org.apache.hadoop.fs.Path.init(Path.java:126)
 at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
 at 
 org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
 at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
 at 
 org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
 {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (MAPREDUCE-1425) archive throws OutOfMemoryError

2010-01-28 Thread Tsz Wo (Nicholas), SZE (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo (Nicholas), SZE updated MAPREDUCE-1425:
--

  Component/s: harchive
Fix Version/s: 0.22.0

 archive throws OutOfMemoryError
 ---

 Key: MAPREDUCE-1425
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1425
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: harchive
Reporter: Tsz Wo (Nicholas), SZE
Assignee: Mahadev konar
 Fix For: 0.22.0


 {noformat}
 -bash-3.1$ hadoop  archive -archiveName t4.har -p . t4 .
 Exception in thread main java.lang.OutOfMemoryError: Java heap space
 at java.util.regex.Pattern.compile(Pattern.java:1432)
 at java.util.regex.Pattern.init(Pattern.java:1133)
 at java.util.regex.Pattern.compile(Pattern.java:847)
 at java.lang.String.replace(String.java:2208)
 at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
 at org.apache.hadoop.fs.Path.initialize(Path.java:137)
 at org.apache.hadoop.fs.Path.init(Path.java:126)
 at org.apache.hadoop.fs.Path.makeQualified(Path.java:296)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:244)
 at 
 org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:256)
 at 
 org.apache.hadoop.tools.HadoopArchives.archive(HadoopArchives.java:393)
 at org.apache.hadoop.tools.HadoopArchives.run(HadoopArchives.java:736)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
 at 
 org.apache.hadoop.tools.HadoopArchives.main(HadoopArchives.java:751)
 {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.