Gary,

Try to set -Xmx in addition to -Xms


Best,
Oleksii

From: general-boun...@developer.marklogic.com 
[mailto:general-boun...@developer.marklogic.com] On Behalf Of Gary Larsen
Sent: Thursday, November 16, 2017 4:55 PM
To: 'General MarkLogic Developer Discussion' <general@developer.marklogic.com>
Subject: [MarkLogic Dev General] MLCP heap error

Hi,

Trying to use MLCP on Windows to export to an archive in local mode but can't 
get past a heap error.  It's probably something obvious I'm missing and would 
appreciate the help.

Thanks,
Gary

This is the script I created:

SET JAVA_OPTS= -Xms5000m
mlcp.bat export -host localhost -port 8104 -username Admin -password envisn  
-mode local -output_file_path C:\a-backup\MLCP\c1108  -copy_collections true 
-output_type archive

Here's the output:

C:\a-work\mlcp\mlcp-8.0.6.3\bin>rem export to archive

C:\a-work\mlcp\mlcp-8.0.6.3\bin>SET JAVA_OPTS= -Xms5000m

C:\a-work\mlcp\mlcp-8.0.6.3\bin>mlcp.bat export -host localhost -port 8104 
-username Admin -password envisn  -mode local -output_file_path 
C:\a-backup\MLCP\c1108  -copy_collections true -output_type archive
17/11/16 16:43:17 INFO mapreduce.MarkLogicInputFormat: Fetched 1 forest splits.
17/11/16 16:43:17 INFO mapreduce.MarkLogicInputFormat: Made 30 splits.
17/11/16 16:43:18 INFO contentpump.LocalJobRunner:  completed 0%
17/11/16 16:43:27 INFO contentpump.LocalJobRunner:  completed 1%
17/11/16 16:43:45 ERROR contentpump.LocalJobRunner: Error running task:
java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOf(Unknown Source)
        at java.lang.AbstractStringBuilder.ensureCapacityInternal(Unknown Sourc)
        at java.lang.AbstractStringBuilder.append(Unknown Source)
        at java.lang.StringBuffer.append(Unknown Source)
        at com.marklogic.io.IOHelper.literalStringFromReader(IOHelper.java:50)
        at com.marklogic.io.IOHelper.literalStringFromStream(IOHelper.java:66)
        at 
com.marklogic.xcc.types.impl.AbstractStreamableItem.asString(AbstracStreamableItem.java:120)
        at 
com.marklogic.xcc.impl.ResultItemImpl.asString(ResultItemImpl.java:10)
        at 
com.marklogic.mapreduce.DatabaseDocument.set(DatabaseDocument.java:16)
        at 
com.marklogic.contentpump.DatabaseContentReader.nextKeyValue(DatabasContentReader.java:442)
        at 
com.marklogic.contentpump.LocalJobRunner$TrackingRecordReader.nextKeValue(LocalJobRunner.java:444)
        at 
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContxtImpl.java:80)
        at 
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyVale(WrappedMapper.java:91)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at 
com.marklogic.contentpump.LocalJobRunner$LocalMapTask.call(LocalJobRnner.java:378)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
17/11/16 16:44:16 INFO contentpump.LocalJobRunner: 
com.marklogic.mapreduce.MarkogicCounter:
17/11/16 16:44:16 INFO contentpump.LocalJobRunner: INPUT_RECORDS: 7005
17/11/16 16:44:16 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS: 7005
17/11/16 16:44:16 INFO contentpump.LocalJobRunner: Total execution time: 58 sec

C:\a-work\mlcp\mlcp-8.0.6.3\bin>
_______________________________________________
General mailing list
General@developer.marklogic.com
Manage your subscription at: 
http://developer.marklogic.com/mailman/listinfo/general

Reply via email to