Hi,
Trying to use MLCP on Windows to export to an archive in local mode but
can't get past a heap error. It's probably something obvious I'm missing
and would appreciate the help.
Thanks,
Gary
This is the script I created:
SET JAVA_OPTS= -Xms5000m
mlcp.bat export -host localhost -port 8104 -username Admin -password envisn
-mode local -output_file_path C:\a-backup\MLCP\c1108 -copy_collections true
-output_type archive
Here's the output:
C:\a-work\mlcp\mlcp-8.0.6.3\bin>rem export to archive
C:\a-work\mlcp\mlcp-8.0.6.3\bin>SET JAVA_OPTS= -Xms5000m
C:\a-work\mlcp\mlcp-8.0.6.3\bin>mlcp.bat export -host localhost -port 8104
-username Admin -password envisn -mode local -output_file_path
C:\a-backup\MLCP\c1108 -copy_collections true -output_type archive
17/11/16 16:43:17 INFO mapreduce.MarkLogicInputFormat: Fetched 1 forest
splits.
17/11/16 16:43:17 INFO mapreduce.MarkLogicInputFormat: Made 30 splits.
17/11/16 16:43:18 INFO contentpump.LocalJobRunner: completed 0%
17/11/16 16:43:27 INFO contentpump.LocalJobRunner: completed 1%
17/11/16 16:43:45 ERROR contentpump.LocalJobRunner: Error running task:
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Unknown Source)
at java.lang.AbstractStringBuilder.ensureCapacityInternal(Unknown
Sourc)
at java.lang.AbstractStringBuilder.append(Unknown Source)
at java.lang.StringBuffer.append(Unknown Source)
at
com.marklogic.io.IOHelper.literalStringFromReader(IOHelper.java:50)
at
com.marklogic.io.IOHelper.literalStringFromStream(IOHelper.java:66)
at
com.marklogic.xcc.types.impl.AbstractStreamableItem.asString(AbstracStreamab
leItem.java:120)
at
com.marklogic.xcc.impl.ResultItemImpl.asString(ResultItemImpl.java:10)
at
com.marklogic.mapreduce.DatabaseDocument.set(DatabaseDocument.java:16)
at
com.marklogic.contentpump.DatabaseContentReader.nextKeyValue(DatabasContentR
eader.java:442)
at
com.marklogic.contentpump.LocalJobRunner$TrackingRecordReader.nextKeValue(Lo
calJobRunner.java:444)
at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContxtImpl.j
ava:80)
at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyVale(Wrappe
dMapper.java:91)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at
com.marklogic.contentpump.LocalJobRunner$LocalMapTask.call(LocalJobRnner.jav
a:378)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
Source)
at java.lang.Thread.run(Unknown Source)
17/11/16 16:44:16 INFO contentpump.LocalJobRunner:
com.marklogic.mapreduce.MarkogicCounter:
17/11/16 16:44:16 INFO contentpump.LocalJobRunner: INPUT_RECORDS: 7005
17/11/16 16:44:16 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS: 7005
17/11/16 16:44:16 INFO contentpump.LocalJobRunner: Total execution time: 58
sec
C:\a-work\mlcp\mlcp-8.0.6.3\bin>
_______________________________________________
General mailing list
[email protected]
Manage your subscription at:
http://developer.marklogic.com/mailman/listinfo/general
