Thanks Oleksii,

 

Turns out the windows path variable was not finding the correct java
version.

 

Gary

 

 

From: general-boun...@developer.marklogic.com
[mailto:general-boun...@developer.marklogic.com] On Behalf Of Oleksii Segeda
Sent: Thursday, November 16, 2017 4:55 PM
To: MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] MLCP heap error

 

Gary,

 

Try to set -Xmx in addition to -Xms

 

 

Best,

Oleksii

 

From: general-boun...@developer.marklogic.com
[mailto:general-boun...@developer.marklogic.com] On Behalf Of Gary Larsen
Sent: Thursday, November 16, 2017 4:55 PM
To: 'General MarkLogic Developer Discussion'
<general@developer.marklogic.com>
Subject: [MarkLogic Dev General] MLCP heap error

 

Hi,

 

Trying to use MLCP on Windows to export to an archive in local mode but
can't get past a heap error.  It's probably something obvious I'm missing
and would appreciate the help.

 

Thanks,

Gary

 

This is the script I created:

 

SET JAVA_OPTS= -Xms5000m

mlcp.bat export -host localhost -port 8104 -username Admin -password envisn
-mode local -output_file_path C:\a-backup\MLCP\c1108  -copy_collections true
-output_type archive

 

Here's the output:

 

C:\a-work\mlcp\mlcp-8.0.6.3\bin>rem export to archive 

 

C:\a-work\mlcp\mlcp-8.0.6.3\bin>SET JAVA_OPTS= -Xms5000m 

 

C:\a-work\mlcp\mlcp-8.0.6.3\bin>mlcp.bat export -host localhost -port 8104
-username Admin -password envisn  -mode local -output_file_path
C:\a-backup\MLCP\c1108  -copy_collections true -output_type archive 

17/11/16 16:43:17 INFO mapreduce.MarkLogicInputFormat: Fetched 1 forest
splits.

17/11/16 16:43:17 INFO mapreduce.MarkLogicInputFormat: Made 30 splits.

17/11/16 16:43:18 INFO contentpump.LocalJobRunner:  completed 0%

17/11/16 16:43:27 INFO contentpump.LocalJobRunner:  completed 1%

17/11/16 16:43:45 ERROR contentpump.LocalJobRunner: Error running task:

java.lang.OutOfMemoryError: Java heap space

        at java.util.Arrays.copyOf(Unknown Source)

        at java.lang.AbstractStringBuilder.ensureCapacityInternal(Unknown
Sourc)

        at java.lang.AbstractStringBuilder.append(Unknown Source)

        at java.lang.StringBuffer.append(Unknown Source)

        at
com.marklogic.io.IOHelper.literalStringFromReader(IOHelper.java:50)

        at
com.marklogic.io.IOHelper.literalStringFromStream(IOHelper.java:66)

        at
com.marklogic.xcc.types.impl.AbstractStreamableItem.asString(AbstracStreamab
leItem.java:120)

        at
com.marklogic.xcc.impl.ResultItemImpl.asString(ResultItemImpl.java:10)

        at
com.marklogic.mapreduce.DatabaseDocument.set(DatabaseDocument.java:16)

        at
com.marklogic.contentpump.DatabaseContentReader.nextKeyValue(DatabasContentR
eader.java:442)

        at
com.marklogic.contentpump.LocalJobRunner$TrackingRecordReader.nextKeValue(Lo
calJobRunner.java:444)

        at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContxtImpl.j
ava:80)

        at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyVale(Wrappe
dMapper.java:91)

        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)

        at
com.marklogic.contentpump.LocalJobRunner$LocalMapTask.call(LocalJobRnner.jav
a:378)

        at java.util.concurrent.FutureTask.run(Unknown Source)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
Source)

        at java.lang.Thread.run(Unknown Source)

17/11/16 16:44:16 INFO contentpump.LocalJobRunner:
com.marklogic.mapreduce.MarkogicCounter:

17/11/16 16:44:16 INFO contentpump.LocalJobRunner: INPUT_RECORDS: 7005

17/11/16 16:44:16 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS: 7005

17/11/16 16:44:16 INFO contentpump.LocalJobRunner: Total execution time: 58
sec

 

C:\a-work\mlcp\mlcp-8.0.6.3\bin>

_______________________________________________
General mailing list
General@developer.marklogic.com
Manage your subscription at: 
http://developer.marklogic.com/mailman/listinfo/general

Reply via email to