Hello Arvind Kr. I am using the input_file_path, and output uri replace.
-input_file_path /tmp/ml_deploy/src/modules/ -output_uri_replace '/tmp/ml_deploy/src/modules/,'\''/'\'' Another interesting thing I found, if I give it an invalid username/password, it display an error in the log, but the status code return to bash is still 0. My workaround is going to be awk the log. I would still prefer a status code instead of a workaround. Thanks, Tim -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of [email protected] Sent: Friday, May 12, 2017 10:25 AM To: [email protected] Subject: General Digest, Vol 155, Issue 13 Send General mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit http://developer.marklogic.com/mailman/listinfo/general or, via email, send a message with subject or body 'help' to [email protected] You can reach the person managing the list at [email protected] When replying, please edit your Subject line so it is more specific than "Re: Contents of General digest..." Today's Topics: 1. MLCP Error Return (Timothy Pearce) 2. Re: MLCP Error Return (Indrajeet Verma) 3. Re: MLCP Error Return (Arvind Kumar) ---------------------------------------------------------------------- Message: 1 Date: Fri, 12 May 2017 12:33:59 +0000 From: Timothy Pearce <[email protected]> Subject: [MarkLogic Dev General] MLCP Error Return To: "'[email protected]'" <[email protected]> Message-ID: <mwhpr1001mb2239fb09917bc2ffb005dc058d...@mwhpr1001mb2239.namprd10.prod.outlook.com> Content-Type: text/plain; charset="us-ascii" Hello, I'm currently working on improving the continuous integration system I currently have which uses Jenkins. It's deploying our modules into the database via MLCP and the XDBC server. I am seeing one issue with the mlcp script and it is not returning any errors via exit code when it fails to updated a document because it is locked. It is returning exit 0 with "exit $?" tacked on to the end of the run after the mlcp.sh script is called. Is there any way to get this to throw a non 0 exit code on error? I'm not seeing any reference to checking if it the script ran with success or parameters to add that in the mlcp documentation. For a snippet of the mlcp's logging which shows the error: 17/05/11 15:10:41 INFO contentpump.FileAndDirectoryInputFormat: Total input paths to process : 14 17/05/11 15:10:43 INFO contentpump.LocalJobRunner: completed 100% 17/05/11 15:10:43 ERROR mapreduce.ContentWriter: XDMP-LOCKED: Document or Directory is locked 17/05/11 15:10:43 WARN mapreduce.ContentWriter: Failed document /utils/a.xqy in file:/modules/utils/a.xqy 17/05/11 15:10:46 ERROR mapreduce.ContentWriter: XDMP-LOCKED: Document or Directory is locked 17/05/11 15:10:46 WARN mapreduce.ContentWriter: Failed document /utils/b.xqy in file:/modules/utils/b.xqy 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: com.marklogic.mapreduce.MarkLogicCounter: 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: INPUT_RECORDS: 143 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS: 143 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS_COMMITTED: 143 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS_FAILED: 0 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: Total execution time: 4 sec + exit 0 I've verified that the file was not overwritten via adding data to a file stored in marklogic and using mlcp to replace the file, then querying with fn:doc to verify the data was removed. It did not replace the file. Any guidance to helping verify the files were actually written into marklogic would be appreciated. Thanks, Tim Nothing in this message is intended to constitute an electronic signature unless a specific statement to the contrary is included in this message. Confidentiality Note: This message is intended only for the person or entity to which it is addressed. It may contain confidential and/or proprietary material. Any review, transmission, dissemination or other use, or taking of any action in reliance upon this message by persons or entities other than the intended recipient is prohibited. If you received this message in error, please contact the sender and delete it from your computer. -------------- next part -------------- An HTML attachment was scrubbed... URL: http://developer.marklogic.com/pipermail/general/attachments/20170512/c5af82c6/attachment-0001.html ------------------------------ Message: 2 Date: Fri, 12 May 2017 18:39:36 +0530 From: Indrajeet Verma <[email protected]> Subject: Re: [MarkLogic Dev General] MLCP Error Return To: MarkLogic Developer Discussion <[email protected]> Message-ID: <cakwhaehxt9fux2m52b2tr47zz0migedybbz4-bdjrqxsddm...@mail.gmail.com> Content-Type: text/plain; charset="utf-8" Hi Tim - As per my understanding there is nothing by which you can return success/failure. Other developers can guide you if anything is there in mlcp. However your problem should solve using thread count property with value 1 in your option file. -thread_count 1 Regards, Indy On Fri, May 12, 2017 at 6:03 PM, Timothy Pearce <[email protected]> wrote: > Hello, > > > > I?m currently working on improving the continuous integration system I > currently have which uses Jenkins. It?s deploying our modules into the > database via MLCP and the XDBC server. I am seeing one issue with the > mlcp script and it is not returning any errors via exit code when it > fails to updated a document because it is locked. It is returning exit > 0 with ?exit $?? tacked on to the end of the run after the mlcp.sh > script is called. Is there any way to get this to throw a non 0 exit > code on error? I?m not seeing any reference to checking if it the > script ran with success or parameters to add that in the mlcp > documentation. For a snippet of the mlcp?s logging which shows the error: > > > > 17/05/11 15:10:41 INFO contentpump.FileAndDirectoryInputFormat: Total > input paths to process : 14 > > 17/05/11 15:10:43 INFO contentpump.LocalJobRunner: completed 100% > > 17/05/11 15:10:43 ERROR mapreduce.ContentWriter: XDMP-LOCKED: Document > or Directory is locked > > 17/05/11 15:10:43 WARN mapreduce.ContentWriter: Failed document > /utils/a.xqy in file:/modules/utils/a.xqy > > 17/05/11 15:10:46 ERROR mapreduce.ContentWriter: XDMP-LOCKED: Document > or Directory is locked > > 17/05/11 15:10:46 WARN mapreduce.ContentWriter: Failed document > /utils/b.xqy in file:/modules/utils/b.xqy > > 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: > com.marklogic.mapreduce.MarkLogicCounter: > > > 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: INPUT_RECORDS: 143 > > 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS: 143 > > 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: > OUTPUT_RECORDS_COMMITTED: 143 > > 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: > OUTPUT_RECORDS_FAILED: 0 > > 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: Total execution > time: 4 sec > > + exit 0 > > > > I?ve verified that the file was not overwritten via adding data to a > file stored in marklogic and using mlcp to replace the file, then > querying with fn:doc to verify the data was removed. It did not > replace the file. Any guidance to helping verify the files were > actually written into marklogic would be appreciated. > > > > Thanks, > > Tim > > > > > Nothing in this message is intended to constitute an electronic > signature unless a specific statement to the contrary is included in this > message. > Confidentiality Note: This message is intended only for the person or > entity to which it is addressed. It may contain confidential and/or > proprietary material. Any review, transmission, dissemination or other > use, or taking of any action in reliance upon this message by persons > or entities other than the intended recipient is prohibited. If you > received this message in error, please contact the sender and delete > it from your computer. > > _______________________________________________ > General mailing list > [email protected] > Manage your subscription at: > http://developer.marklogic.com/mailman/listinfo/general > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://developer.marklogic.com/pipermail/general/attachments/20170512/434a2d6e/attachment-0001.html ------------------------------ Message: 3 Date: Fri, 12 May 2017 19:54:51 +0530 From: Arvind Kumar <[email protected]> Subject: Re: [MarkLogic Dev General] MLCP Error Return To: MarkLogic Developer Discussion <[email protected]> Message-ID: <CAC=_2yN=+9=vyT5nNmM1SHUA3=tp_zedt-g5jdgxsy3dx2h...@mail.gmail.com> Content-Type: text/plain; charset="utf-8" Hi Tim, Are you using any transform module while ingestion through mlcp. Regards Arvind Kr. On Fri, May 12, 2017 at 6:39 PM, Indrajeet Verma <[email protected]> wrote: > Hi Tim - > > As per my understanding there is nothing by which you can return > success/failure. Other developers can guide you if anything is there > in mlcp. > > However your problem should solve using thread count property with > value > 1 in your option file. > -thread_count > 1 > > Regards, > Indy > > On Fri, May 12, 2017 at 6:03 PM, Timothy Pearce > <[email protected]> > wrote: > >> Hello, >> >> >> >> I?m currently working on improving the continuous integration system >> I currently have which uses Jenkins. It?s deploying our modules into >> the database via MLCP and the XDBC server. I am seeing one issue with >> the mlcp script and it is not returning any errors via exit code when >> it fails to updated a document because it is locked. It is returning >> exit 0 with ?exit $?? tacked on to the end of the run after the >> mlcp.sh script is called. Is there any way to get this to throw a non >> 0 exit code on error? I?m not seeing any reference to checking if it >> the script ran with success or parameters to add that in the mlcp >> documentation. For a snippet of the mlcp?s logging which shows the error: >> >> >> >> 17/05/11 15:10:41 INFO contentpump.FileAndDirectoryInputFormat: Total >> input paths to process : 14 >> >> 17/05/11 15:10:43 INFO contentpump.LocalJobRunner: completed 100% >> >> 17/05/11 15:10:43 ERROR mapreduce.ContentWriter: XDMP-LOCKED: >> Document or Directory is locked >> >> 17/05/11 15:10:43 WARN mapreduce.ContentWriter: Failed document >> /utils/a.xqy in file:/modules/utils/a.xqy >> >> 17/05/11 15:10:46 ERROR mapreduce.ContentWriter: XDMP-LOCKED: >> Document or Directory is locked >> >> 17/05/11 15:10:46 WARN mapreduce.ContentWriter: Failed document >> /utils/b.xqy in file:/modules/utils/b.xqy >> >> 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: >> com.marklogic.mapreduce.MarkLogicCounter: >> >> 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: INPUT_RECORDS: 143 >> >> 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS: >> 143 >> >> 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: >> OUTPUT_RECORDS_COMMITTED: 143 >> >> 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: OUTPUT_RECORDS_FAILED: >> 0 >> >> 17/05/11 15:10:46 INFO contentpump.LocalJobRunner: Total execution time: >> 4 sec >> >> + exit 0 >> >> >> >> I?ve verified that the file was not overwritten via adding data to a >> file stored in marklogic and using mlcp to replace the file, then >> querying with fn:doc to verify the data was removed. It did not >> replace the file. Any guidance to helping verify the files were >> actually written into marklogic would be appreciated. >> >> >> >> Thanks, >> >> Tim >> >> >> >> >> Nothing in this message is intended to constitute an electronic >> signature unless a specific statement to the contrary is included in this >> message. >> Confidentiality Note: This message is intended only for the person or >> entity to which it is addressed. It may contain confidential and/or >> proprietary material. Any review, transmission, dissemination or >> other use, or taking of any action in reliance upon this message by >> persons or entities other than the intended recipient is prohibited. >> If you received this message in error, please contact the sender and >> delete it from your computer. >> >> _______________________________________________ >> General mailing list >> [email protected] >> Manage your subscription at: >> http://developer.marklogic.com/mailman/listinfo/general >> >> > > _______________________________________________ > General mailing list > [email protected] > Manage your subscription at: > http://developer.marklogic.com/mailman/listinfo/general > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://developer.marklogic.com/pipermail/general/attachments/20170512/58a2d504/attachment.html ------------------------------ _______________________________________________ General mailing list [email protected] Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general End of General Digest, Vol 155, Issue 13 **************************************** Nothing in this message is intended to constitute an electronic signature unless a specific statement to the contrary is included in this message. Confidentiality Note: This message is intended only for the person or entity to which it is addressed. It may contain confidential and/or proprietary material. Any review, transmission, dissemination or other use, or taking of any action in reliance upon this message by persons or entities other than the intended recipient is prohibited. If you received this message in error, please contact the sender and delete it from your computer. _______________________________________________ General mailing list [email protected] Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
