date:20131106

Re: [MarkLogic Dev General] Search allowing filter with modular documents

2013-11-06 Thread Fabian Jaramillo

Thanks Geert,

Well my client has documents with many dependencies and the best way to manage 
that is with modular documents, I was thinking to use the function 
xinc:node-expand to get all the information from my main document and make the 
filters after that, but I think I will have to use two search to achieve this. 
Thank you for your answer.

Best regards,

-- 
FABIAN JARAMILLO ORDOÑEZ
SOFTWARE ARCHITECT
Yuxi Pacific Latam S.A.S
Carrera 38 #10-36 Oficinas 801/802
Medellín, Antioquia, Colombia.
Tel: +57-4-2661968/2661977
Mobile: +57-300-2098933
Skype: yuxi-fabian
http://www.yuxipacific.com/

On Nov 6, 2013, at 1:26 PM, Geert Josten  wrote:

> Hi Fabian,
> 
> So, the main xmls are final search results, right? You're best off with a
> two-pass search. What you are looking for is a list of uris of all
> secondary xml's that contain tags with particular values. Using that list
> you can do a search on text elements and main xmls having secondary xmls
> as an include href. Something like this:
> 
> let $uris :=
>   cts:uris((), (),
>   cts:and-query((
>   cts:collection-query("secondaryDocuments"),
>   cts:element-value-query(xs:QName(“tag”), “Study”)
>   ))
>   )
> return
>   cts:search( fn:collection(“mainDocuments”) ,
>   cts:and-query((
>   cts:element-value-query(xs:QName(“text”),
> “Introduction”),
> 
> cts:element-attribute-value-query(xs:QName("xi:include"),
> xs:QName("href"), $uris)
>   ))
>   )
> 
> This does pose limits to the nesting of such modular documents. For
> documents that are nested two deep, you may need a 3-pass search, and so
> on.
> 
> In that respect, it might be easier to use the fragmentation features of
> MarkLogic. Searches in MarkLogic are optimized to return fragments, but if
> you search a parent fragment, sub-fragments are automatically included in
> the query evaluation. There is more to it, but it might be worth
> considering.
> 
> On the other hand, is there a particular reason to have your content
> denormalized like that at all?
> 
> Kind regards,
> Geert
> 
>> -Oorspronkelijk bericht-
>> Van: general-boun...@developer.marklogic.com [mailto:general-
>> boun...@developer.marklogic.com] Namens Fabian Jaramillo
>> Verzonden: woensdag 6 november 2013 18:21
>> Aan: general@developer.marklogic.com
>> Onderwerp: [MarkLogic Dev General] Search allowing filter with modular
>> documents
>> 
>> Hello,
>> 
>> I have a modular document with xinclude in my database, example:
>> 
>> main.xml
>> 
>> 
>> 
>> 
>> Introduction
>> 
>> 
>> 
>> item1.xml
>> 
>> 
>> Hello world
>> 
>> Study
>> Development
>> 
>> 
>> 
>> 
>> so, I want to make a search when I can filter all the main files and
> make
>> some filters to the item1.xml. something like this:
>> 
>> 
>> cts:search( fn:collection(“mainDocuments”) ,
>>  cts:and-query((
>>  cts:element-value-query(xs:QName(“text”),
>> “Introduction”),
>>  cts:element-value-query(xs:QName(“tag”),
>> “Study”)
>>  ))
>>  )
>> 
>> 
>> is it possible to achieve with Marklogic?
>> 
>> --
>> FABIAN JARAMILLO ORDOÑEZ
>> SOFTWARE ARCHITECT
>> Yuxi Pacific Latam S.A.S
>> Carrera 38 #10-36 Oficinas 801/802
>> Medellín, Antioquia, Colombia.
>> Tel: +57-4-2661968/2661977
>> Mobile: +57-300-2098933
>> Skype: yuxi-fabian
>> http://www.yuxipacific.com/
>> 
>> ___
>> General mailing list
>> General@developer.marklogic.com
>> http://developer.marklogic.com/mailman/listinfo/general
> ___
> General mailing list
> General@developer.marklogic.com
> http://developer.marklogic.com/mailman/listinfo/general

___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] Java Memory error with MLCP

2013-11-06 Thread Geert Josten

Hi Walt,



Where, and which memory settings did you change? It might also help to
decrease the number of parallel threads..



Kind regards,

Geert



*Van:* general-boun...@developer.marklogic.com [mailto:
general-boun...@developer.marklogic.com] *Namens *Walt Perez
*Verzonden:* woensdag 6 november 2013 15:04
*Aan:* MarkLogic Developer Discussion
*Onderwerp:* [MarkLogic Dev General] Java Memory error with MLCP



Group,

I was wondering if anyone can help a rookie out? I am trying to load a 78mb
csv file against MLCP and I keep getting the following error…



3/11/06 09:00:26 ERROR contentpump.MultithreadedMapper: Java heap space

java.lang.OutOfMemoryError: Java heap space

at java.util.Arrays.copyOf(Arrays.java:2760)

at java.util.Arrays.copyOf(Arrays.java:2734)

at java.util.ArrayList.ensureCapacity(ArrayList.java:167)

at java.util.ArrayList.add(ArrayList.java:351)

at org.apache.commons.csv.CSVParser.getLine(CSVParser.java:244)

at
com.marklogic.contentpump.DelimitedTextReader.nextKeyValue(DelimitedTextReader.java:114)

at
com.marklogic.contentpump.LocalJobRunner$TrackingRecordReader.nextKeyValue(LocalJobRunner.java:434)



I increased the memory usage in Java to 512, then to 1024, but it does not
help. Does anybody have any suggestions? Here is my current MLCP command
options I am passing in…



import

-host

localhost

-port

8008

-username

admin

-password

admin

-mode

local

-input_file_type

delimited_text

-delimited_uri_id

stock_id

-delimiter

','

-batch_size

1000

-thread_count

25

-output_collections

fins_demo_data



Thanks,



Walt Perez

Senior Sales Engineer

Phone: +1 912 577-9057

MarkLogic Corporation
walt.pe...@marklogic.com
www.marklogic.com
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] Search allowing filter with modular documents

2013-11-06 Thread Geert Josten

Hi Fabian,

So, the main xmls are final search results, right? You're best off with a
two-pass search. What you are looking for is a list of uris of all
secondary xml's that contain tags with particular values. Using that list
you can do a search on text elements and main xmls having secondary xmls
as an include href. Something like this:

let $uris :=
cts:uris((), (),
cts:and-query((
cts:collection-query("secondaryDocuments"),
cts:element-value-query(xs:QName(“tag”), “Study”)
))
)
return
cts:search( fn:collection(“mainDocuments”) ,
cts:and-query((
cts:element-value-query(xs:QName(“text”),
“Introduction”),

cts:element-attribute-value-query(xs:QName("xi:include"),
xs:QName("href"), $uris)
))
)

This does pose limits to the nesting of such modular documents. For
documents that are nested two deep, you may need a 3-pass search, and so
on.

In that respect, it might be easier to use the fragmentation features of
MarkLogic. Searches in MarkLogic are optimized to return fragments, but if
you search a parent fragment, sub-fragments are automatically included in
the query evaluation. There is more to it, but it might be worth
considering.

On the other hand, is there a particular reason to have your content
denormalized like that at all?

Kind regards,
Geert

> -Oorspronkelijk bericht-
> Van: general-boun...@developer.marklogic.com [mailto:general-
> boun...@developer.marklogic.com] Namens Fabian Jaramillo
> Verzonden: woensdag 6 november 2013 18:21
> Aan: general@developer.marklogic.com
> Onderwerp: [MarkLogic Dev General] Search allowing filter with modular
> documents
>
> Hello,
>
> I have a modular document with xinclude in my database, example:
>
> main.xml
>
> 
> 
> 
> Introduction
> 
> 
>
> item1.xml
>
> 
> Hello world
> 
> Study
> Development
> 
> 
>
>
> so, I want to make a search when I can filter all the main files and
make
> some filters to the item1.xml. something like this:
>
>
> cts:search( fn:collection(“mainDocuments”) ,
>   cts:and-query((
>   cts:element-value-query(xs:QName(“text”),
> “Introduction”),
>   cts:element-value-query(xs:QName(“tag”),
> “Study”)
>   ))
>   )
>
>
> is it possible to achieve with Marklogic?
>
> --
> FABIAN JARAMILLO ORDOÑEZ
> SOFTWARE ARCHITECT
> Yuxi Pacific Latam S.A.S
> Carrera 38 #10-36 Oficinas 801/802
> Medellín, Antioquia, Colombia.
> Tel: +57-4-2661968/2661977
> Mobile: +57-300-2098933
> Skype: yuxi-fabian
> http://www.yuxipacific.com/
>
> ___
> General mailing list
> General@developer.marklogic.com
> http://developer.marklogic.com/mailman/listinfo/general
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] mlcp error

2013-11-06 Thread Justin Makeig

Jakob,
Sorry about the unresponsiveness. That looks like you might have uncovered a 
bug. I’ll have an Engineer on our end try to reproduce this and contact you 
offline for more details. I’ll follow up with the list with the eventual 
outcome. Thanks for your feedback.

Justin



Justin Makeig
Director, Product Management
MarkLogic Corporation
justin.mak...@marklogic.com
www.marklogic.com



On Nov 6, 2013, at 7:12 AM, Jakob Fix 
mailto:jakob@gmail.com>>
 wrote:

Hello,

I was just wondering whether the silence in response to my question is 
"stunned", "not interested", "well, can't he figure this out by himself" or 
"oops, didn't see this one"?

:-)

cheers,
Jakob.


On Fri, Nov 1, 2013 at 12:01 AM, Jakob Fix 
mailto:jakob@gmail.com>> wrote:
Hi,

we've run into something we think might be a bug with the most recent version 
of mlcp. We did an export of a database with XML documents and lots of binary 
documents, and an import of the exported data into another database.  In the 
second step of the procedure, i.e. the import into the new database, the error 
below appeared (the line with Archive damaged ...). Apparently, mlcp stores XML 
and binary documents in different zip files. Also, each binary document gets 
its metadata document. In our case, the export created two zip files containing 
the binaries. For some reason, in the case of one document, the actual binary 
file and its metadata file were separated, as shown below:

20131031140432+0100-01-BINARY.zip ==> RO-GE_DTC.pdf.metadata
20131031140432+0100-02-BINARY.zip ==> RO-GE_DTC.pdf

which seems to have caused the error below. The PDF file is indeed not loaded 
into the database.

Reuniting the PDF file with its metadata equivalent in the same binary zip file 
made the import procedure run without errors.

thanks,
Jakob.


marklogic-contentpump-1.0.3\bin\mlcp.bat EXPORT -host 192.168.56.90 -port 5 
-username abc  -password abc  -output_type archive -output_file_path 
db-prod-20131031

marklogic-contentpump-1.0.3\bin\mlcp.bat IMPORT -host 192.168.56.90 -port 40100 
-username abc -password abc -input_file_path db-prod-20131031 -input_file_type 
archive

13/10/31 14:09:54 INFO contentpump.LocalJobRunner: Content type: XML
13/10/31 14:09:54 INFO jvm.JvmMetrics: Initializing JVM Metrics with 
processName=JobTracker, sessionId=
13/10/31 14:09:54 INFO input.FileInputFormat: Total input paths to process : 3
13/10/31 14:09:55 ERROR contentpump.ArchiveRecordReader: Archive damaged: 
no/incorrect metadata for /content/assets/agreements/RO-GE_DTC.pdf in 
/D:/Projects/EOI/deployment/mlcp/eoi-db-prod-20131032/20131031140432+0100-02-BINARY.zip
13/10/31 14:09:55 ERROR contentpump.LocalJobRunner: Error running task: 
attempt___m_01_0
java.lang.NullPointerException
at 
com.marklogic.contentpump.DatabaseContentWriter.write(DatabaseContentWriter.java:231)
at 
com.marklogic.contentpump.DatabaseContentWriter.write(DatabaseContentWriter.java:58)
at 
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at com.marklogic.contentpump.DocumentMapper.map(DocumentMapper.java:46)
at com.marklogic.contentpump.DocumentMapper.map(DocumentMapper.java:32)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at 
com.marklogic.contentpump.LocalJobRunner$LocalMapTask.call(LocalJobRunner.java:375)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
13/10/31 14:09:56 INFO contentpump.LocalJobRunner:  completed 0%
13/10/31 14:14:42 INFO contentpump.LocalJobRunner:  completed 33%
13/10/31 14:15:41 WARN contentpump.DatabaseContentWriter: SEC-PERMDENIED: 
Permission denied
13/10/31 14:18:27 INFO contentpump.LocalJobRunner:  completed 66%
13/10/31 14:18:27 INFO contentpump.LocalJobRunner: 
com.marklogic.contentpump.ContentPumpStats:
13/10/31 14:18:27 INFO contentpump.LocalJobRunner: 
ATTEMPTED_INPUT_RECORD_COUNT: 20230
13/10/31 14:18:27 INFO contentpump.LocalJobRunner: SKIPPED_INPUT_RECORD_COUNT: 0
13/10/31 14:18:27 INFO contentpump.LocalJobRunner: Total execution time: 512 sec




___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

[MarkLogic Dev General] Search allowing filter with modular documents

2013-11-06 Thread Fabian Jaramillo

Hello,

I have a modular document with xinclude in my database, example:

main.xml




Introduction



item1.xml


Hello world

Study
Development




so, I want to make a search when I can filter all the main files and make some 
filters to the item1.xml. something like this:


cts:search( fn:collection(“mainDocuments”) , 
cts:and-query(( 
cts:element-value-query(xs:QName(“text”), 
“Introduction”), 
cts:element-value-query(xs:QName(“tag”), 
“Study”) 
)) 
)


is it possible to achieve with Marklogic?

-- 
FABIAN JARAMILLO ORDOÑEZ
SOFTWARE ARCHITECT
Yuxi Pacific Latam S.A.S
Carrera 38 #10-36 Oficinas 801/802
Medellín, Antioquia, Colombia.
Tel: +57-4-2661968/2661977
Mobile: +57-300-2098933
Skype: yuxi-fabian
http://www.yuxipacific.com/

___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] Stemming for French Words

2013-11-06 Thread Mary Holstege

On Wed, 06 Nov 2013 06:52:57 -0800, Sundaravadivel  Kandasamy  
 wrote:

> Hi All,
> We have MarkLogic 6.0 English version and enabled Basic  
> Stemming in MarkLogic Admin console. We have French content xmls in our  
> ML repository.
>
> Stemming works for few words.
>
> Example
>
>
> 1.   Working for août & aoûts
>
> 2.   Not works for particulier & particuliers
>
> How to enhance the complete stemming for French words in ML. Any other  
> configuration settings required?
>
> Thanks in Advance,
> Sundar
>

French support is a separately licensed option. You would need to
purchase a license that supports it.

//Mary
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] mlcp error

2013-11-06 Thread Jakob Fix

Hello,

I was just wondering whether the silence in response to my question is
"stunned", "not interested", "well, can't he figure this out by himself" or
"oops, didn't see this one"?

:-)

cheers,
Jakob.


On Fri, Nov 1, 2013 at 12:01 AM, Jakob Fix  wrote:

> Hi,
>
> we've run into something we think might be a bug with the most recent
> version of mlcp. We did an export of a database with XML documents and lots
> of binary documents, and an import of the exported data into another
> database.  In the second step of the procedure, i.e. the import into the
> new database, the error below appeared (the line with Archive damaged ...).
> Apparently, mlcp stores XML and binary documents in different zip files.
> Also, each binary document gets its metadata document. In our case, the
> export created two zip files containing the binaries. For some reason, in
> the case of one document, the actual binary file and its metadata file were
> separated, as shown below:
>
> 20131031140432+0100-01-BINARY.zip ==> RO-GE_DTC.pdf.metadata
>
> 20131031140432+0100-02-BINARY.zip ==> RO-GE_DTC.pdf
>
>
> which seems to have caused the error below. The PDF file is indeed not
> loaded into the database.
>
> Reuniting the PDF file with its metadata equivalent in the same binary zip
> file made the import procedure run without errors.
>
> thanks,
> Jakob.
>
>
>
>  marklogic-contentpump-1.0.3\bin\mlcp.bat EXPORT -host 192.168.56.90
> -port 5 -username abc  -password abc  -output_type archive
> -output_file_path db-prod-20131031
>
>
>
> marklogic-contentpump-1.0.3\bin\mlcp.bat IMPORT -host 192.168.56.90 -port
> 40100 -username abc -password abc -input_file_path db-prod-20131031
> -input_file_type archive
>
>
>
> 13/10/31 14:09:54 INFO contentpump.LocalJobRunner: Content type: XML
>
> 13/10/31 14:09:54 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
>
> 13/10/31 14:09:54 INFO input.FileInputFormat: Total input paths to process
> : 3
>
> 13/10/31 14:09:55 ERROR contentpump.ArchiveRecordReader: Archive damaged:
> no/incorrect metadata for /content/assets/agreements/RO-GE_DTC.pdf in
> /D:/Projects/EOI/deployment/mlcp/eoi-db-prod-20131032/20131031140432+0100-02-BINARY.zip
>
>  13/10/31 14:09:55 ERROR contentpump.LocalJobRunner: Error running task:
> attempt___m_01_0
>
> java.lang.NullPointerException
>
> at
> com.marklogic.contentpump.DatabaseContentWriter.write(DatabaseContentWriter.java:231)
>
> at
> com.marklogic.contentpump.DatabaseContentWriter.write(DatabaseContentWriter.java:58)
>
> at
> org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
>
> at
> com.marklogic.contentpump.DocumentMapper.map(DocumentMapper.java:46)
>
> at
> com.marklogic.contentpump.DocumentMapper.map(DocumentMapper.java:32)
>
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>
> at
> com.marklogic.contentpump.LocalJobRunner$LocalMapTask.call(LocalJobRunner.java:375)
>
> at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
>
> at java.util.concurrent.FutureTask.run(Unknown Source)
>
> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
> Source)
>
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source)
>
> at java.lang.Thread.run(Unknown Source)
>
> 13/10/31 14:09:56 INFO contentpump.LocalJobRunner:  completed 0%
>
> 13/10/31 14:14:42 INFO contentpump.LocalJobRunner:  completed 33%
>
> 13/10/31 14:15:41 WARN contentpump.DatabaseContentWriter: SEC-PERMDENIED:
> Permission denied
>
> 13/10/31 14:18:27 INFO contentpump.LocalJobRunner:  completed 66%
>
> 13/10/31 14:18:27 INFO contentpump.LocalJobRunner:
> com.marklogic.contentpump.ContentPumpStats:
>
> 13/10/31 14:18:27 INFO contentpump.LocalJobRunner:
> ATTEMPTED_INPUT_RECORD_COUNT: 20230
>
> 13/10/31 14:18:27 INFO contentpump.LocalJobRunner:
> SKIPPED_INPUT_RECORD_COUNT: 0
>
> 13/10/31 14:18:27 INFO contentpump.LocalJobRunner: Total execution time:
> 512 sec
>
>
>
>
>
>
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

[MarkLogic Dev General] Stemming for French Words

2013-11-06 Thread Sundaravadivel Kandasamy

Hi All,
We have MarkLogic 6.0 English version and enabled Basic 
Stemming in MarkLogic Admin console. We have French content xmls in our ML 
repository.

Stemming works for few words.

Example


1.   Working for août & aoûts

2.   Not works for particulier & particuliers

How to enhance the complete stemming for French words in ML. Any other 
configuration settings required?

Thanks in Advance,
Sundar

 CAUTION - Disclaimer *
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are 
not
to copy, disclose, or distribute this e-mail or its contents to any other 
person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has 
taken
every reasonable precaution to minimize this risk, but is not liable for any 
damage
you may sustain as a result of any virus in this e-mail. You should carry out 
your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this 
e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS End of Disclaimer INFOSYS***
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

[MarkLogic Dev General] Java Memory error with MLCP

2013-11-06 Thread Walt Perez

Group,
I was wondering if anyone can help a rookie out? I am trying to load a 78mb csv 
file against MLCP and I keep getting the following error…

3/11/06 09:00:26 ERROR contentpump.MultithreadedMapper: Java heap space
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:2760)
at java.util.Arrays.copyOf(Arrays.java:2734)
at java.util.ArrayList.ensureCapacity(ArrayList.java:167)
at java.util.ArrayList.add(ArrayList.java:351)
at org.apache.commons.csv.CSVParser.getLine(CSVParser.java:244)
at 
com.marklogic.contentpump.DelimitedTextReader.nextKeyValue(DelimitedTextReader.java:114)
at 
com.marklogic.contentpump.LocalJobRunner$TrackingRecordReader.nextKeyValue(LocalJobRunner.java:434)

I increased the memory usage in Java to 512, then to 1024, but it does not 
help. Does anybody have any suggestions? Here is my current MLCP command 
options I am passing in…

import
-host
localhost
-port
8008
-username
admin
-password
admin
-mode
local
-input_file_type
delimited_text
-delimited_uri_id
stock_id
-delimiter
','
-batch_size
1000
-thread_count
25
-output_collections
fins_demo_data

Thanks,

Walt Perez
Senior Sales Engineer
Phone: +1 912 577-9057
MarkLogic Corporation
walt.pe...@marklogic.com
www.marklogic.com
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] Change Log Location after installation

2013-11-06 Thread Blessing N

Hi Geert,

Thanks for the information.,

Regards,
Blessing

On Wed, Nov 6, 2013 at 5:46 PM, Geert Josten  wrote:
> Hi Blessing,
>
> The location of the Logs directory normally depends on the Data directory
> setting (http://docs.marklogic.com/guide/admin/logfiles#id_22670). Not
> sure how you could influence that, but I think it should be possible to
> replace the actual Logs directory by a sym-link to a Logs directory
> elsewhere, provided you are using a file-system that supports sym-links..
>
> Kind regards,
> Geert
>
>> -Oorspronkelijk bericht-
>> Van: general-boun...@developer.marklogic.com [mailto:general-
>> boun...@developer.marklogic.com] Namens Blessing N
>> Verzonden: woensdag 6 november 2013 11:25
>> Aan: MarkLogic Developer Discussion
>> Onderwerp: [MarkLogic Dev General] Change Log Location after
> installation
>>
>> Hi,
>>
>> Is there a way we can change the default Log location after Marklogic
>> installation?
>>
>> Regards,
>> Blessing.
>> ___
>> General mailing list
>> General@developer.marklogic.com
>> http://developer.marklogic.com/mailman/listinfo/general
> ___
> General mailing list
> General@developer.marklogic.com
> http://developer.marklogic.com/mailman/listinfo/general
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] export / import ?

2013-11-06 Thread Gary Larsen

Hi Geert,

 

I use this syntax on queries which return many results.  It appears that the
objects from cts:search() are able to be removed from the cache after each
iteration.

 

I didn't think the problem would be data related (large documents), but need
to investigate that.  Thanks for the MLCP link.  I was putting of upgrading
to version 6 but now have a good reason.

 

 

Gary Larsen

Envisn Inc.

508 259-6465

 

From: general-boun...@developer.marklogic.com
[mailto:general-boun...@developer.marklogic.com] On Behalf Of Geert Josten
Sent: Tuesday, November 05, 2013 3:46 PM
To: MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] export / import ?

 

Hi Gary,

 

Different memory settings, larger documents, total nr of documents, things
like that..

 

>From the looks of your code, you are still trying to handle all documents
within one query. How about spawning tasks to do your import/export? Perhaps
making $incr a bit smaller too.

 

Information Studio takes that approach too. Might be worth taking a closer
look at that also. I used that as foundation for import/export in one of my
projects..

 

Kind regards,

Geert

 

Van: general-boun...@developer.marklogic.com
[mailto:general-boun...@developer.marklogic.com] Namens Gary Larsen
Verzonden: dinsdag 5 november 2013 17:20
Aan: 'MarkLogic Developer Discussion'
Onderwerp: Re: [MarkLogic Dev General] export / import ?

 

I'll check it out.  Thanks.

 

I've had good luck using this construct to avoid the tree cache errors when
a query returns a lot of data.  Not sure why it's not working at this site.

 

let $incr := 5000

let $size := xdmp:estimate(cts:search(doc(), $cq, 'unfiltered')) 

let $segs := ceiling($size div $incr) return 



for $x in (1 to $segs) 

let $start :=  (($x -1) * $incr) +1 

let $end := $start + $incr -1 

return cts:search(doc(), $cq, 'unfiltered')[$start to $end]

 

Gary Larsen

Envisn Inc.

508 259-6465

 

From: general-boun...@developer.marklogic.com
[mailto:general-boun...@developer.marklogic.com] On Behalf Of Eric Bloch
Sent: Tuesday, November 05, 2013 11:01 AM
To: MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] export / import ?

 

Gary, 

 

See http://developer.marklogic.com/products/mlcp.

 

That said, tree cache errors usually mean you have a query that needs to be
rewritten in some way.  For example, see

 

http://stackoverflow.com/questions/16979086/marklogic-expanded-tree-cache-er
ror-while-inserting-documents

 

Best,

Eric

 

Eric Bloch

Director, Community

MarkLogic Corporation

 

desk +1 650 655 2390 | mobile +1 650 339 0376

email  eric.bl...@marklogic.com

webdeveloper.marklogic.com

twitter @eedeebee

 

On Nov 5, 2013, at 7:59 AM, Gary Larsen 

 wrote:

 

Is there a utility which will allow me to extract all the documents from a
collection, and them import into another database?

 

Trying to debug tree cache errors at a customer site and need to replicate
the error.  I'd rather not try to use backup/restore of the database due to
the size.

 

Thanks,

Gary

___
General mailing list
  General@developer.marklogic.com
 
http://developer.marklogic.com/mailman/listinfo/general

 

___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] Change Log Location after installation

2013-11-06 Thread Geert Josten

Hi Blessing,

The location of the Logs directory normally depends on the Data directory
setting (http://docs.marklogic.com/guide/admin/logfiles#id_22670). Not
sure how you could influence that, but I think it should be possible to
replace the actual Logs directory by a sym-link to a Logs directory
elsewhere, provided you are using a file-system that supports sym-links..

Kind regards,
Geert

> -Oorspronkelijk bericht-
> Van: general-boun...@developer.marklogic.com [mailto:general-
> boun...@developer.marklogic.com] Namens Blessing N
> Verzonden: woensdag 6 november 2013 11:25
> Aan: MarkLogic Developer Discussion
> Onderwerp: [MarkLogic Dev General] Change Log Location after
installation
>
> Hi,
>
> Is there a way we can change the default Log location after Marklogic
> installation?
>
> Regards,
> Blessing.
> ___
> General mailing list
> General@developer.marklogic.com
> http://developer.marklogic.com/mailman/listinfo/general
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

[MarkLogic Dev General] Change Log Location after installation

2013-11-06 Thread Blessing N

Hi,

Is there a way we can change the default Log location after Marklogic
installation?

Regards,
Blessing.
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] Search allowing filter with modular documents

Re: [MarkLogic Dev General] Java Memory error with MLCP

Re: [MarkLogic Dev General] Search allowing filter with modular documents

Re: [MarkLogic Dev General] mlcp error

[MarkLogic Dev General] Search allowing filter with modular documents

Re: [MarkLogic Dev General] Stemming for French Words

Re: [MarkLogic Dev General] mlcp error

[MarkLogic Dev General] Stemming for French Words

[MarkLogic Dev General] Java Memory error with MLCP

Re: [MarkLogic Dev General] Change Log Location after installation

Re: [MarkLogic Dev General] export / import ?

Re: [MarkLogic Dev General] Change Log Location after installation

[MarkLogic Dev General] Change Log Location after installation

13 matches

Site Navigation

Mail list logo

Footer information