Re: [MarkLogic Dev General] Using metadata to store references to several other docs?

2018-04-05 Thread David Gorbet
orges H2O Consulting http://h2o.consulting/ On 23 March 2018 at 15:58, David Gorbet wrote: Have you considered the use of PROV (http://www.w3.org/TR/2013/NOTE-prov-primer-20130430/) for this? You could for eg. put in your envelope on the canonical document some PROV-XML that indicates the prove

Re: [MarkLogic Dev General] Using metadata to store references to several other docs?

2018-03-23 Thread David Gorbet
ta value - using several metadata (ref-1, ref-2, ref-3...) Have I forgot anything? Regards, -- Florent Georges H2O Consulting http://h2o.consulting/ On 22 March 2018 at 21:09, David Gorbet wrote: What is the actual business meaning of the relationships between the documents? And is there something

Re: [MarkLogic Dev General] Using metadata to store references to several other docs?

2018-03-22 Thread David Gorbet
What is the actual business meaning of the relationships between the documents? And is there something in the document that indicates this relationship, just not with the doc URI? From: general-boun...@developer.marklogic.com On Behalf Of Florent Georges Sent: Thursday, March 22, 2018 1:06 PM

Re: [MarkLogic Dev General] Regarding Mark Logic License

2018-03-22 Thread David Gorbet
Hi Siva, one correction: Encryption with an external KMS is part of the Advanced Security option. Encryption with the MarkLogic internal wallet is not. Sorry for the (potential) confusion. From: David Gorbet Sent: Thursday, March 22, 2018 8:05 AM To: general@developer.marklogic.com Subject: RE

Re: [MarkLogic Dev General] Regarding Mark Logic License

2018-03-22 Thread David Gorbet
Hi Siva. Advanced Encryption is a feature that was introduced with MarkLogic 9, so your MarkLogic 7 license key will not be encoded for it. It's part of a separate option called Advanced Security. I've forwarded your email to the appropriate folks in MarkLogic who can help you move forward. Bes

Re: [MarkLogic Dev General] mlcp ingestion issue

2018-02-22 Thread David Gorbet
You should log a support incident so we can look at the server logs. NEWSTAMP generally indicates that there is a bottleneck on one of your hosts that is causing commits to be blocked on that host. Server logs should help us figure out where that is. From: general-boun...@developer.marklogic.co

Re: [MarkLogic Dev General] Rsync-Like DB Contents Comparison and Update?

2018-01-29 Thread David Gorbet
..actually if it’s been disconnected too long (i.e. the journals no longer exist), it does a bulk replication which is not necessarily a full copy. It’s a delta copy of what’s missing. Note though that with Database replication you’re subject to replication lag limits that you may need to monit

Re: [MarkLogic Dev General] Multi-Database Architecture

2017-11-23 Thread David Gorbet
If these are completely separate use cases please consider completely separate clusters. You can use virtualization to make the hardware work out. On Nov 23, 2017, at 12:04 PM, Geert Josten mailto:geert.jos...@marklogic.com>> wrote: Hi Andreas, I think each forest has its own in-memory stand,

Re: [MarkLogic Dev General] Excessive memory usage on WIndows

2017-08-29 Thread David Gorbet
It seems to me that if the memory footprint is stable at 95%, you're getting your money's worth out of the RAM you bought. From: general-boun...@developer.marklogic.com [mailto:general-boun...@developer.marklogic.com] On Behalf Of Gary Larsen Sent: Tuesday, August 29, 2017 8:29 AM To: 'General M

Re: [MarkLogic Dev General] Multi statement transactions updating more than one database?

2017-07-11 Thread David Gorbet
If you use XA transactions, be sure to consider the various failure modes of your system. For example, you need to be aware that transactions will fail if one or the other database is unavailable. Also, you need to plan for how to get back to a consistent state if one or the other of the databas

Re: [MarkLogic Dev General] Windows 2016 support

2017-05-03 Thread David Gorbet
Windows Server 2016 is not yet supported. We do plan to add support for it, but don't have a timeframe yet. From: general-boun...@developer.marklogic.com [mailto:general-boun...@developer.marklogic.com] On Behalf Of Gary Larsen Sent: Wednesday, May 03, 2017 8:11 AM To: 'General MarkLogic Develop

Re: [MarkLogic Dev General] search after xdmp.documentInsert() getting 0 results

2016-10-17 Thread David Gorbet
Note that this is not quite true. Changes to documents are not visible to other code in the same statement, but when executing a multi-statement transaction, changes made in one statement are visible to subsequent statements within the same transaction. So a transaction can read a modification

Re: [MarkLogic Dev General] Regarding running ML on AWS and using the pay-as-you-go payment model

2016-03-09 Thread David Gorbet
The annual subscription on AWS includes support. The hourly does not. From: general-boun...@developer.marklogic.com [mailto:general-boun...@developer.marklogic.com] On Behalf Of Indrajeet Verma Sent: Wednesday, March 09, 2016 7:01 AM To: MarkLogic Developer Discussion Subject: [MarkLogic Dev Gen

Re: [MarkLogic Dev General] Is replica forest ever used by its local server?

2016-02-13 Thread David Gorbet
As long as A is the master, reads and updates will happen on A, regardless of where the query originated. From: general-boun...@developer.marklogic.com [mailto:general-boun...@developer.marklogic.com] On Behalf Of neil bradley Sent: Saturday, February 13, 2016 6:34 AM To: MarkLogic Forum Subjec

Re: [MarkLogic Dev General] Data sync up within ML clusters in different zones

2016-02-01 Thread David Gorbet
, Prakash From: general-boun...@developer.marklogic.com<mailto:general-boun...@developer.marklogic.com> [mailto:general-boun...@developer.marklogic.com] On Behalf Of David Gorbet Sent: Monday, January 25, 2016 4:52 PM To: MarkLogic Developer Discussion Subject: Re: [MarkLogic Dev General] D

Re: [MarkLogic Dev General] Data sync up within ML clusters in different zones

2016-01-25 Thread David Gorbet
rs will see only after it has been checked in. So after is has been checked in, it has to be immediately migrated to rest of the two regions. Thanks, Prakash From: general-boun...@developer.marklogic.com<mailto:general-boun...@developer.marklogic.com> [mailto:general-boun...@developer.ma

Re: [MarkLogic Dev General] Data sync up within ML clusters in different zones

2016-01-25 Thread David Gorbet
rklogic.com] On Behalf Of David Gorbet Sent: Friday, January 22, 2016 1:33 AM To: MarkLogic Developer Discussion Subject: Re: [MarkLogic Dev General] Data sync up within ML clusters in different zones Independent of the technology, what are your business rules for resolving conflicts? e.g. I

Re: [MarkLogic Dev General] A way to detect CPF updates complete?

2016-01-22 Thread David Gorbet
You could also potentially use permissions to do this, which might be more broadly useful since you don’t have to be sure that each search is aware of the collection issue. From: general-boun...@developer.marklogic.com [mailto:general-boun...@developer.marklogic.com] On Behalf Of Ashley Peacock

Re: [MarkLogic Dev General] Data sync up within ML clusters in different zones

2016-01-21 Thread David Gorbet
elow. Thanks, Prakash From: general-boun...@developer.marklogic.com<mailto:general-boun...@developer.marklogic.com> [mailto:general-boun...@developer.marklogic.com] On Behalf Of David Gorbet Sent: Wednesday, January 20, 2016 10:51 PM To: MarkLogic Developer Discussion Subject: Re: [M

Re: [MarkLogic Dev General] Data sync up within ML clusters in different zones

2016-01-20 Thread David Gorbet
Some questions: * Is this database insert-only or does it also allow updates? * If it allows updates, are those updates mastered in one of the three locations for a given document, or is it possible for any location to update any document at any time? * If it's possible

Re: [MarkLogic Dev General] Re-index a replica database

2015-12-01 Thread David Gorbet
, David Gorbet wrote: > Hmm, someone can correct me if I'm wrong, but if you disable replication, you > should then be able to then reindex the erstwhile replica cluster, then > re-enable replication. I just don't think you can reindex it while it's > acting as replica c

Re: [MarkLogic Dev General] Re-index a replica database

2015-12-01 Thread David Gorbet
ou can still click reindex but nothing happens). Cheers Rob From: general-boun...@developer.marklogic.com [general-boun...@developer.marklogic.com] on behalf of David Gorbet [david.gor...@marklogic.com] Sent: 01 December 2015 19:43 To: MarkLogic Developer Disc

Re: [MarkLogic Dev General] Re-index a replica database

2015-12-01 Thread David Gorbet
Out of interest, what's the scenario here? Thx. From: general-boun...@developer.marklogic.com [mailto:general-boun...@developer.marklogic.com] On Behalf Of Wayne Feick Sent: Tuesday, December 01, 2015 11:06 AM To: general@developer.marklogic.com Subject: Re: [MarkLogic Dev General] Re-index a rep

Re: [MarkLogic Dev General] Managed vs Unmanaged Triples

2015-11-19 Thread David Gorbet
You can use sparql update to drop the graph. That should remove them. From: general-boun...@developer.marklogic.com [mailto:general-boun...@developer.marklogic.com] On Behalf Of Robert Del Toro Jr. Sent: Thursday, November 19, 2015 8:03 PM To: MarkLogic Developer Discussion Subject: Re: [MarkLo

Re: [MarkLogic Dev General] Bitemperal Documents vs Document Library Services [I]

2015-11-18 Thread David Gorbet
Another way to think about this is that bitemporality tracks things over time, whereas versioning tracks version numbers. If you want to know your document state at a particular point in time, versioning doesn’t help unless you know what versions were in play at that point. Also, temporal queri

Re: [MarkLogic Dev General] Transitioning from SQL

2015-06-15 Thread David Gorbet
Bitemporal will allow you to query for documents using temporal range queries. If you have a concept of "version" in addition to the temporal ranges, then you should maintain that yourself, and a header is a good place for that. In addition, Bitemporal requires valid begin/end times and system b

Re: [MarkLogic Dev General] XDMP-FRAGTOOLARGE

2015-05-12 Thread David Gorbet
Re: what Geert responded with, I can see a scenario where a very large file ingests fine, then index settings are changed in a way that makes its termlist size expand significantly. With no knowledge of the document or its size, it’s hard to say what the best thing to do here is. I would look at

Re: [MarkLogic Dev General] Fragment root configuration

2015-05-02 Thread David Gorbet
Again, not sure what type of data/content you have, but it's very rare that fragmentation is the right thing to do. Fragmentation is designed for large content containers like books, to fragment them into smaller containers like chapters. It's usually better just to structure your data so that y

Re: [MarkLogic Dev General] XDMP-TOOMANYSTANDS

2015-05-01 Thread David Gorbet
If you had 62 max-sized stands in 1 forest, you probably should be creating more than one forest rather than just increasing the max stand size. I don’t know anything about your cluster (number of nodes, amount of data, etc.), but generally in a 3-node cluster we recommend 6 primary forests and

Re: [MarkLogic Dev General] Too many stands exception

2015-05-01 Thread David Gorbet
If you have too many stands, it’s usually because you’re not merging frequently enough. Usually this is the result of having set a background IO limit that is too low. From: general-boun...@developer.marklogic.com [mailto:general-boun...@developer.marklogic.com] On Behalf Of Shashidhar Rao Sent

[MarkLogic Dev General] Important MarkLogic security update for CVE-2014-0160 (heartbleed) vulnerability

2014-04-12 Thread David Gorbet
If you have any questions about how to patch, feel free to contact supp...@marklogic.com<mailto:supp...@marklogic.com>. More information about the heartbleed vulnerability can be found at http://heartbleed.com or https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2014-0160. n David David

[MarkLogic Dev General] Important security information regarding CVE-2014-0160 (heartbleed) vulnerability

2014-04-10 Thread David Gorbet
http://heartbleed.com or https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2014-0160. n David David Gorbet VP Engineering MarkLogic Corporation email david.gor...@marklogic.com<mailto:david.gor...@marklogic.com> webwww.marklogic.com<http://www.marklogic.com/> Join us on the MarkLogi

Re: [MarkLogic Dev General] Higher relevance for newer documents?

2013-08-20 Thread David Gorbet
Why couldn't you do an exponential decay? You control the formula, right? It could be (weeks-since-1970)^2, couldn't it? Sent from my Windows Phone From: Ron Hitchens Sent: ‎8/‎20/‎2013 12:46 PM To: MarkLogic Developer Discussion