date:20160613

Re: [Virtuoso-users] Replication on a schedule

2016-06-13 Thread Kingsley Idehen

On 6/13/16 9:59 AM, Davis, Daniel (NIH/NLM) [C] wrote:
> I figured out how I could make it work, anyway.   Such "replication on a 
> schedule" is not usually the way that database replication works, and I'm not 
> sure I should try to make it work this way.  

When using Replication (be it Single-Server or Cluster Editions) the
focal points of configuration are:

[1] Publications -- this is where you identify named graphs or SQL
tables to be replicated

[2] Replication Modality -- this is where to select what kind of
replication you seek: transactional, incremental, snapshot

[3] Replication Schedule -- bar transactional (which is depends on
transaction logs and checkpoint intervals) you can schedule intervals
for snapshot and incremental replication modalities.


-- 
Regards,

Kingsley Idehen   
Founder & CEO 
OpenLink Software 
Company Web: http://www.openlinksw.com
Personal Weblog 1: http://kidehen.blogspot.com
Personal Weblog 2: http://www.openlinksw.com/blog/~kidehen
Twitter Profile: https://twitter.com/kidehen
Google+ Profile: https://plus.google.com/+KingsleyIdehen/about
LinkedIn Profile: http://www.linkedin.com/in/kidehen
Personal WebID: http://kingsley.idehen.net/dataspace/person/kidehen#this




smime.p7s
Description: S/MIME Cryptographic Signature
--
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are 
consuming the most bandwidth. Provides multi-vendor support for NetFlow, 
J-Flow, sFlow and other flows. Make informed decisions using capacity 
planning reports. https://ad.doubleclick.net/ddm/clk/305295220;132659582;e___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users

Re: [Virtuoso-users] Replication on a schedule

2016-06-13 Thread Davis, Daniel (NIH/NLM) [C]

Thanks, Hugh.

I figured out how I could make it work, anyway.   Such "replication on a 
schedule" is not usually the way that database replication works, and I'm not 
sure I should try to make it work this way.   I may work with OpenLink to 
decide on that if we decide to purchase a license for Virtuoso Cluster - this 
email was a product of research towards that decision.

-Original Message-
From: Hugh Williams [mailto:hwilli...@openlinksw.com] 
Sent: Friday, June 10, 2016 5:36 PM
To: Davis, Daniel (NIH/NLM) [C] 
Cc: virtuoso-users 
Subject: Re: [Virtuoso-users] Replication on a schedule

Hi Daniel,

This is an open source mailing list for which cluster is not available as it is 
a commercial only feature, thus not likely to get much response on it …

Note sure what you mean by "replicate on a schedule rather than as deltas are 
flushed” ?

You seem to be seeking to use Virtuoso scale out Elastic Cluster [1][2] which 
is for horizontal scaling across multiple machine to pool resources (storage, 
memory, cores) for hosting large datasets that could not otherwise be hosting 
on a single machine. Virtuoso also has normal Database replication although 
this is a commercial feature only also and is also used for providing Virtuoso 
RDF Graph Replication clustering[3] of of single or scale out cluster farms. 
Based on the email you sent to support is would appear the Virtuoso RDF Graph 
Replication Clustering is most suitable for you use case.

See also the different cluster configuration architectures at [4] …

[1] http://docs.openlinksw.com/virtuoso/clusteroperation.html
[2] http://docs.openlinksw.com/virtuoso/clusterstcnf.html
[3] http://docs.openlinksw.com/virtuoso/rdfgraphreplication.html
[4] 
http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VirtClusteringDiagrams

Best Regards
Hugh Williams
Professional Services
OpenLink Software, Inc.  //  http://www.openlinksw.com/
Weblog   -- http://www.openlinksw.com/blogs/
LinkedIn -- http://www.linkedin.com/company/openlink-software/
Twitter  -- http://twitter.com/OpenLink
Google+  -- http://plus.google.com/100570109519069333827/
Facebook -- http://www.facebook.com/OpenLinkSoftware
Universal Data Access, Integration, and Management Technology Providers

> On 10 Jun 2016, at 17:17, Davis, Daniel (NIH/NLM) [C]  
> wrote:
> 
> So, I’m not sure whether these are available in the Conductor interface, but 
> the cluster control utility (clctl) seems to support what I want to do if I 
> have scheduled jobs which turn on a cluster member for replication and then 
> stop the replication at some point:
>  
> At 2 am, clctl rebuild 2
> …
> At 4 am, check that node 2 is up-to-date, and then disable it - 
> clctl disable 2
>  
> This is probably an anti-pattern however.  Running with row-level autocommit 
> has been good because I don’t have clustering, and am manually replicating 
> via scripts.  I should probably rewack my stored procedures and systems 
> architecture so that my update jobs run efficiently with transaction 
> isolation.
>  
> From: Davis, Daniel (NIH/NLM) [C] 
> Sent: Friday, June 10, 2016 10:55 AM
> To: virtuoso-users 
> Subject: [Virtuoso-users] Replication on a schedule
>  
> Hi, does anyone out there with the Cluster edition of Virtuoso replicate on a 
> schedule rather than as deltas are flushed?  Is this desirable?
>  
> The issue is that in a star topology, replication represents an increased 
> risk of the replicant failing.  It may therefore be better to replicate only 
> during certain time frames so that the cluster remains redundant.   I know I 
> could do this scripts subscribing and subscribing to deltas, but it would be 
> more hands-off if Virtuoso has a simple concept of when to apply deltas.
>  
> Dan Davis, Systems/Applications Architect (Contractor),
> Office of Computer and Communications Systems,
> National Library of Medicine, NIH
>  
> --
> What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
> patterns at an interface-level. Reveals which users, apps, and protocols are 
> consuming the most bandwidth. Provides multi-vendor support for NetFlow, 
> J-Flow, sFlow and other flows. Make informed decisions using capacity 
> planning reports. 
> https://ad.doubleclick.net/ddm/clk/305295220;132659582;e___
> Virtuoso-users mailing list
> Virtuoso-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/virtuoso-users

smime.p7s
Description: S/MIME cryptographic signature
--
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols

Re: [Virtuoso-users] ISQL Result Dump format

2016-06-13 Thread Rumi


Hi Hasan,

Dumping results in various formats can be done by using the

*define output:format "{XX}" *

pragma, so in your case it would be:

SQL> sparql define output:format "TURTLE" CONSTRUCT ...

Other possible formats are:
-- NICE_TTL
-- RDF_XML
etc.

When using the ISQL client, use the 'set blobs on;' directive if 
fetching long texts to avoid receiving a 'data truncated' warning.


i.e.:

SQL> set blobs on;
SQL> sparql define output:format ...

For CONSTRUCT the supported formats are:

TRIG, TTL, JSON, JSON;TALIS, SOAP, RDF/XML, NT, RDFA;XHTML, JSON;RES,
HTML;MICRODATA, HTML, JS, ATOM;XML, JSON;ODATA, XML, CXML;QRCODE, CXML,
HTML;UL, HTML;TR, JSON;LD, CSV, TSV, NICE_TTL, HTML;NICE_MICRODATA,
HTML;SCRIPT_LD_JSON, HTML;SCRIPT_TTL, HTML;NICE_TTL

-- Documentation links:
-- Pragmas to control the type of the result: 
http://docs.openlinksw.com/virtuoso/rdfsparql.html#rdfsparqlimplementatioptragmasctr
-- List of supported formats: 
http://docs.openlinksw.com/virtuoso/rdfsparql.html#rdfsparqlimplementatioptragmassfs

-- Examples:
-- 
http://docs.openlinksw.com/virtuoso/rdfsparql.html#anytimequeriessparqlex
-- 
http://docs.openlinksw.com/virtuoso/rdfsparql.html#rdfcontrollingsparqloutputtypes



In case you want to get the result into a local file, that will work:

1) insert the data into XX.ttl local file:
isql host:port dba pwd exec="set blobs on; sparql define output:format 
'"TURTLE"' construct {...} from <> where {}" > XX.ttl


2) trim the first 9 lines so to have as content only the triples:
tail -n +9 XX.ttl > XX_new.ttl

Best Regards,
Rumi




Best Regards,
Rumi


On 13-Jun-16 9:50 AM, S.M.Shamimul Hasan wrote:

Hello,

I am running following query on Virtuoso isql.

SPARQL
CONSTRUCT
{
 ?infectee ?getInfectedBy ?infector
}

FROM 

WHERE
{
  ?s  
.
  ?s 
 ?infectee.
  ?s 
 ?infector.
  ?s  
'0'^^xsd:decimal.
  BIND (iri('http://ndssl.bi.vt.edu/chicago/vocab/getInfectedBy') 
as ?getInfectedBy)

 };

I want to dump result in "N-Triples" format. How can I do it in isql?

Thank you.

Regards,
S.M.Shamimul Hasan



--
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity
planning reports. https://ad.doubleclick.net/ddm/clk/305295220;132659582;e


___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users



--
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are 
consuming the most bandwidth. Provides multi-vendor support for NetFlow, 
J-Flow, sFlow and other flows. Make informed decisions using capacity 
planning reports. https://ad.doubleclick.net/ddm/clk/305295220;132659582;e___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users

[Virtuoso-users] ISQL Result Dump format

2016-06-13 Thread S.M.Shamimul Hasan

Hello,

I am running following query on Virtuoso isql.

SPARQL
CONSTRUCT
{
 ?infectee ?getInfectedBy ?infector
}

FROM 

WHERE
{
  ?s  <
http://ndssl.bi.vt.edu/chicago/vocab/dendrogram>.
  ?s 
?infectee.
  ?s 
?infector.
  ?s 
'0'^^xsd:decimal.
  BIND (iri('http://ndssl.bi.vt.edu/chicago/vocab/getInfectedBy') as
?getInfectedBy)
 };

I want to dump result in "N-Triples" format. How can I do it in isql?

Thank you.

Regards,
S.M.Shamimul Hasan
--
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are 
consuming the most bandwidth. Provides multi-vendor support for NetFlow, 
J-Flow, sFlow and other flows. Make informed decisions using capacity 
planning reports. https://ad.doubleclick.net/ddm/clk/305295220;132659582;e___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users

Re: [Virtuoso-users] Replication on a schedule

Re: [Virtuoso-users] Replication on a schedule

Re: [Virtuoso-users] ISQL Result Dump format

[Virtuoso-users] ISQL Result Dump format

4 matches

Site Navigation

Mail list logo

Footer information