do the ruby scripts in the fuseki distribution make use of the Graph Store Protocol? e.g s-put
On Wed, May 29, 2013 at 1:11 PM, Rob Vesse <[email protected]> wrote: > If you do want to load data to a running system it may be best to use the > Graph Store Protocol features of Fuseki. > > If TDB is the backing store Fuseki will use transactions appropriately and > data can be loaded while users are querying it with TDB's transaction > machinery ensuring that existing read transactions don't see the new data > until it has been committed. However this may have increased memory usage > due to the write ahead journaling that TDB uses to implement transactions. > > Rob > > > > > On 5/29/13 9:43 AM, "Marco Neumann" <[email protected]> wrote: > > >actually when you say it Rob, tdbloader2 is not hitting the webservice but > >tdb on the file system. > > > >so you are right tdbloader2 is running concurrent with the fuseki > >instance. > >not a good idea with the current design. > > > >will have to shut down fuseki before loading the new data now > > > > > > > >On Wed, May 29, 2013 at 12:29 PM, Rob Vesse <[email protected]> wrote: > > > >> I don't quite follow what you are doing here Marco. Exactly what steps > >> are you taking to load the data/run Fuseki? > >> > >> Are you saying that you are running a Fuseki instance against a TDB > >> instance that you are bulk loading in parallel? If so this is a very > >>bad > >> idea, TDB is not safe for concurrent use across multiple JVMs > >> > >> Rob > >> > >> > >> > >> On 5/29/13 7:11 AM, "Marco Neumann" <[email protected]> wrote: > >> > >> >have you seen this before? I am getting this warning recently while > >>fuseki > >> >is building the index after a bulkload with tdbloader2 > >> > > >> >as you can see other users access the fuseki webservice at the same > >>time. > >> > > >> > > >> >13:58:17 Index phase > >> >13:58:17 Index SPO > >> >13:58:20 INFO [4] GET * > >> >13:58:20 INFO [4] Query = PREFIX geo:< > >> >http://www.w3.org/2003/01/geo/wgs84_pos#> PREFIX foaf:< > >> >http://xmlns.com/foaf/0.1/> PREFIX loticoowl:< > >> >http://www.lotico.com/ontology/> DESCRIBE < > >> >http://www.lotico.com/resource/member_12111849> > >> >13:58:20 WARN [4] RC = 500 : BlockAccessBase: Bounds exception: > >> >/public_trust/db/fusekidb/node2id.idn: (1025,1) > >> >com.hp.hpl.jena.tdb.base.block.BlockException: BlockAccessBase: Bounds > >> >exception: /public_trust/db/fusekidb/node2id.idn: (1025,1) > >> > at > >> > >>>com.hp.hpl.jena.tdb.base.file.BlockAccessBase.check(BlockAccessBase.java > >>>:1 > >> >18) > >> > at > >> > >>>com.hp.hpl.jena.tdb.base.file.BlockAccessMapped.read(BlockAccessMapped.j > >>>av > >> >a:93) > >> > at > >> > >>>com.hp.hpl.jena.tdb.base.block.BlockMgrFileAccess.getBlock(BlockMgrFileA > >>>cc > >> >ess.java:81) > >> > at > >> > >>>com.hp.hpl.jena.tdb.base.block.BlockMgrFileAccess.getRead(BlockMgrFileAc > >>>ce > >> >ss.java:70) > >> > at > >> > >>>com.hp.hpl.jena.tdb.base.block.BlockMgrWrapper.getRead(BlockMgrWrapper.j > >>>av > >> >a:52) > >> > at > >> > >>>com.hp.hpl.jena.tdb.base.page.PageBlockMgr.getRead(PageBlockMgr.java:68) > >> > at > >> > >>>com.hp.hpl.jena.tdb.index.bplustree.BPTreeNodeMgr.getRead(BPTreeNodeMgr. > >>>ja > >> >va:105) > >> > at > >> > >>>com.hp.hpl.jena.tdb.index.bplustree.BPTreeNode.getMgrRead(BPTreeNode.jav > >>>a: > >> >166) > >> > at > >> >com.hp.hpl.jena.tdb.index.bplustree.BPTreeNode.get(BPTreeNode.java:154) > >> > at > >> > >>>com.hp.hpl.jena.tdb.index.bplustree.BPTreeNode.findHere(BPTreeNode.java: > >>>42 > >> >2) > >> > at > >> > >>>com.hp.hpl.jena.tdb.index.bplustree.BPTreeNode.internalSearch(BPTreeNode > >>>.j > >> >ava:407) > >> > at > >> > >>>com.hp.hpl.jena.tdb.index.bplustree.BPTreeNode.search(BPTreeNode.java:18 > >>>7) > >> > at > >> >com.hp.hpl.jena.tdb.index.bplustree.BPlusTree.find(BPlusTree.java:282) > >> > at > >> > >>>com.hp.hpl.jena.tdb.nodetable.NodeTableNative.accessIndex(NodeTableNativ > >>>e. > >> >java:132) > >> > at > >> > >>>com.hp.hpl.jena.tdb.nodetable.NodeTableNative._idForNode(NodeTableNative > >>>.j > >> >ava:117) > >> > at > >> > >>>com.hp.hpl.jena.tdb.nodetable.NodeTableNative.getNodeIdForNode(NodeTable > >>>Na > >> >tive.java:79) > >> > at > >> > >>>com.hp.hpl.jena.tdb.nodetable.NodeTableCache._idForNode(NodeTableCache.j > >>>av > >> >a:125) > >> > at > >> > >>>com.hp.hpl.jena.tdb.nodetable.NodeTableCache.getNodeIdForNode(NodeTableC > >>>ac > >> >he.java:79) > >> > at > >> > >>>com.hp.hpl.jena.tdb.nodetable.NodeTableWrapper.getNodeIdForNode(NodeTabl > >>>eW > >> >rapper.java:49) > >> > at > >> > >>>com.hp.hpl.jena.tdb.nodetable.NodeTableInline.getNodeIdForNode(NodeTable > >>>In > >> >line.java:59) > >> > at > >> > >>>com.hp.hpl.jena.tdb.nodetable.NodeTableWrapper.getNodeIdForNode(NodeTabl > >>>eW > >> >rapper.java:49) > >> > at > >> > >>>com.hp.hpl.jena.tdb.nodetable.NodeTupleTableConcrete.idForNode(NodeTuple > >>>Ta > >> >bleConcrete.java:189) > >> > at > >> > >>>com.hp.hpl.jena.tdb.nodetable.NodeTupleTableConcrete.findAsNodeIds(NodeT > >>>up > >> >leTableConcrete.java:142) > >> > at > >>com.hp.hpl.jena.tdb.store.TripleTable.find(TripleTable.java:76) > >> > at > >> > >>>com.hp.hpl.jena.tdb.store.DatasetGraphTDB.findInDftGraph(DatasetGraphTDB > >>>.j > >> >ava:100) > >> > at > >> > >>>com.hp.hpl.jena.sparql.core.DatasetGraphBaseFind.find(DatasetGraphBaseFi > >>>nd > >> >.java:46) > >> > at > >> > >>>com.hp.hpl.jena.tdb.store.GraphTDBBase.graphBaseFindDft(GraphTDBBase.jav > >>>a: > >> >114) > >> > at > >> > >>>com.hp.hpl.jena.tdb.store.GraphTriplesTDB.graphBaseFind(GraphTriplesTDB. > >>>ja > >> >va:71) > >> > at > >>com.hp.hpl.jena.graph.impl.GraphBase.find(GraphBase.java:268) > >> > at > >> >com.hp.hpl.jena.graph.impl.GraphBase.graphBaseFind(GraphBase.java:290) > >> > at > >>com.hp.hpl.jena.graph.impl.GraphBase.find(GraphBase.java:287) > >> > at > >> > >>>com.hp.hpl.jena.rdf.model.impl.ModelCom.listStatements(ModelCom.java:458 > >>>) > >> > at > >> > >>>com.hp.hpl.jena.rdf.model.impl.ModelCom.listStatements(ModelCom.java:464 > >>>) > >> > at > >> > >>>com.hp.hpl.jena.rdf.model.impl.ResourceImpl.listProperties(ResourceImpl. > >>>ja > >> >va:182) > >> > at > >> >com.hp.hpl.jena.sparql.util.Closure.closureNoTest(Closure.java:194) > >> > at > >>com.hp.hpl.jena.sparql.util.Closure.closure(Closure.java:148) > >> > at > >>com.hp.hpl.jena.sparql.util.Closure.closure(Closure.java:127) > >> > at > >> > >>>com.hp.hpl.jena.sparql.core.describe.DescribeBNodeClosure.describe(Descr > >>>ib > >> >eBNodeClosure.java:54) > >> > at > >> > >>>com.hp.hpl.jena.sparql.engine.QueryExecutionBase.execDescribe(QueryExecu > >>>ti > >> >onBase.java:318) > >> > at > >> > >>>com.hp.hpl.jena.sparql.engine.QueryExecutionBase.execDescribe(QueryExecu > >>>ti > >> >onBase.java:257) > >> > at > >> > >>>org.apache.jena.fuseki.servlets.SPARQL_Query.executeQuery(SPARQL_Query.j > >>>av > >> >a:300) > >> > at > >> > >>>org.apache.jena.fuseki.servlets.SPARQL_Query.execute(SPARQL_Query.java:2 > >>>54 > >> >) > >> > at > >> > >>>org.apache.jena.fuseki.servlets.SPARQL_Query.executeWithParameter(SPARQL > >>>_Q > >> >uery.java:215) > >> > at > >> > >>>org.apache.jena.fuseki.servlets.SPARQL_Query.perform(SPARQL_Query.java:1 > >>>06 > >> >) > >> > at > >> > >>>org.apache.jena.fuseki.servlets.SPARQL_ServletBase.doCommonWorker(SPARQL > >>>_S > >> >ervletBase.java:117) > >> > at > >> > >>>org.apache.jena.fuseki.servlets.SPARQL_ServletBase.doCommon(SPARQL_Servl > >>>et > >> >Base.java:67) > >> > at > >> > >>>org.apache.jena.fuseki.servlets.SPARQL_Query.doGet(SPARQL_Query.java:86) > >> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:735) > >> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) > >> > at > >> >org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:669) > >> > at > >> > >>>org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHan > >>>dl > >> >er.java:1336) > >> > at > >> > >>>org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java > >>>:8 > >> >2) > >> > at > >> >org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:264) > >> > at > >> > >>>org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHan > >>>dl > >> >er.java:1307) > >> > at > >> > >>>org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:45 > >>>3) > >> > at > >> > >>>org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler. > >>>ja > >> >va:229) > >> > at > >> > >>>org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler. > >>>ja > >> >va:1072) > >> > at > >> > >>>org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382 > >>>) > >> > at > >> > >>>org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.j > >>>av > >> >a:193) > >> > at > >> > >>>org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.j > >>>av > >> >a:1006) > >> > at > >> > >>>org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java > >>>:1 > >> >35) > >> > at > >> > >>>org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.ja > >>>va > >> >:116) > >> > at org.eclipse.jetty.server.Server.handle(Server.java:365) > >> > at > >> > >>>org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHt > >>>tp > >> >Connection.java:485) > >> > at > >> > >>>org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHt > >>>tp > >> >Connection.java:53) > >> > at > >> > >>>org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractH > >>>tt > >> >pConnection.java:926) > >> > at > >> > >>>org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerCom > >>>pl > >> >ete(AbstractHttpConnection.java:988) > >> > at > >> >org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:635) > >> > at > >> >org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) > >> > at > >> > >>>org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConne > >>>ct > >> >ion.java:72) > >> > at > >> > >>>org.eclipse.jetty.server.nio.BlockingChannelConnector$BlockingChannelEnd > >>>Po > >> >int.run(BlockingChannelConnector.java:298) > >> > at > >> > >>>org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.j > >>>av > >> >a:608) > >> > at > >> > >>>org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.ja > >>>va > >> >:543) > >> > at java.lang.Thread.run(Unknown Source) > >> >13:58:20 INFO [4] 500 BlockAccessBase: Bounds exception: > >> >/public_trust/db/fusekidb/node2id.idn: (1025,1) > >> >13:58:28 Build SPO > >> >13:58:32 Index POS > >> >13:58:47 Build POS > >> >13:58:51 Index OSP > >> >13:59:01 Build OSP > >> >13:59:06 Index phase end > >> >13:59:06 -- TDB Bulk Loader Finish > >> > > >> > > >> >-- > >> > > >> > > >> >--- > >> >Marco Neumann > >> >KONA > >> > >> > > > > > >-- > > > > > >--- > >Marco Neumann > >KONA > > -- --- Marco Neumann KONA
