Hi,
I have huge XML document containing around 70000000 child nodes. I want to
implement paging on this, so that I can fetch a chunk of nodes at time, but
as the start position value increases from 10000000 the execution time
takes more than a second to execute, is there a any optimized way I can
follow.
I have written following code:
public class XQJ
{
public static void main(String[] args) throws XQException
{
XQDataSource xqs = new BaseXXQDataSource();
xqs.setProperty("serverName", "localhost");
xqs.setProperty("port", "1984");
// Change USERNAME and PASSWORD values
XQConnection conn = xqs.getConnection("admin", "admin");
XQPreparedExpression xqpe =
conn.prepareExpression("declare namespace xbrli='
http://www.xbrl.org/2003/instance';" +
" declare variable $doc as xs:string external;" +
" declare variable $start as xs:integer external;" +
" declare variable $pageSize as xs:integer external;" +
" let $allMatches := doc($doc)/xbrli:xbrl/*" +
" return subsequence($allMatches,$start,$pageSize)");
// " return $matches");
xqpe.bindString(new QName("doc"),
"1389962424906/1389962424906/facts.xml", null);
int totalRecords = 70000000;
int pageSize = 10000;
int noOfPages = totalRecords/pageSize;
long startTime = 0;
int start = 0;
for(int i=0; i<noOfPages; i++){
startTime = System.currentTimeMillis();
start = i*pageSize;
xqpe.bindInt(new QName("start"), start, null);
xqpe.bindInt(new QName("pageSize"), pageSize, null);
XQResultSequence rs = xqpe.executeQuery();
// while(rs.next()){}
// System.out.println(rs.getItemAsString(null));
// System.out.println(start + " : " +
(System.currentTimeMillis()-startTime));
}
System.out.println(start + " : " +
(System.currentTimeMillis()-startTime));
conn.close();
}
_______________________________________________
BaseX-Talk mailing list
[email protected]
https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
