Did some further investigation on a local system with these results. Union query: 870 Mb in 3:09 First part: 870 Mb in 3:20 Second part: 0 Mb in 26 seconds.
Will repeat when I’m back at the client. Paul On 20 April 2018 at 15:52:18, Rob Vesse ([email protected]<mailto:[email protected]>) wrote: Ah ok The comment about the UNION is interesting. Remember that Jena lazily evaluates and streams query results, therefore it is possible that once it exhausts one side of the union it has to do quite a lot of work before it starts finding results on the other side of the union. One way to debug would be to run the two sides of the union as separate independent queries and observe how long to start receiving results for each query. If the latter side has a significant delay in returning the first result it would tend to imply that the hypothesis above is correct. Rob On 20/04/2018, 14:37, "Paul Hermans" <[email protected]> wrote: Hi, Some more investigation done. The good news is that we get to the end. Although one needs to be patient. There is a substantial pause at 160Mb. But after some time the process resumes. We do not see something special in the logs. The query itself is using a union. We will try to find out if this is influential. Paul Kind Regards, Paul Hermans ------------------------- ProXML bvba Linked Data services KBO: http://data.kbodata.be/organisation/0476_068_080#id (w) www.proxml.be<http://www.proxml.be/> (e) [email protected]<mailto:[email protected]> (tw) @PaulZH (t) +32 15 23 00 76<tel://+32%2015%2023%2000%2076> (m) +32 473 66 03 20<tel://+32%20473%2066%2003%2020> Narcisweg 17 3140 Keerbergen Belgium On Friday, Apr 20, 2018 at 1:20 PM, Andy Seaborne <[email protected]<mailto:[email protected]>> wrote: There is no specific limitation in the Fseki code but every intermediate proxy can truncate output. Is there anything in the Fuseki log file? Is Fuseki running as a WAR file or standalone server? Andy On 20/04/18 11:49, Rob Vesse wrote: > Paul > > Can you get a Java thread dump for the Fuseki process to see what it is doing when it is hung? > > Rob > > On 20/04/2018, 11:42, "Paul Hermans" wrote: > > It is 160MB downloaded CSV. > > Paul > > On 20 Apr 2018, at 11:31, Laura Morales > wrote: > > Is that 160MB of downloaded CSV file, or 160 Million triples? > > > > > Sent: Friday, April 20, 2018 at 11:25 AM > From: "Paul Hermans" > > To: "Jena Users" > > Subject: limit on resultset from a select query? > Dear, > > > Fuseki version: 3.4.0. > > Context: Doing a select query to generate a tidy csv file for each class in a database. > > The return always seems to stop/hang at 160M. > > > > % Total % Received % Xferd Average Speed Time Time Time Current > > Dload Upload Total Spent Left Speed > > 100 160M 0 160M 0 0 424k 0 --:--:-- 0:06:26 --:--:-- 0 > > > Looking at the output the ending line is 995825 which is truncated > 995824 https://xxxx/2007_00422997000115/aangifte/identificatie#id,http://purl.org/dc/terms/modified,2017-08-12T20:54:49.344 > 995825 https:/xxxx//2007_00422997000115/aangifte/ > > I looked through the documentation for a configuration setting that could be related to this with no success. > > > > > Kind Regards, > Paul > > Kind Regards, > > Paul Hermans > > ------------------------- > > ProXML bvba > > Linked Data services > > KBO: http://data.kbodata.be/organisation/0476_068_080#id > > (w) www.proxml.be > (e) [email protected] > (tw) @PaulZH > (t) +32 15 23 00 76 > (m) +32 473 66 03 20 > Narcisweg 17 > 3140 Keerbergen > Belgium > > > > > > > > > Kind Regards, Paul Hermans ------------------------- ProXML bvba Linked Data services KBO: http://data.kbodata.be/organisation/0476_068_080#id (w) www.proxml.be<http://www.proxml.be/> (e) [email protected]<mailto:[email protected]> (tw) @PaulZH (t) +32 15 23 00 76<tel://+32%2015%2023%2000%2076> (m) +32 473 66 03 20<tel://+32%20473%2066%2003%2020> Narcisweg 17 3140 Keerbergen Belgium ODEdu – Innovative Open Data Education and Training based on PBL and Learning Analytics - http://odedu-project.eu/ OpenGovIntelligence – Public Administration Modernization by exploiting Linked Open Statistical Data - http://www.opengovintelligence.eu<http://www.opengovintelligence.eu/> OpenCube – Linked Open Statistical Data - http://opencube-project.eu/
