Re: [Dhis2-users] Exporting data through SQL View

2016-04-14 Thread Raminosoa Rabemanantsoa, Tantely
Hi Jason, The DHIS2 2.19 is installed on a Linux OS running inside an Amazon web services. The server has in total 30GB RAM. The amount of memory allocated to JVM is now 2GB. The query I am trying to execute is a simple SQL select which intend to pull out the data values for a specified period of

Re: [Dhis2-users] Exporting data through SQL View

2016-04-04 Thread Jason Pickering
Could you provide more information about your setup? How much RAM does your server or servers have? What is the query you are attempting to execute? Where is the timeout occurring (through the Web or from the database itself)? What does your "About DHIS2" say? Have you performed and of the s

Re: [Dhis2-users] Exporting data through SQL View

2016-04-04 Thread Raminosoa Rabemanantsoa, Tantely
Hi Jason, Thnak you for you message. The data value table has about 1,100,000 records. In addition to checking the postgreSQL configuration file, this time-out might also be related to the server configuration. Could you please provide a link for the JVM/Tomcat performance tuning according to the

Re: [Dhis2-users] Exporting data through SQL View

2016-04-04 Thread Jason Pickering
Hi there. In general, if the query is taking such a long time that it times out, then there may be something wrong with the query or the level of performance of your server. Disabling that time query time out, could result in queries which take an extremely long time to complete, leading to the se

Re: [Dhis2-users] Exporting data through SQL View

2016-04-04 Thread Raminosoa Rabemanantsoa, Tantely
Thank you Randy. I am going to check this postgresql.conf file to troubleshoot this issue. Best Regards. On Mon, Apr 4, 2016 at 4:42 PM, Wilson, Randy wrote: > I think the settings are in postgresql.conf. > > You could check the following: > statement_timeout - set it to 0 to disable it. > > I

Re: [Dhis2-users] Exporting data through SQL View

2016-04-04 Thread Wilson, Randy
I think the settings are in postgresql.conf. You could check the following: statement_timeout - set it to 0 to disable it. I can't seem to find the command limited the number of records a query can return. I suppose it varies with the size of the record. Randy On Mon, Apr 4, 2016 at 3:10 PM,

Re: [Dhis2-users] Exporting data through SQL View

2016-04-04 Thread Raminosoa Rabemanantsoa, Tantely
Hi Randy, The SQL script is running fine after putting "limit 100" at the end of the query. Thanks! This script is answering to my question and I would like to customize it further. I am using SSH to connect to the remote server and would like to ask you where should be located the postgres config

Re: [Dhis2-users] Exporting data through SQL View

2016-04-04 Thread Wilson, Randy
Hi Tantely, Are you limiting the data to a single data set at a time? You might try to limit the result set by putting "limit 100" at the end of the query. That way you can at least see if the query is working. There are often limits set on the postgres server for the number of records that can

Re: [Dhis2-users] Exporting data through SQL View

2016-04-03 Thread Raminosoa Rabemanantsoa, Tantely
Thank you Randy and Knut for the scripts. While I am running the sample script and customizing with the dataset name, I am facing another issue with a timed out connection due to a busy server. I cannot output any result yet. Do you know if it is a server memory issue? Best Regards. Tantely. On

Re: [Dhis2-users] Exporting data through SQL View

2016-04-01 Thread Wilson, Randy
Hi Tantely, Here is a sample query that will give you what I think you want: select dv.sourceid as organisationunitid, ou.name, ou.code as facilitycode, de.name, 'Vaccination' as datasetname, pe.startdate, pe.enddate, coc.categoryoptioncomboname, dv.value from datavalue dv inner join org

Re: [Dhis2-users] Exporting data through SQL View

2016-04-01 Thread Knut Staring
Hi Tantely, You are probably looking for the datasetmembers table and the datasetsource table (confusingly and historically, orgunits used to be referred to as sources, and this is still reflected in a few places). When you say data elements, I assume you mean data values? If so, then something a