hmmm
GeometryColumn gc = dsm.getGeometryColumn(query.getDatasetName(),
query.getGeometryAttributeName());
if (gc.isIndexed()) {
gc is return as Null here. dunno why, but Nico should know :).. ede
On 19.02.2019 21:08, Rahkonen Jukka (MML) wrote:
> Hi,
>
> In r6130 the building of layer list from Geopackage datastore works (thanks
> Nicolas) and parsing fields with the date/datetime data is very fast (thanks
> Ede).
> There seems to be still something wrong with adding Geopackage tables into
> map through the layer list. Error gives a hint that building spatial index
> query fails but the same error happens also if I drop the spatial index from
> the geopackage db.
>
> java.lang.NullPointerException
> at
> com.vividsolutions.jump.datastore.spatialite.SpatialiteSQLBuilder.buildSpatialIndexFilter(SpatialiteSQLBuilder.java:157)
> at
> com.vividsolutions.jump.datastore.spatialite.SpatialiteSQLBuilder.buildBoxFilter(SpatialiteSQLBuilder.java:116)
> at
> com.vividsolutions.jump.datastore.spatialite.SpatialiteSQLBuilder.getSQL(SpatialiteSQLBuilder.java:39)
> at
> com.vividsolutions.jump.workbench.ui.plugin.datastore.DataStoreDataSource.createFeatureCollection(DataStoreDataSource.java:165)
> at
> com.vividsolutions.jump.workbench.ui.plugin.datastore.DataStoreDataSource$1.executeQuery(DataStoreDataSource.java:101)
> at
> com.vividsolutions.jump.workbench.ui.plugin.datastore.DataStoreDataSource$1.executeQuery(DataStoreDataSource.java:112)
> at
> org.openjump.core.ui.plugin.datastore.AddDataStoreLayerWizard.executeQuery(AddDataStoreLayerWizard.java:175)
> at
> org.openjump.core.ui.plugin.datastore.AddDataStoreLayerWizard.load(AddDataStoreLayerWizard.java:164)
> at
> org.openjump.core.ui.plugin.datastore.AddDataStoreLayerWizard.createLayer(AddDataStoreLayerWizard.java:138)
> at
> org.openjump.core.ui.plugin.datastore.AddDataStoreLayerWizard.createLayers(AddDataStoreLayerWizard.java:156)
> at
> org.openjump.core.ui.plugin.datastore.AddDataStoreLayerWizard.run(AddDataStoreLayerWizard.java:71)
> at
> org.openjump.core.ui.plugin.file.OpenWizardPlugIn.run(OpenWizardPlugIn.java:110)
> at
> com.vividsolutions.jump.workbench.ui.task.TaskMonitorManager$TaskWrapper.run(TaskMonitorManager.java:151)
>
> -Jukka-
>
> -----Alkuperäinen viesti-----
> Lähettäjä: edgar.sol...@web.de <edgar.sol...@web.de>
> Lähetetty: tiistai 19. helmikuuta 2019 17.27
> Vastaanottaja: Rahkonen Jukka (MML) <jukka.rahko...@maanmittauslaitos.fi>;
> jump devel <jump-pilot-devel@lists.sourceforge.net>; Nicolas Ribot
> <nicolas.ri...@gmail.com>
> Aihe: Re: VS: [JPP-Devel] Slow parsing of date field from Spatialite database
>
> Jukka,
>
> i locally reverted Nico's last change to have the datastore tables listed and
> work on the date/time slowness. OJ r6129 should fix the slow date issue with
> the datastore functionality in OJ CORE.
> when Nico fixes the table listing issue you should be able to double check it.
>
> DB Query extension is a somewhat harder nut to crack as i would have to setup
> the external extension sources to patch them. do you think it is worth the
> effort or urgently needed?
>
> ..ede
>
> On 19.02.2019 13:44, Rahkonen Jukka (MML) wrote:
>> Hi,
>>
>> Here you can get a gpkg that works with DB Query
>> http://latuviitta.org/downloads/stones.gpkg. As I told, DB Query can't read
>> random_points.gpkg but the standard Run datastore query tool has no problem
>> with that.
>> Advice for reading gpkg can be found from the attached document.
>>
>> OJ build 5966 can build the layer list for the gpkg datastore, but build
>> 5977 can't so something has happened in between.
>>
>>
>> -Jukka-
>>
>>
>> -----Alkuperäinen viesti-----
>> Lähettäjä: edgar.sol...@web.de <edgar.sol...@web.de>
>> Lähetetty: tiistai 19. helmikuuta 2019 13.54
>> Vastaanottaja: Rahkonen Jukka (MML)
>> <jukka.rahko...@maanmittauslaitos.fi>
>> Aihe: Re: [JPP-Devel] Slow parsing of date field from Spatialite
>> database
>>
>> hey Jukka,
>>
>> not familiar with the drivers. could you give a short step-by-step for both
>> (Run Datastore Query, DB Query) ?
>>
>> thanks.. ede
>>
>> On 17.02.2019 22:07, Rahkonen Jukka (MML) wrote:
>>> Hi,
>>>
>>> Test geopackage finally ready here
>>> http://latuviitta.org/downloads/random_points.gpkg. It contains
>>> random_points: 105000 points with a date column
>>> random_points_without_date : same points but date column dropped
>>>
>>> Data were created with the OpenJUMP Bean tools and GDAL. Observations:
>>> 1) GeoPackage does not work with OpenJDK 13. Connection to SQLite is OK but
>>> selecting spatial data fails. Use JRE 8 instead for these tests.
>>> 2) When I create a new spatialite connection into gpkg file OpenJUMP
>>> creates the connection but it does not find spatial tables and
>>> adding data to the map is not possible through the Add data... route
>>> 3) Run datastore query, however, does work. The test will be simply
>>> to run select * from random_points; select * from
>>> random_points_without_date;
>>>
>>> The first query creates a map in 30 seconds, the second one in one second.
>>> Tested with OJ Plus snapshot without Spatialite binaries.
>>>
>>> -Jukka-
>>>
>>>
>>>
>>> -----Alkuperäinen viesti-----
>>> Lähettäjä: Rahkonen Jukka (MML)
>>> Lähetetty: sunnuntai 17. helmikuuta 2019 14.26
>>> Vastaanottaja: 'Edgar Soldin' <ed...@soldin.de>
>>> Aihe: Re: [JPP-Devel] Slow parsing of date field from Spatialite
>>> database
>>>
>>> Hi Ede,
>>>
>>> Thanks for reminding, I will have a look at tis today.
>>>
>>> BTW I faced a total dead end today when trying to start OJ. It
>>> stopped on this line (here captured from a successful start) Loading
>>> Plugin
>>> org.openjump.core.ui.plugin.file.SaveLayersWithoutDataSourcePlugIn
>>> took 5.53s
>>>
>>> I could not even kill the JDK process from Windows 10 control panel. Same
>>> happened with OpenJDK 13 and Oracle JRE 1.8. After rebooting my computer
>>> this issue went away.
>>>
>>> -Jukka-
>>>
>>> -----Alkuperäinen viesti-----
>>> Lähettäjä: Edgar Soldin <ed...@soldin.de>
>>> Lähetetty: sunnuntai 17. helmikuuta 2019 14.08
>>> Vastaanottaja: Rahkonen Jukka (MML)
>>> <jukka.rahko...@maanmittauslaitos.fi>
>>> Aihe: Fwd: [JPP-Devel] Slow parsing of date field from Spatialite
>>> database
>>>
>>>
>>> see below.. ede
>>>
>>> -------- Forwarded Message --------
>>> Subject: Re: [JPP-Devel] Slow parsing of date field from Spatialite
>>> database
>>> Date: Tue, 22 Jan 2019 12:06:20 +0100
>>> From: edgar.sol...@web.de
>>> Reply-To: OpenJump develop and use
>>> <jump-pilot-devel@lists.sourceforge.net>
>>> To: OpenJump develop and use
>>> <jump-pilot-devel@lists.sourceforge.net>,
>>> Rahkonen Jukka (MML) <jukka.rahko...@maanmittauslaitos.fi>
>>>
>>> hey Jukka,
>>>
>>> just came across this mail. is this still an issue? can you provide me w/ a
>>> sample dataset?
>>>
>>> ..ede
>>>
>>> On 07.08.2017 09:46, edgar.sol...@web.de wrote:
>>>> probably exactly the same issue of realtime date parsing during loading
>>>> like w/ JML there. maybe i can speed up the parser, by meorizing the
>>>> successful pattern and trying that first on the next value. currently it
>>>> looks like it is bruteforcing the same pattern order over & over agn.
>>>>
>>>> ..ede
>>>>
>>>> On 8/6/2017 21:51, Rahkonen Jukka (MML) wrote:
>>>>> Hi,
>>>>>
>>>>> There seems to be some inefficiency in parsing date field from Spatialite
>>>>> database by using the Run database query tool.
>>>>> Reading 8 million points with one DATE field takes 15 minutes with my
>>>>> computer. If I do not select the DATE field it takes only 35 seconds to
>>>>> get all the data.
>>>>>
>>>>> DB Query plugin cannot parse DATE fields at all so I could not make a
>>>>> proper comparison. Query without DATE field took 3 times more time with
>>>>> DB Query.
>>>>>
>>>>> -Jukka Rahkonen-
>>>>> -------------------------------------------------------------------
>>>>> -
>>>>> -
>>>>> --------- Check out the vibrant tech community on one of the
>>>>> world's most engaging tech sites, Slashdot.org!
>>>>> http://sdm.link/slashdot
>>>>> _______________________________________________
>>>>> Jump-pilot-devel mailing list
>>>>> Jump-pilot-devel@lists.sourceforge.net
>>>>> https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
>>>>>
>>>>
>>>>
>>>> --------------------------------------------------------------------
>>>> -
>>>> -
>>>> -------- Check out the vibrant tech community on one of the world's
>>>> most engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>>>> _______________________________________________
>>>> Jump-pilot-devel mailing list
>>>> Jump-pilot-devel@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
>>>>
>>>
>>
>
>
> _______________________________________________
> Jump-pilot-devel mailing list
> Jump-pilot-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
>
_______________________________________________
Jump-pilot-devel mailing list
Jump-pilot-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
