Re: [postgis-users] Geocoding cross streets?

[Aren Cambre]

Based on the conversation below, it appears there is already a solution,
and people well-versed with PostGIS may be helping with this already. Given
that, are my n00b skillz of much use?

Second question--when might this cross street feature be available? I am
asking for selfish reasons--I am working on a praxis and have thousands of
cross streets I need to geocode.

Aren

On Tue, Nov 29, 2011 at 12:03 PM, Stephen Woodbridge <
wood...@swoodbridge.com> wrote:

> On 11/29/2011 12:42 PM, Stephen Frost wrote:
>
>> * Stephen Woodbridge (wood...@swoodbridge.com) wrote:
>>
>>> I currently have some lists of names that are converted to optimized
>>> pcre regular expressions. I uses these to help separate the street
>>> from the city name. The lists are only used to create header files
>>> that contain the regular expressions that get compiled into the
>>> code. The idea being that these names are reasonably static for a
>>> given data set.
>>>
>>
>> Ah, ok, I see.  When converting this to a PG function, I'd probably want
>> to go ahead and pull those lists from the TIGER data set and compile the
>> regexps on PG backend startup instead.  Does it handle misspelled names
>> or do any kind of "sounds like" searching on the city names?  I'm
>> guessing 'no', but figured I'd ask anyway..
>>
>
> The lists that I have generated are pulled from a number of sources, like
> the actual tiger data, the fips 4-2 placenames, I also have some common
> abbreviations, and misspellings, but it is not doing any sounds like
> searching. I think that I broke the regular expressions into separate state
> specific regular expressions because putting them all into a sine
> expression exceeded some limit in pcre.
>
> The regex expressions are created in perl and are highly optimized. You
> probably can not read the regex's and make much sense out of them, but they
> are extremely efficient to evaluate.
>
> Also you can take just that directory from PAGC and build it and it should
> create a command line executable that you can test with and run it in the
> debugger and valgrind, etc. Something like:
>
> cd parseaddress
> ./configure
> make
> ./parseaddress 101 W MLK AVE NORTH CHELMSFORD MA 01863
>
>
> -Steve
> __**_
> postgis-users mailing list
> postgis-users@postgis.**refractions.net
> http://postgis.refractions.**net/mailman/listinfo/postgis-**users
>
___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

[postgis-users] Postgis 2.0

[Bob Pawley]

Hi

Do you yet have a timeline for the Postgis 2.0 release??

Bob___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

Re: [postgis-users] Raster pixel value

[Pierre Racine]

Andreas, Tom,

I have put two new functions you might be interested by in

http://trac.osgeo.org/postgis/browser/trunk/raster/scripts/plpgsql

The first one, st_areaweightedsummarystats.sql, is usefull when you want to 
compute summary stats (like the weighted mean) of values coming from a raster 
table for a series of polygons and that you use ST_Intersection(raster, 
geometry) to compute the intersection. You normally use it this way:

SELECT gt.id,
   (aws).count, 
   (aws).distinctcount,
   (aws).geom, 
   (aws).totalarea, 
   (aws).meanarea, 
   (aws).totalperimeter, 
   (aws).meanperimeter, 
   (aws).weightedsum, 
   (aws).weightedmean, 
   (aws).maxareavalue, 
   (aws).minareavalue, 
   (aws).maxcombinedareavalue, 
   (aws).mincombinedareavalue, 
   (aws).sum, 
   (aws).mean, 
   (aws).max, 
   (aws).min
FROM (SELECT ST_AreaWeightedSummaryStats(gv) aws
  FROM (SELECT ST_Intersection(rt.rast, gt.geom) gv
FROM rasttable rt, geomtable gt
WHERE ST_Intersects(rt.rast, gt.geom)
   ) foo
  GROUP BY gt.id
 ) foo2

The second one, st_summarystatsagg.sql, serve the same purpose but when you are 
using ST_MapAlgebra() (soon ST_Clip()) to compute the intersection. you 
normally use it like this:

SELECT (ss).count, 
   (ss).sum, 
   (ss).mean, 
   (ss).min, 
   (ss).max
FROM (SELECT ST_SummaryStatsAgg(gv) ss
  FROM (SELECT ST_Clip(rt.rast, gt.geom) gv
FROM rasttable rt, geomtable gt
WHERE ST_Intersects(rt.rast, gt.geom)
   ) foo
  GROUP BY gt.id
 ) foo2

This is very equivalent to what you were doing. The ST_Clip() replace the 
ST_MapAlgebra() part and the ST_SummaryStatsAgg() replace the 
ST_SummaryStats(ST_Union())  part. This should be faster since it does a 
ST_Union() less.

I'm working on a plpgsql version of ST_Clip(). I will post it very soon.

Pierre

___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

Re: [postgis-users] bmd.hasnodata does not exist

[Bborie Park]

Andreas,

You'll probably want to run rtpostgis_upgrade_20_minor.sql every time
you sync up your copy of postgis-trunk.

-bborie

On Wed, Nov 30, 2011 at 9:29 AM, Andreas Forø Tollefsen
 wrote:
> Thanks!
> After updating to latest revision i only ran:
> psql -d database -f postgis.sql
> psql -d database -f rtpostgis.sql
> I was not aware that i had to do the _upgrade_20_minor.sql as well.
> Now it works.
> Andreas
>
> 2011/11/30 Bborie Park 
>>
>> Andreas,
>>
>> Though you upgraded the underlying library, did you run
>> rtpostgis_upgrade_20_minor.sql?  Something is definitely out of sync.
>>
>> -bborie
>>
>> On Tue, Nov 29, 2011 at 12:58 AM, Andreas Forø Tollefsen
>>  wrote:
>> > No one else had the same issue with 8242? This is exactly the same query
>> > as
>> > i ran in r.8001, but now it give me the error below in return.
>> > Any suggestions?
>> > Best,
>> > Andreas
>> >
>> > 2011/11/25 Andreas Forø Tollefsen 
>> >>
>> >> Hi,
>> >> Sorry for posting a lot these days but I am very busy finalizing a
>> >> project.
>> >> Previously, I have been running the following query without problems
>> >> (in
>> >> rev.8001). After updating to rev.8242 i am getting a strange error.
>> >> Could someone please see what is wrong? Is it one of the functions that
>> >> has changed?
>> >> Query:
>> >> SELECT gid, AVG(((foo.geomval).val)) FROM (SELECT p.gid,
>> >> ST_Intersection(p.cell, r.rast) AS geomval FROM mountain r,
>> >> priogrid_land p
>> >> WHERE ST_Intersects(p.cell, r.rast) AND p.gid =219260) AS foo
>> >> GROUP BY gid ORDER BY gid;
>> >> Error:
>> >> ERROR:  column bmd.hasnodata does not exist
>> >> LINE 1: SELECT bmd.hasnodata                FROM ST_BandMetaData(ras...
>> >>                ^
>> >> QUERY:  SELECT bmd.hasnodata                FROM ST_BandMetaData(rast,
>> >> nband) AS bmd
>> >> CONTEXT:  PL/pgSQL function "_st_intersects" line 32 at SQL statement
>> >> PL/pgSQL function "st_intersection" line 5 at assignment
>> >> ** Error **
>> >> ERROR: column bmd.hasnodata does not exist
>> >> SQL state: 42703
>> >> Context: PL/pgSQL function "_st_intersects" line 32 at SQL statement
>> >> PL/pgSQL function "st_intersection" line 5 at assignment
>> >>
>> >> Thanks for any help.
>> >> Best regards,
>> >> Andreas
>> >
>> > ___
>> > postgis-users mailing list
>> > postgis-users@postgis.refractions.net
>> > http://postgis.refractions.net/mailman/listinfo/postgis-users
>> >
>> >
>>
>>
>>
>> --
>> Bborie Park
>> Programmer
>> Center for Vectorborne Diseases
>> UC Davis
>> 530-752-8380
>> bkp...@ucdavis.edu
>> ___
>> postgis-users mailing list
>> postgis-users@postgis.refractions.net
>> http://postgis.refractions.net/mailman/listinfo/postgis-users
>
>
> ___
> postgis-users mailing list
> postgis-users@postgis.refractions.net
> http://postgis.refractions.net/mailman/listinfo/postgis-users
>
>



-- 
Bborie Park
Programmer
Center for Vectorborne Diseases
UC Davis
530-752-8380
bkp...@ucdavis.edu
___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

Re: [postgis-users] bmd.hasnodata does not exist

[Andreas Forø Tollefsen]

Thanks!

After updating to latest revision i only ran:
psql -d database -f postgis.sql
psql -d database -f rtpostgis.sql

I was not aware that i had to do the _upgrade_20_minor.sql as well.

Now it works.

Andreas

2011/11/30 Bborie Park 

> Andreas,
>
> Though you upgraded the underlying library, did you run
> rtpostgis_upgrade_20_minor.sql?  Something is definitely out of sync.
>
> -bborie
>
> On Tue, Nov 29, 2011 at 12:58 AM, Andreas Forø Tollefsen
>  wrote:
> > No one else had the same issue with 8242? This is exactly the same query
> as
> > i ran in r.8001, but now it give me the error below in return.
> > Any suggestions?
> > Best,
> > Andreas
> >
> > 2011/11/25 Andreas Forø Tollefsen 
> >>
> >> Hi,
> >> Sorry for posting a lot these days but I am very busy finalizing a
> >> project.
> >> Previously, I have been running the following query without problems (in
> >> rev.8001). After updating to rev.8242 i am getting a strange error.
> >> Could someone please see what is wrong? Is it one of the functions that
> >> has changed?
> >> Query:
> >> SELECT gid, AVG(((foo.geomval).val)) FROM (SELECT p.gid,
> >> ST_Intersection(p.cell, r.rast) AS geomval FROM mountain r,
> priogrid_land p
> >> WHERE ST_Intersects(p.cell, r.rast) AND p.gid =219260) AS foo
> >> GROUP BY gid ORDER BY gid;
> >> Error:
> >> ERROR:  column bmd.hasnodata does not exist
> >> LINE 1: SELECT bmd.hasnodataFROM ST_BandMetaData(ras...
> >>^
> >> QUERY:  SELECT bmd.hasnodataFROM ST_BandMetaData(rast,
> >> nband) AS bmd
> >> CONTEXT:  PL/pgSQL function "_st_intersects" line 32 at SQL statement
> >> PL/pgSQL function "st_intersection" line 5 at assignment
> >> ** Error **
> >> ERROR: column bmd.hasnodata does not exist
> >> SQL state: 42703
> >> Context: PL/pgSQL function "_st_intersects" line 32 at SQL statement
> >> PL/pgSQL function "st_intersection" line 5 at assignment
> >>
> >> Thanks for any help.
> >> Best regards,
> >> Andreas
> >
> > ___
> > postgis-users mailing list
> > postgis-users@postgis.refractions.net
> > http://postgis.refractions.net/mailman/listinfo/postgis-users
> >
> >
>
>
>
> --
> Bborie Park
> Programmer
> Center for Vectorborne Diseases
> UC Davis
> 530-752-8380
> bkp...@ucdavis.edu
> ___
> postgis-users mailing list
> postgis-users@postgis.refractions.net
> http://postgis.refractions.net/mailman/listinfo/postgis-users
>
___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

Re: [postgis-users] bmd.hasnodata does not exist

[Bborie Park]

Andreas,

Though you upgraded the underlying library, did you run
rtpostgis_upgrade_20_minor.sql?  Something is definitely out of sync.

-bborie

On Tue, Nov 29, 2011 at 12:58 AM, Andreas Forø Tollefsen
 wrote:
> No one else had the same issue with 8242? This is exactly the same query as
> i ran in r.8001, but now it give me the error below in return.
> Any suggestions?
> Best,
> Andreas
>
> 2011/11/25 Andreas Forø Tollefsen 
>>
>> Hi,
>> Sorry for posting a lot these days but I am very busy finalizing a
>> project.
>> Previously, I have been running the following query without problems (in
>> rev.8001). After updating to rev.8242 i am getting a strange error.
>> Could someone please see what is wrong? Is it one of the functions that
>> has changed?
>> Query:
>> SELECT gid, AVG(((foo.geomval).val)) FROM (SELECT p.gid,
>> ST_Intersection(p.cell, r.rast) AS geomval FROM mountain r, priogrid_land p
>> WHERE ST_Intersects(p.cell, r.rast) AND p.gid =219260) AS foo
>> GROUP BY gid ORDER BY gid;
>> Error:
>> ERROR:  column bmd.hasnodata does not exist
>> LINE 1: SELECT bmd.hasnodata                FROM ST_BandMetaData(ras...
>>                ^
>> QUERY:  SELECT bmd.hasnodata                FROM ST_BandMetaData(rast,
>> nband) AS bmd
>> CONTEXT:  PL/pgSQL function "_st_intersects" line 32 at SQL statement
>> PL/pgSQL function "st_intersection" line 5 at assignment
>> ** Error **
>> ERROR: column bmd.hasnodata does not exist
>> SQL state: 42703
>> Context: PL/pgSQL function "_st_intersects" line 32 at SQL statement
>> PL/pgSQL function "st_intersection" line 5 at assignment
>>
>> Thanks for any help.
>> Best regards,
>> Andreas
>
> ___
> postgis-users mailing list
> postgis-users@postgis.refractions.net
> http://postgis.refractions.net/mailman/listinfo/postgis-users
>
>



-- 
Bborie Park
Programmer
Center for Vectorborne Diseases
UC Davis
530-752-8380
bkp...@ucdavis.edu
___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

Re: [postgis-users] bmd.hasnodata does not exist

[Pierre Racine]

One guess:

You have a old version of ST_Intersects()...

Drop all the variant and redefine them with the ones in rtpostgis.sql...

Pierre

> -Original Message-
> From: postgis-users-boun...@postgis.refractions.net [mailto:postgis-users-
> boun...@postgis.refractions.net] On Behalf Of Andreas Forø Tollefsen
> Sent: Tuesday, November 29, 2011 3:58 AM
> To: PostGIS Users Discussion
> Subject: Re: [postgis-users] bmd.hasnodata does not exist
> 
> No one else had the same issue with 8242? This is exactly the same query
> as i ran in r.8001, but now it give me the error below in return.
> Any suggestions?
> 
> Best,
> Andreas
> 
> 
> 2011/11/25 Andreas Forø Tollefsen 
> 
> 
>   Hi,
> 
>   Sorry for posting a lot these days but I am very busy finalizing a
> project.
> 
>   Previously, I have been running the following query without
> problems (in rev.8001). After updating to rev.8242 i am getting a strange
> error.
>   Could someone please see what is wrong? Is it one of the functions
> that has changed?
> 
>   Query:
>   SELECT gid, AVG(((foo.geomval).val)) FROM (SELECT p.gid,
> ST_Intersection(p.cell, r.rast) AS geomval FROM mountain r, priogrid_land p
> WHERE ST_Intersects(p.cell, r.rast) AND p.gid =219260) AS foo
>   GROUP BY gid ORDER BY gid;
> 
>   Error:
>   ERROR:  column bmd.hasnodata does not exist
>   LINE 1: SELECT bmd.hasnodataFROM
> ST_BandMetaData(ras...
>  ^
>   QUERY:  SELECT bmd.hasnodataFROM
> ST_BandMetaData(rast, nband) AS bmd
>   CONTEXT:  PL/pgSQL function "_st_intersects" line 32 at SQL
> statement
>   PL/pgSQL function "st_intersection" line 5 at assignment
> 
>   ** Error **
> 
>   ERROR: column bmd.hasnodata does not exist
>   SQL state: 42703
>   Context: PL/pgSQL function "_st_intersects" line 32 at SQL
> statement
>   PL/pgSQL function "st_intersection" line 5 at assignment
> 
> 
>   Thanks for any help.
> 
>   Best regards,
>   Andreas
> 

___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

Re: [postgis-users] Batch geocoding (~2 mil addresses)

[Andy Colson]

On 11/29/2011 11:18 PM, Ravi ada wrote:

Hello All,

I have been fighting with PostGIS for the last week or two to geocode
about 2 million addresses. Here are the challenges that I am facing.

1)I sorted the addresses by zip, address, city to group the similar
addresses together.

2)So far I have seen only 50% of rating zero, that means perfect match.

3)Some addresses have Suite# or Apt# in address line 1. Geocode function
takes longer time for such addresses

4)Addresses that are on the interstate, may be on the service road.
These are taking longer to code.


How about posting an "EXPLAIN ANALYZE" to http://explain.depesz.com/. 
Maybe we can speed it up.


-Andy
___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

Re: [postgis-users] Batch geocoding (~2 mil addresses)

[Paragon Corporation]

Ravi,
 
If you have pgAdmin, you might want to try something like pgScript.  Unlike
plpgsql it commits on each update so doesn't suffer from the same issue as a
stored proc.
 
http://www.postgresonline.com/journal/archives/181-pgscript_intro.html
 
Hope that helps,
Regina
http://www.postgis.us
 


  _  

From: postgis-users-boun...@postgis.refractions.net
[mailto:postgis-users-boun...@postgis.refractions.net] On Behalf Of Ravi ada
Sent: Wednesday, November 30, 2011 7:06 AM
To: 'PostGIS Users Discussion'
Subject: Re: [postgis-users] Batch geocoding (~2 mil addresses)



Thanks Jonathan for the quick reply.

 

I am doing the similar thing as you did except doing it locally. I got the
address divided into 4 columns, address, city, state and zip. I was able to
query for each state and run the geocode. I was never successful running the
complete state. The query takes forever to finish even though the query plan
shows it is using index scan etc.  I even wrote a psql function to pass one
address at a time to get the geocode, this one also could not complete
because I could not commit each address as I get the gecode and ended up
running out of resources.

How you were able to geocode by state, did you write any scripts or psql
functions? If yes, do you mind sharing? I am having hard time geocoding
these addresses.

Appreciate any help is extended.

 

Thanks,

Ravi Ada

 

From: postgis-users-boun...@postgis.refractions.net
[mailto:postgis-users-boun...@postgis.refractions.net] On Behalf Of
Johnathan Leppert
Sent: Tuesday, November 29, 2011 11:38 PM
To: PostGIS Users Discussion
Subject: Re: [postgis-users] Batch geocoding (~2 mil addresses)

 

Hi Ravi,

 

There is a thread about the tiger geocoder performance from awhile back you
might want to look into. I had to do this before with about 1M addresses and
ended up creating an ec2 instance for each state and sending addresses with
that state to that specific host (using a simple regex to match state in an
address line). Somewhat expensive, but got the job done quickly.

 

Johnathan

 

On Tue, Nov 29, 2011 at 9:18 PM, Ravi ada  wrote:

Hello All,

 

I have been fighting with PostGIS for the last week or two to geocode about
2 million addresses. Here are the challenges that I am facing.

1)  I sorted the addresses by zip, address, city to group the similar
addresses together.

2)  So far I have seen only 50% of rating zero, that means perfect
match.

3)  Some addresses have Suite# or Apt# in address line 1. Geocode
function takes longer time for such addresses

4)  Addresses that are on the interstate, may be on the service road.
These are taking longer to code.

5)  Getting syntax errors on line_segment function when processing some
addresses that have additional data in parenthesis and a period. For example
"5727 FM 3097(HORIZON RD.),ROCKWALL,TX,750327786" 

6)  I am using batch updates selecting the addresses per state to reduce
the size of the batch. I used straight SQL update as mentioned in the
documentation, and wrote a function to call geo code for each address. In
both cases the query ran for more than 6 hours and never been able finish
successfully. If I kill the query, nothing gets updated to the address table
because the whole transaction is killed and not committed.

7)  I am running this on Ubuntu 11.10 and postgresql 9.1 on a virtual
machine on 8GB i5 machine. I know the resources are very less for such a
task.

 

My questions are

1)  How other people are geocoding so many addresses, what is the best
way to do it, knowing that we may not have fully normalized addresses.

2)  How long it should take to geocode about 2mil addresses.

3)  What does it mean if the rating is non-zero, and more than 50. Do we
get the distance wring for such addresses?

4)  What is the recommended hardware configuration? We need to geocode
these addresses only once, and periodically to the delta that we get every
month. 

 

Thank you so much for all the efforts that you guys are contributing to the
project. Any help with my questions would greatly be appreciated.

 

Thanks

Ravi Ada

 

 


___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users





 

-- 
Johnathan

Software Engineer

San Francisco, California

Follow me on Twitter:   @iamleppert

 

___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

Re: [postgis-users] Batch geocoding (~2 mil addresses)

[Ravi ada]

Thanks Jonathan for the quick reply.

 

I am doing the similar thing as you did except doing it locally. I got the
address divided into 4 columns, address, city, state and zip. I was able to
query for each state and run the geocode. I was never successful running the
complete state. The query takes forever to finish even though the query plan
shows it is using index scan etc.  I even wrote a psql function to pass one
address at a time to get the geocode, this one also could not complete
because I could not commit each address as I get the gecode and ended up
running out of resources.

How you were able to geocode by state, did you write any scripts or psql
functions? If yes, do you mind sharing? I am having hard time geocoding
these addresses.

Appreciate any help is extended.

 

Thanks,

Ravi Ada

 

From: postgis-users-boun...@postgis.refractions.net
[mailto:postgis-users-boun...@postgis.refractions.net] On Behalf Of
Johnathan Leppert
Sent: Tuesday, November 29, 2011 11:38 PM
To: PostGIS Users Discussion
Subject: Re: [postgis-users] Batch geocoding (~2 mil addresses)

 

Hi Ravi,

 

There is a thread about the tiger geocoder performance from awhile back you
might want to look into. I had to do this before with about 1M addresses and
ended up creating an ec2 instance for each state and sending addresses with
that state to that specific host (using a simple regex to match state in an
address line). Somewhat expensive, but got the job done quickly.

 

Johnathan

 

On Tue, Nov 29, 2011 at 9:18 PM, Ravi ada  wrote:

Hello All,

 

I have been fighting with PostGIS for the last week or two to geocode about
2 million addresses. Here are the challenges that I am facing.

1)  I sorted the addresses by zip, address, city to group the similar
addresses together.

2)  So far I have seen only 50% of rating zero, that means perfect
match.

3)  Some addresses have Suite# or Apt# in address line 1. Geocode
function takes longer time for such addresses

4)  Addresses that are on the interstate, may be on the service road.
These are taking longer to code.

5)  Getting syntax errors on line_segment function when processing some
addresses that have additional data in parenthesis and a period. For example
"5727 FM 3097(HORIZON RD.),ROCKWALL,TX,750327786" 

6)  I am using batch updates selecting the addresses per state to reduce
the size of the batch. I used straight SQL update as mentioned in the
documentation, and wrote a function to call geo code for each address. In
both cases the query ran for more than 6 hours and never been able finish
successfully. If I kill the query, nothing gets updated to the address table
because the whole transaction is killed and not committed.

7)  I am running this on Ubuntu 11.10 and postgresql 9.1 on a virtual
machine on 8GB i5 machine. I know the resources are very less for such a
task.

 

My questions are

1)  How other people are geocoding so many addresses, what is the best
way to do it, knowing that we may not have fully normalized addresses.

2)  How long it should take to geocode about 2mil addresses.

3)  What does it mean if the rating is non-zero, and more than 50. Do we
get the distance wring for such addresses?

4)  What is the recommended hardware configuration? We need to geocode
these addresses only once, and periodically to the delta that we get every
month. 

 

Thank you so much for all the efforts that you guys are contributing to the
project. Any help with my questions would greatly be appreciated.

 

Thanks

Ravi Ada

 

 


___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users





 

-- 
Johnathan

Software Engineer

San Francisco, California

Follow me on Twitter: @iamleppert  

 

___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

Re: [postgis-users] character encoding problems

[Mark Cave-Ayland]

On 30/11/11 02:24, Clay, Bruce wrote:


I trying to learn more about natural language processing and language
translation
I have installed the English version of WordNet in Postgres without any
problems. I downloaded dictionaries from a varity of site such as are
used in OpenOffice / WinEdt.
When I try to build a table from several of the different languages I
get the following error
ERROR: invalid byte sequence for encoding "UTF8": 0x82
I checked the encoding and it is indeed set up for Unicode-8. I tried to
create databases using a variety of other encoding types such as WIN1252
and others and I got the same error message from all of them except
SQL_ASCII.
When I created the database using SQL_ASCII I recieved the warning that
the database could only store 7 bit data. When I loaded the data in this
database I did not have any errors and when I look at the data it seems
to be the same as in the original text file.
Is there a "proper" encoding type that I should use to load the word
lists so they can interoperate with the WordNet dataset that happily
uses the UTF8 encoding?
Bruce


Hi Bruce,

This isn't strictly a PostGIS question, so you'd be better off 
re-posting to the pgsql-general mailing list to get some answers. 
However, from what you mention above it seems that the extra 
dictionaries you are downloading are not in UTF8 encoding and so may 
require conversion upon import.


You can potentially use SQL_ASCII as a workaround, but I would highly 
recommend that you don't do this, since then you end up with data in a 
mixture of random encodings that you will never be able to output 
correctly across all platforms.



ATB,

Mark.

--
Mark Cave-Ayland - Senior Technical Architect
PostgreSQL - PostGIS
Sirius Corporation plc - control through freedom
http://www.siriusit.co.uk
t: +44 870 608 0063

Sirius Labs: http://www.siriusit.co.uk/labs
___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

Re: [postgis-users] didnt find postgis on my postgresql installation

[Phil James]

Only 32bit Postgres is supported at present I believe.  Uninstall and install 
the 32 bit binaries and it appears in stackbuilder.

Phil



>
> From: Henri De Feraudy 
>To: PostGIS Users Discussion  
>Sent: Wednesday, 30 November 2011, 9:11
>Subject: [postgis-users] didnt find postgis on my postgresql installation
> 
>
>Hello,
>  I just downloaded the latest Postgresql binaries for my Windows 64 bit 
>platform: 9.1.1
>The final phase of installation (Stackbuilder) did not even mention spatial 
>extensions.
>What should I do?
>yours truly
>Henri
>___
>postgis-users mailing list
>postgis-users@postgis.refractions.net
>http://postgis.refractions.net/mailman/listinfo/postgis-users
>
>
>___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

[postgis-users] didnt find postgis on my postgresql installation

[Henri De Feraudy]

Hello,
  I just downloaded the latest Postgresql binaries for my Windows 64 bit 
platform: 9.1.1
The final phase of installation (Stackbuilder) did not even mention spatial 
extensions.
What should I do?
yours truly
Henri___
postgis-users mailing list
postgis-users@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users