[GRASS-user] Re: Exporting Vector data to SHP (v.out.ogr)- takes a lot of time

[Luis Lisboa]

The problem is that, I left it this night processing and, when I
returned it has freezed. So, v.out.ogr is not being able to export
vector files produced by r.to.vect... As I said, maybe it's related
with some option in r.to.vect that is messing this up. Or something
related with tables.

Can anyone give me some tips on this?

Thanks

Luis


>...that´ll be a HUGE vector file!
>So it´s normal, that it takes some minutes.


On Thu, Nov 11, 2010 at 3:08 PM, Luis Lisboa wrote:

> Greetings
>
> I have produced a vector map (with r.to.vector) with the following
> metadata:
>
> v.info test01
>
>  
> ++
>  | Layer:   teste01  |
>  | Mapset:  Regional
>|
>  | Location:Country
>  |
>  | Database:E:\v3
>   |
>  | Title:
>   |
>  | Map scale:   1:1
>   |
>  | Map format:  native
>|
>  | Name of creator: orbit  |
>  | Organization:
>|
>  | Source date: Tue Nov 09 11:11:40 2010
>|
>
>  
> ||
>  |   Type of Map:  vector (level: 2)
>|
>  |
>|
>  |   Number of points:   0   Number of areas:  213680
>   |
>  |   Number of lines:0   Number of islands:73649
>|
>  |   Number of boundaries:   348770  Number of faces:  0
>|
>  |   Number of centroids:213666  Number of kernels:0
>|
>  |
>|
>  |   Map is 3D:  No
>   |
>  |   Number of dblinks:  1
>|
>  |
>|
>  | Projection: Universal Transverse Mercator (zone 0)
>   |
>  |   N:  8832707.83027649S:  7028073.62772369
>   |
>  |   E:  1347458.42001915W:200792.5777576
>   |
>  |
>|
>  |   Digitization threshold: 0
>|
>  |   Comments:
>|
>  |
>|
>
>  
> ++
>
>
> Now I'm trying to export it to SHAPEFILE but, after 10 minutes the
> processing bar is not even in 40%. What might be happening? I mean, is it
> some error with the vector or when I convert to vector (from raster)?
> Because, taking more than 10 minutes to export to vector it's not normal (I
> guess) and taking nearly 7 min to convert to vector also...
>
> Thanks for the reply
> Luis L
>
___
grass-user mailing list
grass-user@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-user

Re: [GRASS-user] Re: Exporting Vector data to SHP (v.out.ogr)- takes a lot of time

[Achim Kisseler]

Am 12.11.2010 09:40, schrieb Luis Lisboa:

The problem is that, I left it this night processing and, when I returned it 
has freezed. So, v.out.ogr is not being able to export vector files produced by 
r.to.vect... As I said, maybe it's related with some option in r.to.vect that 
is messing this up. Or something related with tables.

Can anyone give me some tips on this?


I guess it freezes because it uses so much memory.

Please check if v.out.ogr works with a small vector map. E.g. shrink 
region before r.to.vect or choose only some features from the vector map 
to export.


?

Achim


Thanks

Luis



...that´ll be a HUGE vector file!
So it´s normal, that it takes some minutes.



On Thu, Nov 11, 2010 at 3:08 PM, Luis Lisboa mailto:luislisboa1...@gmail.com>> wrote:

Greetings

I have produced a vector map (with r.to.vector) with the following
metadata:
v.info  test01
  
++
  | Layer:   teste01
  |
  | Mapset:  Regional
|
  | Location:Country
|
  | Database:E:\v3
   |
  | Title:
   |
  | Map scale:   1:1
   |
  | Map format:  native
|
  | Name of creator: orbit
|
  | Organization:
|
  | Source date: Tue Nov 09 11:11:40 2010
|
  
||
  |   Type of Map:  vector (level: 2)
|
  |
|
  |   Number of points:   0   Number of areas:
  213680 |
  |   Number of lines:0   Number of islands:
  73649  |
  |   Number of boundaries:   348770  Number of faces:
  0  |
  |   Number of centroids:213666  Number of kernels:
  0  |
  |
|
  |   Map is 3D:  No
   |
  |   Number of dblinks:  1
|
  |
|
  | Projection: Universal Transverse Mercator (zone 0)
   |
  |   N:  8832707.83027649S:  7028073.62772369
   |
  |   E:  1347458.42001915W:200792.5777576
   |
  |
|
  |   Digitization threshold: 0
|
  |   Comments:
|
  |
|
  
++


Now I'm trying to export it to SHAPEFILE but, after 10 minutes the
processing bar is not even in 40%. What might be happening? I mean,
is it some error with the vector or when I convert to vector (from
raster)? Because, taking more than 10 minutes to export to vector
it's not normal (I guess) and taking nearly 7 min to convert to
vector also...

Thanks for the reply
Luis L




___
grass-user mailing list
grass-user@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-user

___
grass-user mailing list
grass-user@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-user

Re: [GRASS-user] Re: Exporting Vector data to SHP (v.out.ogr)- takes a lot of time

[Luis Lisboa]

Hello Achim... Not really. It didn't work
Let me start from the beggining:
1- My orioginal raster file has the following:
|   Type of Map:  raster   Number of Categories: 11
 |
 |   Data Type:CELL
  |
 |   Rows: 5381
  |
 |   Columns:  4481
  |
 |   Total Cells:  24112261
  |
 |Projection: UTM (zone -24)
 |
 |N: 9659623.5017993S: 8045266.26306668   Res: 300.01063719
  |
 |E: 1077874.87767815W: -266394.50364563   Res: 299.993167
 |
 |   Range of data:min = 1  max = 11
 |
It's a landcover map

2- I convert to vectorusing the following expression
r.to.vect -v input=teste01_l...@regional output=teste05 feature=area
and it returns:
Extracting areas...
Building topology for vector map ...
Registering primiti 907000907256 primitives registered
3527832 vertices registered
Building areas...
321179 areas built
85875 isles built
Attaching islands...
Attaching centroids...
Number of nodes: 671952
Number of primitives: 907256
Number of points: 0
Number of lines: 0
Number of boundaries: 586103
Number of centroids: 321153
Number of areas: 321179
Number of isles: 85875
Number of areas without centroid: 26
r.to.vect complete.
My vector is:
 ||
 |   Type of Map:  vector (level: 2)
 |
 |
 |
 |   Number of points:   0   Number of areas:  321179
  |
 |   Number of lines:0   Number of islands:85875
 |
 |   Number of boundaries:   586103  Number of faces:  0
 |
 |   Number of centroids:321153  Number of kernels:0
 |
 |
 |
 |   Map is 3D:  No
  |
 |   Number of dblinks:  1
 |
 |
 |
 | Projection: Universal Transverse Mercator (zone 0)
  |
 |   N:   9659623.5017993S:  8045266.26306668
  |
 |   E:   911978.65632755W:  -266394.50364563
  |
 |
 |
 |   Digitization threshold: 0
 |
 |   Comments:
 |
 |
 |
 ++
this is a vector composed by areas (as far as I wanted and I believe)
3- I reduced the region in order to export just a piece
4- I exported but, when I open it in QGIS I get an empty vector file
5- Then again: v.out.ogr -c input=test...@regional type=area
dsn=c:\teste07.shp
Exporting 321179 areas (may take some time)...
And after 20 minutes it seems freezed

It this too much polygons?

On Fri, Nov 12, 2010 at 9:06 AM, Achim Kisseler  wrote:

>
>
> Am 12.11.2010 09:40, schrieb Luis Lisboa:
>
>  The problem is that, I left it this night processing and, when I returned
>> it has freezed. So, v.out.ogr is not being able to export vector files
>> produced by r.to.vect... As I said, maybe it's related with some option in
>> r.to.vect that is messing this up. Or something related with tables.
>>
>> Can anyone give me some tips on this?
>>
>
> I guess it freezes because it uses so much memory.
>
> Please check if v.out.ogr works with a small vector map. E.g. shrink region
> before r.to.vect or choose only some features from the vector map to export.
>
> ?
>
> Achim
>
>>
>> Thanks
>>
>> Luis
>>
>>
>>  ...that´ll be a HUGE vector file!
>>> So it´s normal, that it takes some minutes.
>>>
>>
>>
>> On Thu, Nov 11, 2010 at 3:08 PM, Luis Lisboa > > wrote:
>>
>>Greetings
>>
>>I have produced a vector map (with r.to.vector) with the following
>>metadata:
>>v.info  test01
>>
>>
>>  
>> ++
>>  | Layer:   teste01
>>  |
>>  | Mapset:  Regional
>>|
>>  | Location:Country
>>|
>>  | Database:E:\v3
>>   |
>>  | Title:
>>   |
>>  | Map scale:   1:1
>>   |
>>  | Map format:  native
>>|
>>  | Name of creator: orbit
>>|
>>  | Organization:
>>|
>>  | Source date: Tue Nov 09 11:11:40 2010
>>|
>>
>>  
>> ||
>>  |   Type of Map:  vector (level: 2)
>>|
>>  |
>>|
>>  |   Number of points:   0   Number of areas:
>>  213680 |
>>  |   Number of lines:0   Number of islands:
>>  73649  |
>>  |   Number of boundaries:   348770  Number of faces:
>>  0  |
>>  |   Number of centroids:213666  Number of kernels:
>>  0  |
>>  |
>>|
>>  |   Map is 3D:  No
>>   |
>>  |   Number of dblinks:  1
>>|
>>  |
>>|
>>  | Projection: Universal Transverse Mercator (zone 0)
>>   |
>>  |   N:  8832707.83027649S:  7028073.62772369
>>

Re: [GRASS-user] Re: Exporting Vector data to SHP (v.out.ogr)- takes a lot of time

[Hamish]

> Luis wrote:
> 1- My orioginal raster file has the following:
...
> Registering primiti 907000
> 907256 primitives registered

900k is a lot, but not crazy.

> 3527832 vertices registered
> Building areas...
> 321179 areas built

300k areas is not small, but it is not huge either.
...
> Exporting 321179 areas (may take some time)...
>
> And after 20 minutes it seems freezed

wait longer... maybe hours or overnight.
export to shapefile with v.out.ogr is known to be
quite slow.

are you sure it is frozen? check in process monitor
("top" on mac or linux, ctrl-alt-del on Windows)
if cpu usage by v.out.ogr is 100%, and how much
memory it is using. if it is frozen cpu will be 0%,
if it is still working cpu will be 100%.


> It this too much polygons?

perhaps. maybe resample raster to a coarser grid
or try running v.build.polylines on the vector map
prior to export.


Hamish



  
___
grass-user mailing list
grass-user@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-user

Re: [GRASS-user] Re: Exporting Vector data to SHP (v.out.ogr)- takes a lot of time

[Martin Landa]

Hi,

2010/11/12 Hamish :

>> Registering primiti 907000
>> 907256 primitives registered
>
> 900k is a lot, but not crazy.

you can also try GRASS 7.

Martin

-- 
Martin Landa  * http://geo.fsv.cvut.cz/~landa
___
grass-user mailing list
grass-user@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-user

Re: [GRASS-user] Re: Exporting Vector data to SHP (v.out.ogr)- takes a lot of time

[Luis Lisboa]

Well in this case I'm building my Msc Thesis on GRASS
(interfaces+functions+modles) and tyhat would mean loose some part of my
work So, and since GRASS6.4.0 was expected to export this data, what can I
do? is this a lack-of-memory problem? or sometyhing that other users haver
already experienced?
Thanks
Luis

On Mon, Nov 15, 2010 at 7:29 AM, Martin Landa wrote:

> Hi,
>
> 2010/11/12 Hamish :
>
> >> Registering primiti 907000
> >> 907256 primitives registered
> >
> > 900k is a lot, but not crazy.
>
> you can also try GRASS 7.
>
> Martin
>
> --
> Martin Landa  * http://geo.fsv.cvut.cz/~landa
>
___
grass-user mailing list
grass-user@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-user

Re: [GRASS-user] Re: Exporting Vector data to SHP (v.out.ogr)- takes a lot of time

[Markus Metz]

On Mon, Nov 15, 2010 at 10:14 AM, Luis Lisboa  wrote:
> Well in this case I'm building my Msc Thesis on GRASS
> (interfaces+functions+modles) and tyhat would mean loose some part of my
> work So, and since GRASS6.4.0 was expected to export this data, what can I
> do? is this a lack-of-memory problem?

Hamish suggested to check if v.out.ogr is really frozen, i.e. it
should keep the cpu busy. As long as it keeps the cpu busy, everything
is fine and you just have to wait it out. Of course you can also check
how much memory v.out.ogr currently uses. If v.out.ogr goes into swap
space, it will take a very long time. 213680 areas is a lot, and it
will most probably take more than 10 minutes, rather give it a few
hours or run it overnight. It will also require a bit of disk space,
several 100MB, just to be sure you could check that there is enough
disk space where the shapefile is supposed to be written to.

Since the vector to be exported is a converted raster, apparently
without further modification, why not exporting the raster?

> Martin Landa:
>>
>> you can also try GRASS 7.

v.out.ogr in GRASS 7 is probably not much faster, and you would have
to rebuild topology first which will most probably also take more than
10 minutes for 213680 areas...

Markus M
___
grass-user mailing list
grass-user@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-user

Re: [GRASS-user] Re: Exporting Vector data to SHP (v.out.ogr)- takes a lot of time

[Achim Kisseler]

Am 15.11.2010 10:47, schrieb Markus Metz:

Since the vector to be exported is a converted raster, apparently
without further modification, why not exporting the raster?


...I thought the same. What do you want to do?

Maybe you can tile the raster and create some or many vector maps?

Achim
___
grass-user mailing list
grass-user@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/grass-user