Hi, Now it starts to make sense. Could you paste the contents of a single row that you can’t write into xlsx format? You can capture it with ogrinfo “ogrinto [database connection] -sql "select * from my_table limit 1". Or maybe better to convert that row into GML format and attach that to your mail.
-Jukka Rahkonen- Lähettäjä: Kopszak Marta - Partner Hurt <marta.kops...@orange.com> Lähetetty: maanantai 10. tammikuuta 2022 15.07 Vastaanottaja: Rahkonen Jukka (MML) <jukka.rahko...@maanmittauslaitos.fi>; Even Rouault <even.roua...@spatialys.com>; gdal-dev@lists.osgeo.org Aihe: RE: [gdal-dev] Bug in OGR library I have 2 bilions of rows in the whole database and I try to export only one table which has 56 columns and 423 thousands of rows so it’s not the issue with Microsoft Excel limitation. I can’t write even a single row (error Feature creation error (OGR error: negative FID are not supported) occurs immediately), Marta Kopszak Hi, Could you clarify a bit? You have billion rows in the database table but xlsx and ods can support at maximum a bit more than one million rows (1,048,576). You can’t imagine to have success with converting the whole table. Or is your problem that you can’t write even a single row from the source table because the value of the ID key is too big for xlsx/ods formats? -Jukka Rahkonen- Lähettäjä: gdal-dev <gdal-dev-boun...@lists.osgeo.org<mailto:gdal-dev-boun...@lists.osgeo.org>> Puolesta Kopszak Marta - Partner Hurt Lähetetty: maanantai 10. tammikuuta 2022 14.34 Vastaanottaja: Even Rouault <even.roua...@spatialys.com<mailto:even.roua...@spatialys.com>>; gdal-dev@lists.osgeo.org<mailto:gdal-dev@lists.osgeo.org> Aihe: Re: [gdal-dev] Bug in OGR library Hi Even, Thanks for your replay. More info about the problem: Error: Save error: Export to vector file failed. Error: Feature write errors: Feature creation error (OGR error: negative FID are not supported) The database has more than 2 bilons of records (record – I mean record in the database table). The error occurs when I export a single table witout the primary key to .xlsx. I suppose that when the table doesn’t have the primary key it use tid – the tuple identifier, and the size of tid may exceed the size of a 32-bit integer. It cause the problem to export this table to .xlsx format by OGR library. Regards, Marta Kopszak From: gdal-dev <gdal-dev-boun...@lists.osgeo.org<mailto:gdal-dev-boun...@lists.osgeo.org>> On Behalf Of Even Rouault Sent: Monday, January 10, 2022 11:42 AM To: gdal-dev@lists.osgeo.org<mailto:gdal-dev@lists.osgeo.org> Subject: Re: [gdal-dev] Bug in OGR library Marta, What is the bug exactly ? "2 billion records" : by record, you mean cells, like a sheet with 2048 columns and 1048576 rows ? By quickly looking at the code I can't see an obvious limitation, but that doesn't mean anything. Closer investigation would be needed. Please file an issue at https://github.com/OSGeo/gdal/issues/new with exact details how to reproduce (number of rows/features, and columns/fields in particular). But even if the writer side would work, the OGR reader side would probably have issues as the whole spreadsheet will be loaded into RAM and for 2 billion cells, I would expect at least 32 or more GB of RAM to be needed. Perhaps spreadsheet software are able to cope with that in a smarter way. Even Le 10/01/2022 à 11:27, Kopszak Marta - Partner Hurt a écrit : Dear Sirs, I ran into an error when exporting data through the OGR library to the .xlsx and .ods format. The bug occurs when there are more than 2 billion records in the database. I know the problem was solved for other formats, e.g. csv. Will the problem be solved also for other formats (e.g. xlsx, .ods)? If this is not the correct e-mail, please forward this e-mail to the appropriate person. Kind regards, Marta Kopszak Marta Kopszak Współpracownik<https://www.orange.pl/> Rozwój Sieci Stacjonarnej, Wydział Rozwoju Planowania Orange Polska, gen. Romualda Traugutta 55, 50-416 Wrocław | RODO - informacja o danych <https://www.orange.pl/> <https://www.orange.pl/> <https://www.orange.pl/> _______________________________________________<https://www.orange.pl/> gdal-dev mailing list<https://www.orange.pl/> gdal-dev@lists.osgeo.org<https://www.orange.pl/> https://lists.osgeo.org/mailman/listinfo/gdal-dev<https://www.orange.pl/> -- <https://www.orange.pl/> http://www.spatialys.com<https://www.orange.pl/> My software is free, but my time generally not.<https://www.orange.pl/>
_______________________________________________ gdal-dev mailing list gdal-dev@lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/gdal-dev