Re: [Qgis-user] CSV Import records missing on map
Andrea, Garth Thanks for the suggestions and tips. I would have shared the file or some of the data but was unable to get in touch with the data owner for permission in a timely manner. I thought I would share the workaround and experience in case anyone else runs into this. Based on Garth's comments I updated the DMS to ensure it used the specific characters mentioned above ( "The degree symbol ° fails while º works. Under Mac OS X 10.13 the first is Option-Shift-8, the second is Option-0 (opt-zero)."). QGIS still would only successfully assign geometry attributes to a few of the imported records and none to others. In the end I used the Microsoft support site VBA code to do the conversion in Excel from DMS to D.D and then 100% records imported ok as a delimited text file into QGIS. I did have to change the degree symbol from Option-0 to Option-Shift-8 and the seconds symbol from a double single quote to proper double quotes or I could have changed it in the VBA script as well. If I had been a better Python text wrangler I probably could have dealt with modifying a N45 00 00.0 to 45° 00' 00.0 " programmatically without going through the data and adding the ° ' and " manually but at least I have a solution. There are not too many records. Thanks again for the suggestions. Peter On Mon, Sep 27, 2021 at 3:56 PM Garth Fletcher wrote: > CVS import of DMS coords is touchy in my experience. > The degree symbol ° fails while º works. > Under Mac OS X 10.13 the first is Option-Shift-8, the second is > Option-0 (opt-zero). > Also, it seems to want ' for minutes and ' ' for seconds, i.e., a single > ' and two separate '. > It rejects a normal " double quotes, and I'm sure will reject "smart" > quotes, i.e., the ones > that lean in different directions. > > Since I figured those quirks out I have not had any problems with DMS > notation. > > -- > Garth Fletcher > > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user > ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] CSV Import records missing on map
Hi Peter, maybe it might be useful if you shared a minimal csv file with at least one "working" record and one non "working" record so somebody could try to check what's going wrong. Best regards. Andrea ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] CSV Import records missing on map
CVS import of DMS coords is touchy in my experience. The degree symbol ° fails while º works. Under Mac OS X 10.13 the first is Option-Shift-8, the second is Option-0 (opt-zero). Also, it seems to want ' for minutes and ' ' for seconds, i.e., a single ' and two separate '. It rejects a normal " double quotes, and I'm sure will reject "smart" quotes, i.e., the ones that lean in different directions. Since I figured those quirks out I have not had any problems with DMS notation. -- Garth Fletcher ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] CSV Import records missing on map
Agustín Thanks for the tip. I did try placing the lat and long fields as columns 1 and 2 with no success. It is very strange. I guess I will have to get the DMS converted to D.D and go from there. Best regards Peter On Sun, Sep 26, 2021 at 10:11 PM Agustín Diez Castillo wrote: > Hi, > Are latitude and longitude among the first fields? I will try with them in > field 2 and field 3, let field 1 for ID if you wish so. In this way, you > can be sure if the problem is in another field or just in one of them. > This trick helped me in te past to see where was the problems. Nicolas’ > suggestion will be the correct way to go (if you’re in Windows), but the > other could help to see what it’s going on. > Best > Agustín > > On 26 Sep 2021, at 17:39, Nicolas Cadieux > wrote: > > Hi, > > I have never used DMS, but rather Degrees in Decimals so perhaps that is > the problem. Make sure what is currently imported is actually in the > correct place in DMS. > > Normally, problems with csv is related to empty field or extra > separators. Look at the file in notepad or notepad ++ and eliminate to > problematic characters to make sure columns are Perfectly aligned. This can > be hard to find if the separator is a space character. > > Nicolas Cadieux > https://gitlab.com/njacadieux > > Le 26 sept. 2021 à 16:48, Peter Devanney a écrit : > > > Hello > > I have an issue I have never run into before. > > I am adding a delimited text (CSV) layer and only some of the records > appear on the map. 36/118 records show. The rest do not show but are still > in the attribute table. > > When I run add geometry attributes or do an export to .shp I only see the > 36 records that showed up on the map. > > All records look identical in the source CSV. I cannot see any difference > that would explain why one record imported successfully with geometry > attributes and the others didn't. > > The CSV file has separate Lat and Long columns with coordinates in DMS > Latitude Longitude > N45 45 56.1 W075 27 51.3 > > I am running 3.16.8 on OS X Big Sur 11.5.2 > > Scratching my head as to why some records import ok and the others do not, > even though all show up in the attribute table. > > thanks > > Peter Devanney > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user > > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user > > ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] CSV Import records missing on map
Nicolas Thanks for the tip. I did check in Textedit and only see commas as separator values and the DMS all look formatted the same. This is also my first time having to use DMS - I usually use D.D without any issues. Peter On Sun, Sep 26, 2021 at 8:39 PM Nicolas Cadieux wrote: > Hi, > > I have never used DMS, but rather Degrees in Decimals so perhaps that is > the problem. Make sure what is currently imported is actually in the > correct place in DMS. > > Normally, problems with csv is related to empty field or extra > separators. Look at the file in notepad or notepad ++ and eliminate to > problematic characters to make sure columns are Perfectly aligned. This can > be hard to find if the separator is a space character. > > Nicolas Cadieux > https://gitlab.com/njacadieux > > Le 26 sept. 2021 à 16:48, Peter Devanney a écrit : > > > Hello > > I have an issue I have never run into before. > > I am adding a delimited text (CSV) layer and only some of the records > appear on the map. 36/118 records show. The rest do not show but are still > in the attribute table. > > When I run add geometry attributes or do an export to .shp I only see the > 36 records that showed up on the map. > > All records look identical in the source CSV. I cannot see any difference > that would explain why one record imported successfully with geometry > attributes and the others didn't. > > The CSV file has separate Lat and Long columns with coordinates in DMS > Latitude Longitude > N45 45 56.1 W075 27 51.3 > > I am running 3.16.8 on OS X Big Sur 11.5.2 > > Scratching my head as to why some records import ok and the others do not, > even though all show up in the attribute table. > > thanks > > Peter Devanney > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user > > ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] CSV Import records missing on map
Hi, I have never used DMS, but rather Degrees in Decimals so perhaps that is the problem. Make sure what is currently imported is actually in the correct place in DMS. Normally, problems with csv is related to empty field or extra separators. Look at the file in notepad or notepad ++ and eliminate to problematic characters to make sure columns are Perfectly aligned. This can be hard to find if the separator is a space character. Nicolas Cadieux https://gitlab.com/njacadieux > Le 26 sept. 2021 à 16:48, Peter Devanney a écrit : > > > Hello > > I have an issue I have never run into before. > > I am adding a delimited text (CSV) layer and only some of the records appear > on the map. 36/118 records show. The rest do not show but are still in the > attribute table. > > When I run add geometry attributes or do an export to .shp I only see the 36 > records that showed up on the map. > > All records look identical in the source CSV. I cannot see any difference > that would explain why one record imported successfully with geometry > attributes and the others didn't. > > The CSV file has separate Lat and Long columns with coordinates in DMS > Latitude Longitude > N45 45 56.1 W075 27 51.3 > > I am running 3.16.8 on OS X Big Sur 11.5.2 > > Scratching my head as to why some records import ok and the others do not, > even though all show up in the attribute table. > > thanks > > Peter Devanney > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
[Qgis-user] CSV Import records missing on map
Hello I have an issue I have never run into before. I am adding a delimited text (CSV) layer and only some of the records appear on the map. 36/118 records show. The rest do not show but are still in the attribute table. When I run add geometry attributes or do an export to .shp I only see the 36 records that showed up on the map. All records look identical in the source CSV. I cannot see any difference that would explain why one record imported successfully with geometry attributes and the others didn't. The CSV file has separate Lat and Long columns with coordinates in DMS Latitude Longitude N45 45 56.1 W075 27 51.3 I am running 3.16.8 on OS X Big Sur 11.5.2 Scratching my head as to why some records import ok and the others do not, even though all show up in the attribute table. thanks Peter Devanney ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
