Re: [Qgis-user] Record the cracks in our (private) streets
Hi Doug, This makes it a lot easier, the others mentioned good possibilities to find the cracks. Concerning your question of segmentation of the roadbed: You could create a regular grid and count, measure or what else the cracks within the grid cells/polygons. A comparison based on this grid would be easy stuff. Sincerely, Christoph > Am 14.12.2019 um 22:16 schrieb Doug : > > > Christoph, > Thanks for the reference. The crack detection capability they describe is far > beyond what I want. All the cracks in our streets were cleaned and filled > with crack-sealant (tar) before I got my photos. So the crack lines stand out > in stark contrast to the road bed. I think photoshop and other tools can use > extreme contrasting to generate outlines. That’s what I was thinking of. Does > such a filter plugin exist in CGIS? If not, can I code one? > The other parts of my problem still exist: defining segments of the roadbed, > and relating the crack to the segments. Do you have any ideas how to do that? > Doug > > From: Christoph Jung > Sent: Saturday, December 14, 2019 11:57 AM > To: Doug > Cc: qgis-user@lists.osgeo.org > Subject: Re: [Qgis-user] Record the cracks in our (private) streets > > Hello Doug, > > Automatic crack detection is not an easy problem. A semi automatic > classification will not find all cracks, because cracks can have very > different appearances. A state of the art approach would be deep learning. At > the German university TU Ilmenau they developed a robust neuronal network for > the detection and classification of distresses in road surfaces. Here is a > Link to one of the papers of this project: > > https://www.tu-ilmenau.de/fileadmin/media/neurob/publications/conferences_nat/2017/Eisenbach-ATIM-2017.pdf > > Sincerely, > Christoph > > > Am 14.12.2019 um 07:05 schrieb Doug : > > > I have imported a set of drone pictures to QGIS. They show the streets in my > subdivision. I want to “record” the cracks in the pavement to be able to > compare them over time. I want to be able to segment the streets in > arbitrary lengths. For each segment, I want to “draw” the cracks (in layers) > to record where they are. Every year or two I will repeat the process. The > purpose is to be able to compare the set of cracks in successive snapshots to > see how the asphalt is holding up and identify underlying problems. I would > love to have some software to find the cracks for me and generate the crack > layer, if anyone knows of such software. > > First problem: I can trace the outline of the streets to generate a layer > which represents to road surface. Is there a way to slice that layer by > picking two points to “slice” the layer and then have two layers? And then > repeat the process so that I get the segments that I want? Alternatively, is > there a way to create a segment and “snap” to next segment so there is not > overlap or missing space? > > Second problem. Given that I have a layer representing a segment of the road > surface, can I “draw” the cracks for that segment such that every line in the > cracks layer is related (as in SQL) to the segment it reside in? > > Once I have the road surface segments, and the associated cracks, I can then > use SQL to generate all sorts of reports on the cracks: average and median > length, number of horizontal and vertical cracks, total crack length per road > surface segment (or square feet), etc. > > Thanks. > Doug > > > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Record the cracks in our (private) streets
Hi Doug, you can create photogrammetric export models (e.g. DEM, point cloud) with the open source software OpenDroneMap. Try WebODM [1] with the graphical user interface - you can install it with docker. The DEM is perfect for QGIS, you can create a 3D view of your Street with the 3d map view in QGIS and calculate the volume of the cracks. Furthermore you can compare your pointclouds with the open source software CloudCompare [2] (Function "Cloud to Cloud Distance (C2C)") - with this function you can determine the change between two models (your two flights). [1] https://www.opendronemap.org/webodm/ [2] https://www.danielgm.net/cc/ Greetings Charly Charlotte Toma GIS-Consultant WhereGroup GmbH Eifelstraße 7 53119 Bonn Germany Fon: +49 (0)228 / 90 90 38 - 24 Fax: +49 (0)228 / 90 90 38 - 11 i...@wheregroup.com www.wheregroup.com Geschäftsführer: Olaf Knopp, Peter Stamm Amtsgericht Bonn, HRB 9885 Am 14.12.2019 um 07:05 schrieb Doug : I have imported a set of drone pictures to QGIS. They show the streets in my subdivision. I want to “record” the cracks in the pavement to be able to compare them over time. I want to be able to segment the streets in arbitrary lengths. For each segment, I want to “draw” the cracks (in layers) to record where they are. Every year or two I will repeat the process. The purpose is to be able to compare the set of cracks in successive snapshots to see how the asphalt is holding up and identify underlying problems. I would love to have some software to find the cracks for me and generate the crack layer, if anyone knows of such software. First problem: I can trace the outline of the streets to generate a layer which represents to road surface. Is there a way to slice that layer by picking two points to “slice” the layer and then have two layers? And then repeat the process so that I get the segments that I want? Alternatively, is there a way to create a segment and “snap” to next segment so there is not overlap or missing space? Second problem. Given that I have a layer representing a segment of the road surface, can I “draw” the cracks for that segment such that every line in the cracks layer is related (as in SQL) to the segment it reside in? Once I have the road surface segments, and the associated cracks, I can then use SQL to generate all sorts of reports on the cracks: average and median length, number of horizontal and vertical cracks, total crack length per road surface segment (or square feet), etc. Thanks. Doug ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Record the cracks in our (private) streets
On 12/14/2019 12:22 PM, Nicolas Cadieux wrote: > You could always use the KISS method (Keep it simple stupid!) and just > spray paint the cracks before flighting the drone. Depends on what > you want to achieve. +1 ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Record the cracks in our (private) streets
Thanks for sharing Christoph, It’s an interesting paper and I will read it more carefully. Another approach could be to make a point cloud with the drone images and to work with a high resolution DEMs. Depending in the drone camera and flight altitude, you could have a really good cm level DEM. That could help with both semi automatic classification methods, and deep learning. It could make it much easier also to identify cracks visually by building, for example, a shade model. The time spent doing this automatically is likely going to be bigger than the time spent doing it manually. It depends on the scale and goal of the project of course. You could always use the KISS method (Keep it simple stupid!) and just spray paint the cracks before flighting the drone. Depends on what you want to achieve. Cheers! Nicolas > Le 14 déc. 2019 à 13:57, Christoph Jung a écrit : > > > Hello Doug, > > Automatic crack detection is not an easy problem. A semi automatic > classification will not find all cracks, because cracks can have very > different appearances. A state of the art approach would be deep learning. At > the German university TU Ilmenau they developed a robust neuronal network for > the detection and classification of distresses in road surfaces. Here is a > Link to one of the papers of this project: > > https://www.tu-ilmenau.de/fileadmin/media/neurob/publications/conferences_nat/2017/Eisenbach-ATIM-2017.pdf > > Sincerely, > Christoph > >>> Am 14.12.2019 um 07:05 schrieb Doug : >>> >> >> I have imported a set of drone pictures to QGIS. They show the streets in my >> subdivision. I want to “record” the cracks in the pavement to be able to >> compare them over time. I want to be able to segment the streets in >> arbitrary lengths. For each segment, I want to “draw” the cracks (in layers) >> to record where they are. Every year or two I will repeat the process. The >> purpose is to be able to compare the set of cracks in successive snapshots >> to see how the asphalt is holding up and identify underlying problems. I >> would love to have some software to find the cracks for me and generate the >> crack layer, if anyone knows of such software. >> >> First problem: I can trace the outline of the streets to generate a layer >> which represents to road surface. Is there a way to slice that layer by >> picking two points to “slice” the layer and then have two layers? And then >> repeat the process so that I get the segments that I want? Alternatively, is >> there a way to create a segment and “snap” to next segment so there is not >> overlap or missing space? >> >> Second problem. Given that I have a layer representing a segment of the road >> surface, can I “draw” the cracks for that segment such that every line in >> the cracks layer is related (as in SQL) to the segment it reside in? >> >> Once I have the road surface segments, and the associated cracks, I can then >> use SQL to generate all sorts of reports on the cracks: average and median >> length, number of horizontal and vertical cracks, total crack length per >> road surface segment (or square feet), etc. >> >> Thanks. >> Doug >> >> >> ___ >> Qgis-user mailing list >> Qgis-user@lists.osgeo.org >> List info: https://lists.osgeo.org/mailman/listinfo/qgis-user >> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Record the cracks in our (private) streets
Hello Doug, Automatic crack detection is not an easy problem. A semi automatic classification will not find all cracks, because cracks can have very different appearances. A state of the art approach would be deep learning. At the German university TU Ilmenau they developed a robust neuronal network for the detection and classification of distresses in road surfaces. Here is a Link to one of the papers of this project: https://www.tu-ilmenau.de/fileadmin/media/neurob/publications/conferences_nat/2017/Eisenbach-ATIM-2017.pdf Sincerely, Christoph >> Am 14.12.2019 um 07:05 schrieb Doug : > > I have imported a set of drone pictures to QGIS. They show the streets in my > subdivision. I want to “record” the cracks in the pavement to be able to > compare them over time. I want to be able to segment the streets in > arbitrary lengths. For each segment, I want to “draw” the cracks (in layers) > to record where they are. Every year or two I will repeat the process. The > purpose is to be able to compare the set of cracks in successive snapshots to > see how the asphalt is holding up and identify underlying problems. I would > love to have some software to find the cracks for me and generate the crack > layer, if anyone knows of such software. > > First problem: I can trace the outline of the streets to generate a layer > which represents to road surface. Is there a way to slice that layer by > picking two points to “slice” the layer and then have two layers? And then > repeat the process so that I get the segments that I want? Alternatively, is > there a way to create a segment and “snap” to next segment so there is not > overlap or missing space? > > Second problem. Given that I have a layer representing a segment of the road > surface, can I “draw” the cracks for that segment such that every line in the > cracks layer is related (as in SQL) to the segment it reside in? > > Once I have the road surface segments, and the associated cracks, I can then > use SQL to generate all sorts of reports on the cracks: average and median > length, number of horizontal and vertical cracks, total crack length per road > surface segment (or square feet), etc. > > Thanks. > Doug > > > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Record the cracks in our (private) streets
Hi Doug I guess you are new to QGIS and GIS in general? See below. > Le 14 déc. 2019 à 01:05, Doug a écrit : > > > I have imported a set of drone pictures to QGIS. They show the streets in my > subdivision. I want to “record” the cracks in the pavement to be able to > compare them over time. I want to be able to segment the streets in > arbitrary lengths. For each segment, I want to “draw” the cracks (in layers) > to record where they are. Every year or two I will repeat the process. The > purpose is to be able to compare the set of cracks in successive snapshots to > see how the asphalt is holding up and identify underlying problems. I would > love to have some software to find the cracks for me and generate the crack > layer, if anyone knows of such software. How many streets are we looking at? You can use a QGIS plugin like the QGIS semi-automatic classification plugin to help you identify the cracks. You can also explore raster change Detection algorithms. Between you and me through, the time you will spend calibrating each image for these methods to work will probably be much longer than the time spent doing it visually. If you try an automatic method and fail, you will still learn a lot. > > First problem: I can trace the outline of the streets to generate a layer > which represents to road surface. Is there a way to slice that layer by > picking two points to “slice” the layer and then have two layers? And then > repeat the process so that I get the segments that I want? Alternatively, is > there a way to create a segment and “snap” to next segment so there is not > overlap or missing space? You can clip a raster file(the images) with vector Polygons. Google “clip raster” and look in the QGIS documentation. If everything is georeferenced, raster layer will be correctly placed if you open the different file. It’s better to have a local utm based CRS (Coordinates Référence system). This may depend on the drone software you are using. It may be in WGS84 long lat by default. You can change the CRS of the images by reprojecting it but don’t go back and forth. Keep a backup of the originals. You can change the crs of the project thought without problem. You can use a plugin like the quickmapservices to import raster like google earth to make sure things are looking good for the georeferencing. https://qgis.org/en/docs/index.html > > Second problem. Given that I have a layer representing a segment of the road > surface, can I “draw” the cracks for that segment such that every line in the > cracks layer is related (as in SQL) to the segment it reside in? > Yes, vector file formats like shapefile or SpatiaLite will link any line, point or polylines that you draw to a database table. In that table, you can add information manually, like the street name, or you can generate informations like line length based on the drawing using expressions in he field calculator. You can link a crack to a street address if you have the georeferenced street addresses in another file. Google spatial queries. https://docs.qgis.org/3.4/en/docs/user_manual/working_with_vector/index.html > Once I have the road surface segments, and the associated cracks, I can then > use SQL to generate all sorts of reports on the cracks: average and median > length, number of horizontal and vertical cracks, total crack length per road > surface segment (or square feet), etc. > You can use QGIS to generate reports (look in various plugins also) or any favorite tools like excel if you export the table fields to a csv. Good luck with the project. Nicolas > Thanks. > Doug > > > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
[Qgis-user] Record the cracks in our (private) streets
I have imported a set of drone pictures to QGIS. They show the streets in my subdivision. I want to "record" the cracks in the pavement to be able to compare them over time. I want to be able to segment the streets in arbitrary lengths. For each segment, I want to "draw" the cracks (in layers) to record where they are. Every year or two I will repeat the process. The purpose is to be able to compare the set of cracks in successive snapshots to see how the asphalt is holding up and identify underlying problems. I would love to have some software to find the cracks for me and generate the crack layer, if anyone knows of such software. First problem: I can trace the outline of the streets to generate a layer which represents to road surface. Is there a way to slice that layer by picking two points to "slice" the layer and then have two layers? And then repeat the process so that I get the segments that I want? Alternatively, is there a way to create a segment and "snap" to next segment so there is not overlap or missing space? Second problem. Given that I have a layer representing a segment of the road surface, can I "draw" the cracks for that segment such that every line in the cracks layer is related (as in SQL) to the segment it reside in? Once I have the road surface segments, and the associated cracks, I can then use SQL to generate all sorts of reports on the cracks: average and median length, number of horizontal and vertical cracks, total crack length per road surface segment (or square feet), etc. Thanks. Doug ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
