that’s exactly what google maps is doing, though. granted, there are aerial photographs used for this as well, but the 3D structure from photos (called photogrammetry) is completely automated in google maps afaik.
edit: schloss neuschwanstein in google maps 3D (sorry for the music, not my video).
handmade 3D models will always be superior, of course.