I agree that better handling of things like debian/changelog is something we should focus effort on.
I think we can either do something gbp dch like, possibly allowing commits to annotate whether and to what extent they should be included in changelog. Or some code that knows how to merge changelogs Or some file based approach like you discuss. I think exploring options like these and getting experience would be great for Debian.