This is one of the reasons why I am concerned about settlements branching across an entire planet. I personally feel that you shouldn’t have a settlement that can essentially have 2 major builds with the same name, connected by a long winding road. I’ve brought it up a few times in the past when I first noticed how easy it was to absorb other builds (with or without consent).
I’ve written a post as part of @Dzchan94’s suggestion post here … Plots and settlements
My suggestion goes some way to address this issue (and some others that have been bothering me also). It certainly wouldn’t prevent long distance roads from being built, but would somewhat mitigate the desire for them to be built just to join up with other builds for prestige purposes. It also means that any roads that were built “out of a settlements influence”, could essentially become part of a completely different settlement.