We are so used to hearing people speak a certain way. When we hear them speaking differently, it is a big shock to the system!
I think a huge part of the charm of Downton Abbey is the English accents.
If they spoke with an American accent, it would give the show a completely different feel.