Don't stress about what the guests think on the day. It is your day, enjoy it. Ultimately all the stresses about the arrangements, the seating plans and all of that stuff is pretty inconsequential. Be selfish, enjoy it. Hopefully it will be the only time you do this, so make the most it. All the miserable buggers will have plenty of other weddings to grumble their way through.