It really depends on what kind of community you mean. For example, if you and your spouse were deeply connected to your religious institution (church, Kingdom Hall, temple, etc.) then it could definitely affect your standing and cause some divisions amongst the congregation in the same way that friends usually take sides after a breakup.
There's an interesting article about the negative impacts of divorce and the different ways it impacts your life. I think you'll find it really useful.