I mean as far as what other people think, not as far as what happens within the relationship. People will notice a 5-year difference now and might comment on it, but with middle-age couples no one notices or cares.