I've had people who don't know my husband ask me why he's always angry. I guess I can see people thinking that about them. Like if you think someone is always angry, you might think you're always doing something wrong to make them angry, which could make you feel like they're controlling, but that's an internal thing and not about the SLI.
My husband occasionally gets set on something and refuses to budge, but only about things that are truly just about him, and I don't think it's controlling for him to expect he can control himself and his personal space.