It's indeed tough when people misunderstand or misjudge you, especially when their assumptions are unfounded.
Here are some steps you can take to move forward...