Can a facial fracture on the cheek cause any damage permanently ?!

Well when I was 11 years old, My ex friend instigated a fight with me against a boxer and i Didn't even want to fight and the kid ended up beating me up by knocking my glasses off and i ended up with a swollen cheek and black eye. Like he did get a good amount of hits on one spot and the last punch all i felt was a big thump in my cheek . It hurt but every other punch he through felt like a feather {he punched like a girl i didn't even cry} But all i did was ice it and wait for it to go down. But could there be any permanent damage from that over the years? Like it looks fine i think at one point there was a line scar but it faded over timee. But i always feel like i have to rub that spot of my eye and cheek and like strech it by stretching my eye and cheek with this weird facial expression. Should i have gone to the hospital after that? anyone here with some advice on why i do that? could it be nerve damage? this kinda depresses me...as i didn't deserve this.