I've never faced this problem before?

I added a man from my brothers hockey team on facebook. I want to get to know him outside of the network, but I didn't want to approach him once the hockey games were over out of respect for my brother. The man kept staring at me and showing off, but when I added him he didn't accept my friend request, however he did change his profile picture. Should I cancel the request, I don't know why he didn't accept because I am attractive and smart. It's been a week, what would be your advice here.