Once a stag was drinking water in a pool. He saw the reflection of his horns in the water. He felt proud. When he saw the reflection of his legs, he felt ashamed. Just then, he heard the barking of a hunter's dogs.
He ran away as fast as he could. His thin legs helped him to escape. He realized that his ugly-looking legs were his real friends.
Soon his beautiful horns proved an enemy to him. They got entangled in a bush. He tried his best to release himself. But he could not succeed. The dogs reached there. They killed him.
Moral: All that glitters is not gold.
--------
But seriously, unless thicker wrists serve a purpose to you, i don't think it matters.
You can start body building, but wrist exercising in NOT EASY. Infact, its one of the most difficult exercises. The chances of getting your wrist injured are SKY HIGH. Plus, the muscle building process in your wrists will be painfully slow. But can be done.
If i were you, i'd rather not pay attention those people pointing this out.