There's another reason who it might not be common. It would be called "genetic culling". That is, suppose a family did have strong psychic powers. What would happen to that family? They'd likely be outnumbered by mobs who would burn them as witches. Or they might find they have troubles in the romance department as everything about a person is written out like it's on a page.
Psychic ability might be a survival advantage but not a social one.
There is also the possibility that the bulk of the population does have this gene, but due to a social climate that isn't very open, most people either never learn to use them, or if they had, hide them for their own survival. In essence, the absence of psychic ability is not an absence of evidence for it, but evidence that our society is not sophisticated enough to deal with it.