If it's a collet style prop adapter then it's the wrong size, or it's worn (meaning: it's the wrong size now, whatever it may have been before).
Before it's tightened, it should slip onto the shaft with very little, if any, play. If it feels loose from side to side when you slide it on, it's too big for one reason or another.