If the IP is changed and they come back, then we just simply put the IP in... and range ban it to a different range.
Then you have 2 dynamic IPs banned, and the player can change it again. So if someone that was not cheating gets one of that 2 IPs he'll be banned for no reason.