The sync is fine as it is. You cannot expect to have perfect sync, since it has multiple variables involved.
Well, but look at the animations. One player is enabled to walk animation in the other player can see how the previous player runs. Is that what can not be repaired?