You can. Typically if you see multiple people shifting when a player is in motion, most likely they are playing some sort of zone defense.
If a single player moves along with, they are in man to man.
There are obviously nuisances if they are playing some sort of man-zone hybrid for example...