Strolling along gauge theory vacua