Uniform diameter bounds for some families of Cayley graphs