Character sums for Cayley graphs