Fix error messages for incorrect hex literals