You can't compare the evolutionary rates of males and females by comparing between the X and Y chromosomes.Both males and females have X chromosomes for one. The X chromosome doesn't necessarily determine female-ness, while the Y chromosome has the SRY (Sex-determining Region of Y) gene that determines male-ness. Evolution of the X genes affect both sexes, while Y genes only the male. Of course it'll look like they evolve faster.