Brilliant points about evolution shaping morality -- thanks for making them aberglas. Two other things to consider -- other evolutionary processes and our direction going into the singularity.
There are several evolutionary processes besides conventional natural selection (including just random drift). Even just natural selection includes seemingly weird things like "sexual selection" that shape a Peacock's tail because Pehens think big tails are sexy proof of health and strength because they are so hard to survive with. For an AI equivalent of a Peaock's tails, that might lead to AIs thinking other AIs are sexy that do some costly action like either help humans do everything ( e.g. the "With Folded Hands" dystopia) or alternatively just stomp on huge numbers of humans (e.g. Terminator). There can also be different selective pressures at different levels of grouping (EO Wilson has written some on this recently, but the idae goes back decades).
If we are heading into one or more technological singularities, something to contemplate is that our moral direction into the singularity might have something to do with how we transition beyond the singularity. So, while it is no guarantee, is is plausible that if we get our own moral situation in order as soon as possible (increased compassion, increased collaboration, etc.) we may have a happier singularity. One can worry about the vast amounts of money (billions, soon trillions of dollars?) being poured into creating financial AIs that maximize short terms gains by competitive means, socializing costs and risks while privatizing gains. So, twenty million is better than nothing, but it is a drop in the bucket.
Another tangent on evolution and thinking -- what will the evolution of religions mean for AIs?
Two new funny new AI fictional series maybe of interest in thinking about what is possible:
* EarthCent Ambassador Series (with the alien Stryx AI)
* Old Guy Cybertank Series (mostly about human-derived military AI; series authored by a neuroscience researcher)
The late James P. Hogan wrote several stories involving AIs that were quite thought provoking -- especially his early "The Two Faces of Tomorrow". And of course the late Iain Banks' Culture Series is also interesting for its AIs, especially "Excession".