If your kid demonstrates some skill, then by all means encourage that. Others comments seem to imply that computers and real life are mutually exclusive, but of course they aren't. It is possible interact with a computer and the real world at different times.
When my little guy was 2, he had an old desktop in his room that I made from parts salvaged from upgrades. He used it to play Sammy's Science House and Broderbund interactive stories (the beaver's rap in the Tortoise and the Hare was a great favorite). He learned how to click and navigate around and was entertained in a way where he was in control (in contrast to TV watching).
I would not recommend a new anything at that age though, because they just don't understand the consequences of their actions. Give him something you don't mind if he destroys :-)
And lest you think that computer access destroys children....
my son is 11 now, and he's mucked around with the DarkGDK and Visual Studio - actually written some pretty cool stuff with Scratch. He's a straight A student and in a gifted program in our school board.
But he's also goalie for his hockey team in the winter, plays soccer in the summer, takes tae kwon do and boxing classes and runs track.
You just have to encourage ALL aspects of their development. Only you can be the judge of what the appropriate time is.