Young children should be introduced to computers at a young age. In fact, they should begin at the earliest age at which the parents are comfortable with.
There are many great sources of educational freeware. Give Educational Freeware a look first, then expand your search out from there.