Yes. The things that absolutely must be learned from kindergarten through, say, sixth grade do not require computers. When I show my kid the universe of bugs, slugs, and beetles that exist under a log I do it in the back yard. With a log. Not with YouTube. When I have a percussion jam with him we grab whatever we can find in the kitchen to hear how things sound different. We don't click mice. We draw pictures with crayons, markers, and pencils. We use paper, cardboard, or whatever material there is. Not with a iPad.
I grew up in a physical world, I learned about physical things and how they were made and how they worked. Not in a logical way, but in an experiential way. I obtained a very intuitive understanding of the world in wich we live. Putting rote learning aside, this is the core of early childhood learning. Math, physics, nature, and art all must thave this underpinning if they are to be bodies of knowledge and skills that will inform a persons life.
Early education is about testing, sharpening, and tuning childrens senses. In that task real experience matters, screen learning is worthless. I'll even argue that screen learning is of little help in learning the 3 R's.
Background: I did not have access to a computer(TI 99/4a) till I was nine years old. My first task was, well second actually, after I hunted the Wumpus, I started learning BASIC. I am now a sysadmin by profession.