Exactly.. I started with Sinclair Basic by myself, then got taught procedural programming with Comal at school, then dabbled a little with AMOS on my Amiga then moved on to Turbo Pascal at Uni, shortly followed by Turbo C, Borland C++ 4.5 (still the most I have ever paid for a single piece of software). More recently C# and Java are my current poison, mainly for work reasons. Had I started with Java with all its complexities, oddities, need to learn the API etc things would have been a lot harder.
You need to start with something that won't start acting very odd if you type = instead of == or === in an if statement or won't fail to compile just because you missed a ; or put one in the wrong place, as those kind of nuances are very difficult for a beginner to get their head around.