Comment Cheap kit with multiple projects (Score 1) 115
If you have no background in electronics at all, this might be a good place to start:
http://www.innovatoys.com/kits-labs/50-in-one-electronic-project-lab/165
Very basic analog and radio circuits, which in my opinion is the best place to start, and at under $30 it won't break the bank. You'll go through all the projects pretty quickly - but then you can start experimenting with your own circuits. No soldering required - just connect the pre-tinned wires to the connector springs. I had a similar kit from Radio Shack when I was young and first getting into electronics, and I loved it. I even ended up stripping it of parts to use in my own projects when I graduated to building circuits on perfboard.
Whatever kit you begin with, analog or digital, you'll want a Digital Multi-Meter, or DMM. It doesn't have to be a good one, and these days a cheap one can be had for 10 or 15 dollars. Because you're just beginning, I suggest not getting an auto-ranging meter - you'll maintain a better sense of where you are and what you're doing if you have to pay attention to the range setting.
Best of luck to you sir; if electronics continues to interest you then you're in for a lot of fun!