I still use a Nokia 6310 most of the time. Sure, it doesn't have any internet connectivity, but it's a better phone than anything being sold today, the battery lasts for a week, I can drop it without it breaking, and no one's going to steal it.
There's certainly no shame involved. Quite the opposite in fact. When people are boasting about their new phones and I pull my old Nokia out the reaction is: "Wow! I used to have one of those. Now that was a good phone!"