If you rent less than a movie a week (and if you can get by with a small catalog of current-ish releases), Redbox is pretty economical at $1.29 per DVD per day. You can't leave it sitting around your house for days at a time, but then you don't really need to because you get the movie when you want to see it (as opposed to requesting it on the site a day or two in advance) and then return it the next time you're out. There are redboxes everywhere in my area so getting to one isn't a big deal. In the 2 or 3 years years I've been using redbox, there have literally only been 2 or 3 times where I had to make a special trip to drop off a movie on time. Usually, I leave the house at some point during a day, and if I do, there's a redbox either where I'm going or on the way. (On the borders of my subdivision, there are redboxes at the Walgreens stores on the NW and SE corners, and one at the 7-11 on the NE corner. There's nothing on the SW corner, but I rarely go that way, and if I do, it's 1 mile to the next redbox.) My usual process is to get something on the way home from work and then drop it off when I go out the next day.
One thing in Redbox's favor is that the window between "hey, I want to see that" and having the movie in your hand can be just a matter of minutes. And if you do that, say, twice a month, that's $33/year instead of $96/year. So for small users -- like me -- it's actually faster and cheaper. (Plus they send codes by email or text for either a free rental, rent-one-get-one-free, or $.75 off a rental, about once every 3 weeks. I used redbox about once a month when I first signed up and I just rented when I had codes and I only paid for about 2 movies the first 6 months. Once I got used to using it, I started renting a little more.)