EarthLink Is Losing a Lot of Email 291
LandGator writes "Robert X. Cringely, doyen compu-columnist for PBS, reports on a hidden e-mail problem at Earthlink: They're losing up to 9 messages out of 10, found as a result of a friend's testing." From the article: "He sent messages from other accounts to his Earthlink address, to his aliased Blackberry address, and to his Gmail account. For every 10 messages sent, 1-2 arrived in his Earthlink mailbox, 1-2 (not necessarily the SAME 1-2) on his Blackberry, and all 10 arrived with Gmail. Swimming upstream through Earthlink customer support, my buddy finally found a technical contact who freely acknowledged the problem. Since June, he was told, Earthlink's mail system has been so overloaded that some users have been missing up to 90 percent of their incoming e-mail. It isn't bounced back to senders; it just disappears. And Earthlink hasn't mentioned the problem to these affected customers unless they complain."
They DID notify customers (Score:5, Funny)
Re: (Score:2)
Re: (Score:2)
It's user@earthlink.net not user@earthlink.com
Re: (Score:3, Informative)
"Nothing for you to see here..." (Score:5, Funny)
Lucky for Earthlink Customers! (Score:5, Funny)
DIY (Score:3, Insightful)
Re:DIY (Score:5, Informative)
Technically that is against the ToS for regular Earthlink accounts.
Secondly they like to block a lot of traffic on email-esque ports.
Either way... As a former employee, I'm not surprised.
Re: (Score:3, Insightful)
So...get a business acct. I had one with Cox..was great. Static IP...no caps on uploads or downloads...could run all the servers I wanted, and a low level SLA. The one time I had trouble, I called the support line..rather than put me on hold, I left a msg. with my problem. In about 3 min..I had a tech call ME back.
It was only about $70/mo....I'd highly recommend it.
Re: (Score:3, Insightful)
But back on topic here, earthlink has had email problems for YEARS. The only difference now is that the problem is worse than it was and more people are noticing.
Re: (Score:3, Informative)
Same here. Ever since they closed the Pasadena Call Center and dumped about 2/3 of their most experienced employees the quality of service has been dropping. It used to be that you had to understand what was going on in order to work there. Now, all you need is the ability to read scripts. You don't even need to be able to tell when the scripts don't apply, or when to ask somebody that knows what they're doing for help. Just read the script and don't care if i
Re: (Score:3, Insightful)
Re: (Score:2, Informative)
I'm surprised you can do this. Most ISPs block port 25 traffic that isn't sent to or from their own badly overloaded email servers.
No, only the bad ISPs block port 25 unilaterally without appeal. If you're on cable or cheap fucker ILEC administered DSL, yeah, youu probably can't go out through port 25. You probably also don't have a static IP either. Any halfway decent DSL ISP will open port 25 for you upon request. I use DSL Extreme and while they do block 25 by default, i only need to log in to their website and check a box to open it up.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
> At least this way I usually know when it's broken, and I have the opportunity to fix it.
tverbeek can be reached at tverbeek@masochist.net
Re: (Score:2)
Re:DIY (Score:5, Interesting)
Though I wouldn't use the word "inept".
Try putting a couple hundred domains and 10k users on it and your threat surface for spammers goes up exponentially from a small server with a few domains and a couple hundred users.
Ours gets tens of thousands of bogus connection attempts from spammers per hour. How many are you getting? 50? That's not including the stuff that does get into the filters to be processed by the rules.
Until you have run a big box with lots of users on it, you have no freaking idea what we deal with on a daily basis. And it has gotten MUCH worse in the past 18 months.
Re: (Score:2)
Re: (Score:2)
Re: (Score:3, Informative)
A couple of comments though - I admin a few Exchange Servers. For the most part, they take literally zero effort to maintain. They're very well behaved. Perhaps I'm doing something wrong?
On the other hand, it's definitely unnecessarily complex and bloated for 'home use'. Someone wanting to run a DIY mail server on a Windows box could do a lot worse than to take a look at the very clean, compact, GPL'd Hmails
Re: (Score:2, Interesting)
I used to be in Tech Support for MindSpring, and remember the Netcom mail fiasco. This sounds like it could be worse. Glad I'm not there anymore.
TowerDave
Re: (Score:2)
I dunno about the OP...but, I use Postfix on a Gentoo box...virtual email hosting, etc.
I put it all on a little Sun Ultra2 dual 300mhz box (I think) with about half a gig of ram I got off eBay awhile back.
A little overkill for a dedicated email server (nothing else), but, seems about bulletproof.
Since Katrina, had to put it in storage till I can move somewhere again more permanent, and get my cable business acct. again. Man...I miss that connectivity and speed.
Lost e-mail? WHAT THE HECK? (Score:5, Insightful)
Re: (Score:3, Insightful)
Re: (Score:2)
Re:Lost e-mail? WHAT THE HECK? (Score:5, Informative)
This is absolutely correct, so any policy checks that occur during the SMTP handshake (who are you? where are you coming from? who do you want to send to? how much data do you have? Oh, do you now? REJECT). However, anti-spam and anti-virus checks happen after the message is accepted. If the result of the check is X, and policy rules say drop mail on the floor when X, then bye-bye e-mail and sorry Bond, the government will not ackowledge its involvement.
Otherwise, the only way to loose mail is to shutdown a machine with a heavy queue and throw out the disk. SMTP is impervious to network badness. My money is on an SMTP policy run amok.
Re: (Score:3, Insightful)
Re:Lost e-mail? WHAT THE HECK? (Score:4, Interesting)
Then it's a horrible policy.
Every single email service I've signed up for that does spam filtering has a "spam" or "bulk mail" or "junk mail" folder. I implemented my own when I deployed my own personal server.
And virus scans should be able to remove the virus and tag the message as "WHOOPS THIS HAS A VIRUS", but shouuld not drop them on the floor.
If this is causing undue stress, you could implement policies in the handshake. "Oh, I've gotten 100 emails from you in the past hour, and 90 of them were spam/viruses. REJECT." Or put it in some sort of tarpit.
An email service losing email is somewhat like anyone losing data these days. There is absolutely no situation where email should completely disappear into an email server and never come out.
Re: (Score:2, Insightful)
That said, 90% failure is ridiculous.
Re: (Score:2)
SMTP Digression (Score:5, Informative)
To be losing mail, Earthlink servers must be accepting mail and then throwing it away, or at the very least, not continuing to forward it to the destination, which is just as bad. This goes completely against how the system is supposed to work. If they can't handle the load, there's a specific set of return codes to give (RFC821 [faqs.org], section 4.2): I understand your perspective -- email is a loosely connected system, with lots of points of failure. However, in the vast majority of cases, a failure at one point will cause either delays or errors, not dropped mail.
Re:Lost e-mail? WHAT THE HECK? (Score:4, Insightful)
Re:Lost e-mail? WHAT THE HECK? (Score:5, Funny)
Re: (Score:2, Insightful)
Re:Lost e-mail? WHAT THE HECK? (Score:4, Funny)
There are style guides that disagree on this point, granted, but the ones that disagree with me are self-evidently wrong.
What MTA do they use? (Score:5, Informative)
Re:What MTA do they use? (Score:5, Informative)
I used to work there back in the day.
Re: (Score:3, Informative)
These days, good old postfix is more than sufficient. Or qmail, if you can stand it -- it works for Yahoo, who deals with more than a little bit of email.
Re: (Score:2)
By the way, even if you could get something useful out of their SMTP banner, that isn't necessaril
Wonder if they can be sued (Score:5, Interesting)
Hotmail does this too (Score:2)
I use the phone a lot more now. Email is such a crapshoot these days.
Re: (Score:2)
SImilarly, back in the day I had to open an AOL account to contact AOL customers, but that was because AOL had a junkmail setting to block all non-AOL email "sent from the internet."
Earthlink is turning rapidly into a turd, in addition to dropping valid emails, they now browser jack [slashdot.org] you.
Re:Wonder if they can be sued (Score:4, Informative)
Re: (Score:2)
Re: (Score:2, Insightful)
She loves me not (Score:5, Funny)
Re: (Score:2)
Is this 1998? (Score:4, Funny)
2) I didn't know Cringely was still around.
If it hadn't been for the reference to GMail, I'd be wondering if this story had been sitting in the queue since 1998. Now, off to buy some LNUX shares, and one of those Tommy Hilfiger straps to hang my keys around my neck!
White list spam block with challenge (Score:5, Informative)
I run an online retail business, and non-tech savy customers using earthlink don't get a lot of our email.
Biggest problem is that Earthlink uses a white-list spam blocking setup that sends back a time-limited challenge to the sender ("Please go to this link and fill in this form so that this user can receive your mail").
We get these challenges when our automated system sends messages to customers
- Roach
Re: (Score:2)
If people can write code to figure out captchas (or whatever those pictures are) they could certainly write a piece of code to respond properly or act on challenge requests.
Re: (Score:3)
Your problem could be your users or it could be you.
USER LAZINESS Suspect email to the user sits in Earthlink's SuspectEmail page for a default of 14 days. Earthlink users can easily go that page to move email and add you to their address book. However checking a web page takes energy and users might not do that very diligently.
MULTIPLE EMAIL ADDRESSES One problem with some businesses email is they constantly change their internal email address. For example NRA (National Rifle Association) always
Re: (Score:2)
As for the email address, our outgoing address has been the same for years. It never changes (You should see how much junk we get per
Re: (Score:2)
The whitelist is an opt-in thing. Their email service defaults to not using it-- I still use earthlink email for a lot of stuff for historical reasons (it's a pita to change a lot of people over to a new address). I don't think I've had much mail go missing, but I might send myself some tests.
Re: (Score:2)
Re: (Score:2)
It's opt-in, off by default. The user has to go into their webmail interface and turn it on from there. If it's on, it's not by accident.
"We get these challenges when our automated system sends messages to customers"
And this, ladies and gentlemen (well, gentlemen), is why email hosts have these whitelists and why people use them. "Would you like to not opt-out of our informative
Re: (Score:2)
Oooh, I just love it when people make stupid assumptions!
Here's the total list of emails sent by our system, to which I was referring:
1) MAP (Minimum Advertised Price) restricted item pricing. This is the biggest. It is sent when a customer requests it to be sent to get pricing on a MAP controlled item to be able to
When asked about the email problems... (Score:4, Funny)
Spam... (Score:2)
The problem, of course, is... (Score:2, Funny)
I bet I know whats happening... (Score:4, Interesting)
I would wager thats whats going on here and they don't want to admit it. There is some admin there (or it could be company policy) that see's alot of mail getting queued up but not being delivered but instead of fixing the problem he just deletes the mail and everything's fine.
Much smaller scale version of the same problem (Score:2)
I'm not posting my ISP here because I haven't done a rigourous test, and don't want to accuse anyone unfairly with estimated n
They must have hired the BOFH (Score:4, Funny)
...in other news, Earthlink customers report... (Score:2)
Fix the Blog Post Link (Score:2)
Not only losing incoming email (Score:5, Interesting)
There's a simple solution to this..... (Score:2)
Problem solved IMHO.
Re: (Score:2)
I was having trouble with Yahoo! losing my mail a while back so I decided to keep my Earthlink account since they've always been clueful. D'oh...
C'mon guys, if a few $grand for an Opteron server or two is going to break the bank it's time to hang it up. Just give us fair warning.
Re: (Score:2)
I use earthlink for some of my email, and when I send email that uses postfix on my mac at home as the outgoing server earthlink drops it on the way in (as do many other large ISPs). I think most of my other accounts (including my web hosting service at hub.org) do a better job of
Here's the root of the problem (Score:5, Funny)
Have you seen the commercials? They've off-shored half their jobs to magic-fairytale land. They've probably got some under trained ogre for an email admin who stands around the water cooler all day chatting with the fairies. Sure, it's a lot cheaper when you can pay your staff in pixie dust, but you end up getting bitten by poor customer service (I had to call them the other day, and the customer service rep had such a thick elven accent I could barely understand him). Outsourcing just doesn't work...
Earthlink whitelists are user settings, not server (Score:2)
Re:Earthlink whitelists are user settings, not ser (Score:2)
I've been using Earthlink for ten years now and with a very few exceptions where they specifically stated that they were having issues (web acces, email, etc), I have never had a single email which was sent to me get lost.
My original email account is the one I use for people to contact me if they stumble upon my web page (hosted by Earthlink also) and it got overrun with spam, even with max filtering, so I added a new email address just for parents and friends and it has
Re: (Score:2)
No guaranteed email delivery (Score:5, Insightful)
"there is no guarantee of email delivery" (and optionally "Get over it")
Remember this folks, no where in the RFC's is there anything that states email will get delivered....
Just because all us sys-admins do such a great job, most of the time it does get there, people forget the dark ages of the internet when this would happen all the time.
OK 90% email loss is really really bad, and it use to be more like 5% loss (at worst), but people need to remember email isn't guaranteed.
Re:No guaranteed email delivery (Score:5, Insightful)
Back then, you may have had an excuse. Today, the excuse that the RFC doesn't specify email gets delivered should get you fired for being a failure who doesn't give a shit. Just my $0.02.
So? No guaranteed US postal mail either .... (Score:3, Interesting)
Um, no. (Score:2)
It is true that there is no end-to-end mechanism with SMTP, and for that reason you can't be assured the email will get delivered. But IIRC the RFC's state that you can't tell an SMTP server you get mail from that you really have it until you have the mail committed to _disk_, not just memory. And if you have the mail sitting on the hard drive, nothing short of filesystem corruption should cause you to lo
Re:No guaranteed email delivery (Score:5, Informative)
naturally there is alot more, including cases where it is acceptable not to send a notification, but I don't think any apply here.
So basically, SMTP is defined as a reliable protocol which guarantees delivery or notification of failure. The days of unreliable e-mail no longer apply.
Service tags timing out (Score:2)
Reminds me of the time Verizon DSL switched my DSL service from fixed IP address to PPoE _without notifying me._ Since they hadn't notified me, effectively I completely lost internet connectivity. Unfortunately, this happened at about the same time there was a major worm or virus attack.
When I called them, the first checked the electronic connection from my house to the telco office (approximately 1000 feet away), and said it was perfect and there
Phony "availability" numbers (Score:2)
Back, back through the wayback machine to the 1970s, when I was trying to conduct a class exercise at a major state university that shall remain nameless.
The university's computing center published a newsletter every month and every month near the top was the uptime for the month, typically 99.4%
Semantic Man! (Score:2)
All we know is that is has not arrived... yet...
It could be that they have a really really long timeout, and that the 4xx error will at some point be sent... or that they have it, and have not yet delievered.
Seeing a black sheep in the field does not prove that every sheep is black, nor that there is at least one black sheep. All you can prove is that there is at least one sheep that is black on at least one side...
Re: (Score:3, Insightful)
Seeing a black sheep in the field does not prove that every sheep is black, nor that there is at least one black sheep. All you can prove is that there is at least one sheep that is black on at least one side.
Donald Rumsfeld, is that you?
Re: (Score:3, Insightful)
Re: (Score:2)
Sniff.
Pure poetry.
Spam Filter (Score:2)
Real Nerds use Speakeasy! (Score:2)
pffft. EarthLink - you might as well be on AOL.
Bullshit (Score:2, Insightful)
As An Earthlink Customer (Score:3, Insightful)
Believe it or not, they've been very good. The one issue I've had they resolved quickly once I was escalated above first-level tech support.
Maybe it's a location-specific issue?
I can qualify another post that talked about the new email sender verification thing. I get it sending mail from the web email interface. But none of my friends or the emails I send myself from work require sender verification.
I don't know what the motivation behind these complaints may be. It certainly isn't bothering me or my wife. Maybe it will..
(shrugs)
Re: (Score:3, Insightful)
EarthLink? Doesn't surprise me any more (Score:2)
Re:Says a lot.. (Score:5, Insightful)
Re: (Score:3, Insightful)
C'mon, can people not even be bothered to read the article SUMMARY any more?
Re: (Score:2)
Re: (Score:2)
What? Reading the summary? Come on, be serious. This is Slashdot.
Be grateful to the few who read the title.
Re: (Score:2)
For some people, every glass is just half full, and no matter what you do, they complain. Too bad not up to 9 out of 10 of their complaints just get lost somehow!
Re:Says a lot.. (Score:4, Funny)
I turn green up to 9 out of 10 times I take a shower
Can I watch?
Re: (Score:3, Insightful)
In this case what they have is an estimate of the average. But it's not based on much data or systematic testing. By saying "up to" they are actually encouraging the reader to interpret their results narrowlly. They could have
Re: (Score:2)
Re: (Score:2, Informative)
Re: (Score:2, Funny)
NOW it might be getting hit by people, since the article is out, but I hope to gawd his 10 email tests wouldn't cause problems!!!
The clue store is open...