Is The Internet Growing Too Fast? 156
SpunOne writes: "According to this article, the Internet is growing faster than today's routers can handle. After years of predictable growth, the size of the routing table and traffic in it exploded during the past six months, topping 104,000 entries in March, compared with 75,000 a year ago. Even more troubling is evidence that frequent updates to the routing table entries by network managers are causing instability in the Internet's backbone routing infrastructure."
Re:Hey actually something interesting on Slashdot! (Score:1)
SCTP can solve the problem (Score:1)
Today, Multihoming (an important feature for realibility) prevents signifant aggregation, thus inflating the route table.
The solution:
Give each node addresses on each of the connected networks (easy with IPv6), multihome only on a limited scale (I.e. Tell provider B about provider A's addresses, but he should not propagate it any farther), then let a next generation replacement for TCP/UDP impliment the multihoming..
Guess what, this protocol alread exists, it's called SCTP. It's already implimented for Linux, but Microsoft will likely signifantly hamper it's
adoption just like they have with IPv6.
Re:Hey actually something interesting on Slashdot! (Score:1)
Face it.. Cisco/Juniper/etc are the only way.
If they want to reduce multihoming... (Score:2)
Like hell. If my (very large) ISP didn't occasionally wipe out our mission-critical connection for an hour or so, maybe I wouldn't care about multihoming. I'm not multihomed yet for budget reasons, unfortunately, but once we can afford to go that route we damn well will.
I actually had a solution for this (Score:5)
When a pitched it then, it was quickly shot down. However, it allowed for regional routing, which is where you just sent packets to the router responsible for a major lat/lon, which then forwarded packets to things in its area. Really simple.
It also allowed you to figure out where things were coming from (if the user opted in), which meant you could redirect them to a regional mirror. As a side-effect, folks like Yahoo could actually keep all the French out of websites, since the IP would actually have some sort of location information in it.
Routing would be more efficient, and smaller, and faster. But hey, I'm just a nutcase, as the IPv6 guys said.
Hey actually something interesting on Slashdot! (Score:5)
the fact here is that a multihomed router taking full BGP routes from their upstreams today needs atleast 256 megs of RAM and a big cpu (example cisco 7500 MINUMUM) in order to handle it..
The problem is all the recent "hey let's be a DSL provider!!" idiots that have no understanding of route summarization and addressing.. Thankfully many of these ISPs are going bankrupt now so hopefully all their /23's and /24's will be withdrawn after their lights go out.
The ISPs need GOOD engineers who can design a network in a manner that only the most aggregate route will be announced to external peers.. the biggest problem is they assign smaller blocks and then that customer gets multihomed and the original provider has to cut holes in their BGP filters in order for it to work right.
If you're going to multihome, GET YOUR OWN ADDRESSES FROM ARIN!!! Places like Verio have very Nazi-ish filtering policies and their routing tables only hit about 85,000.. While verio makes bad routing decisions, this shows an example of what the internet routing table SHOULD look like.
SUMMARIZE, SUMMARIZE, FUCK YOUR TOASTER, IT DOESN'T NEED AN IP ADDRESS!@@!#@!#
Fuck you. (Score:1)
--
"Don't trolls get tired?"
Re:Fuck you. (Score:1)
--
"Don't trolls get tired?"
Fuck you. (Score:1)
- A.P.
--
* CmdrTaco is an idiot.
well... (Score:1)
--
* CmdrTaco is an idiot.
Re:Jesus. (Score:2)
Well, isn't that what those people get paid to do?
-A.P.
--
* CmdrTaco is an idiot.
Yahoo is long gone (Score:5)
You're absolutely right that our ability to cope with the net is what's suffering. A friend of mine once said that the Internet is "like giving +1 to everyone's intelligence. If they don't know something, they now have a tool that lets them look it up and get a ton of information quickly." But now we realize that you only get the +1 bonus if you are already fairly intelligent, because it takes intelligence to be able to do Internet research, more intelligence to determine if the sites that you're looking at are good sites and/or responsible with facts.
With the wisdom of hundreds of other netters, and the net's gift of great communication, I can be more intelligent than a doctor is about a given prescription drug, for example. But if I don't select sources correctly, I can be downright dangerously ignorant about that drug.
If the tools that we have for research improve, THEN we can add +1 to everyone's intelligence. So what we have in the meantime is a tool where the smart get smarter and the dumb stay pretty much where they are.
It may be that the current economic contraction may be just what the net needs. It may stagnate in growth for a little bit -- and then we'll have a little bit of time to catch our collective breaths and allow humans to catch up with what is possible. One reason we have all these fucked companies is that the masses didn't adapt as quickly as the netted elite. The main reason is the temporarily insane marketplace, sure, but a lot of online things are much better than their offline counterparts, it's just that people couldn't catch up with the growth of the net. It's better to meet online than to travel 2000 miles to meet, but today we are still adapting to the idea that we can shop for airline tickets over the net.
The net has allowed us to see what's possible and to implement new and better approaches. But it could not hold our hand and show us the new and better approaches. With time at a premium in everyone's lives, no-one can afford the time for experimentation or learning with these new approaches.
OK, I'll stop now before I become Katz.
Re:Yahoo is long gone (Score:2)
After all we have never known a web site to put up information that is flat out wrong have we.
Re:TMI (Score:3)
The result - the Internet's population CAN exceed its useful capacity. (It has, several times. I've experienced outages on international links of up to 14 days, due to catastrophic hardware overload.)
The problem is that the AVERAGE load needs to be less than 1/3 the total capacity, if you want to avoid major packet loss. However, when you look at profit-run businesses, it makes no sense to have three times the capacity you can get away with. That's just going to eat profits.
The major failure of a profit-driven IP-based network is that you hit maximum profits when you hit minimum quality of service. There's no way round that.
In the end, privatizing the Internet may turn out to be a failure. Upgrades are expensive, and the increase in revenue will typically be trivial, in comparison, making maintenance unprofitable and (in a depressed tech market) marketplace suicide. (You think shareholders'll approve a plan to "throw away money"? No matter how necessary it might be, from a quality standpoint?)
In the end, enough people just use the net for music, prawn and e-mail (none of which require speed) that the Internet could, in principle, survive off just those services.
This is why projects such as Internet 2 became popular. Researchers and Universities around the world realised that the Internet is dead for any "real" (read: "Network-Intensive") work.
The now-famous live videoconference between American and Russian hospitals, over the MBone, would not be possible today. (It was barely possible, then, with networks around the globe suffering melt-downs from the incredible demands it placed on the system.)
Today, even connecting to the MBone is a nightmare. Mail the MBone mailing list, and they'll tell you to pay over hard cash or talk your ISP into doing so. Gone are the days of trading resources, knowledge and capabilities.
The Internet will live on, but we'll see further fragmentation, as commercialization forces people to build specialized, distinct networks, which will become ever-more incompatiable.
If this is the world "we" (as the users and therefore the funding) want, then oh well. It sounds b awful, to me. But this has gone far beyond anything any individual can change. I'm not even sure it's something even large corporations can change. (Microsoft tried! And is still trying!) This may well be the scenario we're locked into, no matter what.
Re:IPV6 (Score:1)
kashani
Re:Routers need to upgrade their processors (Score:1)
sho ver
cisco 2620 (MPC860) processor
kashani
Re:IPV6 (Score:1)
kashani
Re:Why do we need dynamic routes? (Score:1)
We need dynamic routes so that we can actually pass traffic when links fail. Link go down, route gets dropped. Router crashes routes get dropped. Also have you ever tried to static route 100K routes?
kashani
Re:IPV6 (Score:1)
with 32 bits a
with 128 bits a
Re:I actually had a solution for this (Score:2)
kashani
Re:Developing countries (Score:4)
This is the single funniest statement I've read in days.
Re:You prove my point (Score:1)
An unfortunate side effect of high intelligence is a remarkable lack of patience for lesser intelligences.
Thus, a routing guru may have a very good reason for dismissing your proposal out of hand, but feels that it's beneath his intellect to talk down to you in terms you can understand.
Whether this is good or not is irrelavent. It's just the way we're wired.
Personally, I think your idea has merit, but then my idea of complicated routing is getting my home and office wired together across different providers. I'm no guru.
A real guru, with the vision to see beyond your idea in totality may take the idea and run with it in a similar, if not same, direction, and come up with a great solution. I wouldn't count on it, though. I've found that really, really talented/skilled people are very, very focused on their talent/skill. Thus, as a prima donna ballerina is a great dancer but sucks at fixing your car, a routing guru may not have the right-brain capability to think outside the box of routing table rules.
"Beware by whom you are called sane."
OMG~~~ im outa Patch cableS!!!! (Score:1)
(plugs holes with fingers)
hurry, im running outa fingers here!!!
Re:IPV6 (Score:1)
Benny
Re:Deja e-vu (Score:1)
Re:Hey actually something interesting on Slashdot! (Score:1)
Sky not falling (Score:2)
Why is that quote funny to me?
Re:Bush Orders Rolling Blankouts (Score:1)
Death of the Internet predicted, film at 11:00... (Score:1)
Computing is the only field in which we consider adding a wing to the building to be maintenance.
Re:TMI (Score:1)
For one, how many people do you know have a little bio page that basically says "I'm joe shmoe, and I do nothing special, but I feel I need a web page." I'd say about 70% of personal home pages are worthless (and that's based on a very easy rating scale).
So, as a result, the engines like Yahoo and so on are trying hard to keep up with the crap, but the crap is crap, and should remain listed as such. I think it might be better worth-while to figure out some sort of sponsor-to-create system with all sorts of checks-n-balances to keep useless websites from ever existing. That won't ever happen though, because after a few more years, the novelty of the 'net will fade, and it will become a standard part of our lives. People won't see the need to have their own website anymore, unless they really are trying to share something with the world that is worthwhile. That won't prevent the crap from piling up, but it will slow and the 'net will become stable again.
I can't wait 'til that happens.
Classmates.com (Score:1)
And I find that to be content oriented.
Cisco hardware is half-weak, tho (Score:1)
Why does a Cisco router with the equivilent of an Athlon and 512MB of RAM cost $50k or more? I'm sure the I/O engine of a Cisco router is actually better designed than a PC with PCI slots full of four-port hundred megabit NICs, but has anyone ever done any test to determine just how fast such a PC could be?
25k routes! Holy crap, the net is too big. (Score:1)
Gonna collapse from all this
Gonna run out of IP addresses by 1996 or so
Is IPv6 going to help this all?
Only if we give out prefixes in a sensible manner (for some definition of sensible - country? Provider? Height of user? You decide).
This is the Good Times Virus (tm) of Routing.
numbers limited by AS numbers? (Score:5)
Verio's routing policy. (Score:1)
This isn't "Nazi-ish." This is common sense. If everyone started aggregating properly, there would be a lot less overhead.
Frankly, I think IP allocations should be yanked from people who don't know how to announce them properly.
---
click a button, feed a hungry person!
Well it will adapt... eventually (Score:1)
The reason that routers are slow is that there isn't enough reasonable route summarisation that is relevant to a global basis.
This will fix itself over time as the internet is built in such a way that it can adapt itself in an evolutionary fashion. Very much as open source can do the same.
Stop worrying...
Let the "corporate entities" sort it all out...
Re:SCTP can solve the problem (Score:1)
It seems very harsh to blame Microsoft for the slow adoption of IPv6. There's been an IPv6 stack available for Windows for ages. I would guess it's more the ISPs who are holding back on upgrading expensive equipment.
john
Re:TMI (Score:1)
Quickly! To action (Score:1)
All ISP or service providers: scale back your IP ranges! Everyone with a class A group of IPs should move to class B; everyone with B to C. All service providers currently shopping for IP addresses, please purchase one (1) and set up virtual domains.
You there! with the vanity domain for IRC vhosts and email - cut that shit out! And you, with the pointlessly obscure and insipidly dull "weblog" with it's own domain - to GeoCities with your ilk!
We can save ourselves, but only through moderation! (hint, hint!)
Cheers,
levine
Re:Hey actually something interesting on Slashdot! (Score:1)
>cisco 7500 MINUMUM) in order to handle it..
Nah. not really. we got full routes from one provider plus partialrouters from uunet and are easily under 128mb. CPU usage of a 7200 is hovering around 30%.
I really don't see this as a problem. Memory is dirt cheap, (yes, even Ciscos use sdram) the cpu usage isn't that high at all, BGP updates don't occur THAT often, if someone is fucking their routes up badly, that's what route flapping is for.
No one ever said you had to pick up the
Re:SCTP can solve the problem (Score:1)
who cares? no decent internet provider is going to run their core router as a linux box. Running a MS box for routing is unheard of. When Cisco (with the basic enterprise IOS, i don't want to buy a module for it when i can still use BGP w/o a problem) AND my upstream provider will do it with me (haha yah right), then i'll even think about considering it.
MS is not repsonsible for the IPv6 not catching on, the reason is because I (the ISP) have absolutely no incentive to go to IPv6. ARIN will give me more IPv6 ips than Ipv4. woohoo, who cares, the difference in cost for me upgrading my /18 to a /17 is $0. My CPU usage is at 40%, my memory usage is at 60%, but at current memory prices, who cares?
Re:The real problem... (Score:1)
Re:IPV6 (Score:1)
Re:Why do we need dynamic routes? (Score:1)
> for the convenience of the routers -- that's
> the idea behind Class A, B & C arrd blocks
Well they weren't. This is one of the many things IPv6 is supposed to solve... though i'm still not entirely sure that a problem even exists...
Re:SCTP can solve the problem (Score:1)
And the core routers do care, they need to have more or less a NEXT_BEST that points to the other provider of the downstream AS in question.
Developing countries (Score:1)
A discussion on this topic at
Re:Developing countries (Score:1)
This is the single funniest statement I've read in days.
You know, judging by the topics and the overall cynicism at
Re:Developing countries (Score:1)
Read the whole thread shithead. Stop thinking so linear.
Maybe if our government took your laissez-faire sentiments to their logical conclusion we wouldn't have a third world dominated by officially sanctioned dictators, they would be owned by some infinitely benign corporation.
I suggested it should be a humanitarian effort. I also suggested corporations wouldn't be interested in solving this problem for said reasons. If you still don't understand, I can't help you AC.
Re:Developing countries (Score:2)
The major reason birthrates are disproportionate with family income is because of a lack of education and access to information. That is the primary benefit of the internet - access to information, something people in socially and economically deprived countries desperately need! When a government is too negligent to supply basic infrastures and social services to it's citizens, the people have to impower themselves. Communication via the internet would allow people to assemble, exchange ideas and find solutions for their particular situations.
"...teach a man to fish" is all I'm saying Rich. Enable people to find their own solutions.
Unfortunately, there is no financial incentive for multinational corporations or wealthy countries like United States and Canada to help developing countries participate in the information age. And redundant (and just plain stupid) topics like "Is the internet growing too fast" is a bloody waste of time when all this focused brainpower - using the internet *ahem* - could be used to tackle serious global issues.
[ soapbox | off ]
Re:All you deregulation and commercialization!!!!! (Score:2)
Good post, thanks. Just wanted to add - The city of Sacramento actually used to own a nuclear plant (called SMUD) but they closed it down about 11 years ago. Certain groups (including myself) warned at the time that it was an irresponsible action based on unscientific feel-good eco-politics and could eventually cause brownouts and power shortages. So you have to understand that this California Stupidity thing has been going on for over a decade now.
I live in Dallas today, thank God. It's comforting to live in a state that never voted for Bill Clinton, even once, for anything. And a state that can take care of its own power grid, thank you very much.
Re:Numbering problems (Score:1)
IPv6 is totally non-locative? Does that conflict with the goals stated in the RFC's [rfc-editor.org] that are worried about "transparency"?
Either way, I don't see any guarantee one way or another on 'locative' vs. 'transparency' with IPv6. There's been only a few addressing formats specified. We may not have seen the one that gets widely adopted yet.
--
Re:TMI (Score:1)
Actually standard population cycles have huge crashes where the population drops, often precipitously. Let's hope the analogy doesn't quite fit
However, more important is that it's not that more people won't be able to join the internet, it's that performace will degrade to unusable long before that.
A better analogy is probably traffic gridlock. With too many cars, nobody moves. Unfortunately, that can mean financial catastrophe as people start "giving up on the net" because it's just too slow or unreliable. As if e-commerce didn't have enough problems.
Re:Who do we blame? off-topic reply (Score:2)
Boss of nothin. Big deal.
Son, go get daddy's hard plastic eyes.
Re:Good. (Score:2)
Looking forward to hearing your developments!
Seriously, there was somone a year or two ago who made a vast leap in voice recognition by realizing that you need to vary the timing between firings. Now I haven't heard of any practical developments, patents, licenses, or products as a result, so it may have been bullshit, but... Given that so many years of neural net research apparently overlooked this simple variation of technique, and given that any application of this to routing technology would necessarily make use of asynchronous signals, someone like myself who has no real knowledge about neural nets at all can see that it's likely that a big chunk of the theoretical groundwork for such an application is still terra incognita. Which means that we could easily be looking at 5 years research time PLUS design, development, implementation, and deployment of an utterly new routing protocol, one which would have to speak natively to at least BGP, if not other routing protocls, and which could have mission-critical implications for every major backbone provider.
Good luck!
P.S. Don't forget to post those links when you find them!
Boss of nothin. Big deal.
Son, go get daddy's hard plastic eyes.
Re:Have a snickers. (Score:1)
Screw the banners...with broadband to the home, you can run your own server and put whatever you want on it, with the only size limit being what your hard drive can hold and without those stupid "punch the monkey" banner ads. If anything, personal pages have the potential to proliferate (say that three times quickly :-) ) to an even greater extent than before, and potentially with less meddling from The Powers That Be (assuming for a moment that they don't do something really stupid, like say that you can't host your own website on your cable-modem or DSL connection).
(FWIW, I've heard from people in other parts of the country with high-bandwidth connections that their usage of those connections is somewhat restricted. Maybe I'm lucky, as the provider I'm using [lvcm.com] doesn't seem to care much what I do with the fat pipe, as long as I don't resell bandwidth or provide warez/kiddie pr0n/etc. through whatever services I might make available. Besides, with 128 kbps upstream, it's only good for a personal site [dyndns.org] that sees maybe 10-20 hits on a good day.)
Good. (Score:1)
Re:Good. (Score:1)
Re:Good. (Score:1)
Re:Why do we need dynamic routes? (Score:1)
I asked why we need _heavily_ dynamic routes that build deep routing tables. Sounds to me like someone is abusing the tables. Or using multi-homes as pass-thrus.
Why do we need dynamic routes? (Score:2)
Is it because somebody wants 69.69.69.69 to be on one end of the Continent and 69.69.69.99 to be on the other? Why? I'd be sorely tempted to screw'em. Drop 69.69.69.99's packets on the floor if it's away from the rest of it's C class.
IP addr's aren't sacred. They should be chosen for the convenience of the routers -- that's the idea behind Class A, B & C arrd blocks. If AOL wants to use a US IP addr for *.de traffic, fine, just drop the packet in the US and let'em route it themselves.
When a system is taxed, somebody will suffer. It shouldn't be those who follow the rules. Otherwise, nobody will follow the rules and it will get much worse.
Re:Developing countries (Score:1)
Have a snickers. (Score:2)
No offense, but bullshit. Did the novelty of the Polaroid fade? Are the only people who have an interest in photography these days folks like Ansel and Maplethorpe? No! Now we have disposable cameras and sticky film.
Personal pages will be around as long as somebody's giving away free hosting in exchange for ad banners... Now if you want to debate the certain death of the ad banner, that's different.
"Smear'd with gumms of glutenous heat, I touch..." - Comus, John Milton
News Flash! (Score:1)
(Sorry, couldn't resist)
Re:Why do we need dynamic routes? (Score:1)
Read this very *intelligent* comment (Score:5)
Re:Internet != WWW (Score:2)
Re:Who do we blame? (Score:3)
And what commision is it that is planning to "delete spammers from the internet"? I hope they don't delete me.
Troll...........
clearly (Score:1)
again? (Score:1)
---
Re:The other side of the story. (Score:1)
The other side of the story. (Score:5)
"Half of the companies that are multihomed should have gotten better service from their providers," says Patrik Faltstrom, a Cisco engineer and co-chair of the IETF's Applications Area. "ISPs haven't done a good enough job explaining to their customers that they don't need to multihome."
Yeah sure, my provider told me how I didn't need to multi-home and I got burned. Excuse me for stamping on your elitism here, but everybody wants redundancy and you shouldn't have to be a fortune 500 to get it.
About a year and a half ago our company was looking into upgrading bandwidth, and since we already had a t1 my boss figured we could buy another t1 one from a different company than our normal bandwidth provider, thus achieving increased speed redundancy with a different isp at the same time.
Well I found out that in order to do something like that I needed to run BGP to get myself into the core routers routing table because I would have multiple paths to my network. I was a big concerned about this because it sounded drastic to me and I spoke with my tech rep at my current provider and we mutually agreed that perhaps it wasn't the best thing to do as we could get redundnacy from their network and I wouldn't need to have my own AS.
Well, to make a long story not quite as long, I got burned. They had some routing problems that affected both of my links at once, and we were down for a bit. I had to explain to the boss why I had made the decision I did and he wasn't real happy about it. I am about to be installing our 3rd t1 and switching to bgp so we can be multihomed.
This is a very typical story, and is the primary reason that the BGP4 tables are so huge. Every dotcom and their mom has been going through a similar scenario the past year or so. Now of course this is starting to not work very well so we are seeing some problems, and these same dotcoms are being blamed for this.
The problem isn't the dotcom's, its due to limitations in the current system. I suppose they (we) do shoulder some of the blame, but christ shouldn't we be allowed to have some kind redundancy? What is there some kind of special "VIP's only" sign in front of the redundancy bar? To hell with that. Obvously the current situation cannot continue, but I'll tell you right now that all of these dotcom's (and their moms) are not going to be giving up redundancy, so you core router guys better figure out why to let everyone in on the redundancy bandwagon.
Re:Routers need to upgrade their processors (Score:2)
I've worked with Extreme's switches. They're good. Simple, WICKED fast, and more cost-effective than Cisco.
My only beef is that if you want to use them as core routers, you've got to be running Ethernet. No ATM interfaces. No T1 interfaces, no DS3 intercaces, no OC3/12/96 interfaces. So you've still got to hang other vendors' boxes off the mess and you risk vendors fingerpointing when something chokes.
It's kind of a catch-22. Cisco's mature, but almost too much so, which all sorts of useless legacy equipment in their product line that they have to support and legacy code in the IOS kernel. Extreme needs to become more mature, I kind of feel their software needs some fleshing out yet and they need to add some components to their product line.
I love that crazy fast backplane on the BlackDiamonds, but for chrissake can't we do something about the purple and green color scheme?
-carl
Re:Routers need to upgrade their processors (Score:4)
Actually, I'm pretty sure that Cisco's 2500-series routers to have m68k processors. 68030, I believe. Everything never has a PowerPC variant. Dunno about Juniper, but I'm going to guess they're running a RISC processor of some sort.
The hardware issue was another factor covered by NANOG this morning in response to this article. The long and the short of is that throwing hardware at a problem might get you through the day, but good planning and forethought will bring you through a lot more cleanly.
With any router manufacturer, your value-added is never the hardware but rather the software (i.e. Cisco's IOS) and the service. Sure, you could grab a PII and run GNU Zebra for your BGP peering, but the CCO is a great resource to have when troubleshooting. Puts MS's TechNotes system to shame. It WORKS. Plus, working in downtown Chicago I know that if my 7200 takes a dive, Cisco's got a parts depot blocks away where I can get parts.
-carlRe:TMI (Score:2)
As one of the replies to your post pointed out, a lot of these jillion pages (the vast majority of homepages, anyway) are crap. Personal crap. Yes, they're sitting on a web that's supposed to be interconnected, but for these personal pages there's no need - they exist simply so their owners can tell a friend or relative, "hey, go check it out, it's got my dog's picture on it."
This majority of personal pages should be ignored by search engines simply because there is nothing to search for in them - typing "Cindy" into google when looking for your cousin's homepage wouldn't be much use no matter how many times google's been to her site.
---
Re:Good. (Score:2)
We're thrilled to see your enthusiasm, and we look forward to the results of your research and work in this field to help this endeavor get off the ground. Godspeed, sir.
---
Re:Internet != WWW (Score:2)
Well, I certainly don't think that NNTP is putting a strain on any routers...
TMI (Score:5)
Second of all, a greater concern might be "Is the Internet growing too disorganized?" There are ten jillion pages out there, and the vast majority of them aren't even linked to from other documents. They don't show up on search engines, they just sit there, with the web masters wondering why they've only gotten 3 visits in the past year.
Even the sites that can be found by search engines are getting increasingly hard to organize. Yahoo! [yahoo.com] is starting to wobble in their traditional high-quality, hand-picked links directory. They can't keep up with the net, so they've started implementing pay-for-listing programs. The Open Directory Project [dmoz.org] survives because of heaps and heaps of volunteer editors, but every category varies in qualities, and some basic categories don't even have editors. Many other search engines have attempted dynamically-created directories based on keywords, but these are easy to spam and often have very low-quality content.
All the disorganization also affects our information processing [jamesarcher.net] skills. We don't read like we used to. Hardcore web surfers are generally incapable of sitting down and enjoying a good book, because they're too accustomed to the "This page doesn't have it, go to the next one" cognitive paradigm.
What we really need is a new way to organize web sites [jamesarcher.net], perhaps based on a combination of client (most visited sites), server (author-specified categories), and parsed (most linked-to sites) information.
The internet is not growing too fast. Our ability to cope with it, however, is failing to grow with it.
Re:Who do we blame? (Score:3)
=\=\=\=\=\=\=\=\=\=\=\=\=\=\=\=\=\=\=\=\=
Numbering problems (Score:3)
The same is true of telephone numbers. Originally, the area code addressed an area, the exchange prefix addressed a specific switch, and switches didn't need much routing info. Today, two adjacent phones can have completely different area codes and exchange prefixes, and most phone calls involve a database lookup to get routing info for the call. The internal architecture of the phone system has changed completely in the last twenty years to make this possible.
The Internet is going through the same transition. The endpoint is probably IPv6, totally non-locative addresses, a lookup for every routing decision, and a hierarchical cache of a distrbiuted database system for the routing info, somewhat like DNS. But we're not there yet. The existing technology was designed for a network with a hierachical address structure, so that the routers only needed to track class A, B and C networks. Now they're expected to track more finely divided portions of the IP address space, requiring more router info. BGP is hard-pressed to keep up.
I looked at this problem once in the 1980s, and concluded that part of the solution was a strong separation between information about actual topology (what nodes and links actually exist) and network status (which nodes and links are up). The former changes more slowly than the latter, and contains more data. The link state info changes more rapidly, but the data volume per link is small. Such a separation helps you get a handle on the data volume.
It also makes the network more robust, because you can afford to do more checking on topology data. You'd like to verify that both ends of a link agree on a link before putting it into the topology, for example. That is, before anybody accepts a link between A and B, they need to see A saying it has a link to B and B saying it has a link to A, preferably with digital signatures. I was trying to devise a routing protocol for DoD that would resist attacks on the network in the form of bad routing data. But we didn't get the contract to build that, so I went on to other things. Whomever gets stuck with replacing BGP needs to solve that problem.
But I did this before mobile IP was an issue, and never had to deal with that very difficult problem.
Re:Jesus. (Score:5)
Ignore this shit. Every year, someone predicts the internet will "collapse under its own weight". Guess what? It NEVER DOES. People have been claiming the sky is falling since NSFnet became available to the public -- I'm still waiting.
I think you misspelled "Feel free to sit back on your lazy ass while somebody else designs and implements a fix - just like they always do". HTH. HAND.
Re:IPV6 (Score:5)
There is also some very interesting information regarding IPv6 in various sites, such as 6BONE [6bone.net]'s, and Sun [sun.com]'s. It is really great to poke around with IPv6 stuff, there are a lot of programs that support it by now, such as lynx (-dev tree only), w3m, BitchX, epic, etc. etc. etc. And also, IPv6 is cool because it lets you create such educational hosts like dead:beef:c0ff:eeca:bf00:3:133:7.
If you don't believe me, here is my sit1 interface:
You're tired of Slashdot ads? Get junkbuster [junkbusters.com] now!
Re:All you deregulation and commercialization!!!!! (Score:2)
Utilities such as: Gas, Electric, Water, Internet Access, should be GOVERNMENT regulated and provided. "
"
YES!! more socialism! while we're at it cars, computers, televisions, steak tar tar and beer should also be provided by the government.
"
I think the argument is infrastructure should be built and maintained by the government, otherwise you'd need multiple gas supplies to your house for competition. The idea is only one set of power lines needs to be built to your house, rather than one per electricity company.
Re:I actually had a solution for this (Score:2)
 
What about devices that change position. I suppose that a "rough" latitude would work for devices that don't move very far, but what about device on trucks, trains, airplanes, etc, that routinely cross continents? Would they have to get new IP addresses if they moved "too far"?
Jeff
Sounds Familiar (Score:2)
This Slashdot story reminds me of the restaurants nobody goes to because they are too crowded.
Re:TMI (Score:2)
I think it's called "XML". Define the data on a site so that it's easier to search. Of course, there are 101 reasons why this hasn't caught on on the client side yet...
Also, I can't imagine it's as bad as you say. Whenever I need something, I type it in Google. I'm amazed at how fast and accurate my results are. I almost always find what I'm looking for (no, not pr0n!). I'm sure there's a LOT of sites that I've never seen, but do I care? The relevant ones with good content seem to come up just fine. Yes, there's some serious room for improvement, but I wouldn't say that it's completley disorganized.
soft out (Score:4)
Yeap, seen this too many times to be funny: Network managers, when you make a change to the networks you advertise or your filters, use "clear ip bgp * soft out"! Without the soft out, all your routes get withdrawn and then re-added around a minute later, crating a mini route wave through the Internet. Instead of forcefully resetting your peers, soft out will just add to the table version without withdrawing routes. You could also use "soft in" for applying filters to incoming routes also BUT watch out for memory useage with this command. Soft out doesn't have this issue.
This is fairly basic Cisco IOS stuff but I've seen network admins from 2 of the top ISPs do this on peering point routers that were advertising a lot of routes to a lot of peers.
Re:numbers limited by AS numbers? (Score:2)
I can't be karma whoring - I've already hit 50!
Re:Making home-brew routers (Re:Cisco hardware...) (Score:2)
I can't be karma whoring - I've already hit 50!
Re:I actually had a solution for this (Score:2)
What about devices that change position. I suppose that a "rough" latitude would work for devices that don't move very far, but what about device on trucks, trains, airplanes, etc, that routinely cross continents? Would they have to get new IP addresses if they moved "too far"?
What he proposes is great, and makes sense. Its just like the phone system, with an area code and exchange.
I guess cell phones have to get a new phone number when they leave an area code? :)
The phone companies managed huge networks years before most of us were born, maybe we should take a lesson from them and quit being stuck up assholes.
-
At last (Score:2)
Then /. would have to switch off the lameness filter once and for all.
Bush Orders Rolling Blankouts (Score:5)
To avoid a complete meltdown of the Internet, President G.W. Bush has recommended that rolling blankouts begin within the next two months. During peak periods of Internet traffic, up to 100,000 sites may have their routing tables blanked for up to an hour in order to reduce the load on the system.
"I may not know much about the Internet, but I don't think you need a PhD to see what all this free music trading is doing to our nation supply of routing tables," Bush was quoted as saying. Asked if he was implying that Napster was responsible for the rolling blankouts, he replied "The RIAA says they are, so it must be true."
Re:All you deregulation and commercialization!!!!! (Score:2)
feel better now?
"DeRegulation and Commercialization of basic utilities was the dumbest idea ever invented.
"Okay what did it help? Not a blithering thing, okay so some jackass in idaho saved $2.95 on his gas bill, which of course is more important then the 14 BILLION dollar debt the California utilities are suffering. "
No, the dumbest idea ever was calling the removal wholesale cost restrictions and keeping consumer charges fixed, deregulation. Lets open the backend to market fluctation and not allow the front end to respond. hmmm that's smart.
By the way, that was Cali's deregulation and had nothing to do with Idaho, Washington, Arizona, Colorado or any other state. If you'r going to deregulate, do it right an open the whole thing to the market.
"De-Regulation was an idea pushed through by greedy assholes trying to convince you it was a good idea while they were planning to run with the profits even more then when they abused the government contracts. "
Uhh huh... Price fixing is a great way to promote greed. Let's charge the customer less then it costs us to provide a power and make a HUGE profit. Then we'll be Billions of dollars of debt and richer the Bill Gates.
"Utilities such as: Gas, Electric, Water, Internet Access, should be GOVERNMENT regulated and provided. "
YES!! more socialism! while we're at it cars, computers, televisions, steak tar tar and beer should also be provided by the government.
"Oh no not that evil government???? I'm sorry but some shit has to be done by the big guys, because they're the only ones not trying to make a buck in fact they loose money constantly."
Ha they don't need to make money, they just spend it and take more from you. So lets give this stuff to people for whom cost is no major impedment, and they still buy form the lowest bidder. Making a buck can be a good thing. It means you provided a good or service for less then people were willing to pay for it.
"Nobody in Cali is building a new Nuclear Plant or Spending billions on alternative energy resources research. "
Damn Right! and that's the problem. If they want the power they've got to generate it somehow. If They don't want a nuclear plant in thier backyard, maybe they can pay the folks in Idaho a few billion dollars to have it in their's. I'm sure the guy in Idaho wouldn't mind getting free power and a check every month from the residents of Cali for that reactor a few miles from his house. OF course maybe Sacremento will realize they can get in on some of that cash down in silicon valley if they are willing to build a reactor or two an d charge a market rate to the folks in the Bay Area.
"Think about shit before you blindly go saying ..."
No comment... :)
"Also why can't we get Clinton back? I don't care who sucks his dick just that he doesn't f up my economy like bush or gore will)"
Well a constitutional Amendment for one thing. Durring who's adminstration did this start? So we see his results, but we'll make Bush or Gore guilty even before they can commit the crime, good.
This reminds me of something I read once...
Who is John Galt?
Re:Well... (Score:2)
Well... (Score:4)
Yahoo is long useless (Score:2)
Google, on the other hand, encourages success from sites that are good, rather than sites that are well-financed. Being well-financed will always help, but Google ultimately places the most weight on sites that get referenced frequently, instead of sites that can afford to take out a $600 yellow page ad. That is the sort of new innovation in web organization that I think will have a big impact on how we find information in the future.
-Keslin [keslin.com], the naked nerd girl
Re:Who do we blame? (Score:3)
Oh great... back to ascii porn
Free^H^H^H^HSpeed Net (Score:2)
don't miss this opportunity (Score:3)
--------------------------------
Re:Jesus. (Score:2)
Yes, the people that are paid to engineer the Internet will solve the technical issue, and as always the gloomy predictions ala Metcalfe, will probably be proved wrong.
Remember when the backbones were 56 Kbps (before 1988) and it was unthinkable to some people it won't collapse? Remember the T1 backbones until 1991, when Internet was doomed to be charged by volume?
Nowadays I have 1-5 Mbps download connection to major sites. Bandwidth is no longer a big issue? Now predictions are about explosions/wild changes of route tables (to be fair, this has been started a long time ago, along with with IPv4 unconceivably too small address space).
Re:Load shifting (Score:2)
Routing uses the process of receiving a packet and checking its destination. Using a table lookup based on the destination, it finds the the neighboring router it should forward the packet to. The table is updated so that routing can find 'the shortest path.' The real question here is how 'shortest' or distance is defined.
Your method of configuring geographic location on routers is basically trying to get the router to calculate its distance to its neighbors. However, you're thinking about geographic distance rather than logical topology which is the 'road map' that routers can travel on. There are two direct problems that stem from your method:
1. Pipe size (bandwidth) is not accounted for. If there exists two paths to the destination, should I take the 'geographically' shorter path that is connected by a 56K line, or a slightly longer path that consists of several OC3's?
2. Hop count is not weighed. With two paths, the geographically shorter path may travel through 20 routers, where a longer path may hop through 5 routers--how do you determine the tradeoffs?
Most importantly, routers currently have a mechanism to address this routing issue by allowing users to define the distance between routers. I believe this is usually set to reflect bandwidth size (ie. usually people define their OC3's to be shorter than their T1's). This is generally easier for network managers to adjust their link distances than to tweak their lat/lon coordinates.
Most of the problems with congestion I've seen is due to capacity problems--where there may be two different paths to a destination, but one path is over-utilized and another is under-utilized. Currently, routers are very limited in their load-balancing techniques. I believe Cisco routers can balance up to 6 equal paths--but configuring multiple 'equal' paths is not easy for a meshed network (equal as in defined distance). Without equal paths, routers generally send their packets down the 'shortest' path, regardless of congestion. Routers are not intelligent enough to recognize congestion and calculate the 'next shortest path' (though 'next-shortest' paths are done when there is a link failure). Without this type of mechanism, if you were to get the router to use the 'path of least resistence,' it would just shift the congestion from the previous route to your newly defined route. Currently, the MPLS initiative is trying to address this capacity issue.