Catch up on stories from the past week (and beyond) at the Slashdot story archive

 


Forgot your password?
Close
typodupeerror
×
The Internet

87M Hosts on the Internet? 69

Posted by CmdrTaco from the is-anybody-out-there?--is-anybody-listening? dept.
NTT writes "The Telcordia Internet Sizer provides daily updates on the size of the Internet. The Telcordia solution to quantifying Internet growth statistics is based on an internally developed unique sampling method. In this approach, over 150,000 randomly generated IP addresses are sampled on a daily basis and checked for their existence. Check out the other stats they have here"
This discussion has been archived. No new comments can be posted.

87M Hosts on the Internet? More

87M Hosts on the Internet?

Comments Filter:
  • not sure, but if you wrote a script or a piece of software that could, I'm sure you could find some sucker to buy it so they could claim to have mapped IP addresses
  • In my own world, twisted as it may be, has a keen fascination with the word "starfish". I have come to discover that starfish's look like anuses. So let us do an experiment. I'm going to replace everytime you say starfish with the word anus. Let's take a look at the insuing hilarity, shall we?:

    Just like anus: big, brown, and hairy. Cut it and you just eventually end up with more anuses. Each operates in its own little anus world not really worrying what the other anus is doing. Ejaculation (eventually) reroute around dead anuses. Only in the old DARPANET days could one logically speak of a central anus.

    Love,

    Bongo
    Inventor of Anal Penetration
  • Correct. Especially if you're on a shoddy dialup like me, and become a part of the 'net only to disconnect, constantly, over and over again! :)

  • I would be willing to bet that we will need a major upgrade of the backbone in the next 3-7 years.

    I have to disagree with that. The bandwidth is always being added. The bandwidth of the internet may lag behind what is needed by a bit; but it is maintaining a steady pace with bandwidth growth. New pipes are added every day.

    If there is an overhaul, it may need to be at major peering points. Not so much upgrades as much as new ones.
  • How do they account for IPs not evenly distributed? Say some countries have used more of their IPs than others.

    What about many computers with the same IP, or many IPs pointing to the same computer?


    ---

  • Re:Named hosts only... (Score:3)

    by BridgeBum ( 11413 ) on Wednesday August 02, 2000 @02:02PM (#884315)
    There are many instances where internal hosts (that is, those behind a firewall) have real registered address space addresses. RFC 1918 addresses are nice, but not even close to every company uses them, even for their internal network.

    Also, this test doesn't really consider network address translated addresses with public DNS entries. For example, suppose I have an address for www.mydomain.com with my own authoratative domain server. The address is, say, 172.16.1.1 and anyone can connect to it. However, I actually have my firewall round robin the requests for that address to my web farm of 10 machines, 192.168.1.1-10, none of which are in external DNS. The survey would only catch one address, which actually has *no* machine directly associated with it. DNS is a reasonable measure of the size of the internet, but it is hardly an authoritative one.

    This isn't even counting DMZ machines (those external to firewalls) that are connected to the internet "directly", but don't have a DNS entry. Why would you want a machine like that? Well, how about IP addresses on routers? Would you want those in DNS? How about intrusion detection servers, which monitor incoming traffic for attempted break ins. You really want to make yourself publicly known, making it easier for script kiddies to find you?

    A better test would be an aggragate test of DNS reverse resolution, ping & traceroute. I'm sure that there are many machines out there that are open to some of these but not all three.
  • The most common sites I can think of that are open all of the time without firewalls are porn sites, therefore...
  • According to this netsizer site there are 18.2m users of the internet in the UK (click the java world map, then go to europe).

    However, a recent consumer association (I think) survey reported that 40% of UK households now have internet access. That would make about 25m and then you need to include the number of people that have access at work etc..

    Whilst the method they use may return a acurate(ish) report on the number of hosts on the internet, I can't see how they have extrapolated the number of users.

    In a recent survey, 45% of those surveyed admited that they lied in surveys.

  • Appearing tomorrow:

    Immediately following posting on slashdot.org of the statistic of
    approximately 87 million hosts being connected to the internet, the
    statistics increased jumped to 186 trillion hosts. "How in the hell is
    this possible," one spokesman was quoted as saying, "There aren't that
    many people on this whole damn planet, and Hell! There can't be _THAT_
    many addresses under IPv4!"
    Logs indicate connections above and beyond the standard 255.255.255.255
    range, showing such IP addresses as 1.4m.3l337.b147ch and 666.666.666.666.
    Federal officers have been subsequently summoned to investigate whether or
    not this is actualy a function of a new Distributed Denial of Service
    [DDoS] such as the one that struck Yahoo! and other major sites recently.
    This phenomenon is being classed as a new variant of well-known Trinoo and
    TFN, labelled curiously "Slashdot Effect".
  • The error induced by the sample size is overcome by the error in the sampling methodology.

    They presume reverse DNS implies IP address usage. This is not correct, of course. There are many machines that don't reverse lookup. Also, there are many IP addresses that reverse lookup and aren't there. The most glaring data is to look at Lucent in their enterprise list [netsizer.com] Apparently, Lucent has 48 machines for each employee. Lucent will successfully reverse DNS every IP that they are asked about, into something like h135-1-1-1.outland.lucent.com. Splitrock.net apparently has a similar scheme, although the naming method is a little more opaque.

    When your estimate is 87 million, of which 8.3 million of your count are highly suspect, it's not the 3 per cent sampling error that you should be concerned about.

  • 87 million hosts with which to unleash DDoS'es upon our beloved ethical enemies. (heyhey! doubleclick.com =)
  • Now THAT is a whole lotta pink and brown cylinders and hemispheres!!

  • The Ping heard 'round the world!
  • Mine just dials my usual selection of ISPs. As it happens one of them is a fixed IP dialup (demon internet since the have mobile phone access numbers for very fast conencting) and what I was pinging was definitely my phone since the ping time was about 900ms from a cable modem and when i hung the phone up the responses stopped.

    Since my freephone ISP (lineone)are stopping access soon i'll have to start paying for access again soon :( Does anyone else know any particularly Wap friendly 0800 isps in the uk?
  • should we count google's 6000 clustered linux servers? They don't have public ip addresses, and I'd say we should.
  • Sure, as long as you can talk the people who aren't using all of their class A's and class B's into loaning you a couple addresses.

    Besides, if you assume it doubles every one and a half years, I'd say you've got maybe 8 more years. Not 20.
  • I'm always curious as to why people are interested in the size of the internet. As long as it works, and people think it's running nicely, does it really matter?

    I'm guessing you're not a network administrator.
    It works because the infrastructure can support all the traffic that's currently on it. If your infrastructure is build to support 10 billion hosts, and your survey reveals you have 10 million active hosts, you can relax.

    On the other hand, if it reveals you have 900 million hosts, and you only had 500 millon two weeks ago, you're in trouble and you need to get some new hardware, fast.

    So aside from a general curiosity as to how many people out there want to download my mp3's, there's a legitimate reason for the 'net community to be interested and even concerned by the size and growth rate of the Internet.
  • Verio isn't listed at all under ISPs with the most hosts, and yet Verio's PR says it's the world's largest business webhosting provider? Or am I missing something, here?

    ---
    click a button, feed a hungry person!

  • I did a "measure-the-internet" script a long time ago.

    I generated random IP addresses then tested to see if there was a webserver running; From what I remember ~25% of machines had a server running..


    Steve
    ---

  • Does it matter? (Score:3)

    by DrWiggy ( 143807 ) on Wednesday August 02, 2000 @12:18PM (#884329)
    I'm always curious as to why people are interested in the size of the internet. As long as it works, and people think it's running nicely, does it really matter? I can't see any competitors to the internet for various institutions to be battling down, so I'm assuming that these reports are issued as nothing more than a cheap way to get some hits on reporter's website and to raise their meagre profile a little.

    But then, I've always been cynical like that. ;-)

    Thoughts?

  • This only measures how many hosts are listed within DNS, not the total number of machines on the internet. It doesn't measure IPs used by dialups, machines behind firewalls, IP masquaraded machines, etc. In other words, there are more than 87 million computers on the internet, quite a few more I would guess. In fact, I would say that the exact number is almost impossible to figure out.

    I doubt that machines using IPs reserved for local networks (machines that therefore never can be reached directly from the Internet) really should be counted as "hosts on the internet"... (this is the case with masqueraded machines, etc)


    --
  • Now that this survey has shown us how deep the penetration of the Internet is, let's figure out the stats for the real meaning of the net: PORNO!!!!!

    Assuming that each host were to have 10 megs of original, non duplicate pr0n online (yes I know thats a very very low estimate), with 87 million hosts out there, that would mean that there 830 terrabytes of luscious luscious pr0n out for your downloading pleasure! Excuse me while I check out the newsgroups...


    "The most fortunate of persons is he who has the most means to satisfy his vagaries."
  • Hell, that means we can put off IPv6 for another 20 years or so, right? :)

    We'd better. If we start using IPv6 now, we'll put them out of business!

    "OK, only 26 billion more IP addresses to go..."

  • Especially interesting is how hosts are added 87 per minute, every minute. Someone needs to teach netsizer about significant digits...
  • I wonder if they take into account which netblocks have been issued [arin.net] by regional registries like ARIN [arin.net]
  • Please tell me they're not assuming equal distribution across the IP address range.

    With all the mostly unused but allocated Class As and Class Bs that were given out long before we ever knew how popular the net was going to be, firewalls, masquerading, dynamic IPs and God knows what else, how good can sampling be on this network?

    --

  • A general rule of thumb for errors in counting in a sample is sqrt(n).

    Err...If I remember correctly from my stats class the general rule for margin of error is actually 1/sqrt(n). Common sense says that as the sample size increases, the margin of error should decrease, so sqrt(n) doesn't seem right.

    (IIRC, this is because we are sampling from binomial distribution (either an IP exists or it doesn't), where the margin of error in the normal approximation is given by z_star*sqrt(p_hat*(1-p_hat))/sqrt(n). Using z_star~2 for 95% confidence and p_hat=.5 in the worst case, this reduces to 1/sqrt(n)).

    Anyway, a sample size of 150,000 is incredibly good, and I think margin of error will be so small that it's not worth calculating (yes I'm lazy). So a better statistical question is whether the IP addresses tested were a random sample of all possible IP addresses? (For example, I know that some addresses are reserved and may not be used, so it would be a mistake to sample such addresses.)

    Comments/corrections are appreciated.

    Wil

  • ipchains -P input DENY to be contiunued... long live IP address surveys.

    This is a good point. If they do a scan at an IP address and none of the priviledged ports are responding (accepting connections or indicating that they're closed), the best you can do is assume that there's no computer there. Right?

    How will this have skewed the results?

  • Does this measure all IP's, or just addresses in DNS or what? If its all IPs then that means theres only 87000000 out of a possible 256^4=4294967296 which means we are only using 2% of the possible address space. So why all the noise about IPv6?
  • Every host, router ,web server,dns server,ftp server and every computer connected to the internet needs an IP. There are ways to share an IP but I have to think that of all the host on the internet more than 98% are just grandmothers browsing the web, that leaves a smaller and smaller amount for every one else. The crunch is on, just try to get your ISP to give you a static IP or your own block without some explaning.
  • If I remember correctly from my stats class the general rule for margin of error is actually 1/sqrt(n). Common sense says that as the sample size increases, the margin of error should decrease, so sqrt(n) doesn't seem right.

    1/sqrt(n) gives you the margin of error as a percentage, to figure out the number of IP addresses which this accounts for, the calculation is 1/sqrt(n) * n which becomes sqrt(n) which is what he was talking about.

    Anyway, a sample size of 150,000 is incredibly good, and I think margin of error will be so small that it's not worth calculating

    It's 0.258%

  • More importantly, (Score:1)

    by Anonymous Coward
    20% of them are at FSU.

  • Only 87 Million? (Score:3)

    by Rombuu ( 22914 ) on Wednesday August 02, 2000 @12:07PM (#884342)
    Hell, that means we can put off IPv6 for another 20 years or so, right? :)
  • I thought "...the backbone is going to collapse any day now..." FUD was behind us now.
  • With how fast the net's expanding will it's backbone be able to handle the traffic in the coming years?
  • note these are hosts, not individual IP addresses..... I wonder what would happen if someone when right through from start to finish how many IP addresses they would find active at any random time???

    Yhcrana

  • How the hell can it grow? (Score:4)

    by Red Moose ( 31712 ) on Wednesday August 02, 2000 @12:10PM (#884346)
    My sister says she has the internet on her iMac, which has only got a 6 gig HD, so how the hell could it be growing if she's never upgraded?
  • How many are serious hosts and not someone running a server off of their pc?
  • I would be willing to bet that we will need a major upgrade of the backbone in the next 3-7 years. Simply because of the growth of the broadband market and the fact that the internet is catering itself to that market. I mean imagine the volume of network traffic that /. produces simply through raw text and then imagine a site like Joe Cartoon [joecartoon.com] or Shockwave.com [shockwave.com] might produce through their flash and other multimedia products being transported across the net.

    Yhcrana

  • What about those ignorant Website Administrators
    that filter out ICMP completely (because there are many evil attacks that use ICMP ;) and dont't know what consequences it will have ?
    (besides on not counting them ;)
    Samba Information HQ
  • Well, we've all been waiting with baited breath for months for the number to hit that magic 87, and now it's done it, and Slashdot was the first to let us know. Rock on!

    sig:

  • I have a site with a 7 IP block ... only the gateway IP address is accessible by pinging, etc.

    Doing a full service scan of them might reveal something, but that would be dangerous considering the number of people who take a dim view of being probed.
  • I've whiled away many a dreary evening by trying to make a guess at the amount of data available on the Web. Once upon a time I thought there were no more than maybe a couple of terabytes out there. NOw I know that this is wrong by several orders of magnitude. I'm starting to think that we're on the order of tens of petabytes here- maybe more. The *useful* information is of course a tiny fraction of that.

    The difficulty I think is that I have no concept of size above about a megabyte. It just loses all meaning, and becomes purely "big". The same applies to the count of the hosts on the net, or the number of people reading this. It means nothing more than a number to me...
  • You don't need to be running a "server" off of your pc in order to be an internet host. You just need to be a "computer" on the internet. Hell, you don't even need to be a computer. In my senior year, I developed software and hardware to put a coffee machine on the web.

    All's you need is an IP address and a TCP/IP stack (oh, and since they probably check for the existence of hosts using ICMP messages, you might want to have your host reply to ping requests in order to become part of this statistic).
  • Hey - how could she have the Internet on her hard drive? The AOL commercials said it was MY Internet! I know, because I have the Internet right here on my computer. Your sister is a dirty liar!

    - Joe

  • A general rule of thumb for errors in counting in a sample is sqrt(n). So if they sample 150,000 the error is around +/-400 but of course, they then scale this up to apply to the internet with its' ~2^30 (usable) ip addresses. So they're scaling by a factor of ~7200 so their error is of the order of 7200*400 or nearly 3 million.

    It's something to be borne in mind when you see polls on TV. Frequently the sample is so small that any lead one party has is lost in statistical noise. Say in a poll of 400 people, you have a statistical error of 20 or in other words, 1 in 20 or 5%. Thus if for example, in suchg a small sampled poll, Bush leads Gore by 8%, with a 5% error on each candidate's poopularity or 10% overall, it's statistically insignificant and doesn't show a thing.

    Rich

  • I'd say that it is kind of like taking the census. People want to know the size of the internet in the same way that they want to know the size of the population. I'm just waiting until they try to figure out everyone's age/sex/race. Now THAT will be fun.
  • If they sample randomly, then it's not terribly important how it's distributed. Of course you can never really sample truly randomly, but you can get pretty close.

  • Re:Accuracy? (Score:1)

    by Anonymous Coward
    How do they account for IPs not evenly distributed? Say some countries have used more of their IPs than others.

    Think about for a second. If they take a random sample it doesn't matter if IPs are not evenly distributed. Simple statistics. Now say Do'h.

  • Moore's Law? (Score:1)

    by Anonymous Coward
    Interestingly, the number of hosts seems to be doubling every 18 months. Cooincidence?
  • These behave very strangely. The TCP/IP stack on my nokia 7110 does respond to pings (although i'd hazard a guess that not all models do. It does produce very odd results in nmap - which kicks up dozens of errors about unrecognised responses.

    Remember that nokia expect there to be a worldwide market for 500 million wap enabled phones!? that'll eat into the ip space.
  • Or multiplied by 2^30, about 3 million ;)

    Rich

  • Because of the way they work...

    Phone -> Gateway -> Wapsite

    ...with most providers using their own gateway, generally the phones are allocated IP's in the private address space.

    This does make some sense, since a random probe (you know, you get them all the time on any machine that's been connected for longer than 10 minutes) could upset this little (generally buggy) device. An nmap scan is enough to crash some of the early 7110's (which btw have had a lot of stack problems so don't be suprised about different ping replies between different firmware versions). Even with the always-on GPRS, it's likely some kind of cut-down and reshaped DHCP will be used, since even though the phones can stay on-line all the time a lot of people don't leave them switched on all the time... :) silly really, I have about 3 weeks uptime on my Motorola Timeport :)

  • OK, I don't know any Latin, but wouldn't it be 'anii'?

  • I`m still waiting for 3d porn. You know, with polygons. Like to see intelligent search engines look for `flesh-tones` or whatever in jpgs.
  • Anybody know what the margin for error with this thing is? I mean, with the millions of possibilities for IP addresses, how accurate can a "random sampling" of 150,000 IP addresses?

    Just curious, 'cause I couldn't find an exact number that they published on the site...
  • ipchains -P input DENY
    to be contiunued...
    long live IP address surveys.
    That is besides all poor souls writing lame messages on Slashdot from a MASQed machine.
  • Maybe this would be a cool way to store fingerprints for ATM terminals or something. Has anyone ever considered ASCII?

  • Named hosts only... (Score:3)

    by fremen ( 33537 ) on Wednesday August 02, 2000 @12:13PM (#884368)
    This only measures how many hosts are listed within DNS, not the total number of machines on the internet. It doesn't measure IPs used by dialups, machines behind firewalls, IP masquaraded machines, etc. In other words, there are more than 87 million computers on the internet, quite a few more I would guess. In fact, I would say that the exact number is almost impossible to figure out.
  • a PC can serve web pages as well as AOL's wierd proprietary Stratus machines

    You don't know the first thing about high-traffic web serving, do you?

  • note these are hosts, not individual IP addresses

    Umm, false. From here: [telcordia.com]

    The Telcordia solution to quantifying Internet growth statistics is based on an internally developed unique sampling method. In this approach, over 150,000 randomly generated IP addresses are sampled on a daily basis and checked for their existence.

    I haven't checked http://www.argreenhouse.com/netsizer [argreenhouse.com] ('cause it seems to be taking just forever to load), but they appear to be generating random quads and seeing if they exist, and running statistics against their findings over time.
  • Now I know why she was complaining earlier when she tried to connect and it wouldn't. First I am going to sue you for the theft of the internet. Then I am going to sue AOL for trying to sell a product they no longer owned.
  • Well, I had an HP48 calculator pingable once :-)

    I always look at these kinds of stats with extreme prejudice. Just exactly how do they determine if a host is alive, where it is, how many IPs are on the same physical machine, etc? "Ping" is a VERY bad way to locate devices. It has the lowest possible priority (read: NONE) and in fact is ignored/filtered at most sites.

    As for location... With the increasing use of non-IP transports for IP (read: ATM and SONET), it's even more impossible to guess where something is. Looking at the traceroute to one of my machines, one might think it's in CLT -- that's just the last place it was IP along the ATM path to the IDSL router 200miles away. (Heck, ALL of Interpath's dialup -- three entire states -- looks like the machines are at RDU.)
  • what if a machine wasn't up when it was checked... could there be a lot of machines that just arn't connected all the time?
  • Then I am going to sue AOL for trying to sell a product they no longer owned.

    But AOL is a major corporation; surely they wouldn't do anything wrong like that!

    - Joe

  • Uh..if the internet is on your sister's Mac, then why is it full of pictures of naked women?? Uh..never mind.
  • I have to wonder if all of this hype about the ever-growing size of the internet is just blind optimism. Growth doesn't seem to have brought very much of any good. For every Slashdot or Linux kernel there's a thousand new pr0n or warez sites, a thousand badly designed web pages...

    Corporations patenting obvious ideas left and right to try to gain some control over the network. So-called "intellectual property concerns" become dominant features in internet policy making. Commercialism seems more dominant than community. What happened to it all? Is there any hope for a populist revival to restore more of the old community feel?
  • 150,000 randomly generated IP addresses are sampled on a daily basis and checked for their existence

    My firewall hides (NATs) blocks of hundreds of IPs, and no 'check' will confirm their existence or non-existence.

  • From the nmap man page:

    "-iR This option tells Nmap to generate its own hosts to scan by simply picking random numbers :). It will never end. This can be useful for statistical sampling of the Internet to estimate various things.
    If you are ever really bored, try
    nmap -sS -iR -p 80
    to find some web servers to look at."

    The only difference is that most normal people aren't bored enough to keep going after the 500th or so 403 Forbidden error.

    And 'mid this tumult Kubla heard from far
    Ancestral voices prophesying war!

Slashdot Top Deals

How come financial advisors never seem to be as wealthy as they claim they'll make you?

Close