Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror
×
The Internet Software

Detecting Patterns in Complex Social Networks 167

Roland Piquepaille writes "So-called social networking is very popular these days, as show the proliferation of services like Friendster, Orkut and dozens of others. But do the companies behind these services have any idea of what is hidden inside their complicated networks? When these networks reach a size of millions of users, it's not an easy task. A researcher at the University of Michigan is trying to help, with a new method for uncovering patterns in complicated networks, from football conferences to food webs. This overview contains more details and references about this non-traditional method. It also includes a spectacular representation of the Internet and another image showing a food web at Little Rock Lake."
This discussion has been archived. No new comments can be posted.

Detecting Patterns in Complex Social Networks

Comments Filter:
  • by joeldg ( 518249 ) on Monday February 16, 2004 @02:31PM (#8296001) Homepage
    In this image..
    http://www-personal.umich.edu/~mejn/netwo rks/schoo l.gif

    The little single dots on the left..
    you have to feel bad for them..

    and all the "fringe" people.. they are visibly shown on the fringe..

    kind of interesting..
  • by DecimalThree ( 524862 ) on Monday February 16, 2004 @02:35PM (#8296041)
    We see and understand patterns based on the amount of data we can digest (which has gone much further with computers). Knowing that you could always be one data set off defining a pattern makes you wonder if chaos exists at all, hence the replacement of words like chaos with words like "complex".
  • denominator (Score:4, Interesting)

    by rodentia ( 102779 ) on Monday February 16, 2004 @02:39PM (#8296088)

    The denominator in these equations should be the peer pressure quotient: the desire of most people to be like most other people.
  • by torpor ( 458 ) <ibisum.gmail@com> on Monday February 16, 2004 @02:41PM (#8296117) Homepage Journal
    The uses for this software are astounding. It is, essentially, a breed of software designed to recognize and manipulate social class systems.

    Imagine a system which tells you, easily enough, who the 'most popular person for subject ___Y___' is, in your neighborhood? Target a campaign of computer-buying to only -3- folks in an area, and end up blanketing the entire region with tuber-like memes...

    PR agencies could use this data to identify the core 'gossip leaders', the ones who have massive impact on multiple peers, and then they could target only those people with their campaigns ... imagine that ... a means of actually targetting campaigns and capers directly to the primary delivery mechanisms of word of mouth among a large group. This software can give you that.

    There are numerous religious theories, also, on the strengths of individuals and groups and the effect that these social connections have on a movement ... put this in the hands of the right (wrong?) people, and we could see social revolutions targetted and executed with such blinding accuracy and predictability that most of us simply won't know what hit us ...

    This is the danger zone. The moment we start using computers to do qualitative analysis of social dynamics, and then using the data for commercial/religious/nefarious purposes, well ... maybe its time to unplug.

  • Re:Slashdot?..... (Score:5, Interesting)

    by kfg ( 145172 ) on Monday February 16, 2004 @02:43PM (#8296139)
    On the other hand, if one is interested in science. . .

    I'd be more interested in seeing the data that gets deleted, not the clumps. This isn't to say that the clumps aren't important, especially if you're trying to rebuild oyster populations in the Chesepeake or some such, but plenty of people will be focusing on those. People have an attraction to like objects and group mechanism.

    I have an attraction to the exceptions. That's where the really interesting scientific stuff is likely to be happening, and where the Nobels are most likely to be hiding.

    Why is this star off the main sequence? How did it get there, what makes it tick? What relevance might that have to stars that are on the main sequence?

    KFG
  • Phone Book Network (Score:5, Interesting)

    by dimss ( 457848 ) on Monday February 16, 2004 @02:44PM (#8296149) Homepage
    I have an idea. Phone books of mobile phones form another kind of network. Imagine, A has number of B in his/her phone book. B has number of C. E knows both A and B. Chances are, most of GSM users in Latvia are nodes of this network. But this network can be fragmented as well. I think we could study interesting things about society this way.

    We have 7-digit phone numbers and two mobile networks here in Latvia. Data can be stored this way:

    6787026 -> 9131415
    9131415 -> 5956564
    etc...

    All we need is one hashtable (or MySQL table) and data collection interface :)
  • by PureFiction ( 10256 ) on Monday February 16, 2004 @02:47PM (#8296181)
    The problem is more complicated, and you touch on one of the main weaknesses of any system where reputation and feedback in involved.

    One aspect of the problem is the granularity by which relationships are defined. In many of the sites there is only one state: "friend or non friend". The real world encompases a number of shades and types, from business acquaintance to personal friend, intimate lover, etc.

    Another aspect is the incentive to "game" these systems by increasing your friend count. This inevitably leads people loosening their interpretation such that they increase their visibile friend count. If the number if friends you were linked to was not public, there would be less of this (but you can't do that without breaking some of the functionality of the sites)

    People have talked about "winning" at friendster or tribe or orkut - but there is no "winning" in these systems, as there should not be competition.

    Last, there is no method for verification of any status between peers. Can you "prove" that so and so is really a friend?

    There are others, but these are the main three, and not likely to be solved or addressed any time soon.
  • by G4from128k ( 686170 ) on Monday February 16, 2004 @02:51PM (#8296231)
    Large scale networks have limitations because real relationships are complex. The notion of A-is-a-friend-of-B or A-trusts-B is too simplistic for large scale networks. These connectivity relationships are not transitive in real-life (A-trusts-B & B-trusts-C does not imply A-trusts-C)

    Rather, the network needs some form of role-based assertion or qualification of the relationship. I know friends that I like to go hiking with, but that I disagree with politically. I know people that I do trust to recommend software, but don't trust to recommend a restaurant. And if I trust person B to recommend software, I would probably only trust that person B to recommend another person C in a limited set of domains (like software or technical issues). Thus the real relationship is more like person-A-trusts-person-B-for-role-C.

    Such a scheme of role-defined relationships could be self-organizing or predefined. The self-organizing approach would look for disjoint clusters of members in a network or use semantic analysis of the messages passed between people to infer a set of role-clusters. Predefined relationship might be OK, but could become unwieldly if the network creators force people to answer a long multiple-choice test about every relationship.
  • Re:Slashdot?..... (Score:5, Interesting)

    by BWJones ( 18351 ) * on Monday February 16, 2004 @02:51PM (#8296232) Homepage Journal
    I'd be more interested in seeing the data that gets deleted, not the clumps.

    Following data clumping, it's really the interactions or the nexus of contact that is interesting. For instance, from a computer science or informational processing perspective, what draws someone to a piece of information? How does one direct information to be most useful? In biological systems, the nexus points are where life happens. For instance, the small molecular fluxes that are constantly providing for molecular signaling, protein synthesis etc.... Information is not lost per se, rather there are information fluxes.

    So, to answer your question of stars, it could simply be that a particular star is off the main sequence because of earlier smaller phenomenon that resulted in its appearance much later off the main sequence. Alterations in gravity? Interactions with a binary star? Alterations of proton-proton chains?

  • by Short Circuit ( 52384 ) <mikemol@gmail.com> on Monday February 16, 2004 @02:55PM (#8296265) Homepage Journal
    Well, on Slashdot, I get fans because people see and like what I post. (Except for one guy, I think he's just trying to max out his friends list.) I set friends based on whether I like and appreciate what they say, and would like to be reminded that I have them set as "friends" whenever they say something I don't necessarily agree with. It helps me consider other points of view.

    Granted, its a set of small steps towards understanding the opposing point of view, but it does help broaden my horizons.

    It's actually a very useful system.
  • by S3D ( 745318 ) on Monday February 16, 2004 @02:56PM (#8296280)
    There are a lot of work going in this direction now. For example here is an article about mapping weblog communities. Abstract: "Websites of a particular class form increasingly complex networks, and new tools are needed to map and understand them. A way of visualizing this complex network is by mapping it. A map highlights which members of the community have similar interests, and reveals the underlying social network. In this paper, we will map a network of websites using Kohonen's self-organizing map (SOM), a neural-net like method generally used for clustering and visualization of complex data sets. The set of websites considered has been the Blogalia weblog hosting site (based at this http URL), a thriving community of around 200 members, created in January 2002. In this paper we show how SOM discovers interesting community features, its relation with other community-discovering algorithms, and the way it highlights the set of communities formed over the network"
  • Conceptual Clumps (Score:5, Interesting)

    by _ph1ux_ ( 216706 ) on Monday February 16, 2004 @03:01PM (#8296318)
    I have been thinking about concept clumps - kind of similar to social clumps and cluster - but relating things that are based around similar ideas of information that they are trying to convey.

    Similar in the way that grokker clumps navigable areas together, it would be interesting to instead clump things together based on the relations of the meaning of the information they contain.

    For example, lets say that you are reading an article on any given site. You would be able to highlight a phrase, a word or a sentance, then look that term up in context. This is different than simply googling the term in that you are looking for the context of the term as opposed to a concrete definition.

    so if you were reading an article regarding the legal take over of a company by intel, you would be able to easily search for articles writen that involve intel in any other litigation, with results containing intel involved in purchases or sales of companies and their technologies coming to the top of the list...

    obviously there is a lot more in this required to accomplish it - so Ill just stop here before giving it all away.

    The main point being that this type of searching is easily applicable to understanding relationships in social networks as far as identifying how common intrests are shared.

    The clustering of attractions and dislikes to profile trends and personalities in any given demographic are made especially easy in systems such as friendster and orkut. By having people OPT-IN to the deepest marketing database available and provide you with all the details of not only the things they like (under the guise of sharing yourself with the others in the community) AND showing you what other people they are connected with who share common interests is one of the biggest social hijacks ever.

    Just when you thought marketing was a dead science that is too transparent to have any real impact, social networks arise to provide marketing data on an astounding level.

    [don tin foil hat]

    Just wait till they are able to correlate all this info with DNA profiles :)

    Not that this is bad per se, but it is a fact taht this info will be the next gold standard in market research where marketing will move to a social promotion system.

    I think that the goal here is the promotion of product will largely come from people advertising their likes of a product through their profiles and communications with friends online.

    It will be very easy for a group of people to communicate things (it already is) that are of interest to their social networks. Like on person telling the other 65,000 friends they have how they jsut experienced product Y, and that everyone should try it....

    interstingly, will we see fakesters made specifically to spam the other friends with testimonial like adverts for products they are trying to introduce to a specific demographic?
  • Where's the beef? (Score:4, Interesting)

    by Effugas ( 2378 ) on Monday February 16, 2004 @03:07PM (#8296365) Homepage
    I'm sure there's something really cool these guys are doing, but there is a very strong distinction between Big F*cking Huge Graphs (like we see a bunch of in the links) and Big F*cking Graph Analysis using some new technique, which isn't really clearly anywhere in there.

    I've been singing the praises of LGL [utexas.edu] as of late, pushing it into the Opte project (mass internet viz) and such, but truly the interesting applications involve analysis -- and where's the beef on that in this story?

    --Dan
  • ... and the brain (Score:5, Interesting)

    by Mazzaroth ( 519229 ) on Monday February 16, 2004 @03:13PM (#8296427) Homepage
    Social or internet networks are a lot like the brain
    • the wiring of it (topology) can gives a lot of insight on how it works and can even explain some emerging side effects.
    • it evolves with time - new connexions are made between nodes everyday, and we observe self-optimization.
    • the information that is communicated within the network itself is also pretty important. Actually, this is not only the tracer from which we derive its topology and its evolution, but also the very meaning of it.
    There is something way too similar about social networks, internet and the brain that really troubles me.
  • by Anonymous Coward on Monday February 16, 2004 @03:15PM (#8296456)
    I go to the University of Michigan, and they even have classes where students examine social networks. It's interesting, but it's just used as an excuse to write a paper. It's engineering 100, a/k/a english for engineers.
  • by Apiakun ( 589521 ) <tikora AT gmail DOT com> on Monday February 16, 2004 @03:15PM (#8296457)
    Some people have loose ideas upon which they base a friendship. How frequently have you heard someone say something like "I made a new friend yesterday". I for one find that friendships take much longer to cultivate than a day, a week, a month. It would make more sense to say "I formed the foundation of what may become a friendship yesterday". As subjective as it is in life, I don't see how one could programmatically prove friendship in any way, aside from taking the word of both parties who claim friendship.
  • Re:Slashdot?..... (Score:3, Interesting)

    by kfg ( 145172 ) on Monday February 16, 2004 @03:29PM (#8296634)
    All of which may well lead us to an unexpected physical phenomenon, which in turn leads us to greater understanding of star formation and evolution, perhaps even greater understanding of matter itself.

    In the biological field we may discover Black Smokers, where we learn more about life in general than we do when studying oysters and their ecologies.

    It's simply my preference to overtly assume something like Black Smokers are out there somewhere and go looking for them.

    In social networks you'll often find the isolated data element (which is to say, person) suddenly explodes as a nexus of contact, or gets absorbed into a clump, or a clump spits something out to the fringes. To me this is, in itself, worthy of attention.

    In the example given, for instance, the first thing I want to know is what caused those few interconference games between the physically distant teams to take place at all? It is the nexus of interaction that is interesting to me here, but specifically because that interaction is anomolous.

    There is an invisible subnetwork somewhere.

    I want to examine it.

    KFG
  • by Coulson ( 146956 ) on Monday February 16, 2004 @03:43PM (#8296789) Homepage
    Given that your contacts are stored on your cellphone, who's to say they couldn't (or aren't currently) do this right now? I don't recall my cellphone contract saying anything specifically about them not collecting this data, so...
  • by zapp ( 201236 ) on Monday February 16, 2004 @03:51PM (#8296866)
    I often feel that way about things like rocks. Like when I'd pick up a rock out in a field somewhere, that looked like it had been there for quite a while, and threw it. Then I realized it had no way to get back to its home, and how lonely it must be.

    Those dots are lonely.
  • Six degrees (Score:4, Interesting)

    by digitalhermit ( 113459 ) on Monday February 16, 2004 @04:07PM (#8297063) Homepage
    I'm in the middle of reading _Nexus_ by Mark Buchanan. One of the topics he covers is the work by Mark Granovetter that discusses links in a social network. One thing I found interesting was that weak links, those from friends-of-friends or casual associates, do more to tie together a network than the local, strong links. The reasoning is that local links tend to be more isolated: your friends will have similar interests and know many of the same people. Links to distant nodes will thus tend to be more "ordered" and require more steps to reach that node. Weak links will act as a shortcut between disparate groups.

  • by chia_monkey ( 593501 ) on Monday February 16, 2004 @04:24PM (#8297266) Journal
    The interesting thing to note about these social networks (which seems to have been overlooked) is that everyone will put different weights on what is important when deciding their social cirlcles. You can have ten people, with each having all the same interests. Soccer, computers, ramen noodles, Coors Light, Chihuahuas, and small-waisted women with big breasts. Yet each of these people will probably rank each differently. While one may go right up to Chihuahua lover at a party and strike up a conversation, another will go straight to the kitchen and see who else is looking at the ramen noodle collection.

    Basically, we have to find a way to "train" the software. It's not going to be easy. Training the TiVo still doesn't give you the best results. The personality compatibility tests sure are interesting, eh? Who here has been matched with the perfect roommate in college? Yet I haven't seen much yet on the weights of interests, just discussions about clusters of tight-knit social groups.

Today is a good day for information-gathering. Read someone else's mail file.

Working...