
Search Beyond Google 248
An anonymous reader writes: "'Search Beyond Google', the cover story of the March issue of Technology Review, is one of the few current Google stories that discusses whether their technology can stay ahead of the competition in the months to come."
All good things ... (Score:5, Funny)
... or bad things ... or pretty much anything, come to an end sometime. Except Microsoft of course.
I think Google has deviated too much from searching, with their Blogger aquisition, and other stuff like that. We'll see how long they stay around.
Re:All good things ... (Score:5, Insightful)
But Yahoo seems to be investing in several of the surviving web crawlers from the early days. Clearly, they see Google's hold on the title as the #1 search engine as something they might be able to take back.
Re:All good things ... (Score:5, Interesting)
Re:All good things ... (Score:5, Interesting)
There have been two updates in the last couple months, named Update Florida [google.com] and Update Austin [google.com] by the SEO community [webmasterworld.com]. As typical, various webmasters have been devoting a lot of thought and emotion to them. But as a normal user, all I can see is that Google is definitely trying, and not succeeding yet.
Re:All good things ... (Score:5, Informative)
Another approach I heard being discussed is to give more popular sites a higher weightage. ie If a site has a lot of pages linking to it, the sites linked from this site must also be good. Apparently if done right, you can do a few iterations and get to a better algo.
Or probably assign a number to (karma if you will ) to each site. Then divide this karma by the number of sites it links to and add this to all the linked sites. Eliminate the cycles in the graphs and iterate.
Re:All good things ... (Score:5, Funny)
Look harder (Score:4, Informative)
Actually, there essentially is a meta-moderate link tucked down at the bottom of the page:
It's not an automated system, but it does let you report "bad moderation".
Re:All good things ... (Score:4, Informative)
Re:All good things ... (Score:5, Insightful)
Or I could be reading too much into what is otherwise standard corporate behaviour.
Search engine spam is the key... (Score:5, Insightful)
Re:Search engine spam is the key... (Score:5, Interesting)
Re:Search engine spam is the key... (Score:2)
Re:Search engine spam is the key... (Score:5, Informative)
I thought the whole concept of google was that it ranked pages higher if lots of other pages linked to it.
And this is exactly one of the problems that is now coming to light. Spammers set up hundreds of tiny sites that do nothing but point to each other, thus inflating their PageRanks. They've saturated Google to the point that searching for information about commercial products usually returns 2/10 legitimate pages.
At least, that's been my experience.
Re:Search engine spam is the key... (Score:2, Funny)
So, wait. All those products won't really make me bigger down there. Way to ruin my day.
Comment removed (Score:5, Interesting)
Re:Search engine spam is the key... (Score:5, Insightful)
Just like they do with all of their search results.
Really, whether you tried to do it or not, doesn't matter. It's a fact that more people were referring to your site with links like "s635mp" than were referring to the manufacturer.
Reacting to this is exactly what makes google, google and not Yahoo!. I mean, a search engine whose results can't be manipulated has existed a while. It's called a phone book. Yahoo! results are manipulated simply by keyword volume. Google results are manipulated by keyword volume and a proprietary heuristic based on links and pagerank.
I'm surprised (in retrospect) that it took so many years for so-called ``google-whacking'' to emerge. I wonder how long they [google] knew it was inevitable, or at least a strong possibility (some really bright guys working there)...
Re:Search engine spam is the key... (Score:5, Insightful)
> It's called a phone book.
The phone book can't be manipulated, because it doesn't try to rank entries. Try to find the right person called "Smith" in a phone book...
When you look at the Yellow Pages, they do some sort of ranking and they do get manipulated by those with a lot of money who can take out a bigger ad, but aren't better than any other business.
Re:Search engine spam is the key... (Score:4, Informative)
A Googlewhack [googlewhack.com] is a two-word Google query that returns exactly one result.
The term you're looking for is probably Googlebombing [wikipedia.org], which refers to deliberately placing keywords and links on multiple domains to boost a site's PageRank. Originally, Googlebombs were pranks or in good fun, like a search for weapons of mass destruction [google.com].
Now "Googlebombing" is being expanded by some to include manipulating PageRanks for commercial ends. I'll leave it to the armchair etymologists of Slashdot to decide if that is a correct use of the term.
Re:Search engine spam is the key... (Score:3, Insightful)
Re:Search engine spam is the key... (Score:5, Informative)
something interesting -site:example.com
At this point there's no way to save it as a pref, but you could always drop it in a text file to keep a big list
Re:Search engine spam is the key... (Score:3, Interesting)
http://www.google.com/search?&q=%s+-site:exampl
Of course you would have to add a +-site: for each one.
Google can't rest on its successes (Score:5, Insightful)
But, five years is a long time to sit on an innovation without making it better. It gives the competition time to catch up. Furthermore, since PageRank doesn't seem to have seriously changed much, it's actually slipped backwards a bit as more and more people have figured out how to "beat the system" by posting nonsense sites with links to the site they want on top. Google's clearly trying to fight this, but that's an uphill battle.
Meanwhile, Yahoo now owns three distinct web-crawl based search engines, AltaVista, AllTheWeb, and Inktomi. They also own Overture, which begain life as GoTo.com who was the first to associate real search results with targetted ads. Put all these pieces together. Yahoo also has the original mega-directory site, which Google tries to duplicate by presenting the Open Directory Project on their site. In short, Yahoo's got all the resources to launch a brand with everything that Google has going for it... and when you look at AltaVista [altavista.com] and AllTheWeb [alltheweb.com] they feel quite a bit like Google already. Clearly, Yahoo's gearing up to issue a challenge to Google.
It really seems like Yahoo is making sure they have all the tech in place right now. When they're sure that they're better to Google, I fully expect to see a marketing campaign claiming that and inviting people to do head-to-head searches.
Google, as it stands now, is going to look pale in such showdowns. They've got to seriously modify PageRank so that the link spammers get downranked before Yahoo issues that challenge, or else Yahoo could reclaim the search market under it's "Google-killer" product line, and then direct people back to the original Yahoo site for their other portal needs.
Comment removed (Score:5, Insightful)
Re:Google can't rest on its successes (Score:5, Insightful)
And I doubt Yahoo.com is going to change at all. However, look at the other two search portals they operate. It's quite likely that the offering Yahoo puts forward to fight Google won't be called Yahoo, but be flown under the AltaVista or AllTheWeb brand name.
So, if you just want to search, they'll have a nice clean entry point to their network for you. If you want the full busy-screen portal, there will be another entry point for that. Nothing limits Yahoo to having only one major brand...
Re:Google can't rest on its successes (Score:4, Informative)
Re:Google can't rest on its successes (Score:2, Informative)
if you want a simple search box, navigate to the yahoo! search page [yahoo.com].
Teoma (Score:5, Interesting)
Re:Teoma (Score:5, Interesting)
Hopefully.. (Score:5, Insightful)
Hopefully google will not go public anytime soon like they were talking about earlier. I fear that this would stifle their innovation and bring it closer to some of the other failed portals.. ie more ads in an attempt to satisfy investors.
I think it is a good idea for other search engines to step up to the plate and challenge google. It stops them from beoming complacent and spurs innovation from a desire to be #1.
Re:Hopefully.. (Score:5, Interesting)
I once thought Altavista ruled the universe (Score:5, Insightful)
I see no reason why the cycle cannot repeat. In fact, the cycle may be much like the semiconductor memory business, which has seen boom-bust cycles every few years since the early 70's. Sometimes a name will ride out for many cycles, but usually the company (and as necessary the technology) behind the name changes radically.
Re:I once thought Altavista ruled the universe (Score:3, Insightful)
They then squandered the good name they had with misguided strategies, who knows how many different ones, to follow in Yahoo's footsteps and go from Search Engine to Port
Vivisimo is not a search engine (Score:5, Interesting)
See books about "more stupid f---ing shit" at Amazon.
targeted organization as in targeted selling. All they want is your demographic datum.
IOW google will crush them.
Meta search engines (Score:3, Informative)
dogpile [dogpile.com] is also quite good, when you've got it set to display results by relevance rather than by engine.
Remember, Amazon isn't the only online bookstore, ebay isn't the only online auction site and google isn't the only search engine...
Re:Meta search engines (Score:3, Interesting)
When I first read that, it made sense. Then I went to Vivisimo's site and realized that was...stupid.
Why would Vivisimo happen to have a Google API ready to be loaded up when 'google' is appended to the query string? Why would they trust the client's query string and go digging through whatever loadable modules they may have for ones specified in by the query
Even if they don't... (Score:5, Insightful)
bigco (Score:4, Interesting)
but the ossification that takes over every
large company as it grows. Changes won't be
made because it is too big a change. Changes
won't be made because it's not cost justified.
Marketing concerns will override technology.
People we get fat and happy. And unlike microsoft
i can switch to a different search engine
in a second. Yahoo is looking pretty good...
This has been the "story" for the past two years (Score:5, Insightful)
Re:This has been the "story" for the past two year (Score:5, Insightful)
Re:This has been the "story" for the past two year (Score:2)
Re:This has been the "story" for the past two year (Score:2, Interesting)
And Google isn't exactly dead, its alive and coping with the new stuff all the time.
Re:This has been the "story" for the past two year (Score:2)
This is because no one has created a significant advancement in searches and marketed it well. If that happens watch out Google.
Re:Eternal doom (Score:2)
Well, that's because people have rosy memories of the distant past. It's always been like this, people just look at the past through rose colored glasses...
It's search people (Score:5, Insightful)
As long as that answer is in the first page, usually the first three items listed, people simply will not care about the backend technology.
MS and others will brag about the vastness of the numbers of matching items they can find; most people only worry about finding one or two sites.
This is going to be a big non-event...mark my word.
Re:It's search people (Score:5, Interesting)
Google's starting to be the one wishing this was a non-event.
Google's speciality & ubiquity (Score:5, Insightful)
Enough branding studies have shown that it's very very hard to knock someone off their post once they seize a certain mindshare - e.g. Coke, Windows(grin), and now Google.
So, irrespective of the technical competence, or otherwise of Google, it is going to be around and the leader, for a long time to come. P.S. My favorite missing google feature: search for bittorrent files
Re:Google's speciality & ubiquity (Score:5, Insightful)
This isn't entirely true. Take the 'New Coke' disaster [k12.ut.us] of the late 80's. Pepsi actually overtook the flagship Coke at this time, until Coke Classic was released in 86.
Google is not much different to Coke. As soon as the water starts to taste funny (and on many searches it does now) we jump to the other main brands. Unlike Coke, however, Google cannot afford to keep its flavor constant every year.. but it must at least make it taste fresh instead of spammy.
Re:I've heard the New Coke disaster was planned (Score:4, Informative)
Scout the talent, reap the benefits. (Score:5, Insightful)
But no more stuff like that Friendster wannabe site.
A suggestion -- to stay competitive (Score:5, Interesting)
I'm utterly fed up with eBay with the bloodymindedness of their "enhancement" and roll-out policy. Holding a near strangle-hold on the online-auction market, they are blind to the aggrevations they inflict upon users.
Radical changes to a familiar interface shouldn't take place without dire need, unfortunately some people think it's fine to dust users. Google is all I want in a search engine and it works very well. The only reason I'd seek another search engine is if they (Google) drive me away.
BTW, did you know there's a calculator? [google.com] I found it when I did a search for 'stones to pounds'
Great calculator (Score:3, Funny)
Re:A suggestion -- to stay competitive (Score:2, Insightful)
But yes, the tendency to expand into new (and unrelated) realms is annoying. When Google starts supporting e-mail, as jwz [jwz.org]'s law predicts it will, we'll know we're in trouble. Oh, wait
DejaNews (Score:2, Interesting)
Re:DejaNews (Score:2, Insightful)
Google should leverage that freaking huge database that they have and dejanews. None of the other competitors have that comprehensive of a set of dat
Re:DejaNews (Score:2)
Article is already out of date. (Score:4, Insightful)
I do hope Google can continue its innovation, and reduce much of the annoyance of bad results through blogs.
I'm suprised more attention wasn't given to the Google IPO, and what affect that might have on the "relatively small" 1000 person company.
-m.
Still waiting (Score:5, Interesting)
It's inevitable... (Score:2, Insightful)
Are you Corn Fed? [ebay.com]
I for one.... (Score:5, Interesting)
Google is awesome, and is by far the best search engine out there. Google became the best by being the best. I use it because it works, and it works well.
In order to be dethroned, a search engine needs to work BETTER than Google. I welcome any search engine that can beat Google, as it has to be DAMN good to take that title. Microsoft search flat out sucks. If I look for articles on linux, I get articles about linux alternatives (mostly M$ content). If I google for linux, I get real linux stuff. This is just an example, but it's true across the board. I have yet to see a search engine superior to Google, and I welcome any tool that can prove itself better.
Re:I for one.... (Score:2)
Every good web developer knows... (Score:5, Funny)
Forget about Yahoo and Microsoft. If I was google I would keep an eye on booble [booble.com]. No way they can compete.
Lots of PhDs doing much good? (Score:3, Interesting)
Google is famous for only hiring the academic best (except for those they pick up in acquisitions), but I'm wondering if things are getting stale over there at Google. Google Labs has shown us some interesting concepts, but when a company opens the field to everyone and asks for people to develop ideas for them (as in the recent $10k prize thing), does it mean those PhDs are sitting around eating pizza all day?
PhDs are not the guys you leave around to do server maintenance or fix up problems in the clusters. They also don't make great coffee. So if you've got 60 extremely bright individuals (we're talking way into the top percentile) sitting around for a few years.. and Google has tons of money.. why aren't we seeing some major stuff coming out of Google?
My theory is that either 1) the PhDs are being stifled by upper management, 2) the PhDs aren't really as smart as they're meant to be, or 3) Google has something absolutely massive just around the corner... Take your bets, gentlemen.
Re:Lots of PhDs doing much good? (Score:2)
Re:Lots of PhDs doing much good? (Score:4, Insightful)
Re:Lots of PhDs doing much good? (Score:2)
Or maybe they shot their wad (Score:3, Insightful)
Also the risk-taking will drop off a cliff once they are public. The litmus test for new products is much more stringent once you have quarterly reports. And yes, they are going to have an IPO, stop debating it.
Mousetraps (Score:4, Interesting)
Google has a brilliant algorithm, thanks their 60 PhD's. But there's plenty of other PhD's out there, some of whom I'm sure are just finishing up their newest, succeeding algorithm. It's a constant game of king of the hill.
google needs "stemming" (Score:5, Informative)
Google has added stemming (Score:5, Informative)
Re:google needs "stemming" (Score:4, Informative)
Aditionally, in the 'one up the competition' category, google can search synonyms of words like this:
Google: ~slide ~rule [google.com]. I learned that one in the 'favorite google features' thread. More info on thier advanced help page [google.com] (3rd down, "~" searches). I also really love (and use heavily) thier other search operators [google.com].
Google has an advantage..... (Score:5, Insightful)
In 3 months? (Score:5, Informative)
People seem to think Google is simply a place to find HTML pages. You type in your words, and poof, you get some relavent sites. Could this be replaced in 3 months? Google has a huge index, a very good search algorithm, and works for most people, but (in theory) someone might come up with a working alternative in that period. However:
And more [google.com]. Babelfish translation? Caching like a billion pages? Simple design, with text ads that are actually relavent? In 3 months.
Yeah, right.
Re:In 3 months? (Score:3, Interesting)
In the shamless-self-promotion-department, if you like Google News, might give Findory News [findory.com] a try. It's similar to Google News, but which articles are featured depends on your reading habits.
So, if you read many tech news related to Linux, for example, it will emphasis news articles that are interesting to people who like tech news on Linux. It adapts to your interests.
Regexps, please! Anyone! (Score:5, Insightful)
Re:Regexps, please! Anyone! (Score:2)
Hmm, i guess that could be done with simple booblean logic instead of complex regexps. did i say booblean? i mean boolean.
Re:Regexps, please! Anyone! (Score:4, Informative)
Re:Regexps, please! Anyone! (Score:4, Informative)
technology schmology (Score:5, Insightful)
Google needs to Show some its Cards (Score:3, Interesting)
How I'd fix Google... (Score:5, Insightful)
It would be the rebuttal to Google bombing... searchers could fight back by giving the crap a thumbs-down. Of course, then you would have the bombers voting down all the ligit sites. Dammit.
Re:How I'd fix Google... (Score:4, Informative)
http://www.google.com/contact/spamreport.html
I now have it as a bookmark so I can hit it quickly.
Re:How I'd fix Google... (Score:3, Informative)
The issue's moot... (Score:5, Interesting)
Structure of Information vs Search for Knowledge (Score:5, Interesting)
Google will still stay on top for a while. (Score:5, Insightful)
Visual appeal still counts.
The bar will be raised everywhere (Score:4, Interesting)
Three keys to the search game (Score:5, Informative)
- A large crawl: A search engine with nothing in its database isn't going to work very well. A search engine needs as big of a crawl as possible in order to have any results at all. This takes huge resources in terms of bandwidth and computing power. Some of the early search engines met their demise when they couldn't afford to keep their crawlers growing as fast as new web content comes out.
- The Sorter: Once the long list of results that match the keywords are pulled out of the crawl, a sort needs to be applied in order to locate the best results and present them first. Google got vaulted to the top because PageRank was better than anybody else has ever put out. However, PageRank isn't perfect, so there is still room for somebody to make something better than PageRank.
-Promotion: A web site just sits there unused if it isn't promoted. Google never spent much on advertising and it just relied on word of mouth since it was so strong in the other two areas. And now that everyone turns to them first without even checking other engines, that has given them the strong advantage of a strong brand image. However, we've seen plenty of cases where inferior technology has been beaten out by better marketing. If somebody's tech passes Google, without marketing it nobody will know about it. Therefore, look for the challengers to be launching major ad campaigns inviting people to at least try them before they assume Google is better.
Can anybody put it all together? We're about to find out...
My Problem with Google Search Results. (Score:2)
technology ? (Score:5, Insightful)
Thats all I really want . . . to get my search result seperate from the commercially paid for product placements.
--Tsiangkun
Ranked by your internet favories (Score:3, Interesting)
I thought... (Score:5, Interesting)
Even google cannot answer everything. Web is limited even if you don't believe it. You post your question. Answers will come through trackback, comments, email. Googling the web after you posted the question. Or not.
All you need is some tag to mark post as answer or question. Hot list like metafilter to aggregate.
Is it a good idea or does it belong to recycle bin?
Mailing lists used to be about that. Discussing specific problems. Finding answers. Nowadays they are quite dead. Except some. Newbies, spam, whatever is the reasons. Problem is that those who possess knowledge don't have enough stimulus to share it. I don't solve that problem. The answer might be micropayments or gifts via amazon.
But make a good deed today. Answer one or two questions. In a year it might make quite a lot. In some day you might need answer to something yourself.
http://answers.google.com/answers/main
http://
Google for google (Score:2, Funny)
Hey can you jump on your computer and MSN Search this for me
Hey get on and Yahoo this term
Nothing else will work
Building the wrong mousetrap (Score:5, Interesting)
As a simple example: if your a Mac user, Beholder [mesadynamics.com] is really a much more useful image search frontend than using images.google.com alone (yes, I've mentioned this before, but hey, a developer has to eat).
Re:Building the wrong mousetrap (Score:3, Insightful)
I'd say that 80-90% of the time when I want to do a search, I'm usually, at that point, doing something on the web. Having Google reachable at another website is convenient compared to having to fire up another client application to do a search.
I think one feature that would be awesome in a client-side app (but wouldnt' be limited so) would be a user history of Google searches. I'm looking random things up all day and it would be cool if I could have tho
Re:Building the wrong mousetrap (Score:3, Interesting)
The thing is, Google's servers are many orders of magnitude more powerful than your PC. It can calculate more search algorithms in a millisecond than your (or my) PC can compute in seconds. Seconds mean a lot when you're doing something like this. Very few people have the patience to wait and wait and wait, even if yes, it's fast.
Re:Building the wrong mousetrap (Score:3, Interesting)
Back in Undergrad (Score:5, Interesting)
Yes, Google has some problems (Score:5, Insightful)
I speculated about a 4-byte docID overflow problem in an essay last June at Google Watch [google-watch.org]. In recent months Google started a "Supplemental Index" for some curious, unexplained reason. Their total number of pages indexed was recently updated to 4,285,199,774 -- just below the maximum for a 32-bit integer. It looks as suspicious now as it did last June.
Last November, Google began using an on-the-fly filter to further refine the search results for ecommerce sites. Some spam was deleted, a lot of other spam took its place, and a lot of mom and pop ecommerce sites were dropped inadvertently. Many people were unhappy.
Further evidence that Google's old ranking system is broken is the fact that three famous Googlebombs, "french military victories," "weapons of mass destruction" and "miserable failure" are all still working. The first one is eleven months old. It used to be that such Googlebombs were suppressed at the next monthly crawl, when PageRank was recalculated. Now it seems that suppressing them is beyond Google's ability. How else can you explain why Google puts up with these widely-publicized embarrassments?
Google's results remain unsurpassed for noncommercial sites from EDU, ORG, and GOV domains, however. Their crawling of the noncommercial sector is the most complete of any engine. The reason Google does so well here is probably because spam isn't much of a problem in this area.
So far Yahoo doesn't appear to be making much of an effort at covering the noncommercial web. It should be added that Google has more of a spam problem simply because spammers have been focused on Google for so long. Once Yahoo gets the same attention from spammers, then we'll be able to make a fair comparison of Yahoo with Google.
Search as ongoing computer experience (Score:3, Insightful)
FWIW, in Mozilla Firebird, you can select a bunch of text, right-click on it, and go "Search the Web"... . I've never had to open a separate window for searching. Now, it would be so nice to have this in other apps.
Take email, for example. My idea is that when I'm posting a query to a mailing list, as I type in the words, the program should dynamically build a set of "related links" for the content I have typed in the email. That way, people won't have to ask me to STFW everytime I act clueless and send a simple query to the list.
Alright, I'm kidding. I'm not a clueless user, but you get the idea. For any content on my screen at any given time, I'd like to be able to access "related content" from... er... a sidebar on the screen?
Re:pagelink (Score:2, Interesting)
I love Google. Google has saved my sorry ass more times than I'd care to admit, but it's going to be a close one. They'll have my search, but the market share is still up in the air.