Inside the Google-Plex 130
tappytibbins writes "Baseline magazine has an in-depth story about how Google manages its own IT infrastructure. From the article: 'In general, Google has a split personality when it comes to questions about its back-end systems. To the media, its answer is, "Sorry, we don't talk about our infrastructure." Yet, Google engineers crack the door open wider when addressing computer science audiences, such as rooms full of graduate students whom it is interested in recruiting.'"
A Google Lecture Experience (Score:5, Interesting)
An alum of my university who works at Google recently visited and gave an informative lecture with a long Q&A session. I can vouch for the fact that we were told more than I've ever been able to read online about the way Google manages various issues, like their IT infrastucture. However there were still limitations to what he would/could tell us (sorry I won't go into specifics). It seemed (as you would expect) the better our questions, the better his answers, and if we asked questions that were too good, then it was likely that he did not feel liberated to answer.
Also, Google was cool enough to sponsor a Programming Contest and a Graduate Research Conference we held. Our alum attended our little conference and had great feedback and questions for our presenting students. With respect to knowledge, intelligence, and humor this guy was all I would imagine and/or hope for one of our alums working at Google.
On the otherhand, I was very unimpressed with certain issues concerning lack of professionalism in the lecture. As one example, though this is only an impression, it seemed that he felt he could just get away with wearing jeans and a Google t-shirt for the few days that he was with us because he worked at the ever prestigious Google. It seemed a bit arrogant. Also keep in mind that his position at google is higher than a solutions engineer.
Just thought I'd share.
I once had an interest in Google (Score:2, Interesting)
So I tried to get another interview for a while, but no bites. Google has made it clear that they aren't interested in my work. I've stopped trying to get a job there. Besides, I don't think I can sit in a cube and take long drudgery with the occasional stinging bits of punnishment. I like all my punnishment unending and all at once, and so I just work for startups.
Comment removed (Score:5, Interesting)
Little in the way of structuring data (Score:4, Interesting)
go to the source (Score:5, Interesting)
Sawzall [google.com] (simplified scripting on top of MapReduce)
MapReduce [google.com] (Google's massively parallel system based on the concept found in functional programming. The system takes care of managing jobs, parallelism, and fault tolerance, allowing engineers to more quickly produce code.)
GFS [google.com] (Google's File System)
Google's Cluster [google.com] (An older paper describing how Google's search cluster works. The cluster described in this paper is a few generations out of date.)
BigTable [andrewhitchcock.org] (Google's semi-structured database. There haven't been any papers released, but this is my write up based on a talk given in October 2005.)
And here are some videos:
The Google Linux Cluster [washington.edu]. This is an older video where Urs Hoelzle talks about their system and focuses more on the hardware side of things.
Google: A Behind-the-scenes Look [washington.edu]. Jeff Dean gives an overview of most of the technologies mentioned in papers above. I thought the demonstration of Google's internal word clustering was interesting (and funny).
Perspectives on the Information Industry [washington.edu]. This is a technology-light (IIRC) talk given by Eric Schmidt.
BigTable: A Distributed Structured Storage System [washington.edu]. The talk from which I created my BigTables notes (above).
Andrew
Re:Sysasmin(S) (Score:4, Interesting)
Re:A Google Lecture Experience (Score:5, Interesting)
Please accept the above for the lovely second-hand urban myth that it is, one belonging to a CDC 6600 site where I was lucky enough to attend a few lectures.
Re:Sysasmin(S) (Score:5, Interesting)
i'm guessing google are big enough to have thier own datacenters and thus not have space at such a premium as smaller operations. If space isn't at a premium replacing a machine in a rack probablly isn't worth it (it means you have a machine whose remaining usefull life is out of sync with the rest of the rack its in).
Re:Also... (Score:1, Interesting)
1. Isn't PageRank based on a voting system? OK, in an intranet full of PDFs and Word docs, who votes? Yup, that's right, PageRank doesn't work in an enterprise context.
2. Infrastructure. Thousands of cheap servers. Great, right? Until you have to actually synchronize written data, rather than the read-only nature of 99+% of Google's data. Come to think of it, why do they need that many? Yahoo, MSN, Altavista, and everyone else index the web with far fewer I'll bet. Oh, and no in an enterprise it's not cool to give different results to different users at the same time, something Google does with alacrity.
3. Personnel. Don't get me started. 5,000 PhDs and their efforts to combat Click Fraud amount to -erm- not a whole hill o'beans [digg.com].
Re:On the other hand... (Score:4, Interesting)
So is it neat to have a trendy office space? Sure. Is it neat to have communal centres scattered around the building, and be encouraged to stay afterhours to play games? I guess. But it's the kind of thing that gets old once you realize you've got a family and a life outside of work. Working for Google sounds like working in a basement with a bunch of friends, but that only really works if you don't have other things you want to be devoting time to. Once their workforce matures a bit, I'd guess their "kooky, trippy workspace" won't work quite so well. Don't forget, they're still basically a glorified startup. I'm sure Microsoft had a lot of the same feel back in '86.
My Google Recruitment experience (Score:5, Interesting)
This lead to my observation of part of their file storage system which is quite possibly the most tweaked NFS nightmare/genius/what-the-fuck I'd ever seen. My past experience with networked file system was, I admit, very limited compared to what they had going on. Now, again, I wasn't even going to have anything to do with this system or any sysadmin work at all, but it was obvious that they wanted you to at least have knowledge of the system on some level beyond the user. It also came across as a showing-off culture too. I am glad I didn't take the job for various reasons, but if you are a sysadmin freaker who loves dinking with shit, you'd fit in; especially if you like to show it off too. Just be prepared to have some middle manager there fuck with you for a hour or two on the phone before you get to the outer part of the inner sanctum.
professional presentation for interview (Score:2, Interesting)