The Cache: Technology Expert's Forum
 
*
Welcome, Guest. Please login or register.
Did you miss your activation email?
May 24, 2012, 01:35:52 AM

Login with username, password and session length


Pages: [1]
  Print  
Author Topic: Google Caffeine  (Read 368 times)
isthisthingon
Global Moderator
Lifer
*****
Offline Offline

Posts: 2873



View Profile
« on: June 11, 2010, 02:11:52 PM »

Google Caffeine article...

"Caffeine lets us index web pages on an enormous scale. In fact, every second Caffeine processes hundreds of thousands of pages in parallel. If this were a pile of paper it would grow three miles taller every second. Caffeine takes up nearly 100 million gigabytes of storage in one database and adds new information at a rate of hundreds of thousands of gigabytes per day. You would need 625,000 of the largest iPods to store that much information; if these were stacked end-to-end they would go for more than 40 miles."

Three miles of paper per second?  That's staggering if true but I think they mean a pile of paper that's been waded up into balls, if the metaphor has some truth in it    In any case, a data architecture of this magnitude is simply amazing.  Handling it well with fast results 24/7/365 is a magnificent technical achievement.
Logged

I would love to change the world, but they won't give me the source code.
perkiset
Olde World Hacker
Administrator
Lifer
*****
Offline Offline

Posts: 9896



View Profile
« Reply #1 on: June 11, 2010, 04:28:52 PM »

Unimaginable. We are in the day where both the volume and centricity of money AND data are beyond the scope of any of our imagination. Incredible.
Logged

It is now believed, that after having lived in one compound with 3 wives and never leaving the house for 5 years, Bin Laden called the U.S. Navy Seals himself.
isthisthingon
Global Moderator
Lifer
*****
Offline Offline

Posts: 2873



View Profile
« Reply #2 on: June 11, 2010, 04:44:23 PM »

Regarding money, I can imagine quite a lot Wink
Logged

I would love to change the world, but they won't give me the source code.
Bompa
Administrator
Lifer
*****
Online Online

Posts: 524


View Profile
« Reply #3 on: June 11, 2010, 06:44:55 PM »

umm three miles = 3 * 5280 feet = 15,840 feet

15,840 feet divided by the thickness of one sheet of paper =  ?

I dunno, but that would be how many pages caffiene can index per sec

Logged

"Everything that can be counted does not necessarily count; everything that counts cannot necessarily be counted." -- Albert Einstein
Pages: [1]
  Print  
 
Jump to:  

Perkiset's Place Home   Best of The Cache   phpMyIDE: MySQL Stored Procedures, Functions & Triggers
Politics @ Perkiset's   Pinkhat's Perspective   
cache
mart
coder
programmers
ajax
php
javascript
Powered by MySQL Powered by PHP Powered by SMF 1.1.2 | SMF © 2006-2007, Simple Machines LLC
Seo4Smf v0.2 © Webmaster's Talks


Valid XHTML 1.0! Valid CSS!