Friday, 22 June 2007

Storage costs and crawling time

Storage costs are not the limiting resource in search engine implementation. Simply storing 10 billion pages of 10 kbytes each (compressed) requires 100TB and another 100 TB or so for indexes, giving a total hardware cost of under $200k: 100 cheap PCs each with four 500GB disk drives.[citation needed]

Source: http://en.wikipedia.org/wiki/Searchengine

No comments: