Agile Cat — in the cloud

June 25, 2010

Facebook の HDFS クラスターは 21 PB !!!

Filed under: Big Data,Facebook,HDFS — Agile Cat @ 10:01 am
Tags: , ,

Facebook has the world’s largest Hadoop cluster!
http://hadoopblog.blogspot.com/2010/05/facebook-has-worlds-largest-hadoop.html

facebook_logo

なにげなく Facebook を見ていたら、こんなポストが ・・・ これまでは秘密だったみたいですね。 スゴイ! ーーー A.C.

ーーーーー

It is not a secret anymore!

The Datawarehouse Hadoop cluster at Facebook has become the largest known Hadoop storage cluster in the world. Here are some of the details about this single HDFS cluster:

  • 21 PB of storage in a single HDFS cluster
  • 2000 machines
  • 12 TB per machine (a few machines have 24 TB each)
  • 1200 machines with 8 cores each + 800 machines with 16 cores each
  • 32 GB of RAM per machine
  • 15 map-reduce tasks per machine

That’s a total of more than 21 PB of configured storage capacity! This is larger than the previously known Yahoo!’s cluster of 14 PB. Here are the cluster statistics from the HDFS cluster at Facebook:

image

ーーーーー

立てこんでまして、英語のままでスミマセン。

ーーーーー

<関連>
HDFS のスケーラビリティを考察する _1
Hadoop DFS _ Introduction

Advertisement

Leave a Comment »

No comments yet.

RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Connecting to %s

Theme: Rubric. Blog at WordPress.com.