tag:blogger.com,1999:blog-8556003786324804973.post3449687241408195366..comments2024-01-27T03:43:02.667-08:00Comments on HDFS: Facebook has the world's largest Hadoop cluster!Dhruba Borthakurhttp://www.blogger.com/profile/10832366855372649190noreply@blogger.comBlogger53125tag:blogger.com,1999:blog-8556003786324804973.post-55735411290132204072013-11-07T04:24:57.873-08:002013-11-07T04:24:57.873-08:00Is there an architecture diagram explaining the la...Is there an architecture diagram explaining the latest Hadoop cluster configuration at Hadoop ? Such as the size o data processed and the number of nodes etc.Debuhttps://www.blogger.com/profile/09587306816832198268noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-30921766751759636972013-10-17T00:05:41.159-07:002013-10-17T00:05:41.159-07:00Thanks a lot for the wonderful information and it ...Thanks a lot for the wonderful information and it is useful for us.123trainings provides best <a href="http://123trainings.com/it-hadoop-bigdata-online-training.html" rel="nofollow">Hadoop online training</a>.tosee free demo class<a href="https://www.youtube.com/watch?v=PqbYn5LXzRw" rel="nofollow">Hadoop online training class in india</a>Anonymoushttps://www.blogger.com/profile/06846565237627655193noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-71604224510212131212013-10-11T23:29:41.932-07:002013-10-11T23:29:41.932-07:00Itis good and it is very helpful for us.123trainin...Itis good and it is very helpful for us.123trainings provides best <a href="http://123trainings.com/it-hadoop-bigdata-online-training.html" rel="nofollow">online Hadoop training </a>.to see demo <a href="http://www.youtube.com/watch?v=PqbYn5LXzRw" rel="nofollow">Hadoop online training demo class in hyderabad</a>kumarhttps://www.blogger.com/profile/13120619498930493416noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-15362104854246146202013-10-03T23:35:26.371-07:002013-10-03T23:35:26.371-07:00it is a good piece of knowledge and it is used for...it is a good piece of knowledge and it is used for hadoop learners.Hadoop online trainings provides best<a href="http://hadooponlinetrainings.com/hadoop-online-training/" rel="nofollow">hadoop online training </a>sudheerhttps://www.blogger.com/profile/07387721092977310781noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-30367544180973085742013-10-03T23:17:32.252-07:002013-10-03T23:17:32.252-07:00it is a good piece of knowledge and it is used for...it is a good piece of knowledge and it is used for hadoop learners.123trainings provides best<a href="http://123trainings.com/it-hadoop-bigdata-online-training.html" rel="nofollow">hadoop online training</a> to see free demo class<a href="http://www.youtube.com/watch?v=PqbYn5LXzRw" rel="nofollow">Hadoo online training demo class in Ameerpet</a>sudheerhttps://www.blogger.com/profile/07387721092977310781noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-75742348356112530022013-10-01T02:09:39.743-07:002013-10-01T02:09:39.743-07:00It's amazing and this information is very very...<br /><br />It's amazing and this information is very very useful for us.Hadoop online trainings also provides <a href="http://hadooponlinetrainings.com/hadoop-online-training/" rel="nofollow">hadoop online traning</a>kumarhttps://www.blogger.com/profile/13120619498930493416noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-32340504811127518082013-10-01T02:03:49.145-07:002013-10-01T02:03:49.145-07:00It's amazing and this information is very very...It's amazing and this information is very very useful for us.123trainings also provides <a href="http://123trainings.com/it-hadoop-bigdata-online-training.html" rel="nofollow">hadoop online traning</a><br />to see free demo<a href="" rel="nofollow">hadoop online training classes in india</a>kumarhttps://www.blogger.com/profile/13120619498930493416noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-49683975216818197632013-09-29T23:05:27.285-07:002013-09-29T23:05:27.285-07:00Great helpful information. Thanks for providing wo...Great helpful information. Thanks for providing wonderful hadoop information.123trainings provides <a rel="nofollow">hadoop online training</a> we can see free demo class <br /><a href="https://www.youtube.com/watch?v=PqbYn5LXzRw" rel="nofollow">hadoop online training classes in hyderabad</a>.<br />kumarhttps://www.blogger.com/profile/13120619498930493416noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-75042657075496583082013-07-28T05:18:23.032-07:002013-07-28T05:18:23.032-07:00your blog is very nice.Hadoop is very important fo...your blog is very nice.Hadoop is very important for any organization, So hadoop training is must to improve yourself business.<br />thanks for the tips.<a href="http://intellipaat.com/big-data/" rel="nofollow">hadoop online tutorial</a>jameshttps://www.blogger.com/profile/05892380143404747782noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-89255205402425365112013-06-26T04:18:14.322-07:002013-06-26T04:18:14.322-07:00I think the things you covered through the post ar...I think the things you covered through the post are quite impressive, good job and great efforts. I found it very interesting and enjoyed reading all of it... keeps it up, good job.<br />Chloe Phillipshttp://www.micoequipment.com/noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-24223928235254561172013-05-23T09:58:39.735-07:002013-05-23T09:58:39.735-07:00Very nice and informative blog.
@Shruti: Ya Hadoo...Very nice and informative blog.<br /><br />@Shruti: Ya Hadoop has great scope now a days.<br />As you can get an idea from this blog too.<br />And I took this course from WIZIQ and now I am doing job as HADOOP developer.<br />wanna tell you that this course is awsme as tutor is cloudera certified and he knows where we lag and where we make mistakes.<br />Thanks to him as I got a job only because of that tutor.<br />And yes WIZIQ is very supportive and Very responsive.<br />Just close your eyes and click enroll button.<br />:)<br />Hope it will be helpful for you.<br /><br />Anonymoushttps://www.blogger.com/profile/00480843854155986520noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-1251721254997707772013-05-23T08:47:48.558-07:002013-05-23T08:47:48.558-07:00Hey this shows the scope of HADOOP.
What do you th...Hey this shows the scope of HADOOP.<br />What do you think programmers?<br />Its time to learn Hadoop online.<br />I am looking for online hadoop live tutorial means online course.<br />and one of my friend suggested me WIZIQ for online learning having course id 21308.<br />and they are giving free demo for any course.<br />So what do u think?<br />I am thinking to take such course and make myself scope in such field.<br />Wanna learn HADOOP then do check once WIZIQ.<br />Thank You.Anonymoushttps://www.blogger.com/profile/00095906709483935227noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-83965973345406584392013-05-22T09:32:32.712-07:002013-05-22T09:32:32.712-07:00Wonderful Info. Wonderful Info. Venkathttp://evenkat.comnoreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-79051736794925547652013-05-22T08:23:22.507-07:002013-05-22T08:23:22.507-07:00@Pradeep: The 42000 nodes number from Yahoo is the...@Pradeep: The 42000 nodes number from Yahoo is the total number of nodes in all the hdfs clusters in production at Y!.. and not from a single cluster. Dhruba Borthakurhttps://www.blogger.com/profile/10832366855372649190noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-29703063588405522212013-05-22T02:28:28.130-07:002013-05-22T02:28:28.130-07:00I think yahoo has around 42000 nodes in their clus...I think yahoo has around 42000 nodes in their cluster and LinkedIn has around some 4000 nodes. May be FB has large data in it. But when it comes to the number of data nodes it will be yahoo I guess...Anonymoushttps://www.blogger.com/profile/14592235155944967253noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-10524247979645119132013-03-17T21:06:41.954-07:002013-03-17T21:06:41.954-07:00Hello,
what a amazing news is this! The Datawareho...Hello,<br />what a amazing news is this! The Datawarehouse Hadoop cluster at Facebook has become the largest known Hadoop storage cluster in the world is really a excellent information.I love it.Thanks a lot<br /><a href="http://%20www.%20coxind.co/" rel="nofollow"> Used Pallet Racks</a><br /><br /><br /><br /><br />Anonymoushttps://www.blogger.com/profile/15008755274017936152noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-8226061294839076312013-02-07T06:27:16.769-08:002013-02-07T06:27:16.769-08:00We found interesting link for the Hadoop developer...We found interesting link for the Hadoop developer <br /><br />60 Hadoop Interview Question<br />http://www.pappupass.com/Hadoop_Interview_Question.pdf<br /><br />follow link for Hadoop Exam Simulator<br />http://www.pappupass.com/class/index.php/hadoop/hadoop-exam-simulatorAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-56032644655375974272013-01-10T08:03:46.447-08:002013-01-10T08:03:46.447-08:00very nice post.very nice post.raovahttps://www.blogger.com/profile/09792748960986752195noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-9838983227917986152012-12-26T12:31:12.006-08:002012-12-26T12:31:12.006-08:00The re-replication rate is not limited (AFAIK).The re-replication rate is not limited (AFAIK).Dhruba Borthakurhttps://www.blogger.com/profile/10832366855372649190noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-58065910097115510032012-12-26T11:17:18.453-08:002012-12-26T11:17:18.453-08:00Dhrub,
Your comment >> A rack has 20 machine...Dhrub,<br />Your comment >> A rack has 20 machines. When this happens, we see that HDFS re-replicates the data and this re-replication finishes in about an hour, i.e. our mean-time-to-recover from a failed rack is about 1 hour.<br /><br />Unlike facebook, where you have 2000 machine (with 20 m/c per rack,so I am assuming you have 100 racks), the re-replication takes about an hour. For relatively small clusters - say 60 nodes (i.e. 3 racks with 20 nodes each) when a rack fails the re-replication can overwhelm Top-of-rack switch and the re-replication duration can be larger. Does the re-replication rate-limited ? Any suggestions and/or possible performance numbers for recovery time for such failures? Dheeren Beborthahttp://www.dheerenbebortha.comnoreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-12021709231049974272012-09-25T02:22:07.318-07:002012-09-25T02:22:07.318-07:00Wow....amazing...!!Wow....amazing...!!Facebook Cover Photoshttp://facebookcovers365.blogspot.comnoreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-19285833605821693652012-05-24T02:23:08.539-07:002012-05-24T02:23:08.539-07:00Great post....
worldofhadoop.blogspot.comGreat post....<br /><br />worldofhadoop.blogspot.comAnonymoushttps://www.blogger.com/profile/02732351204798815664noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-3361784764487023632012-03-29T04:57:31.890-07:002012-03-29T04:57:31.890-07:00@Dhruba : Thanks for (all) the post(s). Can you gi...@Dhruba : Thanks for (all) the post(s). Can you give us updated figures about the cluster size at the begining of 2012 ? Is the growth still amazing ?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-56241136154041697072012-01-18T20:45:43.466-08:002012-01-18T20:45:43.466-08:00Great helpful information. Thanks for providing wo...Great helpful information. Thanks for providing wonderful stats of hadoop usage at FB.<br />Hadoop can be used for olap as well as OLTP.<br />Please click <a href="http://www.cloudhadoop.com/2011/12/what-is-hadoop.html" rel="nofollow"> why hadoop is introduced</a>Anonymoushttps://www.blogger.com/profile/07358202936088369060noreply@blogger.comtag:blogger.com,1999:blog-8556003786324804973.post-71572582887064232622011-11-25T23:12:17.129-08:002011-11-25T23:12:17.129-08:00Ya know, I think I have an idea that would reduce ...Ya know, I think I have an idea that would reduce all the hardware requirements down to a fraction of the thousands of servers currently employed.<br /><br />It's a purely analytic solution, but it would work and would be very scalable, especially with the larger sets of data.SVmanhttps://www.blogger.com/profile/01065181814066790944noreply@blogger.com