Hadoop history



*The genesis of Hadoop came from the Google File System paper[11] that was published in October 2003. This paper spawned another research paper from Google – MapReduce: Simplified Data Processing on Large Clusters.[12] Development started on the Apache Nutch project, but was moved to the new Hadoop subproject in January 2006.[13] Doug Cutting, who was working at Yahoo! at the time,[14] named it after his son's toy elephant.[15] The initial code that was factored out of Nutch consisted of 5k lines of code for HDFS and 6k lines of code for MapReduce.


The first committer added to the Hadoop project was Owen O’Malley in March 2006.[16] Hadoop 0.1.0 was released in April 2006[17] and continues to evolve by the many contributors[18] to the Apache Hadoop project.


Timeline[edit]
Year Month Event Ref.
2003 October Google File System paper released [19]
2004 December MapReduce: Simplified Data Processing on Large Clusters [20]
2006 January Hadoop subproject created with mailing lists, jira, and wiki [21]
2006 January Hadoop is born from Nutch 197 [22]
2006 February NDFS+ MapReduce moved out of Apache Nutch to create Hadoop [23]
2006 February Owen O'Malley's first patch goes into Hadoop [24]
2006 February Hadoop is named after Cutting's son's yellow plush toy [25]
2006 April Hadoop 0.1.0 released [26]
2006 April Hadoop sorts 1.8 TB on 188 nodes in 47.9 hours [23]
2006 May Yahoo deploys 300 machine Hadoop cluster [23]
2006 October Yahoo Hadoop cluster reaches 600 machines [23]
2007 April Yahoo runs two clusters of 1,000 machines [23]
2007 June Only three companies on "Powered by Hadoop Page" [27]
2007 October First release of Hadoop that includes HBase [28]
2007 October Yahoo Labs creates Pig, and donates it to the ASF [29]
2008 January YARN JIRA opened Yarn Jira (Mapreduce 279)
2008 January 20 companies on "Powered by Hadoop Page" [27]
2008 February Yahoo moves its web index onto Hadoop [30]
2008 February Yahoo! production search index generated by a 10,000-core Hadoop cluster [23]
2008 March First Hadoop Summit [31]
2008 April Hadoop world record fastest system to sort a terabyte of data. Running on a 910-node cluster, Hadoop sorted one terabyte in 209 seconds [23]
2008 May Hadoop wins TeraByte Sort (World Record sortbenchmark.org) [32]
2008 July Hadoop wins Terabyte Sort Benchmark [33]
2008 October Loading 10 TB/day in Yahoo clusters [23]
2008 October Cloudera, Hadoop distributor is founded [34]
2008 November Google MapReduce implementation sorted one terabyte in 68 seconds [23]
2009 March Yahoo runs 17 clusters with 24,000 machines [23]
2009 April Hadoop sorts a petabyte [35]
2009 May Yahoo! used Hadoop to sort one terabyte in 62 seconds [23]
2009 June Second Hadoop Summit [36]
2009 July Hadoop Core is renamed Hadoop Common [37]
2009 July MapR, Hadoop distributor founded [38]
2009 July HDFS now a separate subproject [37]
2009 July MapReduce now a separate subproject [37]
2010 January Kerberos support added to Hadoop [39]
2010 May Apache HBase Graduates [40]
2010 June Third Hadoop Summit [41]
2010 June Yahoo 4,000 nodes/70 petabytes [42]
2010 June Facebook 2,300 clusters/40 petabytes [42]
2010 September Apache Hive Graduates [43]
2010 September Apache Pig Graduates [44]
2011 January Apache Zookeeper Graduates [45]
2011 January Facebook, LinkedIn, eBay and IBM collectively contribute 200,000 lines of code [46]
2011 March Apache Hadoop takes top prize at Media Guardian Innovation Awards [47]
2011 June Rob Beardon and Eric Badleschieler spin out Hortonworks out of Yahoo. [48]
2011 June Yahoo has 42K Hadoop nodes and hundreds of petabytes of storage [48]
2011 June Third Annual Hadoop Summit (1,700 attendees) [49]
2011 October Debate over which company had contributed more to Hadoop. [46]
2012 January Hadoop community moves to separate from MapReduce and replace with YARN [25]
2012 June San Jose Hadoop Summit (2,100 attendees) [50]
2012 November Apache Hadoop 1.0 Available [37]
2013 March Hadoop Summit – Amsterdam (500 attendees) [51]
2013 March YARN deployed in production at Yahoo [52]
2013 June San Jose Hadoop Summit (2,700 attendees) [53]
2013 October Apache Hadoop 2.2 Available [37]
2014 February Apache Hadoop 2.3 Available [37]
2014 February Apache Spark top Level Apache Project [54]
2014 April Hadoop summit Amsterdam (750 attendees) [55]
2014 June Apache Hadoop 2.4 Available [37]
2014 June San Jose Hadoop Summit (3,200 attendees) [56]
2014 August Apache Hadoop 2.5 Available [37]
2014 November Apache Hadoop 2.6 Available [37]
2015 April Hadoop Summit Europe [57]
2015 June Apache Hadoop 2.7 Available [37]
优秀的个人博客,低调大师

微信关注我们

原文链接:https://yq.aliyun.com/articles/71705

转载内容版权归作者及来源网站所有!

低调大师中文资讯倾力打造互联网数据资讯、行业资源、电子商务、移动互联网、网络营销平台。持续更新报道IT业界、互联网、市场资讯、驱动更新,是最及时权威的产业资讯及硬件资讯报道平台。

相关文章

发表评论

资源下载

更多资源
优质分享Android(本站安卓app)

优质分享Android(本站安卓app)

近一个月的开发和优化,本站点的第一个app全新上线。该app采用极致压缩,本体才4.36MB。系统里面做了大量数据访问、缓存优化。方便用户在手机上查看文章。后续会推出HarmonyOS的适配版本。

Oracle Database,又名Oracle RDBMS

Oracle Database,又名Oracle RDBMS

Oracle Database,又名Oracle RDBMS,或简称Oracle。是甲骨文公司的一款关系数据库管理系统。它是在数据库领域一直处于领先地位的产品。可以说Oracle数据库系统是目前世界上流行的关系数据库管理系统,系统可移植性好、使用方便、功能强,适用于各类大、中、小、微机环境。它是一种高效率、可靠性好的、适应高吞吐量的数据库方案。

Eclipse(集成开发环境)

Eclipse(集成开发环境)

Eclipse 是一个开放源代码的、基于Java的可扩展开发平台。就其本身而言,它只是一个框架和一组服务,用于通过插件组件构建开发环境。幸运的是,Eclipse 附带了一个标准的插件集,包括Java开发工具(Java Development Kit,JDK)。

Java Development Kit(Java开发工具)

Java Development Kit(Java开发工具)

JDK是 Java 语言的软件开发工具包,主要用于移动设备、嵌入式设备上的java应用程序。JDK是整个java开发的核心,它包含了JAVA的运行环境(JVM+Java系统类库)和JAVA工具。