high_scalability high_scalability-2013 high_scalability-2013-1505 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Google has released an epic second edition of their ground breaking The Datacenter as a Computer book. It's called an introduction, but at 156 pages I would love to see what the Advanced version would look like! John Fries in a G+ comment has what I think is a perfect summary of the ultimate sense of the book: It's funny, when I was at Google I was initially quite intimidated by interacting with an enormous datacenter, and then I started imagining the entire datacenter was shrunk down into a small box sitting on my desk, and realized it was just another machine and the physical size didn't matter anymore It's such a far ranging book that it's impossible to characterize simply. It covers an amazing diversity of topics, from an introduction to warehouse-scale computing; workloads and software infrastructure; hardware; datacenter architecture; energy and power efficiency; cost structures; how to deal with failures and repairs; and it closes with a discussion of key challenge
sentIndex sentText sentNum sentScore
1 Google has released an epic second edition of their ground breaking The Datacenter as a Computer book. [sent-1, score-0.123]
2 In reading it I get the sense the Faerie Queen has transported us to the land of Faerie, a special other place of timeless truths, where dragons roam, and mortal danger lurks. [sent-5, score-0.457]
3 Abstract: After nearly four years of substantial academic and industrial developments in warehouse-scale computing, we are delighted to present our first major update to this lecture. [sent-7, score-0.335]
4 The increased popularity of public clouds has made WSC software techniques relevant to a larger pool of programmers since our first edition. [sent-8, score-0.156]
5 Therefore, we expanded Chapter 2 to reflect our better understanding of WSC software systems and the toolbox of software techniques for WSC programming. [sent-9, score-0.471]
6 In Chapter 3, we added to our coverage of the evolving landscape of wimpy vs. [sent-10, score-0.074]
7 brawny server trade-offs, and we now present an overview of WSC interconnects and storage systems that was promised but lacking in the original edition. [sent-11, score-0.415]
8 Thanks largely to the help of our new co-author, Google Distinguished Engineer Jimmy Clidaras, the material on facility mechanical and power distribution design has been updated and greatly extended (see Chapters 4 and 5). [sent-12, score-0.073]
9 We hope this revised edition continues to meet the needs of educators and professionals in this area. [sent-14, score-0.21]
10 Software and hardware architects must be aware of the end-to-end systems to design good solutions. [sent-16, score-0.073]
11 In reality, building a cost-efficient mas- sive-scale computing platform that has the necessary reliability and programmability requirements for the next generation of cloud-computing workloads is as difficult and stimulating a challenge as any other in computer systems today. [sent-19, score-0.514]
12 We hope that this book will help computer scientists under- stand this relatively new area, and we trust that, in the years to come, their combined efforts will solve many of the fascinating problems arising from warehouse-scale systems. [sent-20, score-0.453]
wordName wordTfidf (topN-words)
[('wsc', 0.387), ('faerie', 0.227), ('datacenter', 0.195), ('chapters', 0.185), ('chapter', 0.16), ('workloads', 0.156), ('book', 0.144), ('computer', 0.13), ('edition', 0.123), ('delighted', 0.103), ('dragons', 0.103), ('truths', 0.103), ('introduction', 0.097), ('timeless', 0.097), ('mortal', 0.097), ('energy', 0.096), ('arising', 0.092), ('repairs', 0.092), ('brawny', 0.092), ('shrunk', 0.092), ('overcoming', 0.089), ('desk', 0.089), ('intimidated', 0.089), ('hope', 0.087), ('cruel', 0.086), ('closes', 0.086), ('roam', 0.086), ('jimmy', 0.084), ('lacking', 0.084), ('amdahl', 0.084), ('escape', 0.084), ('promised', 0.084), ('software', 0.084), ('present', 0.082), ('pizza', 0.082), ('programmability', 0.082), ('danger', 0.082), ('toolbox', 0.082), ('characterize', 0.078), ('transported', 0.078), ('industrial', 0.078), ('expanded', 0.076), ('thethe', 0.076), ('wimpy', 0.074), ('systems', 0.073), ('facility', 0.073), ('computing', 0.073), ('techniques', 0.072), ('distinguished', 0.072), ('developments', 0.072)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000002 1505 high scalability-2013-08-22-The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, Second edition
Introduction: Google has released an epic second edition of their ground breaking The Datacenter as a Computer book. It's called an introduction, but at 156 pages I would love to see what the Advanced version would look like! John Fries in a G+ comment has what I think is a perfect summary of the ultimate sense of the book: It's funny, when I was at Google I was initially quite intimidated by interacting with an enormous datacenter, and then I started imagining the entire datacenter was shrunk down into a small box sitting on my desk, and realized it was just another machine and the physical size didn't matter anymore It's such a far ranging book that it's impossible to characterize simply. It covers an amazing diversity of topics, from an introduction to warehouse-scale computing; workloads and software infrastructure; hardware; datacenter architecture; energy and power efficiency; cost structures; how to deal with failures and repairs; and it closes with a discussion of key challenge
2 0.18062793 1107 high scalability-2011-08-29-The Three Ages of Google - Batch, Warehouse, Instant
Introduction: The world has changed. And some things that should not have been forgotten, were lost. I found these words from the Lord of the Rings echoing in my head as I listened to a fascinating presentation by Luiz André Barroso , Distinguished Engineer at Google, concerning Google's legendary past, golden present, and apocryphal future. His talk, Warehouse-Scale Computing: Entering the Teenage Decade , was given at the Federated Computing Research Conference . Luiz clearly knows his stuff and was early at Google, so he has a deep and penetrating perspective on the technology. There's much to learn from, think about, and build. Lord of the Rings applies at two levels. At the change level, Middle Earth went through three ages . While listening to Luiz talk, it seems so has Google: Batch (indexes calculated every month), Warehouse (the datacenter is the computer), and Instant (make it all real-time). At the "what was forgot" level, in the Instant Age section of the talk, a common theme was
3 0.14718886 810 high scalability-2010-04-14-Parallel Information Retrieval and Other Search Engine Goodness
Introduction: Parallel Information Retrieval is a sample chapter in what appears to be a book-in-progress titled Information Retrieval Implementing and Evaluation Search Engines by Stefan B端ttcher , Google Inc and Charles L. A. Clarke, Gordon V. Cormack , both of the University of Waterloo. The full table of contents is on-line and looks to be really interesting: Information retrieval is the foundation for modern search engines. This text offers an introduction to the core topics underlying modern search technologies, including algorithms, data structures, indexing, retrieval, and evaluation. The emphasis is on implementation and experimentation; each chapter includes exercises and suggestions for student projects . Currently available is the full text of chapters: Introduction, Basic Techniques, Static Inverted Indices, Index Compression, and Parallel Information Retrieval. Parallel Information Retrieval is really meaty: Information retrieval systems often have to deal
Introduction: If you are Google you don't just complain about performance on the web, you do something about it. Doing something about web performance is the job of one Ilya Grigorik , Developer Advocate, Make the Web Fast at Google, and author of a great new book: High Performance Browser Networking: What every web developer should know about networking and web performance . That's a big topic you might be saying to yourself. And it is. The book is 400 plus information packed pages. But never fear. Ilya writes in a very straightforward style. It’s like a man page for the web. Which is a good thing. In case you are not familiar with Ilya, he's the perfect choice for writing such an ambitious book. For years Ilya has been producing excellent content on his blog and if you search YouTube you'll find presentation after presentation on the topics found in the book. Authority established. Reading the book I was struck by what a complicated beast or little World Wide Web has become. That's
Introduction: All in all this is still my favorite post and I still think it's an accurate vision of a future. Not everyone agrees, but I guess we'll see..."But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but c
7 0.1081874 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
8 0.10321279 1116 high scalability-2011-09-15-Paper: It's Time for Low Latency - Inventing the 1 Microsecond Datacenter
9 0.10152501 284 high scalability-2008-03-19-RAD Lab is Creating a Datacenter Operating System
10 0.094728589 1392 high scalability-2013-01-23-Building Redundant Datacenter Networks is Not For Sissies - Use an Outside WAN Backbone
11 0.093533613 765 high scalability-2010-01-25-Let's Welcome our Neo-Feudal Overlords
12 0.093508504 1207 high scalability-2012-03-12-Google: Taming the Long Latency Tail - When More Machines Equals Worse Results
13 0.092118487 1526 high scalability-2013-10-02-RFC 1925 - The Twelve (Timeless) Networking Truths
14 0.091702349 1424 high scalability-2013-03-15-Stuff The Internet Says On Scalability For March 15, 2013
15 0.089618407 706 high scalability-2009-09-16-The VeriScale Architecture - Elasticity and efficiency for private clouds
16 0.08666943 853 high scalability-2010-07-08-Cloud AWS Infrastructure vs. Physical Infrastructure
17 0.086610787 768 high scalability-2010-02-01-What Will Kill the Cloud?
18 0.084316149 1460 high scalability-2013-05-17-Stuff The Internet Says On Scalability For May 17, 2013
20 0.081830978 1310 high scalability-2012-08-23-Economies of Scale in the Datacenter: Gmail is 100x Cheaper to Run than Your Own Server
topicId topicWeight
[(0, 0.155), (1, 0.04), (2, 0.045), (3, 0.111), (4, -0.025), (5, -0.037), (6, -0.022), (7, 0.011), (8, -0.052), (9, 0.05), (10, -0.04), (11, -0.027), (12, 0.01), (13, 0.027), (14, 0.038), (15, 0.007), (16, -0.011), (17, -0.005), (18, 0.041), (19, 0.006), (20, 0.053), (21, 0.062), (22, -0.061), (23, -0.015), (24, 0.005), (25, 0.024), (26, -0.027), (27, 0.014), (28, -0.066), (29, 0.006), (30, -0.03), (31, -0.018), (32, -0.016), (33, 0.002), (34, -0.002), (35, -0.007), (36, 0.011), (37, -0.016), (38, -0.002), (39, 0.017), (40, 0.029), (41, 0.015), (42, -0.03), (43, -0.016), (44, 0.008), (45, -0.021), (46, -0.041), (47, 0.006), (48, 0.049), (49, 0.015)]
simIndex simValue blogId blogTitle
same-blog 1 0.97774357 1505 high scalability-2013-08-22-The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, Second edition
Introduction: Google has released an epic second edition of their ground breaking The Datacenter as a Computer book. It's called an introduction, but at 156 pages I would love to see what the Advanced version would look like! John Fries in a G+ comment has what I think is a perfect summary of the ultimate sense of the book: It's funny, when I was at Google I was initially quite intimidated by interacting with an enormous datacenter, and then I started imagining the entire datacenter was shrunk down into a small box sitting on my desk, and realized it was just another machine and the physical size didn't matter anymore It's such a far ranging book that it's impossible to characterize simply. It covers an amazing diversity of topics, from an introduction to warehouse-scale computing; workloads and software infrastructure; hardware; datacenter architecture; energy and power efficiency; cost structures; how to deal with failures and repairs; and it closes with a discussion of key challenge
2 0.81402397 284 high scalability-2008-03-19-RAD Lab is Creating a Datacenter Operating System
Introduction: The RAD Lab (Reliable Adaptive Distributed Systems Laboratory) wants to leapfrog the Big Switch and create The Next Big Switch, skipping the cloud/utility evolutionary stage altogether. This hyper-evolutionary niche buster develops technology so advanced the cloud disperses and you can go back to building your own personal datacenters again. Where Google took years to create their datacenters, using a prefab Datacenter Operating System you might create your own in a long holiday weekend. Not St. Patrick's of course. Their vision: Enable one person to invent and run the next revolutionary IT service, operationally expressing a new business idea as a multi-million-user service over the course of a long weekend. By doing so we hope to enable an Internet "Fortune 1 million". How? By wizardry in the form of a “datacenter operating system” created from a pinch of "statistical machine learning (SML)" and a tincture of "recent insights from networking and distributed systems." Bu
3 0.76979929 1107 high scalability-2011-08-29-The Three Ages of Google - Batch, Warehouse, Instant
Introduction: The world has changed. And some things that should not have been forgotten, were lost. I found these words from the Lord of the Rings echoing in my head as I listened to a fascinating presentation by Luiz André Barroso , Distinguished Engineer at Google, concerning Google's legendary past, golden present, and apocryphal future. His talk, Warehouse-Scale Computing: Entering the Teenage Decade , was given at the Federated Computing Research Conference . Luiz clearly knows his stuff and was early at Google, so he has a deep and penetrating perspective on the technology. There's much to learn from, think about, and build. Lord of the Rings applies at two levels. At the change level, Middle Earth went through three ages . While listening to Luiz talk, it seems so has Google: Batch (indexes calculated every month), Warehouse (the datacenter is the computer), and Instant (make it all real-time). At the "what was forgot" level, in the Instant Age section of the talk, a common theme was
Introduction: Oh, you don't have a Quantum Computer Lab staffed with researchers? Well, Google does. Here they are on G+ . To learn what they are up to the Verge has A first look inside Google's futuristic quantum lab . The lab is partnership between NASA, Google, and a 512-qubit D-Wave Two quantum computer. One result from the lab is: The first practical application has been on Google Glass, as engineers put the quantum chips to work on Glass's blink detector, helping it to better distinguish between intentional winks and involuntary blinks. For engineering reasons, the quantum processor can never be installed in Glass, but together with Google's conventional server centers, it can point the way to a better blink-detecting algorithm. That would allow the Glass processor to detect blinks with better accuracy and using significantly less power. If successful, it could be an important breakthrough for wink-triggered apps, which have struggled with the task so far. Google thinks quantum
Introduction: Algorithms are moving out of the Platonic realm and are becoming dynamic first class players in real life. We've seen corporations become people. Algorithms will likely also follow that path to agency. Kevin Slavin in his intriguing TED talk: How Algorithms Shape Our World , gives many and varied examples of how algorithms have penetrated RL. One of his most interesting examples is from a highly technical paper on Relativistic statistical arbitrage , which says to make money on markets you have to be where the people are, the red dots (on the diagram below), which means you have to put servers where the blue dots are, many of which are in the ocean. Here's the diagram from the paper: Mr. Slavin neatly sums this up by saying: And it's not the money that's so interesting actually. It's what the money motivates, that we're actually terraforming the Earth itself with this kind of algorithmic efficiency . And in that light, you go back and you look at Michael Najjar's ph
6 0.72771901 839 high scalability-2010-06-09-Paper: Propagation Networks: A Flexible and Expressive Substrate for Computation
7 0.72389972 1234 high scalability-2012-04-26-Akaros - an open source operating system for manycore architectures
8 0.720285 439 high scalability-2008-11-10-Scalability Perspectives #1: Nicholas Carr – The Big Switch
10 0.71274865 1039 high scalability-2011-05-12-Paper: Mind the Gap: Reconnecting Architecture and OS Research
11 0.69613779 309 high scalability-2008-04-23-Behind The Scenes of Google Scalability
13 0.68727493 387 high scalability-2008-09-22-Paper: On Delivering Embarrassingly Distributed Cloud Services
14 0.68491918 753 high scalability-2009-12-21-Hot Holiday Scalability Links for 2009
15 0.68093807 1344 high scalability-2012-10-19-Stuff The Internet Says On Scalability For October 19, 2012
16 0.67984253 1177 high scalability-2012-01-19-Is it time to get rid of the Linux OS model in the cloud?
17 0.67959541 1127 high scalability-2011-09-28-Pursue robust indefinite scalability with the Movable Feast Machine
18 0.6790061 1116 high scalability-2011-09-15-Paper: It's Time for Low Latency - Inventing the 1 Microsecond Datacenter
19 0.67251837 765 high scalability-2010-01-25-Let's Welcome our Neo-Feudal Overlords
topicId topicWeight
[(1, 0.117), (2, 0.197), (10, 0.03), (26, 0.013), (40, 0.026), (51, 0.011), (55, 0.162), (56, 0.03), (61, 0.118), (77, 0.047), (79, 0.129), (85, 0.03), (94, 0.015)]
simIndex simValue blogId blogTitle
same-blog 1 0.92867678 1505 high scalability-2013-08-22-The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, Second edition
Introduction: Google has released an epic second edition of their ground breaking The Datacenter as a Computer book. It's called an introduction, but at 156 pages I would love to see what the Advanced version would look like! John Fries in a G+ comment has what I think is a perfect summary of the ultimate sense of the book: It's funny, when I was at Google I was initially quite intimidated by interacting with an enormous datacenter, and then I started imagining the entire datacenter was shrunk down into a small box sitting on my desk, and realized it was just another machine and the physical size didn't matter anymore It's such a far ranging book that it's impossible to characterize simply. It covers an amazing diversity of topics, from an introduction to warehouse-scale computing; workloads and software infrastructure; hardware; datacenter architecture; energy and power efficiency; cost structures; how to deal with failures and repairs; and it closes with a discussion of key challenge
2 0.92265427 468 high scalability-2008-12-17-Ringo - Distributed key-value storage for immutable data
Introduction: Ringo is an experimental, distributed, replicating key-value store based on consistent hashing and immutable data. Unlike many general-purpose databases, Ringo is designed for a specific use case: For archiving small (less than 4KB) or medium-size data items (<100MB) in real-time so that the data can survive K - 1 disk breaks, where K is the desired number of replicas, without any downtime, in a manner that scales to terabytes of data. In addition to storing, Ringo should be able to retrieve individual or small sets of data items with low latencies (<10ms) and provide a convenient on-disk format for bulk data access. Ringo is compatible with the map-reduce framework Disco and it was started at Nokia Research Center Palo Alto.
3 0.87918562 637 high scalability-2009-06-24-Habits of Highly Scalable Web Applications
Introduction: Nick Belhomme wrote up a excellent summary of a talk given by Eli White on building scalable web applications. Eli worked at digg.com and is now the PHP Community Manager & DevZone Editor-in-Chief at Zend Technologies. Eli takes us on a grand tour through various proven scaling strategies. On the trip you'll visit: What is scalable application design Tip 1: load balancing the webserver Tip 2: scaling from a single DB server to a Master-Slave setup Tip 3: Partitioning, Vertical DB Scaling Tip 4: Partitioning, horizontal DB Scaling Tip 5: Application Level Partitioning Tip 6: Caching to get around your database Resources
Introduction: If you are Google you don't just complain about performance on the web, you do something about it. Doing something about web performance is the job of one Ilya Grigorik , Developer Advocate, Make the Web Fast at Google, and author of a great new book: High Performance Browser Networking: What every web developer should know about networking and web performance . That's a big topic you might be saying to yourself. And it is. The book is 400 plus information packed pages. But never fear. Ilya writes in a very straightforward style. It’s like a man page for the web. Which is a good thing. In case you are not familiar with Ilya, he's the perfect choice for writing such an ambitious book. For years Ilya has been producing excellent content on his blog and if you search YouTube you'll find presentation after presentation on the topics found in the book. Authority established. Reading the book I was struck by what a complicated beast or little World Wide Web has become. That's
Introduction: There has been an update on Pinterest: Pinterest growth driven by Amazon cloud scalability since our last post: A Short on the Pinterest Stack for Handling 3+ Million Users . With Pinterest we see a story very similar to that of Instagram . Huge growth, lots of users, lots of data, with remarkably few employees, all on the cloud. While it's true that both Pinterest and Instagram are not making great advances in science and technology , that is more indicator of the easy power of today's commodity environments rather than a sign of Silicon Valley's lack of innovation. The numbers are so huge and the valuations are so high we naturally want some sort of fundamental technological revolution to underlie their growth. The revolution is more subtle. It really is just that easy to attain such growth these days, if you can execute on the right idea. Get used to it. This is the new normal. Here's what Pinterest looks like today: 80 million objects stored in S3 with 410 terabytes
6 0.85752475 1020 high scalability-2011-04-12-Caching and Processing 2TB Mozilla Crash Reports in memory with Hazelcast
7 0.85686189 1107 high scalability-2011-08-29-The Three Ages of Google - Batch, Warehouse, Instant
8 0.85387278 1037 high scalability-2011-05-10-Viddler Architecture - 7 Million Embeds a Day and 1500 Req-Sec Peak
9 0.85260564 1007 high scalability-2011-03-18-Stuff The Internet Says On Scalability For March 18, 2011
10 0.85204428 1187 high scalability-2012-02-03-Stuff The Internet Says On Scalability For February 3, 2012
11 0.85196269 733 high scalability-2009-10-29-Paper: No Relation: The Mixed Blessings of Non-Relational Databases
12 0.85189831 687 high scalability-2009-08-24-How Google Serves Data from Multiple Datacenters
13 0.85175157 851 high scalability-2010-07-02-Hot Scalability Links for July 2, 2010
14 0.8515451 1153 high scalability-2011-12-08-Update on Scalable Causal Consistency For Wide-Area Storage With COPS
15 0.85133052 1302 high scalability-2012-08-10-Stuff The Internet Says On Scalability For August 10, 2012
16 0.85082859 1502 high scalability-2013-08-16-Stuff The Internet Says On Scalability For August 16, 2013
17 0.8508094 331 high scalability-2008-05-27-eBay Architecture
18 0.85066217 1067 high scalability-2011-06-24-Stuff The Internet Says On Scalability For June 24, 2011
19 0.85059947 1600 high scalability-2014-02-21-Stuff The Internet Says On Scalability For February 21st, 2014
20 0.85031134 1567 high scalability-2013-12-20-Stuff The Internet Says On Scalability For December 20th, 2013