high_scalability high_scalability-2010 high_scalability-2010-919 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Every time a technological innovation has spurred automation – since the time of Henry Ford right up to a minute ago – someone has claimed that machines will displace human beings. But the rainbow and unicorn dream attributed to business stakeholders everywhere, i.e. the elimination of IT, is just that – a dream. It isn’t realistic and in fact it’s downright silly to think that systems that only a few years ago were unable to automatically scale up and scale down will suddenly be able to perform the complex analysis required of IT to keep the business running. The rare reports of the elimination of IT staff due to cloud computing and automation are highlighted in the news because they evoke visceral reactions in technologists everywhere and, to be honest, they get the click counts rising. But the jury remains out on this one and in fact many postulate that it is not a reduction in staff that will occur, but a transformation of staff, which may eliminate some old timey positions
sentIndex sentText sentNum sentScore
1 Every time a technological innovation has spurred automation – since the time of Henry Ford right up to a minute ago – someone has claimed that machines will displace human beings. [sent-1, score-0.418]
2 It isn’t realistic and in fact it’s downright silly to think that systems that only a few years ago were unable to automatically scale up and scale down will suddenly be able to perform the complex analysis required of IT to keep the business running. [sent-5, score-0.352]
3 The rare reports of the elimination of IT staff due to cloud computing and automation are highlighted in the news because they evoke visceral reactions in technologists everywhere and, to be honest, they get the click counts rising. [sent-6, score-0.395]
4 But the jury remains out on this one and in fact many postulate that it is not a reduction in staff that will occur, but a transformation of staff, which may eliminate some old timey positions (think sysadmins) and create new ones requiring new skills (think devops). [sent-7, score-0.373]
5 Andi Mann (VP with CA Technologies ) put it well when he says yes, IT staff reductions are always a possible outcome of better IT, “ Yet with a sunk cost in training and skills, and the seemingly endless list of projects on most CIOs’ desks, is cutting staff numbers really a good outcome? [sent-10, score-0.501]
6 ” It is that “seemingly endless list of projects” that makes a mass reduction in IT unlikely along with the fact that systems are simply not ready to “take over” from human beings. [sent-12, score-0.395]
7 The “intelligence” that exists in any system today is little more than a codified set of rules that were specified by - wait for it, wait for it – yes, a human being. [sent-18, score-0.575]
8 It was a person who sat down and codified a set of basic rules for automatically responding to deviances in performance and capacity and specified what action should be taken. [sent-19, score-0.337]
9 It is only when they are seen and understood by a human being that they become valuable and become “information”. [sent-24, score-0.376]
10 The same is true of the data that flies around a data center and upon which decisions are made: it’s just data, even to the systems, until it’s interpreted by a human being. [sent-25, score-0.542]
11 Even after it’s interpreted in its proper context this number requires further analysis to become valuable. [sent-36, score-0.369]
12 The 150 minute-long outage , during which time the site was turned off completely, was the result of a single incorrect setting that produced a cascade of erroneous traffic, Facebook software engineering director Robert Johnson said in a posting to the site . [sent-45, score-0.269]
13 "Today we made a change to the persistent copy of a configuration value that was interpreted as invalid . [sent-46, score-0.318]
14 "To make matters worse, every time a client got an error attempting to query one of the databases, it interpreted it as an invalid value and deleted the corresponding cache key," he added. [sent-49, score-0.318]
15 At no point did the system even recognize that something was wrong, that took a human being. [sent-55, score-0.429]
16 It was just acting on data because that’s all it can do; it cannot analyze and interpret that data into information that leads to the right action. [sent-60, score-0.253]
17 Until it can, we don’t really need a “Three Laws of Cloud” because the systems are not capable of performing the kind of analysis necessary to even recognize its actions might be harming the very applications it is built to deliver (an adaptation of Asimov’s Second Law of Robotics ). [sent-61, score-0.257]
18 History teaches us that assembly line technologies, which is as close a real-world analogy to automation and IT as we’re likely to get, do not reduce the number of human beings required to monitor, manage, and improve the processes codified to achieve such automation. [sent-69, score-0.771]
19 Instead, it frees human beings to do what they are best at: analyzing, innovating and finding new ways to do what we’ve always done that are more efficient. [sent-70, score-0.318]
20 And if we’re lucky, that means that the business stakeholders will stop treating them as though they’re machines and start leveraging their people skills instead. [sent-86, score-0.316]
wordName wordTfidf (topN-words)
[('human', 0.238), ('codified', 0.201), ('interpreted', 0.16), ('skills', 0.143), ('staff', 0.142), ('ford', 0.142), ('elimination', 0.142), ('interpret', 0.126), ('disparate', 0.126), ('recognize', 0.118), ('johnson', 0.113), ('intelligence', 0.111), ('automobile', 0.111), ('olds', 0.111), ('stakeholders', 0.111), ('automation', 0.111), ('outage', 0.107), ('automotive', 0.101), ('erroneous', 0.101), ('convinced', 0.095), ('fact', 0.088), ('daughter', 0.084), ('henry', 0.082), ('invalid', 0.08), ('beings', 0.08), ('worse', 0.079), ('outcome', 0.078), ('value', 0.078), ('meant', 0.076), ('number', 0.074), ('even', 0.073), ('upon', 0.071), ('seemingly', 0.07), ('ago', 0.069), ('cars', 0.069), ('become', 0.069), ('endless', 0.069), ('yes', 0.068), ('rules', 0.068), ('specified', 0.068), ('unable', 0.067), ('processes', 0.067), ('analysis', 0.066), ('could', 0.064), ('analyze', 0.064), ('acting', 0.063), ('manually', 0.063), ('business', 0.062), ('produced', 0.061), ('ultimately', 0.061)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999976 919 high scalability-2010-10-14-I, Cloud
Introduction: Every time a technological innovation has spurred automation – since the time of Henry Ford right up to a minute ago – someone has claimed that machines will displace human beings. But the rainbow and unicorn dream attributed to business stakeholders everywhere, i.e. the elimination of IT, is just that – a dream. It isn’t realistic and in fact it’s downright silly to think that systems that only a few years ago were unable to automatically scale up and scale down will suddenly be able to perform the complex analysis required of IT to keep the business running. The rare reports of the elimination of IT staff due to cloud computing and automation are highlighted in the news because they evoke visceral reactions in technologists everywhere and, to be honest, they get the click counts rising. But the jury remains out on this one and in fact many postulate that it is not a reduction in staff that will occur, but a transformation of staff, which may eliminate some old timey positions
2 0.17113054 910 high scalability-2010-09-30-Facebook and Site Failures Caused by Complex, Weakly Interacting, Layered Systems
Introduction: Facebook has been so reliable that when a site outage does occur it's a definite learning opportunity. Fortunately for us we can learn something because in More Details on Today's Outage , Facebook's Robert Johnson gave a pretty candid explanation of what caused a rare 2.5 hour period of down time for Facebook. It wasn't a simple problem. The root causes were feedback loops and transient spikes caused ultimately by the complexity of weakly interacting layers in modern systems. You know, the kind everyone is building these days. Problems like this are notoriously hard to fix and finding a real solution may send Facebook back to the whiteboard. There's a technical debt that must be paid. The outline and my interpretation (reading between the lines) of what happened is: Remember that Facebook caches everything . They have 28 terabytes of memcached data on 800 servers. The database is the system of record, but memory is where the action is. So when a problem happens that i
Introduction: "But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but consider we have no planet wide applications yet. None.Tomorrow the numbers foreshadow a newCambrian explosionof connectivity that will look as
Introduction: All in all this is still my favorite post and I still think it's an accurate vision of a future. Not everyone agrees, but I guess we'll see..."But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but c
5 0.14293469 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
Introduction: It remains that, from the same principles, I now demonstrate the frame of the System of the World. -- Isaac Newton The practice of IT reminds me a lot of the practice of science before Isaac Newton. Aristotelianism was dead, but there was nothing to replace it. Then Newton came along, created a scientific revolution with his System of the World . And everything changed. That was New System of the World number one. New System of the World number two was written about by the incomparable Neal Stephenson in his incredible Baroque Cycle series. It explores the singular creation of a new way of organizing society grounded in new modes of thought in business, religion, politics, and science. Our modern world emerged Enlightened as it could from this roiling cauldron of forces. In IT we may have had a Leonardo da Vinci or even a Galileo, but we’ve never had our Newton. Maybe we don't need a towering genius to make everything clear? For years startups, like the frenetically inventive
6 0.12814279 96 high scalability-2007-09-18-Amazon Architecture
7 0.12381827 1366 high scalability-2012-12-03-Resiliency is the New Normal - A Deep Look at What It Means and How to Build It
8 0.12025638 1592 high scalability-2014-02-07-Stuff The Internet Says On Scalability For February 7th, 2014
9 0.11907109 881 high scalability-2010-08-16-Scaling an AWS infrastructure - Tools and Patterns
10 0.11874673 1571 high scalability-2014-01-02-xkcd: How Standards Proliferate:
11 0.11685452 1600 high scalability-2014-02-21-Stuff The Internet Says On Scalability For February 21st, 2014
12 0.11661829 1204 high scalability-2012-03-06-Ask For Forgiveness Programming - Or How We'll Program 1000 Cores
14 0.11601128 920 high scalability-2010-10-15-Troubles with Sharding - What can we learn from the Foursquare Incident?
15 0.11597391 954 high scalability-2010-12-06-What the heck are you actually using NoSQL for?
16 0.11376438 538 high scalability-2009-03-16-Are Cloud Based Memory Architectures the Next Big Thing?
17 0.11166125 1502 high scalability-2013-08-16-Stuff The Internet Says On Scalability For August 16, 2013
20 0.11016607 691 high scalability-2009-08-31-Squarespace Architecture - A Grid Handles Hundreds of Millions of Requests a Month
topicId topicWeight
[(0, 0.238), (1, 0.101), (2, 0.035), (3, 0.052), (4, 0.011), (5, -0.046), (6, -0.008), (7, 0.068), (8, -0.019), (9, -0.056), (10, -0.012), (11, 0.053), (12, 0.01), (13, 0.018), (14, 0.081), (15, -0.024), (16, 0.06), (17, -0.004), (18, -0.02), (19, 0.04), (20, 0.001), (21, -0.017), (22, 0.062), (23, 0.047), (24, -0.025), (25, 0.029), (26, -0.059), (27, 0.007), (28, -0.011), (29, 0.014), (30, -0.058), (31, 0.029), (32, 0.011), (33, 0.04), (34, 0.011), (35, 0.037), (36, 0.043), (37, -0.002), (38, 0.042), (39, -0.037), (40, -0.029), (41, -0.041), (42, -0.041), (43, -0.006), (44, 0.009), (45, -0.006), (46, -0.02), (47, -0.021), (48, 0.018), (49, 0.005)]
simIndex simValue blogId blogTitle
same-blog 1 0.96871281 919 high scalability-2010-10-14-I, Cloud
Introduction: Every time a technological innovation has spurred automation – since the time of Henry Ford right up to a minute ago – someone has claimed that machines will displace human beings. But the rainbow and unicorn dream attributed to business stakeholders everywhere, i.e. the elimination of IT, is just that – a dream. It isn’t realistic and in fact it’s downright silly to think that systems that only a few years ago were unable to automatically scale up and scale down will suddenly be able to perform the complex analysis required of IT to keep the business running. The rare reports of the elimination of IT staff due to cloud computing and automation are highlighted in the news because they evoke visceral reactions in technologists everywhere and, to be honest, they get the click counts rising. But the jury remains out on this one and in fact many postulate that it is not a reduction in staff that will occur, but a transformation of staff, which may eliminate some old timey positions
2 0.8588894 1225 high scalability-2012-04-09-Why My Slime Mold is Better than Your Hadoop Cluster
Introduction: Update : Organism without a brain creates external memories for navigation shows slime mold is even cooler than originally thought, storing a record of where it's been using slime: The authors conclude, the slime isn't just the mold's calling card. Instead, it's a way of marking the environment so that the organism can sense where it's been, and not expend effort on searches that won't pay off. Although the situation isn't an exact parallel, the authors make a comparison to the pheromone trails used by ants. In After Life: The Strange Science Of Decay there’s a truly incredible sequence of gorgeously shot video showing how creeping slime mold solves mazes and performs other other amazing feats of computation. Take a look at what simple one celled organisms can do: The whole video is really well done and shockingly revelatory. It’s the story of decay, how atoms created during the Big Bang and through countless supernova explosions are continually rearranged an
Introduction: Update 17 : Are Wireless Road Trains the Cure for Traffic Congestion? BY ADDY DUGDALE . The concept of road trains--up to eight vehicles zooming down the road together--has long been considered a faster, safer, and greener way of traveling long distances by car Update 16: The first electric vehicle in the country powered completely by ultracapacitors . The minibus can be fully recharged in fifteen minutes, unlike battery vehicles, which typically takes hours to recharge. Update 15: How to Make UAVs Fully Autonomous . The Sense-and-Avoid system uses a four-megapixel camera on a pan tilt to detect obstacles from the ground. It puts red boxes around planes and birds, and blue boxes around movement that it determines is not an obstacle (e.g., dust on the lens). Update 14: ATNMBL is a concept vehicle for 2040 that represents the end of driving and an alternative approach to car design. Upon entering ATNMBL, you are presented with a simple question: "Where can I take you
4 0.82437867 1500 high scalability-2013-08-12-100 Curse Free Lessons from Gordon Ramsay on Building Great Software
Introduction: Gordon Ramsay is a world renowned chef with a surprising amount to say on software development. Well, he says it about cooking and running a restaurant, but it applies to software development too. You may have seen Gordon Ramsay on one of his many TV shows. Hell's Kitchen is a competition between chefs trying to win a dream job: head chef of their own high-end restaurant. On this show Ramsay is judge, jury, and executioner. And he chops off more than a few heads. Kitchen Nightmares is a show where Ramsay is called in by restaurant owners to help turn around their failing restaurants. On this show Ramsay is there to help. If you just watch Hell's Kitchen you will likely conclude Ramsay is one of the devil's own helpers ("ram" is the symbol of the devil and "say" means he speaks for the devil: Ramsay). Ramsay screams, yells, cusses, belittles, and throws tantrums even a 7 year old could learn from. Then he does it all over gain just for spite. In Hell's Kitchen there's no evidence a
5 0.82133627 1503 high scalability-2013-08-19-What can the Amazing Race to the South Pole Teach us About Startups?
Introduction: At the heart of every software adventure exists a journey in service of a quest. Melodramatic much? Sorry, but while wandering dazzled through Race to the End of the Earth , a fantastic exhibit at the Royal BC Museum on the 1911-1912 race to the South Pole between Norwegian explorer Roald Amundsen and British naval officer Robert Scott , I couldn’t help but think of the two radically different approaches each team took to the race and it shocked me to see that some of the same principles that lead to success or failure in software development also seem to lead to success or failure in exploration. I wish I could reproduce the experience of walking through the exhibit . Plaque after plaque I remember wondering out loud at Scott’s choices and then nod in agreement with Amundsen’s approach. The core conflict was straight out of any ancient Agile (Amundsen) vs Waterfall (Scott) thread you can find on Usenet. And Waterfall lost. As background here are some sources you may want
6 0.81905848 863 high scalability-2010-07-22-How can we spark the movement of research out of the Ivory Tower and into production?
7 0.81566024 347 high scalability-2008-07-07-Five Ways to Stop Framework Fixation from Crashing Your Scaling Strategy
8 0.81529987 1204 high scalability-2012-03-06-Ask For Forgiveness Programming - Or How We'll Program 1000 Cores
9 0.81122899 1526 high scalability-2013-10-02-RFC 1925 - The Twelve (Timeless) Networking Truths
10 0.81033128 1592 high scalability-2014-02-07-Stuff The Internet Says On Scalability For February 7th, 2014
11 0.80993432 1366 high scalability-2012-12-03-Resiliency is the New Normal - A Deep Look at What It Means and How to Build It
12 0.80683678 311 high scalability-2008-04-29-Strategy: Sample to Reduce Data Set
13 0.803886 1506 high scalability-2013-08-23-Stuff The Internet Says On Scalability For August 23, 2013
14 0.80299056 1209 high scalability-2012-03-14-The Azure Outage: Time Is a SPOF, Leap Day Doubly So
15 0.79680395 1410 high scalability-2013-02-20-Smart Companies Fail Because they Do Everything Right - Staying Alive to Scale
16 0.79534608 352 high scalability-2008-07-18-Robert Scoble's Rules for Successfully Scaling Startups
17 0.79412496 1381 high scalability-2013-01-04-Stuff The Internet Says On Scalability For January 4, 2013
18 0.79383898 1607 high scalability-2014-03-07-Stuff The Internet Says On Scalability For March 7th, 2014
19 0.79115915 1377 high scalability-2012-12-26-Ask HS: What will programming and architecture look like in 2020?
topicId topicWeight
[(1, 0.141), (2, 0.192), (4, 0.179), (10, 0.024), (20, 0.011), (30, 0.035), (40, 0.021), (47, 0.017), (51, 0.012), (61, 0.084), (77, 0.041), (79, 0.097), (85, 0.032), (94, 0.034)]
simIndex simValue blogId blogTitle
Introduction: Facebook has been teasing us. While many of their recent acquisitions have been surprising, shocking is the only word adequately describing Facebook's 5 day whirlwind acquisition of Oculus , immersive virtual reality visionaries, for a now paltry sounding $2 billion. The backlash is a pandemic, jumping across social networks with the speed only a meme powered by the directly unaffected can generate. For more than 30 years VR has been the dream burning in the heart of every science fiction fan. Now that this future might finally be here, Facebook’s ownage makes it seem like a wonderful and hopeful timeline has been choked off, killing the Metaverse before it even had a chance to begin. For the many who voted for an open future with their Kickstarter dollars , there’s a deep and personal sense of betrayal, despite Facebook’s promise to leave Oculus alone. The intensity of the reaction is because Oculus matters to people. It's new, it's different, it create
2 0.92645246 12 high scalability-2007-07-15-Isilon Clustred Storage System
Introduction: The Isilon IQ family of clustered storage systems was designed from the ground up to meet the needs of data-intensive enterprises and high-performance computing environments. By combining Isilon's OneFS® operating system software with the latest advances in industry-standard hardware, Isilon delivers modular, pay-as-you-grow, enterprise-class clustered storage systems. OneFS, with TrueScale™ technology, powers the industry's first and only storage system that enables linear or independent scaling of performance and capacity. This new flexible and tunable system, featuring a robust suite of clustered storage software applications, provides customers with an "out of the box" solution that is fully optimized for the widest range of applications and workflow needs. * Scales from 4 TB ti 1 PB * Throughput of up to 10 GB per seond * Linear scaling * Easy to manage Related Articles Inside Skinny On Isilon by StorageMojo
Introduction: It’s called “east-west” networking, which when compared to its predecessor, “north-south” networking, evinces images of maelstroms and hurricane winds and tsunamis for some reason. It could be the subtle correlation between the transformative shift this change in networking patterns has on the data center with that of El Niño’s transformative power upon the weather patterns across the globe. Traditionally, data center networks have focused on North-South network traffic. The assumption is that clients on the edge would mainly communicate with servers at the core, rather than across the network to other clients. But server virtualization changes all this, with servers, virtual appliances and even virtual desktops scattered across the same physical infrastructure. These environments are also highly dynamic, with workloads moving to different physical locations on the network as virtual servers are migrated (in the case of data center networks) and clients move
same-blog 4 0.91748887 919 high scalability-2010-10-14-I, Cloud
Introduction: Every time a technological innovation has spurred automation – since the time of Henry Ford right up to a minute ago – someone has claimed that machines will displace human beings. But the rainbow and unicorn dream attributed to business stakeholders everywhere, i.e. the elimination of IT, is just that – a dream. It isn’t realistic and in fact it’s downright silly to think that systems that only a few years ago were unable to automatically scale up and scale down will suddenly be able to perform the complex analysis required of IT to keep the business running. The rare reports of the elimination of IT staff due to cloud computing and automation are highlighted in the news because they evoke visceral reactions in technologists everywhere and, to be honest, they get the click counts rising. But the jury remains out on this one and in fact many postulate that it is not a reduction in staff that will occur, but a transformation of staff, which may eliminate some old timey positions
5 0.90503377 1213 high scalability-2012-03-22-Paper: Revisiting Network I-O APIs: The netmap Framework
Introduction: Here's a really good article in the Communications of the ACM on reducing network packet processing overhead by redesigning the network stack: Revisiting Network I/O APIs: The Netmap Framework by Luigi Rizzo . As commodity networking performance increases operating systems need to keep up or all those CPUs will go to waste. How do they make this happen? Abstract: Today 10-gigabit interfaces are used more and more in datacenters and servers. On these links, packets flow as fast as one every 67.2 nanoseconds, yet modern operating systems can take 10-20 times longer just to move one packet between the wire and the application. We can do much better, not with more powerful hardware but by revising architectural decisions made long ago regarding the design of device drivers and network stacks. The netmap framework is a promising step in this direction. Thanks to a careful design and the engineering of a new packet I/O API, netmap eliminates much unnecessary overhead and moves
6 0.90123773 916 high scalability-2010-10-07-Hot Scalability Links For Oct 8, 2010
8 0.86106199 670 high scalability-2009-08-05-Anti-RDBMS: A list of distributed key-value stores
9 0.86097544 1436 high scalability-2013-04-05-Stuff The Internet Says On Scalability For April 5, 2013
10 0.85946083 309 high scalability-2008-04-23-Behind The Scenes of Google Scalability
11 0.85105902 79 high scalability-2007-09-01-On-Demand Infinitely Scalable Database Seed the Amazon EC2 Cloud
12 0.84116721 1620 high scalability-2014-03-27-Strategy: Cache Stored Procedure Results
13 0.83975762 469 high scalability-2008-12-17-Scalability Strategies Primer: Database Sharding
14 0.83539295 1343 high scalability-2012-10-18-Save up to 30% by Selecting Better Performing Amazon Instances
15 0.83532178 106 high scalability-2007-10-02-Secrets to Fotolog's Scaling Success
16 0.83520508 1589 high scalability-2014-02-03-How Google Backs Up the Internet Along With Exabytes of Other Data
18 0.83391225 1538 high scalability-2013-10-28-Design Decisions for Scaling Your High Traffic Feeds
19 0.83347011 282 high scalability-2008-03-18-Database War Stories #3: Flickr
20 0.83293009 1302 high scalability-2012-08-10-Stuff The Internet Says On Scalability For August 10, 2012