high_scalability high_scalability-2010 high_scalability-2010-778 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. Earlier we talked about how a single botnet could harness more compute power than our largest super computers. Well, that's just the start of it. The amount of computer power available to the Ambient Cloud will be truly astounding. 2 Billion Personal Computers The number of personal computers is still growing. By 2014 one estimate is there will be 2 billion PCs . That's a giant reservoir of power to exploit, especially considering these new boxes are stuffed with multiple powerful processors and gigabytes of memory. 7 Billion Smartphones By now it's common wisdom smartphones are the computing platform of the future. It's plausible to assume the total number of mobile phones in use will roughly equal the number of people on earth. That's 7 billion smartphones. Smartphones aren't just tiny little wannabe computers anymore either. They are rea
sentIndex sentText sentNum sentScore
1 Earlier we talked about how a single botnet could harness more compute power than our largest super computers. [sent-2, score-0.367]
2 The amount of computer power available to the Ambient Cloud will be truly astounding. [sent-4, score-0.289]
3 2 Billion Personal Computers The number of personal computers is still growing. [sent-5, score-0.242]
4 That's a giant reservoir of power to exploit, especially considering these new boxes are stuffed with multiple powerful processors and gigabytes of memory. [sent-7, score-0.31]
5 7 Billion Smartphones By now it's common wisdom smartphones are the computing platform of the future. [sent-8, score-0.311]
6 Their computing capabilities will only increase as smartphones are fit with more processors and more graphics processors . [sent-19, score-0.551]
7 Tilera founder Anant Agarwal estimates by 2017 embedded processors could have 4,096 cores, server CPUs might have 512 cores and desktop chips could use 128 cores. [sent-21, score-0.336]
8 But all the compute power in the world is of little use if the cores can't talk to each other. [sent-29, score-0.436]
9 The Cell Network Bandwidth and Latency Question Aren't cell phone networks slow and have high latencies? [sent-30, score-0.346]
10 But the technology trend is towards much higher bandwidth cell connections and reasonable latencies. [sent-32, score-0.325]
11 For cell connections your milleage may vary considerably as cell performance changes on a cell-by-cell manner according to the individual site's local demographics, projected traffic demand and the target coverage area of the cell. [sent-34, score-0.679]
12 Current bandwidth rates and latencies for cell networks don't make them a sturdy a platform on which to build a cloud. [sent-49, score-0.557]
13 True HPC (high performance computing) low-latency-interconnect applications won't find a cell based cloud attractive at all. [sent-51, score-0.348]
14 But for applications that can be designed to be highly parallel and deal with short latencies, cell based clouds look attractive. [sent-53, score-0.25]
15 Another potential source of distributed compute power are sensors on smart grids . [sent-64, score-0.457]
16 While these are certainly just educated guesstimates about the potential size of the smart grid, it's clear it forms another massive potential compute platform for the cloud. [sent-69, score-0.408]
17 There are billions of humans and with multiple processors per human and communication network, it will be possible to integrate another huge pool of compute resources into the larger grid. [sent-83, score-0.392]
18 Let's compare the collective power of PCs + smartphones + smart grid + smart everything + BANs with the traditional cloud: it's trillions against many 10s of millions. [sent-85, score-0.748]
19 And there are many many more distributed computing projects like SETI@home supplying huge amounts of compute power to their users. [sent-101, score-0.381]
20 Plura is an excellent example of how these resources can be used as a compute grid, the next step is think of all these resources can be used as an application runtime. [sent-113, score-0.276]
wordName wordTfidf (topN-words)
[('cell', 0.25), ('smartphones', 0.221), ('ambient', 0.215), ('compute', 0.158), ('cores', 0.145), ('plura', 0.142), ('latencies', 0.136), ('power', 0.133), ('specialty', 0.13), ('processors', 0.12), ('projected', 0.11), ('computer', 0.103), ('cloud', 0.098), ('networks', 0.096), ('computers', 0.096), ('grid', 0.096), ('bans', 0.094), ('home', 0.091), ('computing', 0.09), ('seti', 0.089), ('personal', 0.086), ('kbps', 0.085), ('potential', 0.084), ('iphone', 0.083), ('smart', 0.082), ('mbps', 0.08), ('collective', 0.078), ('super', 0.076), ('bandwidth', 0.075), ('runner', 0.074), ('billion', 0.074), ('gb', 0.071), ('estimates', 0.071), ('million', 0.071), ('autonomic', 0.07), ('area', 0.069), ('blade', 0.069), ('formed', 0.068), ('meets', 0.062), ('network', 0.062), ('number', 0.06), ('become', 0.06), ('resources', 0.059), ('giant', 0.057), ('traditional', 0.056), ('capacity', 0.056), ('larger', 0.055), ('truly', 0.053), ('packet', 0.053), ('assume', 0.053)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999994 778 high scalability-2010-02-15-The Amazing Collective Compute Power of the Ambient Cloud
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. Earlier we talked about how a single botnet could harness more compute power than our largest super computers. Well, that's just the start of it. The amount of computer power available to the Ambient Cloud will be truly astounding. 2 Billion Personal Computers The number of personal computers is still growing. By 2014 one estimate is there will be 2 billion PCs . That's a giant reservoir of power to exploit, especially considering these new boxes are stuffed with multiple powerful processors and gigabytes of memory. 7 Billion Smartphones By now it's common wisdom smartphones are the computing platform of the future. It's plausible to assume the total number of mobile phones in use will roughly equal the number of people on earth. That's 7 billion smartphones. Smartphones aren't just tiny little wannabe computers anymore either. They are rea
2 0.81770724 768 high scalability-2010-02-01-What Will Kill the Cloud?
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. If datacenters are the new castles, then what will be the new gunpowder? As soon as gunpowder came on the scene, castles, which are defensive structures, quickly became the future's cold, drafty hotels. Gunpowder fueled cannon balls make short work of castle walls. There's a long history of "gunpowder" type inventions in the tech industry. PCs took out the timeshare model. The cloud is taking out the PC model. There must be something that will take out the cloud. Right now it's hard to believe the cloud will one day be no more. They seem so much the future, but something will transcend the cloud. We even have a law that says so: Bell's Law of Computer Classes which holds that roughly every decade a new, lower priced computer class forms based on a new programming platform, network, and interface resulting in new usage and the establishment of
Introduction: "But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but consider we have no planet wide applications yet. None.Tomorrow the numbers foreshadow a newCambrian explosionof connectivity that will look as
Introduction: All in all this is still my favorite post and I still think it's an accurate vision of a future. Not everyone agrees, but I guess we'll see..."But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but c
5 0.26918072 786 high scalability-2010-03-02-Using the Ambient Cloud as an Application Runtime
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. The future looks many, big, complex, and adaptive: Many clouds. Many servers. Many operating systems. Many languages. Many storage services. Many database services. Many software services. Many adjunct human networks (like Mechanical Turk). Many fast interconnects. Many CDNs. Many cache memory pools. Many application profiles (simple request-response, live streaming, computationally complex, sensor driven, memory intensive, storage intensive, monolithic, decomposable, etc). Many legal jurisdictions. Don't want to perform a function on Patriot Act "protected" systems then move the function elsewhere. Many SLAs. Many data driven pricing policies that like airplane pricing algorithms will price "seats" to maximize profit using multi-variate time sensitive pricing models. Many competitive products. The need t
6 0.26157376 761 high scalability-2010-01-17-Applications Become Black Boxes Using Markets to Scale and Control Costs
7 0.19068611 538 high scalability-2009-03-16-Are Cloud Based Memory Architectures the Next Big Thing?
8 0.18592249 758 high scalability-2010-01-11-Have We Reached the End of Scaling?
9 0.18408999 1242 high scalability-2012-05-09-Cell Architectures
10 0.18340461 882 high scalability-2010-08-18-Misco: A MapReduce Framework for Mobile Systems - Start of the Ambient Cloud?
11 0.17604357 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
12 0.15331498 1191 high scalability-2012-02-13-Tumblr Architecture - 15 Billion Page Views a Month and Harder to Scale than Twitter
14 0.15248457 1461 high scalability-2013-05-20-The Tumblr Architecture Yahoo Bought for a Cool Billion Dollars
15 0.15202206 1042 high scalability-2011-05-17-Facebook: An Example Canonical Architecture for Scaling Billions of Messages
16 0.15016595 195 high scalability-2007-12-28-Amazon's EC2: Pay as You Grow Could Cut Your Costs in Half
17 0.14788456 1519 high scalability-2013-09-18-If You're Programming a Cell Phone Like a Server You're Doing it Wrong
18 0.14738236 636 high scalability-2009-06-23-Learn How to Exploit Multiple Cores for Better Performance and Scalability
19 0.14346212 823 high scalability-2010-05-05-How will memristors change everything?
20 0.13144436 1451 high scalability-2013-05-03-Stuff The Internet Says On Scalability For May 3, 2013
topicId topicWeight
[(0, 0.255), (1, 0.11), (2, 0.105), (3, 0.144), (4, -0.17), (5, -0.111), (6, 0.004), (7, 0.068), (8, -0.089), (9, 0.067), (10, 0.004), (11, 0.02), (12, 0.057), (13, 0.169), (14, 0.104), (15, 0.099), (16, -0.202), (17, -0.06), (18, -0.101), (19, 0.06), (20, -0.184), (21, 0.099), (22, -0.126), (23, -0.032), (24, 0.083), (25, -0.053), (26, -0.07), (27, 0.053), (28, 0.06), (29, -0.119), (30, -0.052), (31, 0.02), (32, 0.031), (33, -0.012), (34, 0.096), (35, -0.065), (36, -0.037), (37, 0.019), (38, -0.104), (39, -0.02), (40, 0.069), (41, -0.009), (42, 0.02), (43, -0.093), (44, 0.042), (45, 0.01), (46, 0.082), (47, 0.099), (48, -0.011), (49, 0.024)]
simIndex simValue blogId blogTitle
same-blog 1 0.95797008 778 high scalability-2010-02-15-The Amazing Collective Compute Power of the Ambient Cloud
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. Earlier we talked about how a single botnet could harness more compute power than our largest super computers. Well, that's just the start of it. The amount of computer power available to the Ambient Cloud will be truly astounding. 2 Billion Personal Computers The number of personal computers is still growing. By 2014 one estimate is there will be 2 billion PCs . That's a giant reservoir of power to exploit, especially considering these new boxes are stuffed with multiple powerful processors and gigabytes of memory. 7 Billion Smartphones By now it's common wisdom smartphones are the computing platform of the future. It's plausible to assume the total number of mobile phones in use will roughly equal the number of people on earth. That's 7 billion smartphones. Smartphones aren't just tiny little wannabe computers anymore either. They are rea
2 0.93560058 768 high scalability-2010-02-01-What Will Kill the Cloud?
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. If datacenters are the new castles, then what will be the new gunpowder? As soon as gunpowder came on the scene, castles, which are defensive structures, quickly became the future's cold, drafty hotels. Gunpowder fueled cannon balls make short work of castle walls. There's a long history of "gunpowder" type inventions in the tech industry. PCs took out the timeshare model. The cloud is taking out the PC model. There must be something that will take out the cloud. Right now it's hard to believe the cloud will one day be no more. They seem so much the future, but something will transcend the cloud. We even have a law that says so: Bell's Law of Computer Classes which holds that roughly every decade a new, lower priced computer class forms based on a new programming platform, network, and interface resulting in new usage and the establishment of
Introduction: All in all this is still my favorite post and I still think it's an accurate vision of a future. Not everyone agrees, but I guess we'll see..."But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but c
Introduction: "But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but consider we have no planet wide applications yet. None.Tomorrow the numbers foreshadow a newCambrian explosionof connectivity that will look as
5 0.72539341 761 high scalability-2010-01-17-Applications Become Black Boxes Using Markets to Scale and Control Costs
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. We tend to think compute of resources as residing primarily in datacenters. Given the fast pace of innovation we will likely see compute resources become pervasive. Some will reside in datacenters, but compute resources can be anywhere, not just in the datacenter, we'll actually see the bulk of compute resources live outside of datacenters in the future. Given the diversity of compute resources it's reasonable to assume they won't be homogeneous or conform to a standard API. They will specialize by service. Programmers will have to use those specialized service interfaces to build applications that are adaptive enough to take advantage of whatever leverage they can find, whenever and wherever they can find it. Once found the application will have to reorganize on the fly to use whatever new resources it has found and let go of whatever resources it doe
6 0.72374636 786 high scalability-2010-03-02-Using the Ambient Cloud as an Application Runtime
7 0.64766502 790 high scalability-2010-03-09-Applications as Virtual States
8 0.6313827 826 high scalability-2010-05-12-The Rise of the Virtual Cellular Machines
9 0.61952949 460 high scalability-2008-12-05-Scalability Perspectives #4: Kevin Kelly – One Machine
10 0.60095912 823 high scalability-2010-05-05-How will memristors change everything?
11 0.58508182 758 high scalability-2010-01-11-Have We Reached the End of Scaling?
12 0.58445269 765 high scalability-2010-01-25-Let's Welcome our Neo-Feudal Overlords
13 0.57242471 1584 high scalability-2014-01-22-How would you build the next Internet? Loons, Drones, Copters, Satellites, or Something Else?
14 0.56814665 839 high scalability-2010-06-09-Paper: Propagation Networks: A Flexible and Expressive Substrate for Computation
15 0.56538844 439 high scalability-2008-11-10-Scalability Perspectives #1: Nicholas Carr – The Big Switch
16 0.54832095 1091 high scalability-2011-08-02-How Will DIDO Wireless Networking Change Everything?
17 0.53367662 953 high scalability-2010-12-03-GPU vs CPU Smackdown : The Rise of Throughput-Oriented Architectures
18 0.53292221 1316 high scalability-2012-09-04-Changing Architectures: New Datacenter Networks Will Set Your Code and Data Free
19 0.52967042 939 high scalability-2010-11-09-The Tera-Scale Effect
20 0.5288679 753 high scalability-2009-12-21-Hot Holiday Scalability Links for 2009
topicId topicWeight
[(1, 0.099), (2, 0.143), (10, 0.034), (30, 0.022), (40, 0.32), (47, 0.019), (61, 0.058), (77, 0.021), (79, 0.142), (85, 0.025), (94, 0.033)]
simIndex simValue blogId blogTitle
1 0.95547152 338 high scalability-2008-06-02-Total Cost of Ownership for different web development frameworks
Introduction: I would like to compile a comparison matrix on the total cost of ownership for .Net, Java, Lamp & Rails. Where should I start? Has anyone seen or know of a recent study on this subject?
2 0.91952378 1466 high scalability-2013-05-29-Amazon: Creating a Customer Utopia One Culture Hack at a Time
Introduction: If you don’t cannibalize yourself, someone else will. -- Steve Jobs America as the New World has a long history of inspiring Utopian communities . Early experiments were famously religious. But there have been many others as new waves of thought have inspired people to organize and try something different. In the 1840s Transcendentalists, believing the true path lay in the perfection of the individual, created intentional communities like Brook Farm . We've also seen socialist , anarchist , hippy , and virtually every other kind of Utopia in-between. Psychologist B.F. Skinner wrote an infamous book, Walden Two , with a more "scientific" take on creating a Utopian community and Ayn Rand in Atlas Shrugged had her free market version. I believe in startup organizations we see the modern version of Utopian energy in action. We now call it by names like "culture hacking", but the goal is the same: to create a new form of human community to achieve a profound go
3 0.91916084 860 high scalability-2010-07-17-Hot Scalability Links for July 17, 2010
Introduction: And by hot I also mean temperature. Summer has arrived. It's sizzling here in Silicon Valley. Thank you air conditioning! Scale the web by appointing a Crawler Czar? Tom Foremski has the idea that Google should open up their index so sites wouldn't have to endure the constant pounding by ravenous crawler bots. Don MacAskill of SmugMug estimates 50% of our web server CPU resources are spent serving crawlers. What a waste. How this would all work with real-time feeds, paid feeds (Twitter, movies, ...), etc. is unknown, but does it make sense for all that money to be spent on extracting the same data over and over again? Tweets of Gold: jamesurquhart : Key to applications is architecture. Key for infrastructure supporting archs is configurability. Configurability==features . tjake : People who choose their datastore based oh hearsay and not their own evaluation are doomed . b6n : No global lock ever goes unpunished. MichaelSurt
4 0.91613322 1419 high scalability-2013-03-07-It's a VM Wasteland - A Near Optimal Packing of VMs to Machines Reduces TCO by 22%
Introduction: In Algorithm Design for Performance Aware VM Consolidation we learn some shocking facts (gambling in Casablanca?): Average server utilization in many data centers is low, estimated between 5% and 15%. This is wasteful because an idle server often consumes more than 50% of peak power. Surely that's just for old style datacenters? Nope. In Google data centers, workloads that are consolidated use only 50% of the processor cores. Every other processor core is left unused simply to ensure that performance does not degrade. It's a VM wasteland. The goal is to reduce waste by packing VMs onto machines without hurting performance or wasting resources. The idea is to select VMs that interfere the least with each other and places them together on the same server. It's a NP-Complete problem, but this paper describes a practical method that performs provably close to the optimal. Interestingly they can optimize for performance or power efficiency, so you can use different algorithm
5 0.89398909 402 high scalability-2008-10-05-Paper: Scalability Design Patterns
Introduction: I have introduced pattern languages in my earlier post on The Pattern Bible for Distributed Computing . Achieving highest possible scalability is a complex combination of many factors. This PLoP 2007 paper presents a pattern language that can be used to make a system highly scalable. The Scalability Pattern Language introduced by Kanwardeep Singh Ahluwalia includes patterns to: Introduce Scalability Optimize Algorithm Add Hardware Add Parallelism Add Intra-Process Parallelism Add Inter-Porcess Parallelism Add Hybrid Parallelism Optimize Decentralization Control Shared Resources Automate Scalability
same-blog 6 0.88911891 778 high scalability-2010-02-15-The Amazing Collective Compute Power of the Ambient Cloud
7 0.88440752 27 high scalability-2007-07-25-Product: 3 PAR REMOTE COPY
8 0.87659013 330 high scalability-2008-05-27-Should Twitter be an All-You-Can-Eat Buffet or a Vending Machine?
10 0.83632207 1471 high scalability-2013-06-06-Paper: Memory Barriers: a Hardware View for Software Hackers
11 0.82518041 879 high scalability-2010-08-12-Think of Latency as a Pseudo-permanent Network Partition
12 0.82438433 300 high scalability-2008-04-07-Scalr - Open Source Auto-scaling Hosting on Amazon EC2
13 0.82315248 848 high scalability-2010-06-25-Hot Scalability Links for June 25, 2010
14 0.82278889 1414 high scalability-2013-03-01-Stuff The Internet Says On Scalability For February 29, 2013
15 0.81240058 768 high scalability-2010-02-01-What Will Kill the Cloud?
17 0.76871663 757 high scalability-2010-01-04-11 Strategies to Rock Your Startup’s Scalability in 2010
18 0.75285619 1492 high scalability-2013-07-17-How do you create a 100th Monkey software development culture?
19 0.68155181 19 high scalability-2007-07-16-Paper: Replication Under Scalable Hashing
20 0.67727172 97 high scalability-2007-09-18-Session management in highly scalable web sites