high_scalability high_scalability-2010 high_scalability-2010-790 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. As I was writing an article on the architecture of the Storm Botnet , I couldn't help but notice the deep similarity of how Storm works and changes we're seeing in the evolution of political systems. In particular, the rise of the virtual-state . As crazy as this may sound, I think this is also the direction applications will need follow to survive in a complex world of billions of compute devices. You may have already heard of virtual corporations . Virtual corporations are companies with limited office space, a distributed workforce, and production facilities located wherever it is profitable to locate them. The idea is to stay lean and compete using the rapid development and introduction of new products into high value-added markets . If you spot a market opportunity with a small time window, building your own factories and hiring and engine
sentIndex sentText sentNum sentScore
1 You may have already heard of virtual corporations . [sent-5, score-0.348]
2 The manufacture will be contracted out to a virtual fab , then the chip will be sent to a contract manufacturing service for integration. [sent-13, score-0.496]
3 Foreign Affairs magazine published an article titled The Rise of the Virtual State , which defines virtual state as: a country whose economy is reliant on mobile factors of production . [sent-22, score-0.669]
4 So let's just say a virtual state can be any entity requiring political representation. [sent-27, score-0.562]
5 The mobile factors of production part of the definition is a bit confusing, but turns out to be a key driver for why applications make sense as virtual states. [sent-32, score-0.493]
6 If you want to grow a crop it will be difficult to compete with someone if they have better land and climate than you do. [sent-37, score-0.355]
7 If, for example, you land a contract to represent the next great NBA superstar directly out of grade school, you think to yourself why pay Nike all that money to make a sports shoe? [sent-52, score-0.532]
8 They key takeaways from this analysis are that in the modern economy land isn't key. [sent-56, score-0.375]
9 One consequence I see is that a virtual state is really not different than a virtual corporation, there's simply an added political dimension attached. [sent-63, score-0.843]
10 The political dimension stems largely from historical land entanglements in the form of nation states. [sent-64, score-0.633]
11 To any observer of the political process it's quite clear corporations have their own political interests, so the distinction quickly becomes moot, which means the number of virtual states will multiply radically. [sent-65, score-0.888]
12 John Robb even argues that Al Qaeda network is a sort of virtual state, with a consistent source of finance, a recognized hierarchy of officials, foreign alliances, an army, published laws, even a rudimentary welfare system. [sent-66, score-0.431]
13 The goals of the state and corporations have also merged. [sent-70, score-0.346]
14 The goal of a virtual state is to make money, not acquire land, rule people, or seek a greater good. [sent-71, score-0.396]
15 The role of the virtual state is to develop an overall strategy; invest in people, not expensive production capacity; contract out other functions to states that specialize in or need them. [sent-75, score-0.592]
16 Well, I don't think applications will be virtual states in the sense of independent AIs and all that. [sent-79, score-0.404]
17 These goals are imprinted into applications and it's the applications job to achieve the state objectives. [sent-87, score-0.399]
18 The key is to recognize it's all about automated and structured flows controlling mobile factors of production. [sent-120, score-0.39]
19 To a great extent software becomes independent, thus the idea of software becoming like a virtual state. [sent-134, score-0.357]
20 The criminal networks behind botnets like the Storm Botnet have already made the transition to a virtual-state, operating a sort of black hat bazaar that has both economic means and military capability . [sent-135, score-0.33]
wordName wordTfidf (topN-words)
[('land', 0.29), ('political', 0.224), ('virtual', 0.223), ('factors', 0.181), ('contract', 0.162), ('corporations', 0.125), ('state', 0.115), ('flows', 0.114), ('black', 0.114), ('contracted', 0.111), ('ambient', 0.108), ('goals', 0.106), ('capital', 0.104), ('profitable', 0.096), ('automated', 0.095), ('states', 0.092), ('applications', 0.089), ('sort', 0.085), ('economy', 0.085), ('money', 0.08), ('contracts', 0.078), ('intangible', 0.077), ('finance', 0.074), ('immobile', 0.074), ('factories', 0.074), ('nba', 0.074), ('matter', 0.072), ('partnership', 0.071), ('products', 0.069), ('criminal', 0.069), ('software', 0.067), ('published', 0.065), ('climate', 0.065), ('media', 0.065), ('adsense', 0.064), ('botnet', 0.064), ('military', 0.062), ('nation', 0.061), ('market', 0.061), ('firms', 0.059), ('legal', 0.059), ('boundary', 0.059), ('acquire', 0.058), ('dimension', 0.058), ('foreign', 0.058), ('hired', 0.058), ('prime', 0.057), ('coordinated', 0.057), ('protects', 0.057), ('experts', 0.056)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999774 790 high scalability-2010-03-09-Applications as Virtual States
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. As I was writing an article on the architecture of the Storm Botnet , I couldn't help but notice the deep similarity of how Storm works and changes we're seeing in the evolution of political systems. In particular, the rise of the virtual-state . As crazy as this may sound, I think this is also the direction applications will need follow to survive in a complex world of billions of compute devices. You may have already heard of virtual corporations . Virtual corporations are companies with limited office space, a distributed workforce, and production facilities located wherever it is profitable to locate them. The idea is to stay lean and compete using the rapid development and introduction of new products into high value-added markets . If you spot a market opportunity with a small time window, building your own factories and hiring and engine
Introduction: All in all this is still my favorite post and I still think it's an accurate vision of a future. Not everyone agrees, but I guess we'll see..."But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but c
Introduction: "But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but consider we have no planet wide applications yet. None.Tomorrow the numbers foreshadow a newCambrian explosionof connectivity that will look as
4 0.20564218 761 high scalability-2010-01-17-Applications Become Black Boxes Using Markets to Scale and Control Costs
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. We tend to think compute of resources as residing primarily in datacenters. Given the fast pace of innovation we will likely see compute resources become pervasive. Some will reside in datacenters, but compute resources can be anywhere, not just in the datacenter, we'll actually see the bulk of compute resources live outside of datacenters in the future. Given the diversity of compute resources it's reasonable to assume they won't be homogeneous or conform to a standard API. They will specialize by service. Programmers will have to use those specialized service interfaces to build applications that are adaptive enough to take advantage of whatever leverage they can find, whenever and wherever they can find it. Once found the application will have to reorganize on the fly to use whatever new resources it has found and let go of whatever resources it doe
5 0.20521219 765 high scalability-2010-01-25-Let's Welcome our Neo-Feudal Overlords
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. There's a pattern, already begun, that has accelerated by the need for applications to scale and increase complexity, the end result of which will be that applications give up their independence and enter a kind of feudal relationship with their platform provider. To understand how this process works, like a glacier slowly and inevitably carving out a deep river valley, here's the type of question I get quite a lot: I've learned PHP and MySQL and I've built a web app that I HOPE will receive traffic comparable to eBay's with a similar database structure. I see all these different opinions and different techniques and languages being recommended and it's so confusing. All I want is perhaps one book or one website that focuses on PHP and MySQL and building a large database web app like eBay's. Does something like this exist? I'm always at a loss fo
6 0.17752379 786 high scalability-2010-03-02-Using the Ambient Cloud as an Application Runtime
7 0.13327917 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
9 0.12615721 768 high scalability-2010-02-01-What Will Kill the Cloud?
10 0.1226829 363 high scalability-2008-08-12-Strategy: Limit The New, Not The Old
11 0.11979582 538 high scalability-2009-03-16-Are Cloud Based Memory Architectures the Next Big Thing?
12 0.11751077 778 high scalability-2010-02-15-The Amazing Collective Compute Power of the Ambient Cloud
13 0.11069174 126 high scalability-2007-10-20-Should you build your next website using 3tera's grid OS?
14 0.10870463 1600 high scalability-2014-02-21-Stuff The Internet Says On Scalability For February 21st, 2014
15 0.10609489 976 high scalability-2011-01-20-75% Chance of Scale - Leveraging the New Scaleogenic Environment for Growth
16 0.10606194 919 high scalability-2010-10-14-I, Cloud
17 0.10479001 758 high scalability-2010-01-11-Have We Reached the End of Scaling?
18 0.10252056 1410 high scalability-2013-02-20-Smart Companies Fail Because they Do Everything Right - Staying Alive to Scale
topicId topicWeight
[(0, 0.223), (1, 0.058), (2, 0.091), (3, 0.109), (4, -0.044), (5, -0.09), (6, -0.022), (7, 0.065), (8, -0.033), (9, -0.015), (10, -0.036), (11, 0.048), (12, -0.03), (13, 0.072), (14, 0.116), (15, -0.001), (16, -0.082), (17, -0.011), (18, -0.006), (19, 0.065), (20, -0.113), (21, 0.022), (22, -0.01), (23, 0.014), (24, 0.024), (25, 0.05), (26, -0.027), (27, 0.01), (28, -0.003), (29, -0.076), (30, -0.133), (31, 0.044), (32, -0.017), (33, -0.011), (34, -0.025), (35, -0.111), (36, -0.077), (37, 0.003), (38, -0.021), (39, -0.051), (40, 0.025), (41, 0.017), (42, -0.004), (43, 0.063), (44, 0.091), (45, 0.027), (46, -0.015), (47, 0.018), (48, -0.003), (49, 0.073)]
simIndex simValue blogId blogTitle
same-blog 1 0.95718402 790 high scalability-2010-03-09-Applications as Virtual States
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. As I was writing an article on the architecture of the Storm Botnet , I couldn't help but notice the deep similarity of how Storm works and changes we're seeing in the evolution of political systems. In particular, the rise of the virtual-state . As crazy as this may sound, I think this is also the direction applications will need follow to survive in a complex world of billions of compute devices. You may have already heard of virtual corporations . Virtual corporations are companies with limited office space, a distributed workforce, and production facilities located wherever it is profitable to locate them. The idea is to stay lean and compete using the rapid development and introduction of new products into high value-added markets . If you spot a market opportunity with a small time window, building your own factories and hiring and engine
Introduction: "But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but consider we have no planet wide applications yet. None.Tomorrow the numbers foreshadow a newCambrian explosionof connectivity that will look as
Introduction: All in all this is still my favorite post and I still think it's an accurate vision of a future. Not everyone agrees, but I guess we'll see..."But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but c
4 0.81863475 761 high scalability-2010-01-17-Applications Become Black Boxes Using Markets to Scale and Control Costs
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. We tend to think compute of resources as residing primarily in datacenters. Given the fast pace of innovation we will likely see compute resources become pervasive. Some will reside in datacenters, but compute resources can be anywhere, not just in the datacenter, we'll actually see the bulk of compute resources live outside of datacenters in the future. Given the diversity of compute resources it's reasonable to assume they won't be homogeneous or conform to a standard API. They will specialize by service. Programmers will have to use those specialized service interfaces to build applications that are adaptive enough to take advantage of whatever leverage they can find, whenever and wherever they can find it. Once found the application will have to reorganize on the fly to use whatever new resources it has found and let go of whatever resources it doe
5 0.79459286 786 high scalability-2010-03-02-Using the Ambient Cloud as an Application Runtime
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. The future looks many, big, complex, and adaptive: Many clouds. Many servers. Many operating systems. Many languages. Many storage services. Many database services. Many software services. Many adjunct human networks (like Mechanical Turk). Many fast interconnects. Many CDNs. Many cache memory pools. Many application profiles (simple request-response, live streaming, computationally complex, sensor driven, memory intensive, storage intensive, monolithic, decomposable, etc). Many legal jurisdictions. Don't want to perform a function on Patriot Act "protected" systems then move the function elsewhere. Many SLAs. Many data driven pricing policies that like airplane pricing algorithms will price "seats" to maximize profit using multi-variate time sensitive pricing models. Many competitive products. The need t
6 0.78777629 765 high scalability-2010-01-25-Let's Welcome our Neo-Feudal Overlords
7 0.76172906 1377 high scalability-2012-12-26-Ask HS: What will programming and architecture look like in 2020?
8 0.7426759 768 high scalability-2010-02-01-What Will Kill the Cloud?
9 0.73000687 1410 high scalability-2013-02-20-Smart Companies Fail Because they Do Everything Right - Staying Alive to Scale
10 0.71653086 1012 high scalability-2011-03-28-Aztec Empire Strategy: Use Dual Pipes in Your Aqueduct for High Availability
11 0.70687133 778 high scalability-2010-02-15-The Amazing Collective Compute Power of the Ambient Cloud
12 0.70050406 1584 high scalability-2014-01-22-How would you build the next Internet? Loons, Drones, Copters, Satellites, or Something Else?
14 0.67486691 1225 high scalability-2012-04-09-Why My Slime Mold is Better than Your Hadoop Cluster
15 0.67482436 1091 high scalability-2011-08-02-How Will DIDO Wireless Networking Change Everything?
16 0.67273587 363 high scalability-2008-08-12-Strategy: Limit The New, Not The Old
17 0.65936935 826 high scalability-2010-05-12-The Rise of the Virtual Cellular Machines
18 0.65356189 823 high scalability-2010-05-05-How will memristors change everything?
20 0.63851029 1636 high scalability-2014-04-23-Here's a 1300 Year Old Solution to Resilience - Rebuild, Rebuild, Rebuild
topicId topicWeight
[(1, 0.113), (2, 0.138), (3, 0.067), (5, 0.016), (10, 0.052), (16, 0.094), (17, 0.016), (26, 0.017), (30, 0.02), (40, 0.019), (47, 0.021), (56, 0.018), (61, 0.096), (77, 0.028), (79, 0.098), (85, 0.048), (94, 0.05)]
simIndex simValue blogId blogTitle
same-blog 1 0.94099194 790 high scalability-2010-03-09-Applications as Virtual States
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. As I was writing an article on the architecture of the Storm Botnet , I couldn't help but notice the deep similarity of how Storm works and changes we're seeing in the evolution of political systems. In particular, the rise of the virtual-state . As crazy as this may sound, I think this is also the direction applications will need follow to survive in a complex world of billions of compute devices. You may have already heard of virtual corporations . Virtual corporations are companies with limited office space, a distributed workforce, and production facilities located wherever it is profitable to locate them. The idea is to stay lean and compete using the rapid development and introduction of new products into high value-added markets . If you spot a market opportunity with a small time window, building your own factories and hiring and engine
2 0.90947223 1071 high scalability-2011-07-01-Stuff The Internet Says On Scalability For July 1, 2011
Introduction: Submitted for your scaling pleasure: Twitterers tweet 200 million tweets a day. Popular topics are eclectic, ranging from Swine Flu to Rebecca Black. Twitter has a really cool video on the global flow of tweets in the world . Worth watching. It looks like a rainbow arcing across the northern hemisphere. Amazon Cloud Now Stores 339 Billion Objects , more than doubling last years volume. Quotable quotes for independence Alex: n8foo : My fav part about the new #AWS pricing announcement - 500TB is the level where they say 'contact us'. RoeyYaniv : Scalability guidelines - Technology can and will fail. The business should not. stevedekorte : Are the folks advocating FP for scalability unaware of the Von Neumann bottleneck? nivertech : #Hadoop is a guy with a machete in front of a jungle - it made a trail, but there are new better #BigData middleware offerings in the jungle lhazlewood : I don't think I've ever had a Love/Hate relationship like I've ha
3 0.90477341 1178 high scalability-2012-01-20-Stuff The Internet Says On Scalability For January 20, 2012
Introduction: If you’ve got the time, we’ve got the HighScalability: Google+: 90 million users ; Internet 2011 : 2.1 billion Internet users, 1 trillion YouTube views, 5.9 billion mobile subscriptions; Fusion-io: One Billion IOPS ; 12 atoms: size of IBM's new memory bit ; 32 Million: Stack monthly visitors ; Gmail: 350 Million Users ; TimTebow: 1.5 million Tweets Quotable Quotes: Similarity : There is no canonical schema anymore. Instead you should ask: What high-volume queries will I need to serve with my data? Then work backwards from there. @kvirjee : Dis/Agree? -- "there is no problem but scalability, and architecture is its solution" @robpegoraro : Eternal vigilance can be crowdsourced. Didn't Bill Gates say once that 48 bits would always be enough for an ID? Well, Oracle ran out of bits: Fundamental Oracle flaw revealed . 64 bits, that's the ticket, ipv6 went 128 bits. The day Kodak died : We developed the world's first consumer digital camera bu
4 0.9010427 388 high scalability-2008-09-23-Event: CloudCamp Silicon Valley Unconference on 30th September
Introduction: CloudCamp is an interesting unconference where early adapters of Cloud Computing technologies exchange ideas. With the rapid change occurring in the industry, we need a place we can meet to share our experiences, challenges and solutions. At CloudCamp, you are encouraged you to share your thoughts in several open discussions, as we strive for the advancement of Cloud Computing. End users, IT professionals and vendors are all encouraged to participate. CloudCamp Silicon Valley 08 is scheduled for Tuesday, September 30, 2008 from 06:00 PM - 10:00 PM in Sun Microsystems' EBC Briefing Center 15 Network Circle Menlo Park, CA 94025 CloudCamp follows an interactive, unscripted unconference format. You can propose your own session or you can attend a session proposed by someone else. Either way, you are encouraged to engage in the discussion and “Vote with your feet”, which means … “find another session if you don’t find the session helpful”. Pick and choose from the conversat
5 0.9000451 926 high scalability-2010-10-24-Hot Scalability Links For Oct 24, 2010
Introduction: On a cold and rainy Fall day, a day stolen from winter rather than our usual gorgeous Indian Summers , a day not even the SF Giants winning the pennant can help warm, here are some hot links to read by a digital flame: Using MySQL as a NoSQL - A story for exceeding 750,000 qps on a commodity server by Yoshinori Matsunobu. Wonderfully detailed post on how you can lookup a row by ID really fast if you bypass all the typical MySQL query parsing overhead. Minecraftwiki.net and minecraftforum.net now serve more traffic than Slashdot and Stackoverflow! 1 million pageviews and 100k uniques per day, per site; 10TB of bandwidth a month; 4+ machines running Varnish, HAProxy, PHP, MySQL, Nginx. Stuff the Internet Says: @ old_sound : Somebody make me a t-shirt that says "I've read the CAP theorem and I liked it" @dscape : How relevant do I think the CAP theorem is? Not at all. I honestly hate conversations where anyone talks about crap.. cap, sorry. @humidbei
6 0.88730133 1600 high scalability-2014-02-21-Stuff The Internet Says On Scalability For February 21st, 2014
8 0.87764615 1180 high scalability-2012-01-24-The State of NoSQL in 2012
9 0.87684947 851 high scalability-2010-07-02-Hot Scalability Links for July 2, 2010
10 0.87360173 1382 high scalability-2013-01-07-Analyzing billions of credit card transactions and serving low-latency insights in the cloud
11 0.87322283 1559 high scalability-2013-12-06-Stuff The Internet Says On Scalability For December 6th, 2013
12 0.87313926 853 high scalability-2010-07-08-Cloud AWS Infrastructure vs. Physical Infrastructure
13 0.87215549 1389 high scalability-2013-01-18-Stuff The Internet Says On Scalability For January 18, 2013
14 0.87182772 1109 high scalability-2011-09-02-Stuff The Internet Says On Scalability For September 2, 2011
15 0.87164998 1302 high scalability-2012-08-10-Stuff The Internet Says On Scalability For August 10, 2012
16 0.87133902 1028 high scalability-2011-04-22-Stuff The Internet Says On Scalability For April 22, 2011
17 0.87063789 106 high scalability-2007-10-02-Secrets to Fotolog's Scaling Success
18 0.87059295 1448 high scalability-2013-04-29-AWS v GCE Face-off and Why Innovation Needs Lower Cost Infrastructures
19 0.86968267 1040 high scalability-2011-05-13-Stuff The Internet Says On Scalability For May 13, 2011
20 0.86964512 1189 high scalability-2012-02-07-Hypertable Routs HBase in Performance Test -- HBase Overwhelmed by Garbage Collection