high_scalability high_scalability-2011 high_scalability-2011-1091 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: A conjunction of a few new technologies may trigger disruptive changes in the future. This observation was prompted by a talk Steve Perlman gave at the Columbia Engineering School: Benjamin Button, Cloud Everything and Why Shannon's Law Isn't . In it he covers a set of technologies that at first may seem unrelated, but turn out to be deeply related after all, culminating in a realization of the long talked about vision of an application utility, where all applications are hosted and run out of the cloud. First Perlman talks about the realistic human rendering technology developed at Rearden, his research incubator company. This technology was developed over many years and is the secret behind the wonderful effects found in movies like Benjamin Button . It is now being used in many other films, and promises to revolutionize film making, possibly even replacing actors with computers, in real-time. The next invention at Rearden is OnLive , a cloud based gaming technology for pla
sentIndex sentText sentNum sentScore
1 First Perlman talks about the realistic human rendering technology developed at Rearden, his research incubator company. [sent-4, score-0.353]
2 The next invention at Rearden is OnLive , a cloud based gaming technology for playing video games over the Internet. [sent-7, score-0.41]
3 This should be impossible, but they use a new video compression technology that makes it possible to play slow twitch games a 1000 miles apart. [sent-8, score-0.314]
4 Their gaming and rendering technology makes it possible to centralize applications and still yield good performance. [sent-11, score-0.251]
5 The realistic human rendering technology made it possible to create OnLive. [sent-18, score-0.258]
6 All your applications could live in the cloud and realistic UIs will be served over a boundless low-latency wireless network bandwidth. [sent-23, score-0.364]
7 With a ubiquitous low-latency wireless network it becomes possible to bind the massive distributed power of all our compute resources into one unified application fabric . [sent-27, score-0.311]
8 With networking, especially wireless networking lagging all other parts of the great distributed computing puzzle (CPU, RAM, storage), this new wireless technology would be a stunning advance. [sent-38, score-0.805]
9 An interesting bit for our purposes is how DIDO uses the cloud: DIDO is a cloud wireless system. [sent-40, score-0.311]
10 So, if there are 10 APs and 10 users all within range of each other, then 10 radio signals will sum together at each antenna of each user’s device to produce an independent waveform for each device with only that device’s data. [sent-48, score-0.294]
11 There is no inherent reason for long-range wireless networks to be higher latency than wired or fiber networks, but the complex wireless protocols and distribution systems used in multiuser wireless systems add a great deal of latency. [sent-51, score-0.818]
12 Even LTE (4G) incurs 40ms or more of latency Cellular systems have long range, but have very high latency (up to 150 milliseconds or more for 3G). [sent-52, score-0.2]
13 There is no inherent reason for long-range wireless networks to be higher latency than wired or fiber networks, but the complex wireless protocols and distribution systems used in multiuser wireless systems add a great deal of latency. [sent-54, score-0.818]
14 They went back to fundamental principles of wireless propagation to make it work. [sent-72, score-0.311]
15 Using this new technology shared spectrum is not limited by Shannon's law at all. [sent-73, score-0.226]
16 This technology doesn't need towers anymore and it doesn't require a backhaul network. [sent-83, score-0.245]
17 If that technology could be found, it would revolutionize distributed sensor and device networks. [sent-101, score-0.192]
18 Next is a large section on the real-time human rendering technology behind Benjamin Button. [sent-123, score-0.205]
19 He goes into a lot of depth on OnLive, a cloud based gaming technology for playing video games over the Internet using a new video compression technology. [sent-124, score-0.374]
20 Then he goes into DIDO, the wireless network addressed at the beginning of this post. [sent-125, score-0.311]
wordName wordTfidf (topN-words)
[('dido', 0.638), ('wireless', 0.311), ('rearden', 0.293), ('shannon', 0.186), ('perlman', 0.175), ('aps', 0.159), ('technology', 0.136), ('invention', 0.103), ('multiuser', 0.088), ('onlive', 0.08), ('signals', 0.077), ('milliseconds', 0.074), ('incurs', 0.072), ('rendering', 0.069), ('sum', 0.069), ('video', 0.067), ('backhaul', 0.065), ('cellular', 0.063), ('ap', 0.062), ('waveform', 0.059), ('games', 0.058), ('apple', 0.057), ('device', 0.056), ('wired', 0.054), ('latency', 0.054), ('radio', 0.054), ('twitch', 0.053), ('realistic', 0.053), ('research', 0.052), ('law', 0.05), ('atlas', 0.05), ('antennas', 0.05), ('technologies', 0.048), ('range', 0.048), ('columbia', 0.048), ('radios', 0.048), ('networking', 0.047), ('gaming', 0.046), ('enthusiasm', 0.046), ('telecom', 0.044), ('towers', 0.044), ('incubator', 0.043), ('submillisecond', 0.042), ('center', 0.041), ('wires', 0.04), ('transmitted', 0.04), ('dirt', 0.04), ('wifi', 0.04), ('spectrum', 0.04), ('propagate', 0.039)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 1091 high scalability-2011-08-02-How Will DIDO Wireless Networking Change Everything?
Introduction: A conjunction of a few new technologies may trigger disruptive changes in the future. This observation was prompted by a talk Steve Perlman gave at the Columbia Engineering School: Benjamin Button, Cloud Everything and Why Shannon's Law Isn't . In it he covers a set of technologies that at first may seem unrelated, but turn out to be deeply related after all, culminating in a realization of the long talked about vision of an application utility, where all applications are hosted and run out of the cloud. First Perlman talks about the realistic human rendering technology developed at Rearden, his research incubator company. This technology was developed over many years and is the secret behind the wonderful effects found in movies like Benjamin Button . It is now being used in many other films, and promises to revolutionize film making, possibly even replacing actors with computers, in real-time. The next invention at Rearden is OnLive , a cloud based gaming technology for pla
2 0.19450699 1600 high scalability-2014-02-21-Stuff The Internet Says On Scalability For February 21st, 2014
Introduction: Hey, it's HighScalability time (a particularly bountiful week): The Telephone Wires of Manhattan in 1887 ( full ) $19 billion: you know what it is; $46 billion : cost of Sochi Olympics; 400 gigabytes : data transmitted during the Sochi opening ceremony; 26.9 million : Stack Overflow community monthly visitors; 93 million : Candy Crush daily active users; 200-400 Gbps : The New Normal in DDoS Attacks Quotable Quotes: @brianacton : Facebook turned me down. It was a great opportunity to connect with some fantastic people. Looking forward to life's next adventure. @BenedictEvans : Flickr: $35m. Youtube: $1.65bn Whatsapp: $19bn. Mobile is big. And global. And the next computing platform. Paying attention? @taziden : On the Internet, worst cases will become common cases #fosdem #postfix Brian Hayes : Any quantum program must have a stovepipe architecture: Information flows straight through. So you think V
3 0.12472379 768 high scalability-2010-02-01-What Will Kill the Cloud?
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. If datacenters are the new castles, then what will be the new gunpowder? As soon as gunpowder came on the scene, castles, which are defensive structures, quickly became the future's cold, drafty hotels. Gunpowder fueled cannon balls make short work of castle walls. There's a long history of "gunpowder" type inventions in the tech industry. PCs took out the timeshare model. The cloud is taking out the PC model. There must be something that will take out the cloud. Right now it's hard to believe the cloud will one day be no more. They seem so much the future, but something will transcend the cloud. We even have a law that says so: Bell's Law of Computer Classes which holds that roughly every decade a new, lower priced computer class forms based on a new programming platform, network, and interface resulting in new usage and the establishment of
Introduction: All in all this is still my favorite post and I still think it's an accurate vision of a future. Not everyone agrees, but I guess we'll see..."But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but c
Introduction: "But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but consider we have no planet wide applications yet. None.Tomorrow the numbers foreshadow a newCambrian explosionof connectivity that will look as
6 0.11684163 1603 high scalability-2014-02-28-Stuff The Internet Says On Scalability For February 28th, 2014
7 0.096792981 661 high scalability-2009-07-25-Latency is Everywhere and it Costs You Sales - How to Crush it
8 0.093776561 796 high scalability-2010-03-16-Justin.tv's Live Video Broadcasting Architecture
9 0.093765795 1359 high scalability-2012-11-15-Gone Fishin': Justin.Tv's Live Video Broadcasting Architecture
10 0.092799999 1592 high scalability-2014-02-07-Stuff The Internet Says On Scalability For February 7th, 2014
11 0.09174417 1342 high scalability-2012-10-17-World of Warcraft's Lead designer Rob Pardo on the Role of the Cloud in Games
12 0.082473576 446 high scalability-2008-11-18-Scalability Perspectives #2: Van Jacobson – Content-Centric Networking
13 0.081489123 1519 high scalability-2013-09-18-If You're Programming a Cell Phone Like a Server You're Doing it Wrong
14 0.081144549 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
15 0.080094159 904 high scalability-2010-09-21-Playfish's Social Gaming Architecture - 50 Million Monthly Users and Growing
16 0.077750646 823 high scalability-2010-05-05-How will memristors change everything?
17 0.077344604 1502 high scalability-2013-08-16-Stuff The Internet Says On Scalability For August 16, 2013
18 0.076923966 1637 high scalability-2014-04-25-Stuff The Internet Says On Scalability For April 25th, 2014
19 0.076060027 1177 high scalability-2012-01-19-Is it time to get rid of the Linux OS model in the cloud?
20 0.075431958 1207 high scalability-2012-03-12-Google: Taming the Long Latency Tail - When More Machines Equals Worse Results
topicId topicWeight
[(0, 0.15), (1, 0.056), (2, 0.039), (3, 0.061), (4, -0.019), (5, -0.052), (6, -0.029), (7, 0.059), (8, -0.021), (9, 0.009), (10, -0.005), (11, 0.015), (12, -0.021), (13, 0.041), (14, 0.031), (15, 0.042), (16, 0.002), (17, 0.039), (18, -0.023), (19, -0.021), (20, -0.017), (21, 0.006), (22, 0.002), (23, 0.03), (24, 0.004), (25, 0.034), (26, 0.001), (27, -0.017), (28, -0.018), (29, -0.017), (30, -0.005), (31, -0.006), (32, -0.013), (33, 0.004), (34, 0.027), (35, -0.009), (36, 0.024), (37, -0.005), (38, 0.028), (39, -0.005), (40, 0.036), (41, 0.003), (42, -0.028), (43, -0.012), (44, 0.028), (45, -0.007), (46, 0.01), (47, -0.019), (48, -0.034), (49, 0.027)]
simIndex simValue blogId blogTitle
same-blog 1 0.95000434 1091 high scalability-2011-08-02-How Will DIDO Wireless Networking Change Everything?
Introduction: A conjunction of a few new technologies may trigger disruptive changes in the future. This observation was prompted by a talk Steve Perlman gave at the Columbia Engineering School: Benjamin Button, Cloud Everything and Why Shannon's Law Isn't . In it he covers a set of technologies that at first may seem unrelated, but turn out to be deeply related after all, culminating in a realization of the long talked about vision of an application utility, where all applications are hosted and run out of the cloud. First Perlman talks about the realistic human rendering technology developed at Rearden, his research incubator company. This technology was developed over many years and is the secret behind the wonderful effects found in movies like Benjamin Button . It is now being used in many other films, and promises to revolutionize film making, possibly even replacing actors with computers, in real-time. The next invention at Rearden is OnLive , a cloud based gaming technology for pla
2 0.85867804 1651 high scalability-2014-05-20-It's Networking. In Space! Or How E.T. Will Phone Home.
Introduction: What will the version of the Internet that follows us to the stars look like? Yes, people are really thinking seriously about this sort of thing. Specifically the InterPlanetary Networking Special Interest Group (IPNSIG). Ansible-like faster-than-light communication it isn't. There's no magical warp drive. Nor is a network of telepaths acting as a 'verse spanning telegraph system. It's more mundane than that. And in many ways more interesting as it's sort of like the old Internet on steroids, the one that was based on on UUCP and dial-up connections, but over vastly longer distances and with much longer delays : The Interplanetary Internet (based on IPN, also called InterPlaNet) is a conceived computer network in space, consisting of a set of network nodes which can communicate with each other.[1][2] Communication would be greatly delayed by the great interplanetary distances, so the IPN needs a new set of protocols and technology that are tolerant to large delays and
Introduction: If you were going to design a next generation Internet at the physical layer that routes around the current Internet, what would it look like? What should it do? How should it work? Who should own it? How should it be paid for? How would you access it? It has long been said the Internet routes around obstacles. Snowden has revealed some major obstacles. The beauty of the current current app and web system is the physical network doesn't matter. We can just replace it with something else. Something that doesn't flow through choke points like backhaul networks , under sea cables , and cell towers . What might that something else look like? Google's Loon Project Project Loon was so named because the idea was thought to be loony. Maybe not. The idea is to float high-altitude balloons 20 miles in the air to create an aerial wireless network with up to 3G-like speeds. Signals travel through the balloon network from balloon to balloon, then to a ground-based station conne
4 0.80905133 446 high scalability-2008-11-18-Scalability Perspectives #2: Van Jacobson – Content-Centric Networking
Introduction: Scalability Perspectives is a series of posts that highlights the ideas that will shape the next decade of IT architecture. Each post is dedicated to a thought leader of the information age and his vision of the future. Be warned though – the journey into the minds and perspectives of these people requires an open mind. Van Jacobson Van Jacobson is a Research Fellow at PARC . Prior to that he was Chief Scientist and co-founder of Packet Design. Prior to that he was Chief Scientist at Cisco. Prior to that he was head of the Network Research group at Lawrence Berkeley National Laboratory. He's been studying networking since 1969. He still hopes that someday something will start to make sense. Scaling the Internet – Does the Net needs an upgrade? As the Internet is being overrun with video traffic, many wonder if it can survive. With challenges being thrown down over the imbalances that have been created and their impact on the viability of monopolistic business models, t
5 0.80662513 1526 high scalability-2013-10-02-RFC 1925 - The Twelve (Timeless) Networking Truths
Introduction: The Twelve Networking Truths is one of a long series of timeless truths documented in sacred April Fools' RFC s. Though issued in 1996, it's no less true today. It's hard to pick a favorite because they are all good. But if I had to pick, it would be: Some things in life can never be fully appreciated nor understood unless experienced firsthand. As we grow comfortable behind garden walls, clutching gadgets like lifelines and ideologies like shields, empathy is the true social network. Network Working Group R. Callon , Editor Request for Comments: 1925 IOOF Category: Informational 1 April 1996 The Twelve Networking Truths Status of this Memo This memo provides information for the Internet community. This memo does not specify an Internet standard of any kind. Distribution of this memo is unlimited. Abstract Thi
7 0.78836632 1381 high scalability-2013-01-04-Stuff The Internet Says On Scalability For January 4, 2013
8 0.78307521 1377 high scalability-2012-12-26-Ask HS: What will programming and architecture look like in 2020?
9 0.78074771 1140 high scalability-2011-11-10-Kill the Telcos Save the Internet - The Unsocial Network
10 0.77185392 1490 high scalability-2013-07-12-Stuff The Internet Says On Scalability For July 12, 2013
11 0.76624322 1612 high scalability-2014-03-14-Stuff The Internet Says On Scalability For March 14th, 2014
12 0.75477624 1603 high scalability-2014-02-28-Stuff The Internet Says On Scalability For February 28th, 2014
13 0.75036502 1600 high scalability-2014-02-21-Stuff The Internet Says On Scalability For February 21st, 2014
14 0.74943554 1630 high scalability-2014-04-11-Stuff The Internet Says On Scalability For April 11th, 2014
15 0.74891937 267 high scalability-2008-03-05-Oprah is the Real Social Network
16 0.74811894 1225 high scalability-2012-04-09-Why My Slime Mold is Better than Your Hadoop Cluster
17 0.74699694 823 high scalability-2010-05-05-How will memristors change everything?
18 0.74689627 1592 high scalability-2014-02-07-Stuff The Internet Says On Scalability For February 7th, 2014
19 0.74529201 1410 high scalability-2013-02-20-Smart Companies Fail Because they Do Everything Right - Staying Alive to Scale
topicId topicWeight
[(1, 0.116), (2, 0.122), (10, 0.036), (17, 0.015), (24, 0.194), (30, 0.018), (39, 0.011), (40, 0.025), (43, 0.014), (47, 0.027), (56, 0.019), (61, 0.079), (77, 0.024), (79, 0.096), (85, 0.064), (94, 0.04)]
simIndex simValue blogId blogTitle
1 0.91351634 385 high scalability-2008-09-16-Product: Func - Fedora Unified Network Controller
Introduction: Func is used to manage a large network using bash or Python scripts. It targets easy and simple remote scripting and one-off tasks over SSH by creating a secure (SSL certifications) XMLRPC API for communication. Any kind of application can be written on top of it. Other configuration management tools specialize in mass configuration. They say here's what the machine should look like and keep it that way. Func allows you to program your cluster. If you've ever tried to securely remote script a gang of machines using SSH keys you know what a total nightmare that can be. Some example commands: Using the command line: func "*.example.org" call yumcmd update Using the Pthon API: import func.overlord.client as fc client = fc.Client("*.example.org;*.example.com") client.yumcmd.update() client.service.start("acme-server") print client.hardware.info() Func may certainly overlap in functionality with other tools like Puppet and cfengine, but as programmers we always need more than one
2 0.85554266 1458 high scalability-2013-05-15-Lesson from Airbnb: Give Yourself Permission to Experiment with Non-scalable Changes
Introduction: If you are stuck drowning in too much data and too many options and are dazzled by all the possibilities of code, here's a helpful bit of advice from Airbnb's rags to riches origin story : it's okay to do things that don’t scale . A corollary is the idea of paying attention to and learning from what your users are actually doing and let that lead you without out that annoying voice in your head second guessing you, yelling but that will never scale! Worry about building something good, then worry about making it scale. In Airbnb's case they noticed people weren't booking rooms because the pictures sucked. So they flew to New York and shot some beautiful images. This is a very non-scalable and non-technical solution. Yet it was the turning point for Airbnb and sparked their climb out of the "trough of sorrow." Previously they had been limited by the Silicon Valley idea that every feature had to be scalable. Not every solution can be found behind a computer screen. For the full
3 0.85028517 60 high scalability-2007-08-07-Can you profit from the coming Content Delivery Network wars?
Introduction: Playing like the big boys may be getting cheaper. The big boys, like YouTube , farm the serving of their most popular videos to a third party CDN. A lot of people were surprised YouTube didn't serve all their content themselves, but it makes sense. It allows them to keep up with demand without a large hit for infrastructure build out, much like leasing computers instead of buying them. The problem has been CDNs are expensive. Om Malik reports in Akamai & the CDN Price Wars that may be changing. CDN service could be becoming affordable enough that you might consider using them as part of your scaling strategy. Akamai , once the clear leader in the CDN field, is facing strong competition from the likes of Limelight Networks, Level 3, Internap, CDNetworks, Panther Express and EdgeCast Networks. This commoditization may be bad for their stock prices, but it's good for website builders looking for new scaling strategies. EdgeCast, for example, passes on the cost savings when
same-blog 4 0.8492288 1091 high scalability-2011-08-02-How Will DIDO Wireless Networking Change Everything?
Introduction: A conjunction of a few new technologies may trigger disruptive changes in the future. This observation was prompted by a talk Steve Perlman gave at the Columbia Engineering School: Benjamin Button, Cloud Everything and Why Shannon's Law Isn't . In it he covers a set of technologies that at first may seem unrelated, but turn out to be deeply related after all, culminating in a realization of the long talked about vision of an application utility, where all applications are hosted and run out of the cloud. First Perlman talks about the realistic human rendering technology developed at Rearden, his research incubator company. This technology was developed over many years and is the secret behind the wonderful effects found in movies like Benjamin Button . It is now being used in many other films, and promises to revolutionize film making, possibly even replacing actors with computers, in real-time. The next invention at Rearden is OnLive , a cloud based gaming technology for pla
5 0.83882362 396 high scalability-2008-09-26-Lucasfilm: The Real Magic is in the Data Center
Introduction: Kevin Clark, director of IT operations for Lucasfilm, discusses how their data center works: * Linux-based platform, SUSE (looking to change), and a lot of proprietary open source applications for content creation. * 4,500-processor render farm in the datacenter. Workstations are used off hours. * Developed their own proprietary scheduler to schedule their 5,500 available processors. * Render nodes, the blade racks (from Verari), run dual-core dual Opteron chips with 32GB of memory on board, but are expanding those to quad-core. Are an AMD shop. * 400TB of storage online for production. * Every night they write out 10-20TB of new data on a render. A project will use up to a hundred-plus terabytes of storage. * Incremental backups are a challenge because the data changes up to 50 percent over a week. * NetApps used for storage. They like the global namespace in the virtual file system. * Foundry Networks architecture shop. One of the larger 10-GbE-backbone facilities
6 0.81803817 1058 high scalability-2011-06-13-Automation on AWS with Ruby and Puppet
7 0.81147152 1015 high scalability-2011-04-01-Stuff The Internet Says On Scalability For April 1, 2011
8 0.78426927 958 high scalability-2010-12-16-7 Design Patterns for Almost-infinite Scalability
9 0.77309793 1302 high scalability-2012-08-10-Stuff The Internet Says On Scalability For August 10, 2012
10 0.77111095 738 high scalability-2009-11-06-Product: Resque - GitHub's Distrubuted Job Queue
11 0.75001091 663 high scalability-2009-07-28-37signals Architecture
12 0.74460667 1537 high scalability-2013-10-25-Stuff The Internet Says On Scalability For October 25th, 2013
13 0.73460287 851 high scalability-2010-07-02-Hot Scalability Links for July 2, 2010
14 0.73445058 1389 high scalability-2013-01-18-Stuff The Internet Says On Scalability For January 18, 2013
15 0.7339837 1559 high scalability-2013-12-06-Stuff The Internet Says On Scalability For December 6th, 2013
16 0.73228019 1045 high scalability-2011-05-20-Stuff The Internet Says On Scalability For May 20, 2011
17 0.73215914 790 high scalability-2010-03-09-Applications as Virtual States
18 0.73105168 1028 high scalability-2011-04-22-Stuff The Internet Says On Scalability For April 22, 2011
19 0.73098409 1040 high scalability-2011-05-13-Stuff The Internet Says On Scalability For May 13, 2011
20 0.7306723 106 high scalability-2007-10-02-Secrets to Fotolog's Scaling Success