high_scalability high_scalability-2014 high_scalability-2014-1584 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: If you were going to design a next generation Internet at the physical layer that routes around the current Internet, what would it look like? What should it do? How should it work? Who should own it? How should it be paid for? How would you access it? It has long been said the Internet routes around obstacles. Snowden has revealed some major obstacles. The beauty of the current current app and web system is the physical network doesn't matter. We can just replace it with something else. Something that doesn't flow through choke points like backhaul networks , under sea cables , and cell towers . What might that something else look like? Google's Loon Project Project Loon was so named because the idea was thought to be loony. Maybe not. The idea is to float high-altitude balloons 20 miles in the air to create an aerial wireless network with up to 3G-like speeds. Signals travel through the balloon network from balloon to balloon, then to a ground-based station conne
sentIndex sentText sentNum sentScore
1 If you were going to design a next generation Internet at the physical layer that routes around the current Internet, what would it look like? [sent-1, score-0.197]
2 It has long been said the Internet routes around obstacles. [sent-7, score-0.129]
3 The beauty of the current current app and web system is the physical network doesn't matter. [sent-9, score-0.235]
4 The idea is to float high-altitude balloons 20 miles in the air to create an aerial wireless network with up to 3G-like speeds. [sent-15, score-0.78]
5 Signals travel through the balloon network from balloon to balloon, then to a ground-based station connected to an Internet service provider (ISP), then onto the global Internet. [sent-16, score-0.59]
6 There are elements here common to several of the aerial solutions. [sent-17, score-0.488]
7 Stations in the air, be that a drone, balloon, copter, or satellite carries some sort of communication equipment. [sent-18, score-0.261]
8 And some form of Aerial OS implementing data plane management along with a control plane and management plane, acts like a cellular network , with users being handed off to different stations as they move and as the stations move and as new stations are added or drop out of range. [sent-19, score-1.208]
9 With enough coverage would it be possible to connect directly to devices with the signals being routed only in the air? [sent-22, score-0.156]
10 The Drones are Here the Drones are Here This is a picture of the Solara 60 drone from Titan Aerospace . [sent-23, score-0.123]
11 I has a 250 pound payload, which should be enough for communication equipment and perhaps enough memory and CPU power to be a decent caching node. [sent-25, score-0.371]
12 Of course power for the computing equipment is still an issue. [sent-27, score-0.146]
13 The advantage over the Loon is the drone is not at the mercy of the wind, though the Aerial OS should be able to integrate stations from any platform. [sent-30, score-0.547]
14 PocketQube Satellite PocketQubes is a new satellite design, using a 5cm cube, that can be launched to a 700 km orbit for about $20,000. [sent-31, score-0.186]
15 That's getting affordable and if you put enough of them up it could possibly make a good backbone for communication. [sent-34, score-0.256]
16 While these can't provide backbone Internet connectivity, they could provide local or even regional mesh connectivity and then integrate in with the Aerial OS to route to the broader Internet constructed from the other technologies. [sent-36, score-0.254]
17 In this type of architecture edge caching and edge computing strategies become key as latency requirements would dictate not accessing a centralized cloud for services. [sent-37, score-0.192]
18 The beauty of personal copters is these will be affordable so the pool of resources can easily grow and as people put more into operation. [sent-38, score-0.266]
19 What is exciting is it seems technologies are coming together so that we can do something different. [sent-45, score-0.172]
20 You can start to see pools of communication resources dynamically coming together and being managed by an Aerial OS that connects and routes everything together over a diverse infrastructure owned and run by a diverse set of participants. [sent-47, score-0.356]
wordName wordTfidf (topN-words)
[('aerial', 0.488), ('balloon', 0.295), ('stations', 0.286), ('air', 0.149), ('plane', 0.144), ('internet', 0.142), ('loon', 0.139), ('routes', 0.129), ('drone', 0.123), ('drones', 0.123), ('satellite', 0.112), ('something', 0.101), ('os', 0.101), ('beauty', 0.099), ('affordable', 0.093), ('backbone', 0.093), ('connectivity', 0.087), ('signals', 0.086), ('communication', 0.085), ('equipment', 0.081), ('integrate', 0.074), ('fleshed', 0.074), ('plugs', 0.074), ('herethis', 0.074), ('swarming', 0.074), ('governance', 0.074), ('orbit', 0.074), ('balloons', 0.074), ('copters', 0.074), ('explodes', 0.074), ('diverse', 0.071), ('exciting', 0.071), ('enough', 0.07), ('ft', 0.069), ('float', 0.069), ('rf', 0.069), ('current', 0.068), ('beowulf', 0.066), ('agencies', 0.066), ('titan', 0.066), ('cubes', 0.066), ('snowden', 0.066), ('power', 0.065), ('carries', 0.064), ('mercy', 0.064), ('dictate', 0.064), ('edge', 0.064), ('handed', 0.062), ('towers', 0.062), ('enforcement', 0.062)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999988 1584 high scalability-2014-01-22-How would you build the next Internet? Loons, Drones, Copters, Satellites, or Something Else?
Introduction: If you were going to design a next generation Internet at the physical layer that routes around the current Internet, what would it look like? What should it do? How should it work? Who should own it? How should it be paid for? How would you access it? It has long been said the Internet routes around obstacles. Snowden has revealed some major obstacles. The beauty of the current current app and web system is the physical network doesn't matter. We can just replace it with something else. Something that doesn't flow through choke points like backhaul networks , under sea cables , and cell towers . What might that something else look like? Google's Loon Project Project Loon was so named because the idea was thought to be loony. Maybe not. The idea is to float high-altitude balloons 20 miles in the air to create an aerial wireless network with up to 3G-like speeds. Signals travel through the balloon network from balloon to balloon, then to a ground-based station conne
Introduction: "But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but consider we have no planet wide applications yet. None.Tomorrow the numbers foreshadow a newCambrian explosionof connectivity that will look as
Introduction: All in all this is still my favorite post and I still think it's an accurate vision of a future. Not everyone agrees, but I guess we'll see..."But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but c
4 0.089775451 1600 high scalability-2014-02-21-Stuff The Internet Says On Scalability For February 21st, 2014
Introduction: Hey, it's HighScalability time (a particularly bountiful week): The Telephone Wires of Manhattan in 1887 ( full ) $19 billion: you know what it is; $46 billion : cost of Sochi Olympics; 400 gigabytes : data transmitted during the Sochi opening ceremony; 26.9 million : Stack Overflow community monthly visitors; 93 million : Candy Crush daily active users; 200-400 Gbps : The New Normal in DDoS Attacks Quotable Quotes: @brianacton : Facebook turned me down. It was a great opportunity to connect with some fantastic people. Looking forward to life's next adventure. @BenedictEvans : Flickr: $35m. Youtube: $1.65bn Whatsapp: $19bn. Mobile is big. And global. And the next computing platform. Paying attention? @taziden : On the Internet, worst cases will become common cases #fosdem #postfix Brian Hayes : Any quantum program must have a stovepipe architecture: Information flows straight through. So you think V
5 0.086667553 1456 high scalability-2013-05-13-The Secret to 10 Million Concurrent Connections -The Kernel is the Problem, Not the Solution
Introduction: Now that we have the C10K concurrent connection problem licked, how do we level up and support 10 million concurrent connections? Impossible you say. Nope, systems right now are delivering 10 million concurrent connections using techniques that are as radical as they may be unfamiliar. To learn how it’s done we turn to Robert Graham , CEO of Errata Security, and his absolutely fantastic talk at Shmoocon 2013 called C10M Defending The Internet At Scale . Robert has a brilliant way of framing the problem that I’ve never heard of before. He starts with a little bit of history, relating how Unix wasn’t originally designed to be a general server OS, it was designed to be a control system for a telephone network. It was the telephone network that actually transported the data so there was a clean separation between the control plane and the data plane. The problem is we now use Unix servers as part of the data plane , which we shouldn’t do at all. If we were des
6 0.086345784 768 high scalability-2010-02-01-What Will Kill the Cloud?
7 0.08235877 1651 high scalability-2014-05-20-It's Networking. In Space! Or How E.T. Will Phone Home.
8 0.082318127 853 high scalability-2010-07-08-Cloud AWS Infrastructure vs. Physical Infrastructure
9 0.081009835 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
10 0.078071177 761 high scalability-2010-01-17-Applications Become Black Boxes Using Markets to Scale and Control Costs
11 0.077436939 778 high scalability-2010-02-15-The Amazing Collective Compute Power of the Ambient Cloud
13 0.075377613 920 high scalability-2010-10-15-Troubles with Sharding - What can we learn from the Foursquare Incident?
14 0.073515862 1491 high scalability-2013-07-15-Ask HS: What's Wrong with Twitter, Why Isn't One Machine Enough?
15 0.073455006 1634 high scalability-2014-04-18-Stuff The Internet Says On Scalability For April 18th, 2014
16 0.070766121 803 high scalability-2010-04-05-Intercloud: How Will We Scale Across Multiple Clouds?
17 0.070222206 786 high scalability-2010-03-02-Using the Ambient Cloud as an Application Runtime
18 0.069682695 1091 high scalability-2011-08-02-How Will DIDO Wireless Networking Change Everything?
19 0.069265351 446 high scalability-2008-11-18-Scalability Perspectives #2: Van Jacobson – Content-Centric Networking
20 0.06872154 661 high scalability-2009-07-25-Latency is Everywhere and it Costs You Sales - How to Crush it
topicId topicWeight
[(0, 0.137), (1, 0.065), (2, 0.024), (3, 0.05), (4, -0.031), (5, -0.052), (6, -0.01), (7, 0.032), (8, -0.032), (9, 0.002), (10, -0.024), (11, 0.025), (12, -0.009), (13, 0.02), (14, 0.045), (15, 0.0), (16, -0.009), (17, 0.001), (18, -0.026), (19, 0.004), (20, -0.033), (21, 0.017), (22, -0.018), (23, 0.021), (24, 0.008), (25, 0.036), (26, 0.004), (27, -0.009), (28, -0.023), (29, -0.011), (30, -0.037), (31, -0.001), (32, 0.011), (33, 0.016), (34, 0.003), (35, 0.007), (36, -0.0), (37, 0.024), (38, 0.019), (39, 0.032), (40, 0.027), (41, 0.007), (42, -0.004), (43, -0.001), (44, 0.009), (45, 0.013), (46, -0.041), (47, -0.01), (48, -0.061), (49, -0.015)]
simIndex simValue blogId blogTitle
same-blog 1 0.96374249 1584 high scalability-2014-01-22-How would you build the next Internet? Loons, Drones, Copters, Satellites, or Something Else?
Introduction: If you were going to design a next generation Internet at the physical layer that routes around the current Internet, what would it look like? What should it do? How should it work? Who should own it? How should it be paid for? How would you access it? It has long been said the Internet routes around obstacles. Snowden has revealed some major obstacles. The beauty of the current current app and web system is the physical network doesn't matter. We can just replace it with something else. Something that doesn't flow through choke points like backhaul networks , under sea cables , and cell towers . What might that something else look like? Google's Loon Project Project Loon was so named because the idea was thought to be loony. Maybe not. The idea is to float high-altitude balloons 20 miles in the air to create an aerial wireless network with up to 3G-like speeds. Signals travel through the balloon network from balloon to balloon, then to a ground-based station conne
2 0.86621946 1651 high scalability-2014-05-20-It's Networking. In Space! Or How E.T. Will Phone Home.
Introduction: What will the version of the Internet that follows us to the stars look like? Yes, people are really thinking seriously about this sort of thing. Specifically the InterPlanetary Networking Special Interest Group (IPNSIG). Ansible-like faster-than-light communication it isn't. There's no magical warp drive. Nor is a network of telepaths acting as a 'verse spanning telegraph system. It's more mundane than that. And in many ways more interesting as it's sort of like the old Internet on steroids, the one that was based on on UUCP and dial-up connections, but over vastly longer distances and with much longer delays : The Interplanetary Internet (based on IPN, also called InterPlaNet) is a conceived computer network in space, consisting of a set of network nodes which can communicate with each other.[1][2] Communication would be greatly delayed by the great interplanetary distances, so the IPN needs a new set of protocols and technology that are tolerant to large delays and
3 0.85181487 1091 high scalability-2011-08-02-How Will DIDO Wireless Networking Change Everything?
Introduction: A conjunction of a few new technologies may trigger disruptive changes in the future. This observation was prompted by a talk Steve Perlman gave at the Columbia Engineering School: Benjamin Button, Cloud Everything and Why Shannon's Law Isn't . In it he covers a set of technologies that at first may seem unrelated, but turn out to be deeply related after all, culminating in a realization of the long talked about vision of an application utility, where all applications are hosted and run out of the cloud. First Perlman talks about the realistic human rendering technology developed at Rearden, his research incubator company. This technology was developed over many years and is the secret behind the wonderful effects found in movies like Benjamin Button . It is now being used in many other films, and promises to revolutionize film making, possibly even replacing actors with computers, in real-time. The next invention at Rearden is OnLive , a cloud based gaming technology for pla
4 0.84774387 1140 high scalability-2011-11-10-Kill the Telcos Save the Internet - The Unsocial Network
Introduction: Someone is killing the Internet. Since you probably use the Internet everyday you might find this surprising. It almost sounds silly, and the reason is technical, but our crack team of networking experts has examined the patient and made the diagnosis. What did they find? Diagnostic team : the Packet Pushers gang ( Greg Ferro , Jan Zorz , Ivan Pepelnjak ) in the podcast How We Are Killing the Internet . Diagnosis : invasive tunnelation. ( tubes anyone? ) Prognosis : even Dr. House might not be able to help. Cure : go back to what the Internet was; kill the tunnels; route IPv4 and IPv6; have public addresses on everything; disrupt the telcos. This is a classic story in a strange setting--the network--but the themes are universal: centralization vs. decentralization (that's where the telcos obviously come in), good vs. evil, order vs. disorder, tyranny vs. freedom, change vs. stasis, simplicity vs. complexity. And it's all being carried out on battlefield few get
Introduction: The story of driving the golden spike to symbolize the completion of the transcontinental railroad is famous in the US. What is not so well known is the story of how it also foreshadowed changes to come as an early version of both the Internet and the Internet of Things. But that was 1869, how can that possibly be? Telegraph as Internet First, let's establish the telegraph and cable systems was an early version of an Internet. As railroad tracks were being laid a transcontental telegraph system was also being constructed. Telegraph lines were installed parallel to the tracks making instant communication available across the continent, faster than any horse could ride. With the transalantic cable system information could quickly span continents in minutes: The miles of American telegraph grew from 40 in 1846 to 12,000 in 1850 to 23,000 in 1852. In Europe it increased from 2,000 in 1849 to 110,000 in 1869. The cost of sending 10 words was $1.55 in 1850, $1 in 1870, 40
6 0.8236106 1526 high scalability-2013-10-02-RFC 1925 - The Twelve (Timeless) Networking Truths
7 0.80585825 1256 high scalability-2012-06-04-OpenFlow-SDN is Not a Silver Bullet for Network Scalability
9 0.78760612 284 high scalability-2008-03-19-RAD Lab is Creating a Datacenter Operating System
10 0.78697526 1225 high scalability-2012-04-09-Why My Slime Mold is Better than Your Hadoop Cluster
11 0.78456807 446 high scalability-2008-11-18-Scalability Perspectives #2: Van Jacobson – Content-Centric Networking
14 0.77794027 750 high scalability-2009-12-16-Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud
15 0.77107686 823 high scalability-2010-05-05-How will memristors change everything?
16 0.76639497 790 high scalability-2010-03-09-Applications as Virtual States
17 0.76417458 1381 high scalability-2013-01-04-Stuff The Internet Says On Scalability For January 4, 2013
18 0.76029509 1572 high scalability-2014-01-03-Stuff The Internet Says On Scalability For January 3rd, 2014
19 0.75379354 761 high scalability-2010-01-17-Applications Become Black Boxes Using Markets to Scale and Control Costs
20 0.74744743 266 high scalability-2008-03-04-Manage Downtime Risk by Connecting Multiple Data Centers into a Secure Virtual LAN
topicId topicWeight
[(1, 0.094), (2, 0.154), (10, 0.048), (17, 0.303), (25, 0.01), (47, 0.013), (56, 0.027), (61, 0.054), (79, 0.126), (85, 0.048), (94, 0.051)]
simIndex simValue blogId blogTitle
1 0.92523444 506 high scalability-2009-02-03-10 More Rules for Even Faster Websites
Introduction: Update: How-To Minimize Load Time for Fast User Experiences . Shows how to analyze the bottlenecks preventing websites and blogs from loading quickly and how to resolve them. 80-90% of the end-user response time is spent on the frontend, so it makes sense to concentrate efforts there before heroically rewriting the backend. Take a shower before buying a Porsche, if you know what I mean. Steve Souders, author of High Performance Websites and Yslow , has ten more best practices to speed up your website : Split the initial payload Load scripts without blocking Don’t scatter scripts Split dominant content domains Make static content cookie-free Reduce cookie weight Minify CSS Optimize images Use iframes sparingly To www or not to www Sadly, according to String Theory, there are only 26.7 rules left, so get them while they're still in our dimension. Here are slides on the first few rules. Love the speeding dog slide. That's exactly what my dog looks like trav
2 0.90884298 543 high scalability-2009-03-17-Sun to Announce Open Cloud APIs at CommunityOne
Introduction: One of the key items Sun will be talking about in today's cloud computing announcement (at 9AM EST/6AM PST) will be Sun's opening of the APIs that we'll use for the Sun Cloud. We're making these available so that those who are interested will be able to review and comment on these APIs. Continuing our commitment to openness, we're making these APIs available via the Creative Commons Version 3.0 license. ...
3 0.88825071 1225 high scalability-2012-04-09-Why My Slime Mold is Better than Your Hadoop Cluster
Introduction: Update : Organism without a brain creates external memories for navigation shows slime mold is even cooler than originally thought, storing a record of where it's been using slime: The authors conclude, the slime isn't just the mold's calling card. Instead, it's a way of marking the environment so that the organism can sense where it's been, and not expend effort on searches that won't pay off. Although the situation isn't an exact parallel, the authors make a comparison to the pheromone trails used by ants. In After Life: The Strange Science Of Decay there’s a truly incredible sequence of gorgeously shot video showing how creeping slime mold solves mazes and performs other other amazing feats of computation. Take a look at what simple one celled organisms can do: The whole video is really well done and shockingly revelatory. It’s the story of decay, how atoms created during the Big Bang and through countless supernova explosions are continually rearranged an
4 0.88251925 1393 high scalability-2013-01-24-NoSQL Parody: say No! No! and No!
Introduction: While certainly not in the same class as Hilarious Video: Relational Database vs NoSQL Fanbois or NSFW: Hilarious Fault-Tolerance Cartoon , this parody does have some really good moments:
5 0.87306947 631 high scalability-2009-06-15-Large-scale Graph Computing at Google
Introduction: To continue the graph theme Google has got into the act and released information on Pregel . Pregel does not appear to be a new type of potato chip. Pregel is instead a scalable infrastructure... ...to mine a wide range of graphs. In Pregel, programs are expressed as a sequence of iterations. In each iteration, a vertex can, independently of other vertices, receive messages sent to it in the previous iteration, send messages to other vertices, modify its own and its outgoing edges' states, and mutate the graph's topology. Currently, Pregel scales to billions of vertices and edges, but this limit will keep expanding. Pregel's applicability is harder to quantify, but so far we haven't come across a type of graph or a practical graph computing problem which is not solvable with Pregel. It computes over large graphs much faster than alternatives, and the application programming interface is easy to use. Implementing PageRank, for example, takes only about 15 lines of code. Developers
6 0.86187309 1467 high scalability-2013-05-30-Google Finds NUMA Up to 20% Slower for Gmail and Websearch
same-blog 7 0.81949359 1584 high scalability-2014-01-22-How would you build the next Internet? Loons, Drones, Copters, Satellites, or Something Else?
8 0.80484295 956 high scalability-2010-12-08-How To Get Experience Working With Large Datasets
9 0.7552318 869 high scalability-2010-07-30-Hot Scalability Links for July 30, 2010
10 0.73541254 1392 high scalability-2013-01-23-Building Redundant Datacenter Networks is Not For Sissies - Use an Outside WAN Backbone
11 0.71292871 765 high scalability-2010-01-25-Let's Welcome our Neo-Feudal Overlords
12 0.70033801 465 high scalability-2008-12-14-Scaling MySQL on a 256-way T5440 server using Solaris ZFS and Java 1.7
13 0.69664723 507 high scalability-2009-02-03-Paper: Optimistic Replication
14 0.68500298 1333 high scalability-2012-10-04-LinkedIn Moved from Rails to Node: 27 Servers Cut and Up to 20x Faster
15 0.66670215 467 high scalability-2008-12-16-[ANN] New Open Source Cache System
16 0.65741575 199 high scalability-2008-01-01-S3 for image storing
18 0.63092452 427 high scalability-2008-10-22-Server load balancing architectures, Part 2: Application-level load balancing
19 0.62834817 849 high scalability-2010-06-28-VoltDB Decapitates Six SQL Urban Myths and Delivers Internet Scale OLTP in the Process
20 0.62646288 1143 high scalability-2011-11-16-Google+ Infrastructure Update - the JavaScript Story