high_scalability high_scalability-2011 high_scalability-2011-1019 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Submitted for your reading pleasure on this tomato killing frosty morn... Now we really know why vampires feed on blood...they are elastically acquiring more compute power. Your Next Computer May Be Made of...Blood! It's those memristors again. Ancient vamps are really just giant super computers. Twitter now at 155 million tweets a day , up from 55 million a year ago. 10,000-core Linux supercomputer built in Amazon cloud By Jon Brodkin. T he 10,000 cores were composed of 1,250 instances with eight cores each, as well as 8.75TB of RAM and 2PB disk space. The cluster ran for eight hours at a cost of $8,500 . Quotable Quotes for $273 Alex: @davidklemke : Holy balls Windows Azure Tables is awesome. Man am I regretting not getting into this cloud stuff sooner, it's scalability heaven. @nik : The volume of tweets we are flowing into HBase is truly staggering #bigdata #datasift @wattersjames : One of the key points I mentioned before: Scalability is being abl
sentIndex sentText sentNum sentScore
1 Now we really know why vampires feed on blood. [sent-4, score-0.087]
2 Twitter now at 155 million tweets a day , up from 55 million a year ago. [sent-14, score-0.099]
3 T he 10,000 cores were composed of 1,250 instances with eight cores each, as well as 8. [sent-16, score-0.27]
4 The cluster ran for eight hours at a cost of $8,500 . [sent-18, score-0.122]
5 Quotable Quotes for $273 Alex: @davidklemke : Holy balls Windows Azure Tables is awesome. [sent-19, score-0.077]
6 @nik : The volume of tweets we are flowing into HBase is truly staggering #bigdata #datasift @wattersjames : One of the key points I mentioned before: Scalability is being able to deploy on the smallest systems that meets your req's @swiftriver : Great #data quote: "More is not better. [sent-21, score-0.178]
7 For information about resiliency in a larger context take a look at Resilient Communities . [sent-32, score-0.072]
8 Either the strangest beat poetry you've ever heard or the stragest programming language history you've ever heard. [sent-34, score-0.188]
9 These illusions allow programmers to think: bytecodes are fast and have a reasonable cost model, you can quickly change the program at any time, infinite memory, consistent threading and memory model, quick time access, that these other illusions all work on all sorts of machines from cell phones. [sent-39, score-0.881]
10 But we want to be beguiled even further with illusions of infinite Stack, code is data, Integers are as cheap as ints, memory supports atomic update, a JVM run utterly different languages. [sent-40, score-0.494]
11 Remember we just wanted mirrors that gave us the illusion of youth and beauty? [sent-41, score-0.263]
12 The point is Virtualization adds complexity and there are at least some cases when you may be lied to about IO completion . [sent-54, score-0.091]
13 Stack Exchange: Windows Azure vs Amazon EC2 vs Google App Engine . [sent-61, score-0.214]
14 Really good exchange on the tradeoffs between the systems. [sent-62, score-0.096]
15 This is what Etsy stands for: The little guy being able to organize a better marketplace. [sent-65, score-0.108]
wordName wordTfidf (topN-words)
[('illusions', 0.387), ('bloggers', 0.15), ('blame', 0.138), ('etsy', 0.134), ('eight', 0.122), ('guy', 0.108), ('vs', 0.107), ('infinite', 0.107), ('azure', 0.103), ('bigdata', 0.103), ('tweets', 0.099), ('poetry', 0.097), ('originate', 0.097), ('req', 0.097), ('posterous', 0.097), ('youth', 0.097), ('datasift', 0.097), ('wattersjames', 0.097), ('exchange', 0.096), ('john', 0.092), ('mirrors', 0.091), ('ints', 0.091), ('lied', 0.091), ('messiness', 0.091), ('strangest', 0.091), ('humans', 0.091), ('jvm', 0.091), ('vampires', 0.087), ('ina', 0.084), ('windows', 0.081), ('gabriel', 0.081), ('error', 0.081), ('integers', 0.079), ('glad', 0.079), ('bases', 0.079), ('smallest', 0.079), ('sooner', 0.077), ('balls', 0.077), ('failures', 0.075), ('illusion', 0.075), ('azul', 0.075), ('elastically', 0.075), ('io', 0.074), ('cliff', 0.074), ('jon', 0.074), ('takeaway', 0.074), ('cores', 0.074), ('qualities', 0.072), ('qcon', 0.072), ('resiliency', 0.072)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000002 1019 high scalability-2011-04-08-Stuff The Internet Says On Scalability For April 8, 2011
Introduction: Submitted for your reading pleasure on this tomato killing frosty morn... Now we really know why vampires feed on blood...they are elastically acquiring more compute power. Your Next Computer May Be Made of...Blood! It's those memristors again. Ancient vamps are really just giant super computers. Twitter now at 155 million tweets a day , up from 55 million a year ago. 10,000-core Linux supercomputer built in Amazon cloud By Jon Brodkin. T he 10,000 cores were composed of 1,250 instances with eight cores each, as well as 8.75TB of RAM and 2PB disk space. The cluster ran for eight hours at a cost of $8,500 . Quotable Quotes for $273 Alex: @davidklemke : Holy balls Windows Azure Tables is awesome. Man am I regretting not getting into this cloud stuff sooner, it's scalability heaven. @nik : The volume of tweets we are flowing into HBase is truly staggering #bigdata #datasift @wattersjames : One of the key points I mentioned before: Scalability is being abl
2 0.13436399 1148 high scalability-2011-11-29-DataSift Architecture: Realtime Datamining at 120,000 Tweets Per Second
Introduction: I remember the excitement of when Twitter first opened up their firehose. As an early adopter of the Twitter API I could easily imagine some of the cool things you could do with all that data. I also remember the disappointment of learning that in the land of BigData, data has a price, and that price would be too high for little fish like me. It was like learning for the first time there would be no BigData Santa Clause. For a while though I had the pleasure of pondering just how I would handle all that data. It's a fascinating problem. You have to be able to reliably consume it, normalize it, merge it with other data, apply functions on it, store it, query it, distribute it, and oh yah, monetize it. Most of that in realish-time. And if you are trying to create a platform for allowing the entire Internet do to the same thing to the firehose, the challenge is exponentially harder. DataSift is in the exciting position of creating just such a firehose eating, data chomping machine. Y
3 0.12507513 459 high scalability-2008-12-03-Java World Interview on Scalability and Other Java Scalability Secrets
Introduction: OK, this interview is with me on Java scalability issues. I sound like a bigger idiot than I would like, but I suppose it could have been worse. The Java World folks were very nice and did a good job, so there’s no blame on them :-) The interview went an interesting direction, but there’s more I’d like add and I will do so here. Two major rules regarding Java and scalability have popped out at me: Java – It’s the platform stupid . Java the language isn’t the big win. What is the big win is the ecosystem building up around the JVM, libraries, and toolsets. Java – It’s the community stupid . A lot of creativity is being expended on leveraging the Java platform to meet scalability challenges. The amazing community that has built up around Java is pushing Java to the next level in almost every direction imaginable. The fecundity of the Java ecosystem can most readily be seen with the efforts to tame our multi-core future. There’s a multi-core crisis going in case you haven’t
Introduction: "But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but consider we have no planet wide applications yet. None.Tomorrow the numbers foreshadow a newCambrian explosionof connectivity that will look as
Introduction: All in all this is still my favorite post and I still think it's an accurate vision of a future. Not everyone agrees, but I guess we'll see..."But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but c
6 0.11962927 538 high scalability-2009-03-16-Are Cloud Based Memory Architectures the Next Big Thing?
9 0.10847551 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
10 0.10718177 1379 high scalability-2012-12-31-Designing for Resiliency will be so 2013
11 0.10689853 768 high scalability-2010-02-01-What Will Kill the Cloud?
12 0.10572336 1420 high scalability-2013-03-08-Stuff The Internet Says On Scalability For March 8, 2013
13 0.10485697 1067 high scalability-2011-06-24-Stuff The Internet Says On Scalability For June 24, 2011
14 0.10340821 1297 high scalability-2012-08-03-Stuff The Internet Says On Scalability For August 3, 2012
15 0.10048935 1089 high scalability-2011-07-29-Stuff The Internet Says On Scalability For July 29, 2011
16 0.10026355 1215 high scalability-2012-03-26-7 Years of YouTube Scalability Lessons in 30 Minutes
17 0.099217758 954 high scalability-2010-12-06-What the heck are you actually using NoSQL for?
18 0.098991618 1516 high scalability-2013-09-13-Stuff The Internet Says On Scalability For September 13, 2013
19 0.098809011 1502 high scalability-2013-08-16-Stuff The Internet Says On Scalability For August 16, 2013
20 0.09871453 1330 high scalability-2012-09-28-Stuff The Internet Says On Scalability For September 28, 2012
topicId topicWeight
[(0, 0.206), (1, 0.097), (2, 0.007), (3, 0.082), (4, -0.01), (5, 0.017), (6, -0.048), (7, 0.035), (8, 0.01), (9, -0.025), (10, -0.017), (11, -0.035), (12, 0.048), (13, 0.012), (14, -0.052), (15, -0.035), (16, 0.017), (17, -0.042), (18, -0.031), (19, 0.009), (20, -0.004), (21, -0.007), (22, -0.064), (23, 0.002), (24, -0.023), (25, -0.006), (26, 0.014), (27, 0.007), (28, 0.015), (29, 0.019), (30, 0.03), (31, -0.019), (32, 0.017), (33, -0.034), (34, 0.005), (35, -0.012), (36, -0.049), (37, 0.003), (38, 0.028), (39, -0.012), (40, 0.021), (41, -0.03), (42, 0.009), (43, 0.007), (44, -0.029), (45, 0.008), (46, 0.014), (47, 0.039), (48, 0.017), (49, 0.025)]
simIndex simValue blogId blogTitle
same-blog 1 0.96914965 1019 high scalability-2011-04-08-Stuff The Internet Says On Scalability For April 8, 2011
Introduction: Submitted for your reading pleasure on this tomato killing frosty morn... Now we really know why vampires feed on blood...they are elastically acquiring more compute power. Your Next Computer May Be Made of...Blood! It's those memristors again. Ancient vamps are really just giant super computers. Twitter now at 155 million tweets a day , up from 55 million a year ago. 10,000-core Linux supercomputer built in Amazon cloud By Jon Brodkin. T he 10,000 cores were composed of 1,250 instances with eight cores each, as well as 8.75TB of RAM and 2PB disk space. The cluster ran for eight hours at a cost of $8,500 . Quotable Quotes for $273 Alex: @davidklemke : Holy balls Windows Azure Tables is awesome. Man am I regretting not getting into this cloud stuff sooner, it's scalability heaven. @nik : The volume of tweets we are flowing into HBase is truly staggering #bigdata #datasift @wattersjames : One of the key points I mentioned before: Scalability is being abl
2 0.85129923 1455 high scalability-2013-05-10-Stuff The Internet Says On Scalability For May 10, 2013
Introduction: Hey, it's HighScalability time: ( In Thailand, they figured out how to solve the age-old queuing problem! ) Nanoscale : Plants IM Using Nanoscale Sound Waves; 100 petabytes : CERN data storage Quotable Quotes: Geoff Arnold : Arguably all interesting advances in computer science and software engineering occur when a resource that was previously scarce or expensive becomes cheap and plentiful. @jamesurquhart : "Complexity is a characteristic of the system, not of the parts in it." -Dekker @louisnorthmore : Scaling down - now that's scalability! @peakscale : Where distributed systems people retire to forget the madness: http://en.wikipedia.org/wiki/Antipaxos @dozba : "The Linux Game Database" ... Well, at least they will never have scaling problems. Michael Widenius : There is no reason at all to use MySQL @steveloughran : Whenever someone says "unlimited scalability", ask if that exceeds the ber
3 0.83311492 1045 high scalability-2011-05-20-Stuff The Internet Says On Scalability For May 20, 2011
Introduction: Submitted for your reading pleasure on this beautiful morning: Group Decision Making in Honey Bee Swarms . In distributed computing systems nodes reach a quorum when deciding what to do as a group. It turns out bees also use quorum logic when deciding on where to nest! Bees do it a bit differently of course: A scout bee votes for a site by spending time at it, somehow the scouts act and interact so that their numbers rise faster at superior sites, and somehow the bees at each site monitor their numbers there so that they know whether they've reached the threshold number (quorum) and can proceed to initiating the swarm's move to this site. Ants use similar mechanisms to control foraging. Distributed systems may share common mechanisms based on their nature as being a distributed system, the components may not matter that much. Fire! Fire! Brent Chapman shows how to put that IT fire out in Incident Command for IT: What We Can Learn from the Fire Department .
4 0.81750834 1411 high scalability-2013-02-22-Stuff The Internet Says On Scalability For February 22, 2013
Introduction: Hey, it's HighScalability time: Quotable Quotes: @p337er : I have committed some truly horrendous crimes against scalability today. @ErrataRob : doubling performance doesn't double scalability. @rsingel : In 2008 when Yahoo.com linked out, I had a Wired story get 1M visitors in an hour from their homepage. @philiph : Lets solve this scalability problem with a queuing system @jaykreps : Transferring data across data centers? Read this page and go tune your TCP buffer sizes... @gwestr : In which the node community showers schadenfreude upon the rails community for "scalability is not my problem" architectures @pbailis : Makes sense, though I think there's a tradeoff re: coordination and scalability (always homogeneous vs dynamically heterogenous) @pembleton : To summarize Yoav's philosophy: we started as quick as we can and then we accelerated #operationgrandma in #reversim @surfichris : “We chose Heroku because we be
5 0.80970109 1534 high scalability-2013-10-18-Stuff The Internet Says On Scalability For October 18th, 2013
Introduction: Hey, it's HighScalability time: Test your sense of scale. Is this image of something microscopic or macroscopic? Find out . $3.5 million : Per Episode Cost of Breaking Bad Quotable Quotes: @GammaCounter : "There are 400 billion trees in the Amazon River basin, close to the number of stars in the Milky Way galaxy." @rbranson : Virtualization has near-zero overhead, unless the VM spends most of it's time copying between RAM and network… like memcached or haproxy. @HackerNewsOnion : Programming is 1% inspiration, 99% trying to get your environment working. @aneel : "roundtrips, not bandwidth, is now often the bottleneck for most applications" @jamesurquhart : Not to mention the fact that auto-scaling should happen above IaaS layer. Think multi-cloud. Sheref Mansy : A machine keeps sort of chugging away, without worrying about its environment. But a living system has to. V.D. Veksler : it just came to my attention that Javascri
6 0.80478817 1147 high scalability-2011-11-25-Stuff The Internet Says On Scalability For November 25, 2011
7 0.8019501 916 high scalability-2010-10-07-Hot Scalability Links For Oct 8, 2010
8 0.80142093 1451 high scalability-2013-05-03-Stuff The Internet Says On Scalability For May 3, 2013
9 0.80027074 1420 high scalability-2013-03-08-Stuff The Internet Says On Scalability For March 8, 2013
10 0.79874474 1129 high scalability-2011-09-30-Stuff The Internet Says On Scalability For September 30, 2011
11 0.79658443 1024 high scalability-2011-04-15-Stuff The Internet Says On Scalability For April 15, 2011
12 0.79568172 1403 high scalability-2013-02-08-Stuff The Internet Says On Scalability For February 8, 2013
13 0.79535443 1247 high scalability-2012-05-18-Stuff The Internet Says On Scalability For May 18, 2012
14 0.793338 1397 high scalability-2013-02-01-Stuff The Internet Says On Scalability For February 1, 2013
15 0.79236126 1252 high scalability-2012-05-25-Stuff The Internet Says On Scalability For May 25, 2012
16 0.79231989 999 high scalability-2011-03-04-Stuff The Internet Says On Scalability For March 4, 2011
17 0.79207551 869 high scalability-2010-07-30-Hot Scalability Links for July 30, 2010
18 0.78954315 1297 high scalability-2012-08-03-Stuff The Internet Says On Scalability For August 3, 2012
19 0.78865629 1322 high scalability-2012-09-14-Stuff The Internet Says On Scalability For September 14, 2012
20 0.78850377 1537 high scalability-2013-10-25-Stuff The Internet Says On Scalability For October 25th, 2013
topicId topicWeight
[(1, 0.134), (2, 0.2), (10, 0.048), (27, 0.013), (30, 0.044), (41, 0.157), (47, 0.018), (61, 0.077), (77, 0.031), (79, 0.092), (85, 0.039), (94, 0.088)]
simIndex simValue blogId blogTitle
1 0.93906933 996 high scalability-2011-02-28-A Practical Guide to Varnish - Why Varnish Matters
Introduction: This is a guest post by Jeff Su from Factual. What is Varnish? Varnish is an open source, high performance http accelerator that sits in front of a web stack and caches pages. This caching layer is very configurable and can be used for both static and dynamic content. One great thing about Varnish is that it can improve the performance of your website without requiring any code changes. If you haven’t heard of Varnish (or have heard of it, but haven’t used it), please read on. Adding Varnish to your stack can be completely noninvasive, but if you tweak your stack to play along with some of varnish’s more advanced features, you’ll be able to increase performance by orders of magnitude. Some of the high profile companies using Varnish include: Twitter , Facebook , Heroku and LinkedIn . Our Use Case One of Factual’s first high profile projects was Newsweek’s “America’s Best High Schools: The List” . After realizing that we had only a few weeks to increase our
2 0.91308725 1388 high scalability-2013-01-16-What if Cars Were Rented Like We Hire Programmers?
Introduction: Imagine if you will that car rental agencies rented cars like programmers are hired at many software companies... Agency : So sorry you had to wait in the reception area for an hour. Nobody knew you were coming to today. I finally found 8 people to interview before we can rent you a car. If we like you you may have to come in for another round of interviews tomorrow because our manager isn't in today. I didn't have a chance to read your application, so I'll just start with a question. What car do you drive today? Applicant : I drive a 2008 Subaru. Agency : That's a shame. We don't have a Subaru to rent you. Applicant : That's OK. Any car will do. Agency : No, we can only take on clients who know how to drive the cars we stock. We find it's safer that way. There are so many little differences between cars, we just don't want to take a chance. Applicant : I have a drivers license. I know how to drive. I've been driving all kinds of cars for 15 years, I am sure I can adapt.
same-blog 3 0.91198587 1019 high scalability-2011-04-08-Stuff The Internet Says On Scalability For April 8, 2011
Introduction: Submitted for your reading pleasure on this tomato killing frosty morn... Now we really know why vampires feed on blood...they are elastically acquiring more compute power. Your Next Computer May Be Made of...Blood! It's those memristors again. Ancient vamps are really just giant super computers. Twitter now at 155 million tweets a day , up from 55 million a year ago. 10,000-core Linux supercomputer built in Amazon cloud By Jon Brodkin. T he 10,000 cores were composed of 1,250 instances with eight cores each, as well as 8.75TB of RAM and 2PB disk space. The cluster ran for eight hours at a cost of $8,500 . Quotable Quotes for $273 Alex: @davidklemke : Holy balls Windows Azure Tables is awesome. Man am I regretting not getting into this cloud stuff sooner, it's scalability heaven. @nik : The volume of tweets we are flowing into HBase is truly staggering #bigdata #datasift @wattersjames : One of the key points I mentioned before: Scalability is being abl
4 0.90787923 1454 high scalability-2013-05-08-Typesafe Interview: Scala + Akka is an IaaS for Your Process Architecture
Introduction: This is an email interview with Viktor Klang , Director of Engineering at Typesafe , on the Scala Futures model & Akka, both topics on which is he is immensely passionate and knowledgeable. How do you structure your application? That’s the question I explored in the article Beyond Threads And Callbacks . An option I did not talk about, mostly because of my own ignorance, is a powerful stack you may not be all that familiar with: Scala and Akka. To remedy my oversight is our acting tour guide, Typesafe’s Viktor Klang, long time Scala hacker and Java enterprise systems architect. Viktor was very patient in answering my questions and was enthusiastic about sharing his knowledge. He’s a guy who definitely knows what he is talking about. I’ve implemented several Actor systems along with the messaging infrastructure, threading, async IO, service orchestration, failover, etc, so I’m innately skeptical about frameworks that remove control from the programmer at
Introduction: Joseph Smarr, former CTO of Plaxo (which explains why I recognized his picture), in I'm a technical lead on the Google+ team. Ask me anything , reveals the stack used for building Google+: Our stack is pretty standard fare for Google apps these days: we use Java servlets for our server code and JavaScript for the browser-side of the UI, largely built with the (open-source) Closure framework, including Closure's JavaScript compiler and template system. A couple nifty tricks we do: we use the HTML5 History API to maintain pretty-looking URLs even though it's an AJAX app (falling back on hash-fragments for older browsers); and we often render our Closure templates server-side so the page renders before any JavaScript is loaded, then the JavaScript finds the right DOM nodes and hooks up event handlers, etc. to make it responsive (as a result, if you're on a slow connection and you click on stuff really fast, you may notice a lag before it does anything, but luckily most people don't run
6 0.90047652 1267 high scalability-2012-06-18-The Clever Ways Chrome Hides Latency by Anticipating Your Every Need
7 0.9000991 1007 high scalability-2011-03-18-Stuff The Internet Says On Scalability For March 18, 2011
8 0.87596464 1429 high scalability-2013-03-25-AppBackplane - A Framework for Supporting Multiple Application Architectures
9 0.87389511 293 high scalability-2008-03-31-Read HighScalability on Your Mobile Phone Using WidSets Widgets
10 0.86346638 645 high scalability-2009-06-30-Hot New Trend: Linking Clouds Through Cheap IP VPNs Instead of Private Lines
11 0.86310309 1516 high scalability-2013-09-13-Stuff The Internet Says On Scalability For September 13, 2013
12 0.86169887 1117 high scalability-2011-09-16-Stuff The Internet Says On Scalability For September 16, 2011
13 0.85935688 1245 high scalability-2012-05-14-DynamoDB Talk Notes and the SSD Hot S3 Cold Pattern
14 0.85865712 72 high scalability-2007-08-22-Wikimedia architecture
15 0.85840183 1637 high scalability-2014-04-25-Stuff The Internet Says On Scalability For April 25th, 2014
16 0.85784388 517 high scalability-2009-02-21-Google AppEngine - A Second Look
17 0.85767353 301 high scalability-2008-04-08-Google AppEngine - A First Look
18 0.85753614 1389 high scalability-2013-01-18-Stuff The Internet Says On Scalability For January 18, 2013
19 0.85735029 1407 high scalability-2013-02-15-Stuff The Internet Says On Scalability For February 15, 2013
20 0.85695255 1490 high scalability-2013-07-12-Stuff The Internet Says On Scalability For July 12, 2013