high_scalability high_scalability-2008 high_scalability-2008-363 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: One of the most popular and effective scalability strategies is to impose limits ( GAE Quotas , Fotolog , Facebook ) as a means of protecting a website against service destroying traffic spikes . Twitter will reportedly limit the number followers to 2,000 in order to thwart follow spam. This may also allow Twitter to make some bank by going freemium and charging for adding more followers. Agree or disagree with Twitter's strategies, the more interesting aspect for me is how do you introduce new policies into an already established ecosystem? One approach is the big bang. Introduce all changes at once and let everyone adjust. If users don't like it they can move on. The hope is, however, most users won't be impacted by the changes and that those who are will understand it's all for the greater good of their beloved service. Casualties are assumed, but the damage will probably be minor. Now in Twitter's case the people with the most followers tend to be o
sentIndex sentText sentNum sentScore
1 One of the most popular and effective scalability strategies is to impose limits ( GAE Quotas , Fotolog , Facebook ) as a means of protecting a website against service destroying traffic spikes . [sent-1, score-0.157]
2 The hope is, however, most users won't be impacted by the changes and that those who are will understand it's all for the greater good of their beloved service. [sent-8, score-0.213]
3 Now in Twitter's case the people with the most followers tend to be opinion leaders who shape much of the blognet echo chamber . [sent-10, score-0.205]
4 The idea is to only impose the limits on new accounts, not the old. [sent-15, score-0.157]
5 Old people are happy and new people understand what they are getting into. [sent-16, score-0.154]
6 The reason I like this suggestion so much is that it has deep historical roots, all the way back to the fall of the Roman republic and the rise of the empire due to the agrarian reforms laws passed in 133BC. [sent-17, score-1.247]
7 In ancient Rome property and power, as they tend to do, became concentrated in the hands of a few wealthy land owners. [sent-18, score-0.446]
8 The greatness that was Rome was founded on a agrarian society. [sent-20, score-0.289]
9 As power concentrated small farmers were kicked of the land and forced to move to the city. [sent-22, score-0.685]
10 It had a mixed constitution with two consuls at the top, a senate, and tribunes below. [sent-29, score-0.276]
11 The agrarian laws passed by Gracchus set off a war between between the nobility and the people. [sent-31, score-0.858]
12 The nobles obviously didn't want to lose their the land and set in motion a struggle eventually leading to the defeat of the people, the fall of the Republic, and the rise of the Empire. [sent-32, score-0.589]
13 Machiavelli, despite his unpopular press, was a big fan of the republican form of government, and pinpointed the retroactive and punitive nature of the agrarian laws as why the Republic fell. [sent-33, score-1.029]
14 He didn't say reform wasn't needed, but he thought the mistake was in how in how the reform was carried out. [sent-34, score-0.61]
15 By making the laws retroactive it challenged the existing order. [sent-35, score-0.633]
16 And by making the laws so punitive it made the nobility willing to fight to keep what they already had. [sent-36, score-0.642]
17 In fact, this is the origin in the ex post facto clause in the US Constitution, which says you can't pass a law that with retroactive effect. [sent-38, score-0.217]
18 Machiavelli suggested the reforms should have been carried out so they only impacted the future. [sent-39, score-0.309]
19 For example, in new conquered lands small farmers would be given more land. [sent-40, score-0.432]
20 In this way the nobility wouldn't be directly challenged, reform could happen slowly over time, and the republic would have been preserved. [sent-41, score-0.727]
wordName wordTfidf (topN-words)
[('laws', 0.321), ('agrarian', 0.289), ('republic', 0.289), ('land', 0.27), ('reform', 0.262), ('retroactive', 0.217), ('farmers', 0.197), ('rome', 0.185), ('nobility', 0.176), ('gracchus', 0.145), ('punitive', 0.145), ('tribunes', 0.145), ('constitution', 0.131), ('reforms', 0.131), ('roman', 0.123), ('lands', 0.113), ('concentrated', 0.11), ('impose', 0.102), ('challenged', 0.095), ('impacted', 0.092), ('carried', 0.086), ('twitter', 0.081), ('people', 0.077), ('rise', 0.074), ('passed', 0.072), ('fall', 0.071), ('tend', 0.066), ('nobles', 0.066), ('followersto', 0.066), ('reestablish', 0.066), ('beloved', 0.066), ('conquered', 0.066), ('pissing', 0.066), ('redress', 0.066), ('introduce', 0.064), ('imbalance', 0.062), ('echo', 0.062), ('civil', 0.059), ('redistribute', 0.059), ('unpopular', 0.057), ('small', 0.056), ('history', 0.056), ('hope', 0.055), ('struggle', 0.055), ('limits', 0.055), ('defeat', 0.053), ('attempted', 0.053), ('kicked', 0.052), ('remained', 0.052), ('reclaimed', 0.052)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 363 high scalability-2008-08-12-Strategy: Limit The New, Not The Old
Introduction: One of the most popular and effective scalability strategies is to impose limits ( GAE Quotas , Fotolog , Facebook ) as a means of protecting a website against service destroying traffic spikes . Twitter will reportedly limit the number followers to 2,000 in order to thwart follow spam. This may also allow Twitter to make some bank by going freemium and charging for adding more followers. Agree or disagree with Twitter's strategies, the more interesting aspect for me is how do you introduce new policies into an already established ecosystem? One approach is the big bang. Introduce all changes at once and let everyone adjust. If users don't like it they can move on. The hope is, however, most users won't be impacted by the changes and that those who are will understand it's all for the greater good of their beloved service. Casualties are assumed, but the damage will probably be minor. Now in Twitter's case the people with the most followers tend to be o
2 0.1226829 790 high scalability-2010-03-09-Applications as Virtual States
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. As I was writing an article on the architecture of the Storm Botnet , I couldn't help but notice the deep similarity of how Storm works and changes we're seeing in the evolution of political systems. In particular, the rise of the virtual-state . As crazy as this may sound, I think this is also the direction applications will need follow to survive in a complex world of billions of compute devices. You may have already heard of virtual corporations . Virtual corporations are companies with limited office space, a distributed workforce, and production facilities located wherever it is profitable to locate them. The idea is to stay lean and compete using the rapid development and introduction of new products into high value-added markets . If you spot a market opportunity with a small time window, building your own factories and hiring and engine
3 0.11383051 765 high scalability-2010-01-25-Let's Welcome our Neo-Feudal Overlords
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. There's a pattern, already begun, that has accelerated by the need for applications to scale and increase complexity, the end result of which will be that applications give up their independence and enter a kind of feudal relationship with their platform provider. To understand how this process works, like a glacier slowly and inevitably carving out a deep river valley, here's the type of question I get quite a lot: I've learned PHP and MySQL and I've built a web app that I HOPE will receive traffic comparable to eBay's with a similar database structure. I see all these different opinions and different techniques and languages being recommended and it's so confusing. All I want is perhaps one book or one website that focuses on PHP and MySQL and building a large database web app like eBay's. Does something like this exist? I'm always at a loss fo
4 0.11137915 201 high scalability-2008-01-04-For $5 Million You Can Buy Enough Storage to Compete with Google
Introduction: Kevin Burton calculates that Blekko , one of the barbarian hoard storming Google's search fortress, would need to spend $5 million just to buy enough weapons, er storage. Kevin estimates storing a deep crawl of the internet would take about 5 petabytes. At a projected $1 million per petabyte that's a paltry $5 million. Less than expected. Imagine in days of old an ambitious noble itching to raise an army to conquer a land and become its new prince. For a fine land, and the search market is one of the richest, that would be a smart investment for a VC to make. In these situations I always ask: What would Machiavelli do? Machiavelli taught some lands are hard to conquer and easy to keep and some are easy to conquer and hard to keep. A land like France was easy to conquer because it was filled with nobles. You can turn nobles on each other because they always hate each other for some reason or another. But it's hard to keep a land of nobles because they all think they
5 0.099782616 1600 high scalability-2014-02-21-Stuff The Internet Says On Scalability For February 21st, 2014
Introduction: Hey, it's HighScalability time (a particularly bountiful week): The Telephone Wires of Manhattan in 1887 ( full ) $19 billion: you know what it is; $46 billion : cost of Sochi Olympics; 400 gigabytes : data transmitted during the Sochi opening ceremony; 26.9 million : Stack Overflow community monthly visitors; 93 million : Candy Crush daily active users; 200-400 Gbps : The New Normal in DDoS Attacks Quotable Quotes: @brianacton : Facebook turned me down. It was a great opportunity to connect with some fantastic people. Looking forward to life's next adventure. @BenedictEvans : Flickr: $35m. Youtube: $1.65bn Whatsapp: $19bn. Mobile is big. And global. And the next computing platform. Paying attention? @taziden : On the Internet, worst cases will become common cases #fosdem #postfix Brian Hayes : Any quantum program must have a stovepipe architecture: Information flows straight through. So you think V
6 0.097141385 750 high scalability-2009-12-16-Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud
8 0.08502952 837 high scalability-2010-06-07-Six Ways Twitter May Reach its Big Hairy Audacious Goal of One Billion Users
9 0.072372846 1366 high scalability-2012-12-03-Resiliency is the New Normal - A Deep Look at What It Means and How to Build It
10 0.063664824 639 high scalability-2009-06-27-Scaling Twitter: Making Twitter 10000 Percent Faster
11 0.057209365 1356 high scalability-2012-11-07-Gone Fishin': 10 Ways to Take your Site from One to One Million Users by Kevin Rose
12 0.056974672 1385 high scalability-2013-01-11-Stuff The Internet Says On Scalability For January 11, 2013
13 0.056049008 156 high scalability-2007-11-16-Mogulus Doesn't Own a Single Server and has $1.2 million in funding, 15,000 People Creating Channels
14 0.053589638 1112 high scalability-2011-09-07-What Google App Engine Price Changes Say About the Future of Web Architecture
15 0.053547159 715 high scalability-2009-10-06-10 Ways to Take your Site from One to One Million Users by Kevin Rose
16 0.053351652 1040 high scalability-2011-05-13-Stuff The Internet Says On Scalability For May 13, 2011
17 0.052730069 1444 high scalability-2013-04-23-Facebook Secrets of Web Performance
18 0.052602738 701 high scalability-2009-09-10-When optimizing - don't forget the Java Virtual Machine (JVM)
19 0.05119998 323 high scalability-2008-05-19-Twitter as a scalability case study
20 0.051152229 330 high scalability-2008-05-27-Should Twitter be an All-You-Can-Eat Buffet or a Vending Machine?
topicId topicWeight
[(0, 0.082), (1, 0.048), (2, 0.015), (3, 0.031), (4, 0.011), (5, -0.047), (6, -0.032), (7, 0.053), (8, 0.019), (9, -0.023), (10, -0.027), (11, 0.028), (12, -0.012), (13, 0.021), (14, 0.036), (15, -0.009), (16, -0.005), (17, -0.029), (18, -0.003), (19, 0.014), (20, -0.023), (21, -0.027), (22, 0.019), (23, -0.01), (24, -0.006), (25, 0.012), (26, -0.007), (27, -0.007), (28, 0.001), (29, -0.003), (30, 0.0), (31, -0.021), (32, -0.03), (33, 0.017), (34, -0.064), (35, -0.018), (36, -0.022), (37, 0.003), (38, -0.005), (39, -0.018), (40, 0.021), (41, 0.013), (42, 0.001), (43, 0.015), (44, 0.038), (45, 0.025), (46, 0.002), (47, 0.0), (48, 0.002), (49, 0.045)]
simIndex simValue blogId blogTitle
same-blog 1 0.95267385 363 high scalability-2008-08-12-Strategy: Limit The New, Not The Old
Introduction: One of the most popular and effective scalability strategies is to impose limits ( GAE Quotas , Fotolog , Facebook ) as a means of protecting a website against service destroying traffic spikes . Twitter will reportedly limit the number followers to 2,000 in order to thwart follow spam. This may also allow Twitter to make some bank by going freemium and charging for adding more followers. Agree or disagree with Twitter's strategies, the more interesting aspect for me is how do you introduce new policies into an already established ecosystem? One approach is the big bang. Introduce all changes at once and let everyone adjust. If users don't like it they can move on. The hope is, however, most users won't be impacted by the changes and that those who are will understand it's all for the greater good of their beloved service. Casualties are assumed, but the damage will probably be minor. Now in Twitter's case the people with the most followers tend to be o
2 0.74371779 352 high scalability-2008-07-18-Robert Scoble's Rules for Successfully Scaling Startups
Introduction: Robert Scoble in an often poignant FriendFeed thread commiserating PodTech's unfortunate end, shared what he learned about creating a successful startup. Here's a summary of a Robert's rules and why Machiavelli just may agree with them: Have a story. Have everyone on board with that story. If anyone goes off of that story, make sure they get on board immediately or fire them. Make sure people are judged by the revenues they bring in. Those that bring in revenues should get to run the place. People who don't bring in revenues should get fewer and fewer responsibilities, not more and more. Work ONLY for a leader who will make the tough decisions. Build a place where excellence is expected, allowed, and is enabled. Fire idiots quickly. If your engineering team can't give a media team good measurements, the entire company is in trouble. Only things that are measured ever get improved. When your stars aren't listened to the company is in trouble. Getting rid of t
3 0.73669684 1500 high scalability-2013-08-12-100 Curse Free Lessons from Gordon Ramsay on Building Great Software
Introduction: Gordon Ramsay is a world renowned chef with a surprising amount to say on software development. Well, he says it about cooking and running a restaurant, but it applies to software development too. You may have seen Gordon Ramsay on one of his many TV shows. Hell's Kitchen is a competition between chefs trying to win a dream job: head chef of their own high-end restaurant. On this show Ramsay is judge, jury, and executioner. And he chops off more than a few heads. Kitchen Nightmares is a show where Ramsay is called in by restaurant owners to help turn around their failing restaurants. On this show Ramsay is there to help. If you just watch Hell's Kitchen you will likely conclude Ramsay is one of the devil's own helpers ("ram" is the symbol of the devil and "say" means he speaks for the devil: Ramsay). Ramsay screams, yells, cusses, belittles, and throws tantrums even a 7 year old could learn from. Then he does it all over gain just for spite. In Hell's Kitchen there's no evidence a
4 0.73146421 166 high scalability-2007-11-27-Solving the Client Side API Scalability Problem with a Little Game Theory
Introduction: Now that the internet has become defined as a mashup over a collection of service APIs, we have a little problem: for clients using APIs is a lot like drinking beer through a straw. You never get as much beer as you want and you get a headache after. But what if I've been a good boy and deserve a bigger straw? Maybe we can use game theory to model trust relationships over a life time of interactions over many different services and then give more capabilities/beer to those who have earned them? Let's say Twitter limits me to downloading only 20 tweets at a time through their API. But I want more. I may even want to do something so radical as download all my tweets. Of course Twitter can't let everyone do that. They would be swamped serving all this traffic and service would be denied. So Twitter does that rational thing and limits API access as a means of self protection. As does Google, Yahoo, Skynet , and everyone else. But when I hit the API limit I think, but hey it
5 0.72669077 330 high scalability-2008-05-27-Should Twitter be an All-You-Can-Eat Buffet or a Vending Machine?
Introduction: Om proposes one solution to the Twitter Problem is to limit followers to three square meals a day. The reasonable idea being that lower limits should mean fewer scaling problems. And as a kicker raising those limits is a good way to raise much needed revenue. Scoble thinks users should consume without limit and will drive to another buffet if all-you-can-eat privileges are revoked. The reasonable idea being that if an internet service can't solve internet scale problems then there's not much use for it. Dave says comp power users a top floor suite and shower them with free passes to the buffet. Let the good times roll! The reasonable idea being that power users help create popular restaurants, er, services in the first place and limiting them starves users and starved users won't come back. So, should web services like Twitter be a buffet, a fixed eight course fine dining experience, a small plate restaurant, a family style joint, or a vending machine? Or
6 0.7193175 790 high scalability-2010-03-09-Applications as Virtual States
7 0.71831244 837 high scalability-2010-06-07-Six Ways Twitter May Reach its Big Hairy Audacious Goal of One Billion Users
8 0.71766829 1377 high scalability-2012-12-26-Ask HS: What will programming and architecture look like in 2020?
9 0.71591789 1515 high scalability-2013-09-11-Ten Lessons from GitHub’s First Year in 2008
10 0.70603716 777 high scalability-2010-02-15-Scaling Ambition at StackOverflow
11 0.70224237 347 high scalability-2008-07-07-Five Ways to Stop Framework Fixation from Crashing Your Scaling Strategy
12 0.70052284 1012 high scalability-2011-03-28-Aztec Empire Strategy: Use Dual Pipes in Your Aqueduct for High Availability
13 0.69885474 1491 high scalability-2013-07-15-Ask HS: What's Wrong with Twitter, Why Isn't One Machine Enough?
15 0.69382465 1635 high scalability-2014-04-21-This is why Microsoft won. And why they lost.
16 0.68780333 765 high scalability-2010-01-25-Let's Welcome our Neo-Feudal Overlords
17 0.68252879 1410 high scalability-2013-02-20-Smart Companies Fail Because they Do Everything Right - Staying Alive to Scale
18 0.68102157 863 high scalability-2010-07-22-How can we spark the movement of research out of the Ivory Tower and into production?
19 0.67989504 1458 high scalability-2013-05-15-Lesson from Airbnb: Give Yourself Permission to Experiment with Non-scalable Changes
20 0.67951924 1432 high scalability-2013-04-01-Khan Academy Checkbook Scaling to 6 Million Users a Month on GAE
topicId topicWeight
[(1, 0.032), (2, 0.125), (3, 0.02), (10, 0.062), (30, 0.011), (32, 0.361), (40, 0.013), (61, 0.077), (76, 0.011), (77, 0.035), (79, 0.103), (85, 0.042), (94, 0.021)]
simIndex simValue blogId blogTitle
same-blog 1 0.84872699 363 high scalability-2008-08-12-Strategy: Limit The New, Not The Old
Introduction: One of the most popular and effective scalability strategies is to impose limits ( GAE Quotas , Fotolog , Facebook ) as a means of protecting a website against service destroying traffic spikes . Twitter will reportedly limit the number followers to 2,000 in order to thwart follow spam. This may also allow Twitter to make some bank by going freemium and charging for adding more followers. Agree or disagree with Twitter's strategies, the more interesting aspect for me is how do you introduce new policies into an already established ecosystem? One approach is the big bang. Introduce all changes at once and let everyone adjust. If users don't like it they can move on. The hope is, however, most users won't be impacted by the changes and that those who are will understand it's all for the greater good of their beloved service. Casualties are assumed, but the damage will probably be minor. Now in Twitter's case the people with the most followers tend to be o
2 0.81700933 1193 high scalability-2012-02-16-A Short on the Pinterest Stack for Handling 3+ Million Users
Introduction: Pinterest co-founder Paul Sciarra shared a bit about their stack on Quora: Python + heavily-modified Django at the application layer Tornado and (very selectively) node.js as web-servers. Memcached and membase / redis for object- and logical-caching, respectively. RabbitMQ as a message queue. Nginx, HAproxy and Varnish for static-delivery and load-balancing. Persistent data storage using MySQL. MrJob on EMR for map-reduce. Git. Alex Popescu has created a cool diagram of the setup and provided some thoughtful analysis as well.
3 0.75521493 523 high scalability-2009-02-25-Relating business, systems & technology during turbulent time -By John Zachman
Introduction: If you want to understand Complexity and Contradiction in IT Architecture and struggling to manage non-adaptive and dysfunctional systems, you don't want to miss this. one day Certified conference by John Zachman in Dubai on 23rd March 2009. For more details visit http://www.EnterpriseArchitectureLive.com For registrations, group discounts or further details please contact Caroline.smith@icmgworld.com
4 0.74635428 287 high scalability-2008-03-24-Advertise
Introduction: If you would like to advertise on this site please contact me at todd@possibility.com . We can work out the details over email. Thanks
5 0.7309612 251 high scalability-2008-02-18-How to deal with an I-O bottleneck to disk?
Introduction: A site I'm working with has an I/O bottleneck. They're using a static server to deliver all of the pictures/video content/zip downloads ecetera but now that the bandwith out of that server is approaching 50Mbit/second the latency on serving small files has increased to become unacceptable. I'm curious how other people have dealt with this situation. Seperating into two different servers would require a significant change to the sites architecutre (because the premise is that all uploads go into one server, all subdirectorie are created in one directory, etc.) and may not really solve the problem.
6 0.71647859 552 high scalability-2009-04-01-Art of scalability (1) - Scalability principles
7 0.71184123 648 high scalability-2009-07-02-It Must be Crap on Relational Dabases Week
8 0.59165508 291 high scalability-2008-03-29-20 New Rules for Faster Web Pages
9 0.54155302 1374 high scalability-2012-12-18-Georeplication: When Bad Things Happen to Good Systems
10 0.53487992 556 high scalability-2009-04-05-At Some Point the Cost of Servers Outweighs the Cost of Programmers
11 0.53385961 1318 high scalability-2012-09-07-Stuff The Internet Says On Scalability For September 7, 2012
13 0.51965582 1593 high scalability-2014-02-10-13 Simple Tricks for Scaling Python and Django with Apache from HackerEarth
14 0.51361269 569 high scalability-2009-04-14-Scalability resources
15 0.50468308 974 high scalability-2011-01-18-Paper: Relational Cloud: A Database-as-a-Service for the Cloud
16 0.49547207 1286 high scalability-2012-07-18-Strategy: Kill Off Multi-tenant Instances with High CPU Stolen Time
17 0.47735906 331 high scalability-2008-05-27-eBay Architecture
18 0.45716578 526 high scalability-2009-03-05-Strategy: In Cloud Computing Systematically Drive Load to the CPU
19 0.45710847 1248 high scalability-2012-05-21-Pinterest Architecture Update - 18 Million Visitors, 10x Growth,12 Employees, 410 TB of Data
20 0.45563453 1098 high scalability-2011-08-15-Should any cloud be considered one availability zone? The Amazon experience says yes.