high_scalability high_scalability-2010 high_scalability-2010-783 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Cassandra @ Twitter: An Interview with Ryan King . Great interview by Alex Popescu on Twitter's thought process for switching to Cassandra. Twitter chose Cassandra because it had more big system features out of the box. Is that Cassandra FTW? I Had Downtime Today. Here’s What I’m Doing About It by Patrick McKenzie. Awesome deep dive into went wrong with Bingo Card Creator. Sh*t happens. How do you design a process to help prevent it from happening and how do you deal with problems with integrity when they do? High Availability Principle : Request Queueing by Ashish Soni. Queue request to ride out traffic spikes: 1) Request Queuing allows your system to operate at optimal throughput. 2) Your users only experience linear degradation versus exponential degradation. 3) Your system experiences NO degradation. pfffft twatter tweeter by Knowbuddy. The reason you should care [about NoSQL] is because now you have more options--you're not stuck trying to wedge your system into
sentIndex sentText sentNum sentScore
1 Great interview by Alex Popescu on Twitter's thought process for switching to Cassandra. [sent-2, score-0.106]
2 Twitter chose Cassandra because it had more big system features out of the box. [sent-3, score-0.131]
3 How do you design a process to help prevent it from happening and how do you deal with problems with integrity when they do? [sent-9, score-0.083]
4 Queue request to ride out traffic spikes: 1) Request Queuing allows your system to operate at optimal throughput. [sent-11, score-0.2]
5 2) Your users only experience linear degradation versus exponential degradation. [sent-12, score-0.083]
6 The reason you should care [about NoSQL] is because now you have more options--you're not stuck trying to wedge your system into a relational model if you don't want to. [sent-15, score-0.116]
7 How does Facebook deal with 12 TB of compressed new data everyday? [sent-23, score-0.083]
8 Comes a close to living up to the title as you can in a 45 minute presentation. [sent-26, score-0.101]
9 Scaling Web Applications with HMVC by Sam de Freyssinet. [sent-40, score-0.081]
10 The Hierarchical-Model-View-Controller (HMVC) pattern is a direct extension to the MVC pattern that manages to solve many of the scalability issues. [sent-41, score-0.326]
11 Scaling python webapps from 0 to 50 million users - A top-down approach by Jinal Jhaveri. [sent-42, score-0.196]
12 How Facebook attacked network time, generation time, and render time. [sent-46, score-0.098]
13 One in a million happens a lot when your site is big By Gabriel Weinberg. [sent-47, score-0.169]
14 Well, When you get those kinds of numbers [large], the one in a million occurrence happens quite frequently How Intel Manages 100,000 Servers by Rich Miller. [sent-49, score-0.27]
15 Cloud computing has been variously dismissed as a fad, a fraud, or even a corporate conspiracy to rob us of our property rights. [sent-51, score-0.208]
16 But for software developers, cloud computing services are a very real and legitimate alternative to traditional server environments, and are only becoming more so. [sent-52, score-0.096]
wordName wordTfidf (topN-words)
[('ashish', 0.273), ('twitter', 0.153), ('varnish', 0.139), ('chose', 0.131), ('cassandra', 0.126), ('itby', 0.124), ('bingo', 0.124), ('dismiss', 0.124), ('dismissed', 0.124), ('ftw', 0.124), ('scribd', 0.124), ('rails', 0.117), ('wedge', 0.116), ('fad', 0.116), ('webapps', 0.116), ('request', 0.112), ('manages', 0.112), ('scalabilityby', 0.111), ('hadoopby', 0.111), ('shit', 0.111), ('populated', 0.107), ('pattern', 0.107), ('interview', 0.106), ('bradford', 0.104), ('gabriel', 0.104), ('completes', 0.104), ('close', 0.101), ('occurrence', 0.101), ('facebook', 0.1), ('attacked', 0.098), ('mvc', 0.096), ('sam', 0.096), ('wordpress', 0.096), ('legitimate', 0.096), ('popescu', 0.094), ('sh', 0.092), ('patrick', 0.091), ('fraud', 0.089), ('happens', 0.089), ('everyday', 0.088), ('jason', 0.088), ('ride', 0.088), ('ian', 0.088), ('rob', 0.084), ('degradation', 0.083), ('deal', 0.083), ('jonathan', 0.081), ('freedom', 0.081), ('de', 0.081), ('million', 0.08)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000002 783 high scalability-2010-02-24-Hot Scalability Links for February 24, 2010
Introduction: Cassandra @ Twitter: An Interview with Ryan King . Great interview by Alex Popescu on Twitter's thought process for switching to Cassandra. Twitter chose Cassandra because it had more big system features out of the box. Is that Cassandra FTW? I Had Downtime Today. Here’s What I’m Doing About It by Patrick McKenzie. Awesome deep dive into went wrong with Bingo Card Creator. Sh*t happens. How do you design a process to help prevent it from happening and how do you deal with problems with integrity when they do? High Availability Principle : Request Queueing by Ashish Soni. Queue request to ride out traffic spikes: 1) Request Queuing allows your system to operate at optimal throughput. 2) Your users only experience linear degradation versus exponential degradation. 3) Your system experiences NO degradation. pfffft twatter tweeter by Knowbuddy. The reason you should care [about NoSQL] is because now you have more options--you're not stuck trying to wedge your system into
2 0.17082343 855 high scalability-2010-07-11-So, Why is Twitter Really Not Using Cassandra to Store Tweets?
Introduction: A firestorm of accusations circled around recently saying that Cassandra, the elected-by-major-adopters emperor of the NoSQL movement, has no clothes. It was said Twitter was dumping Cassandra; Reddit outages were linked to Cassandra; and even Facebook, Cassandra's cradle of birth, was said to have abandoned Cassandra. Shouts of NoSQL Fail! were heard in the streets. Much gloating followed. Is the emperor really naked? Casually dressed maybe, but not naked. (Note: after this point the article contains a flow chart that is NSFW. Some people are very sensitive about cussing, so if that's you, please go back, don't read on. Danger! There are no nude pictures or anything, just some strong language. But this is my most favorite flow chart of all time, so it's worth it :-) Is Twitter really abandoning Cassandra? Not according to Twitter, which came out with a post, Cassandra at Twitter Today , explaining that they are using Cassandra in production for geolocation and analytics. T
3 0.16666386 837 high scalability-2010-06-07-Six Ways Twitter May Reach its Big Hairy Audacious Goal of One Billion Users
Introduction: Twitter has a big hairy audacious goal of reaching one billion users by 2013. Three forces stand against Twitter. The world will end in 2012 . But let's be optimistic and assume we'll make it. Next is Facebook. Currently Facebook is the user leader with over 400 million users . Will Facebook stumble or will they rocket to one billion users before Twitter? And lastly, there's Twitter's "low" starting point and "slow" growth rate. Twitter currently has 106 million registered users and adds about 300,000 new users a day. That doesn't add up to a billion in three years. Twitter needs to triple the number of registered users they add per day. How will Twitter reach its goal of over one billion users served? From recent infrastructure announcements and information gleaned at Chirp ( videos ) and other talks, it has become a little clearer how they hope to reach their billion user goal: 1) Make a Big Hairy Audacious Goal 2) Hire Lots of Quality People 3) Hug Developers and Users 4) D
4 0.16273254 639 high scalability-2009-06-27-Scaling Twitter: Making Twitter 10000 Percent Faster
Introduction: Update 6: Some interesting changes from Twitter's Evan Weaver : everything in RAM now, database is a backup; peaks at 300 tweets/second; every tweet followed by average 126 people; vector cache of tweet IDs; row cache; fragment cache; page cache; keep separate caches; GC makes Ruby optimization resistant so went with Scala; Thrift and HTTP are used internally; 100s internal requests for every external request; rewrote MQ but kept interface the same; 3 queues are used to load balance requests; extensive A/B testing for backwards capability; switched to C memcached client for speed; optimize critical path; faster to get the cached results from the network memory than recompute them locally. Update 5: Twitter on Scala . A Conversation with Steve Jenson, Alex Payne, and Robey Pointer by Bill Venners. A fascinating discussion of why Twitter moved to the Java JVM for their server infrastructure (long lived processes) and why they moved to Scala to program against it (high level langu
5 0.12823221 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
Introduction: Update: Jake in Does Django really scale better than Rails? thinks apps like FFS shouldn't need so much hardware to scale. In a short three months Friends for Sale (think Hot-or-Not with a market economy) grew to become a top 10 Facebook application handling 200 gorgeous requests per second and a stunning 300 million page views a month. They did all this using Ruby on Rails, two part time developers, a cluster of a dozen machines, and a fairly standard architecture. How did Friends for Sale scale to sell all those beautiful people? And how much do you think your friends are worth on the open market? Site: http://www.facebook.com/apps/application.php?id=7019261521 Information Sources Siqi Chen and Alexander Le, co-creators of Friends for Sale, answering my standard questionairre. Virality on Facebook The Platform Ruby on Rails CentOS 5 (64 bit) Capistrano - update and restart application servers. Memcached MySQL Nginx Starling - distrib
6 0.1196776 1123 high scalability-2011-09-23-The Real News is Not that Facebook Serves Up 1 Trillion Pages a Month…
7 0.11785206 1321 high scalability-2012-09-12-Using Varnish for Paywalls: Moving Logic to the Edge
8 0.11340613 954 high scalability-2010-12-06-What the heck are you actually using NoSQL for?
9 0.11105353 96 high scalability-2007-09-18-Amazon Architecture
10 0.11061103 750 high scalability-2009-12-16-Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud
12 0.10811391 1424 high scalability-2013-03-15-Stuff The Internet Says On Scalability For March 15, 2013
13 0.10596028 1626 high scalability-2014-04-04-Stuff The Internet Says On Scalability For April 4th, 2014
14 0.10430343 996 high scalability-2011-02-28-A Practical Guide to Varnish - Why Varnish Matters
15 0.10353178 356 high scalability-2008-07-22-Scaling Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App
16 0.10329498 1110 high scalability-2011-09-06-Big Data Application Platform
18 0.10148226 721 high scalability-2009-10-13-Why are Facebook, Digg, and Twitter so hard to scale?
19 0.10146205 943 high scalability-2010-11-16-Facebook's New Real-time Messaging System: HBase to Store 135+ Billion Messages a Month
20 0.10100056 835 high scalability-2010-06-03-Hot Scalability Links for June 3, 2010
topicId topicWeight
[(0, 0.212), (1, 0.069), (2, 0.011), (3, 0.02), (4, 0.042), (5, -0.059), (6, -0.086), (7, 0.011), (8, 0.041), (9, 0.02), (10, 0.029), (11, 0.035), (12, 0.031), (13, 0.003), (14, -0.102), (15, -0.019), (16, 0.05), (17, -0.028), (18, -0.012), (19, 0.004), (20, 0.016), (21, 0.039), (22, 0.05), (23, -0.026), (24, 0.062), (25, -0.037), (26, 0.01), (27, 0.018), (28, 0.001), (29, 0.008), (30, -0.014), (31, -0.055), (32, -0.055), (33, 0.024), (34, -0.038), (35, 0.025), (36, -0.049), (37, 0.004), (38, -0.075), (39, 0.01), (40, 0.003), (41, -0.031), (42, -0.004), (43, 0.008), (44, -0.039), (45, -0.011), (46, 0.015), (47, 0.001), (48, 0.035), (49, 0.03)]
simIndex simValue blogId blogTitle
same-blog 1 0.96237159 783 high scalability-2010-02-24-Hot Scalability Links for February 24, 2010
Introduction: Cassandra @ Twitter: An Interview with Ryan King . Great interview by Alex Popescu on Twitter's thought process for switching to Cassandra. Twitter chose Cassandra because it had more big system features out of the box. Is that Cassandra FTW? I Had Downtime Today. Here’s What I’m Doing About It by Patrick McKenzie. Awesome deep dive into went wrong with Bingo Card Creator. Sh*t happens. How do you design a process to help prevent it from happening and how do you deal with problems with integrity when they do? High Availability Principle : Request Queueing by Ashish Soni. Queue request to ride out traffic spikes: 1) Request Queuing allows your system to operate at optimal throughput. 2) Your users only experience linear degradation versus exponential degradation. 3) Your system experiences NO degradation. pfffft twatter tweeter by Knowbuddy. The reason you should care [about NoSQL] is because now you have more options--you're not stuck trying to wedge your system into
2 0.82577235 855 high scalability-2010-07-11-So, Why is Twitter Really Not Using Cassandra to Store Tweets?
Introduction: A firestorm of accusations circled around recently saying that Cassandra, the elected-by-major-adopters emperor of the NoSQL movement, has no clothes. It was said Twitter was dumping Cassandra; Reddit outages were linked to Cassandra; and even Facebook, Cassandra's cradle of birth, was said to have abandoned Cassandra. Shouts of NoSQL Fail! were heard in the streets. Much gloating followed. Is the emperor really naked? Casually dressed maybe, but not naked. (Note: after this point the article contains a flow chart that is NSFW. Some people are very sensitive about cussing, so if that's you, please go back, don't read on. Danger! There are no nude pictures or anything, just some strong language. But this is my most favorite flow chart of all time, so it's worth it :-) Is Twitter really abandoning Cassandra? Not according to Twitter, which came out with a post, Cassandra at Twitter Today , explaining that they are using Cassandra in production for geolocation and analytics. T
3 0.76954788 1223 high scalability-2012-04-06-Stuff The Internet Says On Scalability For April 6, 2012
Introduction: It's HighScalability Time: Exascale Supercomputer : how IBM plans to understand data from a universe of light; 905 Billion Objects and 650,000 Requests/Second : S3; 64-cores : PostgreSQL shows linear read scalability; Quotable quotes: pkaler : Programming is hard. Scaling is harder. @crucially : As far as I can tell, openstack is what happens when ops people write code. @DEVOPS_BORAT : Goal of sysadmin is replace itself with small shell script. Goal of devops is replace itself with small REST API. @fowlduck : ec2, where dynamic scalability means them running out of instances :( hcarvalhoalves : You know what is amazing? Is that as soon you hit bigger or more general problems, you always face the compromise of "trading X resource for accuracy". Which leads me to believe that software, so far, has only been deterministic by pure accident. Kyle Lemmons : Clearly Go is a superior weapon if the goal is to shoot everyone in the > foot at the same ti
4 0.75027561 1626 high scalability-2014-04-04-Stuff The Internet Says On Scalability For April 4th, 2014
Introduction: Hey, it's HighScalability time: The world ends not with a bang, but with 1 exaFLOP of bitcoin whimpers. Quotable Quotes: @EtienneRoy : Algorithm: you must encode and leverage your ignorance, not only your knowledge #hadoopsummit - enthralling Chris Brenny : A material is nothing without a process. While the constituent formulation imbues the final product with fundamental properties, the bridge between material and function has a dramatic effect on its perception and use. @gallifreya n: Using AWS c1, m1, m2? @adrianco says don't. c3, m3, r3 are now better and cheaper. #cloudconnect #ccevent @christianhern : Mobile banking in the UK: 1,800 transactions per MINUTE. A "seismic shift" that banks were unprepared for While we are waiting for that epic article deeply comparing Google's Cloud with AWS, we have Adrian Cockcroft's highly hopped slide comparing the two . Google: no enterprise customers, no reservation options, need m
5 0.74576646 873 high scalability-2010-08-06-Hot Scalability Links for Aug 6, 2010
Introduction: Twitter Sees Its 20 Billionth Tweet writes Marshall Kirkpatrick of ReadWriteWeb. Startups die for not having customers, so STOP thinking about how to scale . Alessandro Orsi says focusing on the architecture and scaling possibilities of your app for millions of users is just plain dumb...concentrate on marketing...concentrate on user experience . Alessandro is perfectly correct, but this isn't the year the 2000 when the default architecture that is easy is also not scalable and when sites were built from scratch one painful user at a time. Today neither is tue. In the era of social networks, where Facebook has 500 million users, successful applications can and often do spike to millions of users seemingly overnight. And you have to have some architecture. With today's tool-chains you don't have to choose easy and non-scalable. There are other options. Of course, it's all pointless without customers and that is what you need to worry about, but it's a false choice in this era to
6 0.74476743 639 high scalability-2009-06-27-Scaling Twitter: Making Twitter 10000 Percent Faster
7 0.74303025 1024 high scalability-2011-04-15-Stuff The Internet Says On Scalability For April 15, 2011
8 0.73991764 1368 high scalability-2012-12-07-Stuff The Internet Says On Scalability For December 7, 2012
9 0.73945791 1389 high scalability-2013-01-18-Stuff The Internet Says On Scalability For January 18, 2013
10 0.73647714 837 high scalability-2010-06-07-Six Ways Twitter May Reach its Big Hairy Audacious Goal of One Billion Users
11 0.72389972 860 high scalability-2010-07-17-Hot Scalability Links for July 17, 2010
12 0.71679378 1424 high scalability-2013-03-15-Stuff The Internet Says On Scalability For March 15, 2013
13 0.71661687 988 high scalability-2011-02-11-Stuff The Internet Says On Scalability For February 11, 2011
14 0.70650476 1274 high scalability-2012-06-29-Stuff The Internet Says On Scalability For June 29, 2012 - The Velocity Edition
15 0.70252484 1414 high scalability-2013-03-01-Stuff The Internet Says On Scalability For February 29, 2013
16 0.70205897 1122 high scalability-2011-09-23-Stuff The Internet Says On Scalability For September 23, 2011
17 0.70179397 356 high scalability-2008-07-22-Scaling Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App
18 0.70136964 1084 high scalability-2011-07-22-Stuff The Internet Says On Scalability For July 22, 2011
19 0.69941056 1344 high scalability-2012-10-19-Stuff The Internet Says On Scalability For October 19, 2012
20 0.69870895 1154 high scalability-2011-12-09-Stuff The Internet Says On Scalability For December 9, 2011
topicId topicWeight
[(1, 0.139), (2, 0.211), (30, 0.416), (61, 0.043), (79, 0.076), (94, 0.033)]
simIndex simValue blogId blogTitle
1 0.98363531 1016 high scalability-2011-04-04-Scaling Social Ecommerce Architecture Case study
Introduction: A recent study showed that over 92 percent of executives from leading retailers are focusing their marketing efforts on Facebook and subsequent applications. Furthermore, over 71 percent of users have confirmed they are more likely to make a purchase after “liking” a brand they find online. ( source ) Sears Architect Tomer Gabel provides an insightful overview on how they built a Social Ecommerce solution for Sears.com that can handle complex relationship quires in real time. Tomer goes through: the architectural considerations behind their solution why they chose memory over disk how they partitioned the data to gain scalability why they chose to execute code with the data using GigaSpaces Map/Reduce execution framework how they integrated with Facebook why they chose GigaSpaces over Coherence and Terracotta for in-memory caching and scale In this post I tried to summarize the main takeaway from the interview. You can also watch the full interview (highly reco
2 0.98098207 131 high scalability-2007-10-25-Should JSPs be avoided for high scalability?
Introduction: I just heard about some web sites where Velocity templates are used to render HTML instead of using JSPs and all the processing in performed in servlets. Can JSPs cause issue with scalability? Thanks, Unmesh
3 0.97009641 1459 high scalability-2013-05-16-Paper: Warp: Multi-Key Transactions for Key-Value Stores
Introduction: Looks like an interesting take on "a completely asynchronous, low-latency transaction management protocol, in line with the fully distributed NoSQL architecture." Warp: Multi-Key Transactions for Key-Value Stores  overview: Implementing ACID transactions has been a longstanding challenge for NoSQL systems. Because these systems are based on a sharded architecture, transactions necessarily require coordination across multiple servers. Past work in this space has relied either on heavyweight protocols such as Paxos or clock synchronization for this coordination. This paper presents a novel protocol for coordinating distributed transactions with ACID semantics on top of a sharded data store. Called linear transactions, this protocol achieves scalability by distributing the coordination task to only those servers that hold relevant data for each transaction. It achieves high performance by serializing only those transactions whose concurrent execution could potentially yield a vio
4 0.96572775 991 high scalability-2011-02-16-Paper: An Experimental Investigation of the Akamai Adaptive Video Streaming
Introduction: Video is hot on the Internet and people are really interested in knowing how to make it work. Dan Rayburn has a post pointing to a fascinating paper: An Experimental Investigation of the Akamai Adaptive Video Streaming , which talks in some detail about the protocols big players like YouTube, Skype and Akamai use to serve video over on an inherently video unfriendly medium like the Internet. For Akamai they found: Each video is encoded in five versions at different bit rates and stored in separate files. The client sends commands to the server with an average inter departure time of about 2 s, i.e. the control algorithm is executed on average each 2 seconds. Akamai uses only the video level to adapt the video source to the available bandwidth, whereas the frame rate of the video is kept constant. When a sudden drop in the available bandwidth occurs, short interruptions of the video playback can occur due to the a large actuation delay. For a sudden increase of the avai
5 0.9356969 16 high scalability-2007-07-16-Book: High Performance MySQL
Introduction: As users come to depend on MySQL, they find that they have to deal with issues of reliability, scalability, and performance--issues that are not well documented but are critical to a smoothly functioning site. This book is an insider's guide to these little understood topics. Author Jeremy Zawodny has managed large numbers of MySQL servers for mission-critical work at Yahoo!, maintained years of contacts with the MySQL AB team, and presents regularly at conferences. Jeremy and Derek have spent months experimenting, interviewing major users of MySQL, talking to MySQL AB, benchmarking, and writing some of their own tools in order to produce the information in this book. In High Performance MySQL you will learn about MySQL indexing and optimization in depth so you can make better use of these key features. You will learn practical replication, backup, and load-balancing strategies with information that goes beyond available tools to discuss their effects in real-life environments. And you
6 0.92549127 500 high scalability-2009-01-22-Heterogeneous vs. Homogeneous System Architectures
7 0.91393876 261 high scalability-2008-02-25-Make Your Site Run 10 Times Faster
8 0.90173602 308 high scalability-2008-04-22-Simple NFS failover solution with symbolic link?
9 0.88347417 14 high scalability-2007-07-15-Web Analytics: An Hour a Day
same-blog 10 0.88277829 783 high scalability-2010-02-24-Hot Scalability Links for February 24, 2010
11 0.87953633 182 high scalability-2007-12-12-Oracle Can Do Read-Write Splitting Too
12 0.8747223 263 high scalability-2008-02-27-Product: System Imager - Automate Deployment and Installs
13 0.86624008 831 high scalability-2010-05-26-End-To-End Performance Study of Cloud Services
14 0.86514145 336 high scalability-2008-05-31-Biggest Under Reported Story: Google's BigTable Costs 10 Times Less than Amazon's SimpleDB
15 0.81637621 1284 high scalability-2012-07-16-Cinchcast Architecture - Producing 1,500 Hours of Audio Every Day
16 0.81020629 334 high scalability-2008-05-29-Amazon Improves Diagonal Scaling Support with High-CPU Instances
17 0.78510487 917 high scalability-2010-10-08-4 Scalability Themes from Surgecon
18 0.77781749 291 high scalability-2008-03-29-20 New Rules for Faster Web Pages
20 0.75621521 699 high scalability-2009-09-10-How to handle so many socket connection