high_scalability high_scalability-2009 high_scalability-2009-544 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Evan Weaver from Twitter presented a talk on Twitter software upgrades, titled Improving running components as part of the Systems that never stop track at QCon London 2009 conference last Friday. The talk focused on several upgrades performed since last May, while Twitter was experiencing serious performance problems.
sentIndex sentText sentNum sentScore
1 Evan Weaver from Twitter presented a talk on Twitter software upgrades, titled Improving running components as part of the Systems that never stop track at QCon London 2009 conference last Friday. [sent-1, score-1.671]
2 The talk focused on several upgrades performed since last May, while Twitter was experiencing serious performance problems. [sent-2, score-1.764]
wordName wordTfidf (topN-words)
[('upgrades', 0.392), ('twitter', 0.326), ('weaver', 0.304), ('titled', 0.279), ('qcon', 0.262), ('evan', 0.254), ('experiencing', 0.224), ('last', 0.223), ('serious', 0.186), ('london', 0.185), ('talk', 0.183), ('presented', 0.178), ('improving', 0.17), ('performed', 0.164), ('focused', 0.161), ('stop', 0.144), ('track', 0.139), ('conference', 0.131), ('components', 0.108), ('several', 0.096), ('since', 0.095), ('never', 0.089), ('part', 0.074), ('problems', 0.066), ('running', 0.066), ('may', 0.058), ('software', 0.057), ('systems', 0.05), ('performance', 0.04)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 544 high scalability-2009-03-18-QCon London 2009: Upgrading Twitter without service disruptions
Introduction: Evan Weaver from Twitter presented a talk on Twitter software upgrades, titled Improving running components as part of the Systems that never stop track at QCon London 2009 conference last Friday. The talk focused on several upgrades performed since last May, while Twitter was experiencing serious performance problems.
2 0.24495485 574 high scalability-2009-04-20-Some things about Memcached from a Twitter software developer
Introduction: Memcached is generally treated as a black box. But what if you really need to know what's in there? Not for runtime purposes, but for optimization and capacity planning? Read more on Evan Weaver, a software developer working for Twitter (a contributor for Rails core and Mongrel).
3 0.23809415 537 high scalability-2009-03-12-QCon London 2009: Database projects to watch closely
Introduction: Geir Magnusson from 10gen presented a talk titled Cloud Data Persistence or ‘We’re in a database reneaissance - pay attention” today at QCon London 2009. The main message of his talk was that “physical limitations of today’s technology combined with the computational complexity of conventional relational databases are driving databases into new exciting spaces”, or to put it simpler the database landscape is changing and we should keep our eyes on that.
4 0.22676013 837 high scalability-2010-06-07-Six Ways Twitter May Reach its Big Hairy Audacious Goal of One Billion Users
Introduction: Twitter has a big hairy audacious goal of reaching one billion users by 2013. Three forces stand against Twitter. The world will end in 2012 . But let's be optimistic and assume we'll make it. Next is Facebook. Currently Facebook is the user leader with over 400 million users . Will Facebook stumble or will they rocket to one billion users before Twitter? And lastly, there's Twitter's "low" starting point and "slow" growth rate. Twitter currently has 106 million registered users and adds about 300,000 new users a day. That doesn't add up to a billion in three years. Twitter needs to triple the number of registered users they add per day. How will Twitter reach its goal of over one billion users served? From recent infrastructure announcements and information gleaned at Chirp ( videos ) and other talks, it has become a little clearer how they hope to reach their billion user goal: 1) Make a Big Hairy Audacious Goal 2) Hire Lots of Quality People 3) Hug Developers and Users 4) D
5 0.18051362 639 high scalability-2009-06-27-Scaling Twitter: Making Twitter 10000 Percent Faster
Introduction: Update 6: Some interesting changes from Twitter's Evan Weaver : everything in RAM now, database is a backup; peaks at 300 tweets/second; every tweet followed by average 126 people; vector cache of tweet IDs; row cache; fragment cache; page cache; keep separate caches; GC makes Ruby optimization resistant so went with Scala; Thrift and HTTP are used internally; 100s internal requests for every external request; rewrote MQ but kept interface the same; 3 queues are used to load balance requests; extensive A/B testing for backwards capability; switched to C memcached client for speed; optimize critical path; faster to get the cached results from the network memory than recompute them locally. Update 5: Twitter on Scala . A Conversation with Steve Jenson, Alex Payne, and Robey Pointer by Bill Venners. A fascinating discussion of why Twitter moved to the Java JVM for their server infrastructure (long lived processes) and why they moved to Scala to program against it (high level langu
6 0.14545676 154 high scalability-2007-11-15-Lessons from Yahoo, eBay, Orbitz, LinkedIn architecture
7 0.11686232 409 high scalability-2008-10-13-Challenges from large scale computing at Google
8 0.11637611 855 high scalability-2010-07-11-So, Why is Twitter Really Not Using Cassandra to Store Tweets?
9 0.11430851 323 high scalability-2008-05-19-Twitter as a scalability case study
10 0.11148383 568 high scalability-2009-04-14-Designing a Scalable Twitter
11 0.10046348 354 high scalability-2008-07-20-The clouds are coming
12 0.096179061 764 high scalability-2010-01-25-Designing applications for cloud deployment
13 0.086553402 1568 high scalability-2013-12-23-What Happens While Your Brain Sleeps is Surprisingly Like How Computers Stay Sane
14 0.086132064 1159 high scalability-2011-12-19-How Twitter Stores 250 Million Tweets a Day Using MySQL
15 0.081179708 780 high scalability-2010-02-19-Twitter’s Plan to Analyze 100 Billion Tweets
16 0.079882249 629 high scalability-2009-06-14-CLOUD & GRID EVENT BY THE ONLINE GAMING HIGH SCALABILITY SIG
18 0.070577085 851 high scalability-2010-07-02-Hot Scalability Links for July 2, 2010
19 0.07015425 166 high scalability-2007-11-27-Solving the Client Side API Scalability Problem with a Little Game Theory
20 0.070069954 1491 high scalability-2013-07-15-Ask HS: What's Wrong with Twitter, Why Isn't One Machine Enough?
topicId topicWeight
[(0, 0.075), (1, 0.015), (2, -0.011), (3, 0.029), (4, 0.035), (5, -0.028), (6, -0.073), (7, 0.034), (8, -0.002), (9, 0.003), (10, 0.006), (11, 0.049), (12, 0.071), (13, -0.014), (14, -0.02), (15, 0.021), (16, 0.044), (17, -0.056), (18, -0.014), (19, 0.007), (20, -0.028), (21, -0.027), (22, -0.013), (23, -0.006), (24, -0.023), (25, 0.02), (26, -0.015), (27, -0.03), (28, -0.043), (29, 0.1), (30, 0.062), (31, -0.09), (32, -0.087), (33, 0.026), (34, -0.155), (35, -0.007), (36, -0.003), (37, 0.062), (38, -0.084), (39, -0.038), (40, 0.081), (41, -0.03), (42, -0.017), (43, 0.022), (44, -0.055), (45, -0.064), (46, -0.052), (47, 0.036), (48, 0.069), (49, 0.14)]
simIndex simValue blogId blogTitle
same-blog 1 0.98923385 544 high scalability-2009-03-18-QCon London 2009: Upgrading Twitter without service disruptions
Introduction: Evan Weaver from Twitter presented a talk on Twitter software upgrades, titled Improving running components as part of the Systems that never stop track at QCon London 2009 conference last Friday. The talk focused on several upgrades performed since last May, while Twitter was experiencing serious performance problems.
2 0.75687313 568 high scalability-2009-04-14-Designing a Scalable Twitter
Introduction: There were many talks recently about twitter scalability and their specific choice of language such as Scala to address their existing Ruby based scalability. In this post i tried to provide a more methodical approach for handling twitter scalability challenges that is centered around the right choice of architecture patterns rather then the language itself. The architecture pattern are given in a generic fashion that is not specific to twitter itself and can serve anyone who is looking to build a scalable real time web application in the near future.
3 0.75438929 323 high scalability-2008-05-19-Twitter as a scalability case study
Introduction: A lot has been said already about Twitter's scalability issues. Many have given Twitter as an anti-pattern of how not to deal with scalability and have suggested different solutions for scaling it. As Twitter is famously a Ruby-on-Rails deployment, this case has also been used as a weapon in the language/platform wars between the RoR and Java camps, and to a lesser degree, also with the LAMP (PHP) camp
4 0.74249744 837 high scalability-2010-06-07-Six Ways Twitter May Reach its Big Hairy Audacious Goal of One Billion Users
Introduction: Twitter has a big hairy audacious goal of reaching one billion users by 2013. Three forces stand against Twitter. The world will end in 2012 . But let's be optimistic and assume we'll make it. Next is Facebook. Currently Facebook is the user leader with over 400 million users . Will Facebook stumble or will they rocket to one billion users before Twitter? And lastly, there's Twitter's "low" starting point and "slow" growth rate. Twitter currently has 106 million registered users and adds about 300,000 new users a day. That doesn't add up to a billion in three years. Twitter needs to triple the number of registered users they add per day. How will Twitter reach its goal of over one billion users served? From recent infrastructure announcements and information gleaned at Chirp ( videos ) and other talks, it has become a little clearer how they hope to reach their billion user goal: 1) Make a Big Hairy Audacious Goal 2) Hire Lots of Quality People 3) Hug Developers and Users 4) D
5 0.69403416 574 high scalability-2009-04-20-Some things about Memcached from a Twitter software developer
Introduction: Memcached is generally treated as a black box. But what if you really need to know what's in there? Not for runtime purposes, but for optimization and capacity planning? Read more on Evan Weaver, a software developer working for Twitter (a contributor for Rails core and Mongrel).
6 0.67560422 1491 high scalability-2013-07-15-Ask HS: What's Wrong with Twitter, Why Isn't One Machine Enough?
8 0.61551708 1004 high scalability-2011-03-14-Twitter by the Numbers - 460,000 New Accounts and 140 Million Tweets Per Day
9 0.61220521 639 high scalability-2009-06-27-Scaling Twitter: Making Twitter 10000 Percent Faster
10 0.61140013 556 high scalability-2009-04-05-At Some Point the Cost of Servers Outweighs the Cost of Programmers
11 0.58615041 1159 high scalability-2011-12-19-How Twitter Stores 250 Million Tweets a Day Using MySQL
12 0.58529264 855 high scalability-2010-07-11-So, Why is Twitter Really Not Using Cassandra to Store Tweets?
13 0.5335291 1251 high scalability-2012-05-24-Build your own twitter like real time analytics - a step by step guide
14 0.53231835 780 high scalability-2010-02-19-Twitter’s Plan to Analyze 100 Billion Tweets
15 0.49848861 499 high scalability-2009-01-22-Coming soon: better JRockit+Coherence integration
16 0.4857617 363 high scalability-2008-08-12-Strategy: Limit The New, Not The Old
17 0.48002544 1515 high scalability-2013-09-11-Ten Lessons from GitHub’s First Year in 2008
18 0.46484351 1551 high scalability-2013-11-20-How Twitter Improved JVM Performance by Reducing GC and Faster Memory Allocation
19 0.46362638 1148 high scalability-2011-11-29-DataSift Architecture: Realtime Datamining at 120,000 Tweets Per Second
20 0.45229781 970 high scalability-2011-01-06-BankSimple Mini-Architecture - Using a Next Generation Toolchain
topicId topicWeight
[(1, 0.245), (2, 0.148), (27, 0.282), (79, 0.156)]
simIndex simValue blogId blogTitle
1 0.92322648 555 high scalability-2009-04-04-Performance Anti-Pattern
Introduction: Want your apps to run faster? Here’s what not to do. By: Bart Smaalders, Sun Microsystems. Performance Anti-Patterns: - Fixing Performance at the End of the Project - Measuring and Comparing the Wrong Things - Algorithmic Antipathy - Reusing Software - Iterating Because That’s What Computers Do Well - Premature Optimization - Focusing on What You Can See Rather Than on the Problem - Software Layering - Excessive Numbers of Threads - Asymmetric Hardware Utilization - Not Optimizing for the Common Case - Needless Swapping of Cache Lines Between CPUs For more detail go there
2 0.85694164 250 high scalability-2008-02-17-Web Accelerators - snake oil or miracle remedy?
Introduction: Perhaps this question is borderline off-topic but since high scalability solutions often have a global aspect I will give it a try... Have anybody had any experience with different techniques for speeding up their application to places that have a problem with poor ping response time? Ideally I would love to be running only one data center world-wide but one day I know that our sales department will sign up a customer with an unacceptable response time... Could installing a web-accelerator in front of our application extend the reach of our current data center or will we just add complexity and another source of potential errors?
same-blog 3 0.83252054 544 high scalability-2009-03-18-QCon London 2009: Upgrading Twitter without service disruptions
Introduction: Evan Weaver from Twitter presented a talk on Twitter software upgrades, titled Improving running components as part of the Systems that never stop track at QCon London 2009 conference last Friday. The talk focused on several upgrades performed since last May, while Twitter was experiencing serious performance problems.
4 0.80627441 835 high scalability-2010-06-03-Hot Scalability Links for June 3, 2010
Introduction: How Big is a Yottabyte? Not so big that the NSA can't hope to store it says CrunchGear : There are a thousand gigabytes in a terabyte, a thousand terabytes in a petabyte, a thousand petabytes in an exabyte, a thousand exabytes in a zettabyte, and a thousand zettabytes in a yottabyte. In other words, a yottabyte is 1,000,000,000,000,000GB . The CMS data aggregation system . The Large Hadron Collider project is using MongoDB as a cache . Here we discuss a new data aggregation system which consumes, indexes and delivers information from different relational and non-relational data sources to answer cross data-service queries and explore meta-data associated with petabytes of experimental data. Google I/O 2010 Videos are up available (many of them anyway). You might be particularly interested in Google Storage for Developers , Building high-throughput data pipelines with Google App Engine , Batch data processing with App Engine , BigQuery and Prediction APIs , and Measure
5 0.79928696 705 high scalability-2009-09-16-Paper: A practical scalable distributed B-tree
Introduction: We've seen a lot of NoSQL action lately built around distributed hash tables. Btrees are getting jealous. Btrees, once the king of the database world, want their throne back. Paul Buchheit surfaced a paper: A practical scalable distributed B-tree by Marcos K. Aguilera and Wojciech Golab, that might help spark a revolution. From the Abstract: We propose a new algorithm for a practical, fault tolerant, and scalable B-tree distributed over a set of servers. Our algorithm supports practical features not present in prior work: transactions that allow atomic execution of multiple operations over multiple B-trees, online migration of B-tree nodes between servers, and dynamic addition and removal of servers. Moreover, our algorithm is conceptually simple: we use transactions to manipulate B-tree nodes so that clients need not use complicated concurrency and locking protocols used in prior work. To execute these transactions quickly, we rely on three techniques: (1) We use optimistic
7 0.78182662 883 high scalability-2010-08-20-Hot Scalability Links For Aug 20, 2010
8 0.77384126 1141 high scalability-2011-11-11-Stuff The Internet Says On Scalability For November 11, 2011
9 0.77232158 900 high scalability-2010-09-11-Google's Colossus Makes Search Real-time by Dumping MapReduce
10 0.75731087 560 high scalability-2009-04-08-Learned lessons from the largest player (Flickr, YouTube, Google, etc)
11 0.74261558 28 high scalability-2007-07-25-Product: NetApp MetroCluster Software
12 0.73879111 1097 high scalability-2011-08-12-Stuff The Internet Says On Scalability For August 12, 2011
13 0.73542809 769 high scalability-2010-02-02-Scale out your identity management
14 0.73268485 865 high scalability-2010-07-27-A Metric A$$-Ton of Joe Stump: The Cloud is Cheaper than Bare Metal
15 0.73224658 596 high scalability-2009-05-11-Facebook, Hadoop, and Hive
16 0.7289322 10 high scalability-2007-07-15-Book: Building Scalable Web Sites
17 0.72772783 1056 high scalability-2011-06-09-Retrospect on recent AWS outage and Resilient Cloud-Based Architecture
18 0.72751391 444 high scalability-2008-11-14-Private-Public Cloud
19 0.72623074 1483 high scalability-2013-06-27-Paper: XORing Elephants: Novel Erasure Codes for Big Data
20 0.7259593 245 high scalability-2008-02-12-Product: rPath - Creating and Managing Virtual Appliances