high_scalability high_scalability-2010 high_scalability-2010-837 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Twitter has a big hairy audacious goal of reaching one billion users by 2013. Three forces stand against Twitter. The world will end in 2012 . But let's be optimistic and assume we'll make it. Next is Facebook. Currently Facebook is the user leader with over 400 million users . Will Facebook stumble or will they rocket to one billion users before Twitter? And lastly, there's Twitter's "low" starting point and "slow" growth rate. Twitter currently has 106 million registered users and adds about 300,000 new users a day. That doesn't add up to a billion in three years. Twitter needs to triple the number of registered users they add per day. How will Twitter reach its goal of over one billion users served? From recent infrastructure announcements and information gleaned at Chirp ( videos ) and other talks, it has become a little clearer how they hope to reach their billion user goal: 1) Make a Big Hairy Audacious Goal 2) Hire Lots of Quality People 3) Hug Developers and Users 4) D
sentIndex sentText sentNum sentScore
1 Twitter has a big hairy audacious goal of reaching one billion users by 2013. [sent-1, score-0.878]
2 Will Facebook stumble or will they rocket to one billion users before Twitter? [sent-7, score-0.319]
3 Twitter currently has 106 million registered users and adds about 300,000 new users a day. [sent-9, score-0.324]
4 How will Twitter reach its goal of over one billion users served? [sent-12, score-0.637]
5 Make a Big Hairy Audacious Goal Twitter wants to be the first application to reach a billion users. [sent-14, score-0.331]
6 Twitter acts as if they love developers and users and they are banking on that love being reciprocated. [sent-44, score-0.285]
7 Developers need to make money, so showing some concern over how developers put food on the table is a nice touch. [sent-48, score-0.231]
8 Twitter has an actual goal of making developers happy. [sent-51, score-0.267]
9 They want to support, fulfill, and make sure developers have all the tools they need to make great products. [sent-55, score-0.283]
10 They think there's plenty of opportunity in the platform and they want you to think big and build big. [sent-57, score-0.222]
11 The hug style with users has been more A-frame than Bear. [sent-60, score-0.234]
12 Will this be enough to reach the one billion user payday? [sent-66, score-0.385]
13 Liszkiewicz in Cultivated Play: Farmville has an interesting explanation: people are playing Farmville because people are playing Farmville . [sent-82, score-0.264]
14 There's a sort of social self-reinforcing game being played where people make social moves and Twitter is the game board. [sent-101, score-0.41]
15 Will that be enough of a driver to reach a billion users? [sent-103, score-0.331]
16 Towards that goal Twitter follows a different strategy than most websites who want to drive traffic through their front page. [sent-106, score-0.293]
17 What I've been trying to do is identify the positive forces I see that could help Twitter reach a billion users. [sent-131, score-0.396]
18 What will it take to reach the goal of serving 1/6th the population of Earth? [sent-133, score-0.318]
19 A virtuous circle which could substantially jump that growth rate and might make it possible for Twitter to reach their audacious goal of being the first to one billion users. [sent-138, score-0.729]
20 Having said that, the smart money is still on Facebook to reach a billion users first. [sent-144, score-0.493]
wordName wordTfidf (topN-words)
[('twitter', 0.642), ('audacious', 0.198), ('hairy', 0.174), ('reach', 0.174), ('users', 0.162), ('billion', 0.157), ('goal', 0.144), ('farmville', 0.132), ('developers', 0.123), ('chirp', 0.092), ('thepulse', 0.092), ('people', 0.09), ('percent', 0.085), ('bhag', 0.083), ('facebook', 0.078), ('hug', 0.072), ('joining', 0.069), ('forces', 0.065), ('gifts', 0.063), ('ecosystem', 0.061), ('game', 0.06), ('ui', 0.059), ('ride', 0.059), ('make', 0.056), ('bet', 0.054), ('user', 0.054), ('concern', 0.052), ('strategy', 0.051), ('noticed', 0.05), ('social', 0.05), ('drive', 0.05), ('want', 0.048), ('invest', 0.048), ('optimistic', 0.046), ('loop', 0.046), ('quality', 0.046), ('moves', 0.044), ('think', 0.044), ('big', 0.043), ('reliable', 0.043), ('everywhere', 0.043), ('plenty', 0.043), ('tweets', 0.043), ('seen', 0.042), ('playing', 0.042), ('announcements', 0.042), ('fluffy', 0.042), ('casino', 0.042), ('benefiting', 0.042), ('drunk', 0.042)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999958 837 high scalability-2010-06-07-Six Ways Twitter May Reach its Big Hairy Audacious Goal of One Billion Users
Introduction: Twitter has a big hairy audacious goal of reaching one billion users by 2013. Three forces stand against Twitter. The world will end in 2012 . But let's be optimistic and assume we'll make it. Next is Facebook. Currently Facebook is the user leader with over 400 million users . Will Facebook stumble or will they rocket to one billion users before Twitter? And lastly, there's Twitter's "low" starting point and "slow" growth rate. Twitter currently has 106 million registered users and adds about 300,000 new users a day. That doesn't add up to a billion in three years. Twitter needs to triple the number of registered users they add per day. How will Twitter reach its goal of over one billion users served? From recent infrastructure announcements and information gleaned at Chirp ( videos ) and other talks, it has become a little clearer how they hope to reach their billion user goal: 1) Make a Big Hairy Audacious Goal 2) Hire Lots of Quality People 3) Hug Developers and Users 4) D
2 0.34511995 639 high scalability-2009-06-27-Scaling Twitter: Making Twitter 10000 Percent Faster
Introduction: Update 6: Some interesting changes from Twitter's Evan Weaver : everything in RAM now, database is a backup; peaks at 300 tweets/second; every tweet followed by average 126 people; vector cache of tweet IDs; row cache; fragment cache; page cache; keep separate caches; GC makes Ruby optimization resistant so went with Scala; Thrift and HTTP are used internally; 100s internal requests for every external request; rewrote MQ but kept interface the same; 3 queues are used to load balance requests; extensive A/B testing for backwards capability; switched to C memcached client for speed; optimize critical path; faster to get the cached results from the network memory than recompute them locally. Update 5: Twitter on Scala . A Conversation with Steve Jenson, Alex Payne, and Robey Pointer by Bill Venners. A fascinating discussion of why Twitter moved to the Java JVM for their server infrastructure (long lived processes) and why they moved to Scala to program against it (high level langu
3 0.31906748 855 high scalability-2010-07-11-So, Why is Twitter Really Not Using Cassandra to Store Tweets?
Introduction: A firestorm of accusations circled around recently saying that Cassandra, the elected-by-major-adopters emperor of the NoSQL movement, has no clothes. It was said Twitter was dumping Cassandra; Reddit outages were linked to Cassandra; and even Facebook, Cassandra's cradle of birth, was said to have abandoned Cassandra. Shouts of NoSQL Fail! were heard in the streets. Much gloating followed. Is the emperor really naked? Casually dressed maybe, but not naked. (Note: after this point the article contains a flow chart that is NSFW. Some people are very sensitive about cussing, so if that's you, please go back, don't read on. Danger! There are no nude pictures or anything, just some strong language. But this is my most favorite flow chart of all time, so it's worth it :-) Is Twitter really abandoning Cassandra? Not according to Twitter, which came out with a post, Cassandra at Twitter Today , explaining that they are using Cassandra in production for geolocation and analytics. T
4 0.23684791 323 high scalability-2008-05-19-Twitter as a scalability case study
Introduction: A lot has been said already about Twitter's scalability issues. Many have given Twitter as an anti-pattern of how not to deal with scalability and have suggested different solutions for scaling it. As Twitter is famously a Ruby-on-Rails deployment, this case has also been used as a weapon in the language/platform wars between the RoR and Java camps, and to a lesser degree, also with the LAMP (PHP) camp
5 0.23316926 568 high scalability-2009-04-14-Designing a Scalable Twitter
Introduction: There were many talks recently about twitter scalability and their specific choice of language such as Scala to address their existing Ruby based scalability. In this post i tried to provide a more methodical approach for handling twitter scalability challenges that is centered around the right choice of architecture patterns rather then the language itself. The architecture pattern are given in a generic fashion that is not specific to twitter itself and can serve anyone who is looking to build a scalable real time web application in the near future.
6 0.22676013 544 high scalability-2009-03-18-QCon London 2009: Upgrading Twitter without service disruptions
7 0.22159991 780 high scalability-2010-02-19-Twitter’s Plan to Analyze 100 Billion Tweets
9 0.19838852 1491 high scalability-2013-07-15-Ask HS: What's Wrong with Twitter, Why Isn't One Machine Enough?
10 0.1913119 1159 high scalability-2011-12-19-How Twitter Stores 250 Million Tweets a Day Using MySQL
11 0.17972487 166 high scalability-2007-11-27-Solving the Client Side API Scalability Problem with a Little Game Theory
12 0.17617692 1251 high scalability-2012-05-24-Build your own twitter like real time analytics - a step by step guide
13 0.16873468 715 high scalability-2009-10-06-10 Ways to Take your Site from One to One Million Users by Kevin Rose
14 0.16666386 783 high scalability-2010-02-24-Hot Scalability Links for February 24, 2010
15 0.1657657 1356 high scalability-2012-11-07-Gone Fishin': 10 Ways to Take your Site from One to One Million Users by Kevin Rose
16 0.15775643 1626 high scalability-2014-04-04-Stuff The Internet Says On Scalability For April 4th, 2014
17 0.15756759 721 high scalability-2009-10-13-Why are Facebook, Digg, and Twitter so hard to scale?
18 0.1549677 1375 high scalability-2012-12-21-Stuff The Internet Says On Scalability For December 21, 2012
19 0.14795335 976 high scalability-2011-01-20-75% Chance of Scale - Leveraging the New Scaleogenic Environment for Growth
20 0.1477062 774 high scalability-2010-02-08-How FarmVille Scales to Harvest 75 Million Players a Month
topicId topicWeight
[(0, 0.218), (1, 0.079), (2, 0.025), (3, 0.015), (4, 0.107), (5, -0.118), (6, -0.171), (7, 0.132), (8, 0.082), (9, -0.001), (10, 0.06), (11, 0.152), (12, 0.056), (13, 0.044), (14, -0.041), (15, 0.035), (16, 0.043), (17, -0.043), (18, -0.048), (19, 0.02), (20, -0.028), (21, -0.033), (22, 0.061), (23, 0.012), (24, -0.004), (25, 0.007), (26, 0.008), (27, -0.074), (28, -0.01), (29, 0.031), (30, 0.077), (31, -0.158), (32, -0.163), (33, 0.001), (34, -0.204), (35, -0.022), (36, -0.0), (37, 0.084), (38, -0.18), (39, -0.044), (40, 0.1), (41, -0.015), (42, -0.046), (43, 0.014), (44, -0.048), (45, 0.021), (46, -0.009), (47, -0.04), (48, 0.045), (49, 0.086)]
simIndex simValue blogId blogTitle
same-blog 1 0.98823726 837 high scalability-2010-06-07-Six Ways Twitter May Reach its Big Hairy Audacious Goal of One Billion Users
Introduction: Twitter has a big hairy audacious goal of reaching one billion users by 2013. Three forces stand against Twitter. The world will end in 2012 . But let's be optimistic and assume we'll make it. Next is Facebook. Currently Facebook is the user leader with over 400 million users . Will Facebook stumble or will they rocket to one billion users before Twitter? And lastly, there's Twitter's "low" starting point and "slow" growth rate. Twitter currently has 106 million registered users and adds about 300,000 new users a day. That doesn't add up to a billion in three years. Twitter needs to triple the number of registered users they add per day. How will Twitter reach its goal of over one billion users served? From recent infrastructure announcements and information gleaned at Chirp ( videos ) and other talks, it has become a little clearer how they hope to reach their billion user goal: 1) Make a Big Hairy Audacious Goal 2) Hire Lots of Quality People 3) Hug Developers and Users 4) D
Introduction: Toy solutions solving Twitter’s “problems” are a favorite scalability trope. Everybody has this idea that Twitter is easy. With a little architectural hand waving we have a scalable Twitter, just that simple. Well, it’s not that simple as Raffi Krikorian , VP of Engineering at Twitter, describes in his superb and very detailed presentation on Timelines at Scale . If you want to know how Twitter works - then start here. It happened gradually so you may have missed it, but Twitter has grown up. It started as a struggling three-tierish Ruby on Rails website to become a beautifully service driven core that we actually go to now to see if other services are down. Quite a change. Twitter now has 150M world wide active users, handles 300K QPS to generate timelines, and a firehose that churns out 22 MB/sec. 400 million tweets a day flow through the system and it can take up to 5 minutes for a tweet to flow from Lady Gaga’s fingers to her 31 million followers. A couple o
3 0.84540391 855 high scalability-2010-07-11-So, Why is Twitter Really Not Using Cassandra to Store Tweets?
Introduction: A firestorm of accusations circled around recently saying that Cassandra, the elected-by-major-adopters emperor of the NoSQL movement, has no clothes. It was said Twitter was dumping Cassandra; Reddit outages were linked to Cassandra; and even Facebook, Cassandra's cradle of birth, was said to have abandoned Cassandra. Shouts of NoSQL Fail! were heard in the streets. Much gloating followed. Is the emperor really naked? Casually dressed maybe, but not naked. (Note: after this point the article contains a flow chart that is NSFW. Some people are very sensitive about cussing, so if that's you, please go back, don't read on. Danger! There are no nude pictures or anything, just some strong language. But this is my most favorite flow chart of all time, so it's worth it :-) Is Twitter really abandoning Cassandra? Not according to Twitter, which came out with a post, Cassandra at Twitter Today , explaining that they are using Cassandra in production for geolocation and analytics. T
4 0.8318606 1491 high scalability-2013-07-15-Ask HS: What's Wrong with Twitter, Why Isn't One Machine Enough?
Introduction: Can anyone convincingly explain why properties sporting traffic statistics that may seem in-line with with the capabilities of a single big-iron machine need so many machines in their architecture? This is a common reaction to architecture profiles on High Scalability: I could do all that on a few machines so they must be doing something really stupid. Lo and behold this same reaction also occurred to the article The Architecture Twitter Uses to Deal with 150M Active Users . On Hacker News papsosouid voiced what a lot of people may have been thinking: I really question the current trend of creating big, complex, fragile architectures to "be able to scale". These numbers are a great example of why, the entire thing could run on a single server, in a very straight forward setup. When you are creating a cluster for scalability, and it has less CPU, RAM and IO than a single server, what are you gaining? They are only doing 6k writes a second for crying out loud. This is a s
5 0.81362659 544 high scalability-2009-03-18-QCon London 2009: Upgrading Twitter without service disruptions
Introduction: Evan Weaver from Twitter presented a talk on Twitter software upgrades, titled Improving running components as part of the Systems that never stop track at QCon London 2009 conference last Friday. The talk focused on several upgrades performed since last May, while Twitter was experiencing serious performance problems.
6 0.7998355 323 high scalability-2008-05-19-Twitter as a scalability case study
7 0.77272481 639 high scalability-2009-06-27-Scaling Twitter: Making Twitter 10000 Percent Faster
8 0.75708747 574 high scalability-2009-04-20-Some things about Memcached from a Twitter software developer
9 0.75422001 556 high scalability-2009-04-05-At Some Point the Cost of Servers Outweighs the Cost of Programmers
10 0.75314349 568 high scalability-2009-04-14-Designing a Scalable Twitter
11 0.7447421 1004 high scalability-2011-03-14-Twitter by the Numbers - 460,000 New Accounts and 140 Million Tweets Per Day
12 0.74200767 1251 high scalability-2012-05-24-Build your own twitter like real time analytics - a step by step guide
13 0.72913325 363 high scalability-2008-08-12-Strategy: Limit The New, Not The Old
14 0.72289467 166 high scalability-2007-11-27-Solving the Client Side API Scalability Problem with a Little Game Theory
15 0.71588033 1159 high scalability-2011-12-19-How Twitter Stores 250 Million Tweets a Day Using MySQL
16 0.68900365 780 high scalability-2010-02-19-Twitter’s Plan to Analyze 100 Billion Tweets
17 0.678783 1515 high scalability-2013-09-11-Ten Lessons from GitHub’s First Year in 2008
18 0.67004275 116 high scalability-2007-10-08-Lessons from Pownce - The Early Years
19 0.66870147 1148 high scalability-2011-11-29-DataSift Architecture: Realtime Datamining at 120,000 Tweets Per Second
20 0.6448707 783 high scalability-2010-02-24-Hot Scalability Links for February 24, 2010
topicId topicWeight
[(1, 0.155), (2, 0.208), (10, 0.042), (22, 0.021), (26, 0.011), (30, 0.023), (37, 0.013), (40, 0.023), (43, 0.115), (47, 0.013), (61, 0.065), (79, 0.131), (85, 0.019), (94, 0.061)]
simIndex simValue blogId blogTitle
1 0.98069024 1182 high scalability-2012-01-27-Stuff The Internet Says On Scalability For January 27, 2012
Introduction: If you’ve got the time, we’ve got the HighScalability: 9nm : IBM's carbon nanotube transistor that outperforms silicon; YouTube : 4 Billion Views/Day; 864GB RAM : 37signals Memcache, $12K Quotable Quotes: Chad Dickerson : You can only get growth by feeding opportunities. @launchany : It amazes me how many NoSQL database vendors spend more time detailing their scalability and no time detailing the data model and design Google : Let's make TCP faster. WhatsApp : we are now able to easily push our systems to over 2 million tcp connections! Sidney Dekker : In a complex system…doing the same thing twice will not predictably or necessarily lead to the same results. @Rasmusfjord : Just heard about an Umbraco site running on Azure that handles 20.000 requests /*second* Herb Sutter with an epic post, Welcome to the Jungle , touching on a lot of themes we've explored on HighScalability, only in a dramatically more competent way. What's after
2 0.97509629 1336 high scalability-2012-10-09-Batoo JPA - The new JPA Implementation that runs over 15 times faster...
Introduction: This post is by Hasan Ceylan , an Open Source software enthusiast from Istanbul. I loved the JPA 1.0 back in early 2000s. I started using it together with EJB 3.0 even before the stable releases. I loved it so much that I contributed bits and parts for JBoss 3.x implementations. Those were the days our company was considerably still small in size. Creating new features and applications were more priority than the performance, because there were a lot of ideas that we have and we needed to develop and market those as fast as we can. Now, we no longer needed to write tedious and error prone xml descriptions for the data model and deployment descriptors. Nor we needed to use the curse called “XDoclet”. On the other side, our company grew steadily, our web site has become the top portal in the country for live events and ticketing. We now had the performance problems! Although the company grew considerably, due to the economics in the industry, we did not make a lot of money. The ch
3 0.96525192 470 high scalability-2008-12-18-Risk Analysis on the Cloud (Using Excel and GigaSpaces)
Introduction: Every day brings news of either more failures of the financial systems or out-right fraud, with the $50 billion Bernard Madoff Ponzi scheme being the latest, breaking all records. This post provide a technical overview of a solution that was implemented for one of the largest banks in China. The solution illustrate how one can use Excel as a front end client and at the same time leverage cloud computing model and mapreduce as well as other patterns to scale-out risk calculations. I'm hoping that this type of approach will reduce the chances for seeing this type of fraud from happening in the future.
4 0.96359581 1603 high scalability-2014-02-28-Stuff The Internet Says On Scalability For February 28th, 2014
Introduction: Hey, it's HighScalability time: Plus ça change, plus c'est la même chose ( full ) Quotable Quotes: @ML_Hipster : A machine learning researcher, a crypto-currency expert, and an Erlang programmer walk into a bar. Facebook buys the bar for $27 billion. OH: Network effects don't happen on toll roads. Benedict Evans : Google is a vast machine learning engine... and it spent 10-15 years building that learning engine and feeding it data. Mining Experiment: Running 600 Servers for a Year Yields 0.4 Bitcoin . Yes, this is a far superior way of doing things. Chew up the commons for marginal gain. It's like old times. Game designers, forget the sardines and go hunt some whale . Swrve found : half of free-to-play games’ in-app purchases came from 0.15 percent of players. Only 1.5 percent of players of games in the Swrve network spent any money at all. Google has a beta version of their cloud pricing calculator . The interface is a little fun
same-blog 5 0.95159519 837 high scalability-2010-06-07-Six Ways Twitter May Reach its Big Hairy Audacious Goal of One Billion Users
Introduction: Twitter has a big hairy audacious goal of reaching one billion users by 2013. Three forces stand against Twitter. The world will end in 2012 . But let's be optimistic and assume we'll make it. Next is Facebook. Currently Facebook is the user leader with over 400 million users . Will Facebook stumble or will they rocket to one billion users before Twitter? And lastly, there's Twitter's "low" starting point and "slow" growth rate. Twitter currently has 106 million registered users and adds about 300,000 new users a day. That doesn't add up to a billion in three years. Twitter needs to triple the number of registered users they add per day. How will Twitter reach its goal of over one billion users served? From recent infrastructure announcements and information gleaned at Chirp ( videos ) and other talks, it has become a little clearer how they hope to reach their billion user goal: 1) Make a Big Hairy Audacious Goal 2) Hire Lots of Quality People 3) Hug Developers and Users 4) D
6 0.94891131 1088 high scalability-2011-07-27-Making Hadoop 1000x Faster for Graph Problems
7 0.94499022 37 high scalability-2007-07-28-Product: Web Log Storming
8 0.9413783 937 high scalability-2010-11-09-Paper: Hyder - Scaling Out without Partitioning
9 0.94012529 798 high scalability-2010-03-22-7 Secrets to Successfully Scaling with Scalr (on Amazon) by Sebastian Stadil
10 0.93790716 893 high scalability-2010-09-03-Hot Scalability Links For Sep 3, 2010
11 0.93639052 1131 high scalability-2011-10-24-StackExchange Architecture Updates - Running Smoothly, Amazon 4x More Expensive
12 0.93392539 726 high scalability-2009-10-22-Paper: The Case for RAMClouds: Scalable High-Performance Storage Entirely in DRAM
13 0.93136519 1460 high scalability-2013-05-17-Stuff The Internet Says On Scalability For May 17, 2013
14 0.93003082 1245 high scalability-2012-05-14-DynamoDB Talk Notes and the SSD Hot S3 Cold Pattern
15 0.92823738 301 high scalability-2008-04-08-Google AppEngine - A First Look
16 0.92635304 517 high scalability-2009-02-21-Google AppEngine - A Second Look
17 0.92600381 1275 high scalability-2012-07-02-C is for Compute - Google Compute Engine (GCE)
18 0.9248175 327 high scalability-2008-05-27-How I Learned to Stop Worrying and Love Using a Lot of Disk Space to Scale
19 0.92472732 1385 high scalability-2013-01-11-Stuff The Internet Says On Scalability For January 11, 2013
20 0.92442864 1431 high scalability-2013-03-29-Stuff The Internet Says On Scalability For March 29, 2013