high_scalability high_scalability-2010 high_scalability-2010-811 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Twitter gets a total of 3 billion requests a day via its API ; 105,779,710 registered users; 300,000 new registered users a day; 180 million unique visitors a month; 55 million tweets a day. Who has the most servers? Google 1 million+; Intel 100K; 1&1 Internet 70K; Facebook 30K; Akamai 61K; Rackspace 56k+. Cloud Computing Economies of Scale . James Hamilton gives a fabulous talk breaking down where the costs are in the cloud. It's not where you may think. Higher utilization is the key. More here . Erlang Factory: Andy Gross: Distributed Erlang Systems In Operation: Patterns and Pitfalls by Martin J. Logan. Great overview of architecting distributed systems in Erlang. Covers what you want and don't want in a distributed system and how to compromise those elements, what's common, system design, cluster membership, load balancing, upgrades, debugging, and more. Extreme Scale Computing by Irving Wladawsky-Berger . “An exascale supercomputer capable of a million tr
sentIndex sentText sentNum sentScore
1 Twitter gets a total of 3 billion requests a day via its API ; 105,779,710 registered users; 300,000 new registered users a day; 180 million unique visitors a month; 55 million tweets a day. [sent-1, score-0.39]
2 James Hamilton gives a fabulous talk breaking down where the costs are in the cloud. [sent-5, score-0.075]
3 We show that an efficient MMT design can give significant performance improvement by extracting parallelism. [sent-16, score-0.077]
4 A transparently scalable distributed programming language allowing the creation of web applications which can scale transparently through a novel portable continuation-based approach. [sent-21, score-0.343]
5 Swarm embodies the maxim "move the computation, not the data". [sent-22, score-0.174]
6 Gear6 makes memcached infrastructure lower cost on cloud . [sent-30, score-0.083]
7 Infinite web scalability & resilience with Amazon Web Services . [sent-36, score-0.225]
8 Wille Faler provides a simple overview of how to serve semi-dynamic web content with almost infinite horizontal scalability and resilience using Amazon Web Services, with the added boon of making server restores a non-issue . [sent-37, score-0.477]
9 Gear6 decided to use the key-value store Redis because it already had traction among NoSQL users . [sent-43, score-0.079]
10 Amazon Simple Notification Service (Amazon SNS ) is a web service that makes it easy to set up, operate, and send notifications from the cloud. [sent-45, score-0.107]
11 Whether it's social games, social news, social discovery, social search, or other forms of social solutions , developers today are facing new hurdles in building instantly scalable products. [sent-54, score-1.386]
12 The first Social Developer Summit will bring together social application developers to discuss the challenges, solutions, and best practices for building applications in the rapidly expanding social web economy . [sent-55, score-0.629]
13 At the Social Developer Summit, industry experts will share tips and case studies for building high performance social web products. [sent-56, score-0.368]
14 Big Data Workshop - A one-day unconference on Friday, April 23 in Mountain View, CA with a deliberately broad scope including NoSQL, MapReduce, and anything related. [sent-57, score-0.165]
wordName wordTfidf (topN-words)
[('social', 0.261), ('mmt', 0.214), ('adds', 0.131), ('transparently', 0.118), ('resilience', 0.118), ('notification', 0.117), ('summit', 0.115), ('registered', 0.111), ('web', 0.107), ('nosql', 0.105), ('april', 0.103), ('rackspace', 0.099), ('hadoop', 0.097), ('architecutre', 0.097), ('autos', 0.097), ('gigaspace', 0.097), ('faler', 0.097), ('wille', 0.097), ('managementby', 0.097), ('storeby', 0.097), ('asimple', 0.097), ('dusbabek', 0.097), ('edified', 0.097), ('sns', 0.097), ('toleranceby', 0.097), ('triples', 0.097), ('kirk', 0.091), ('todiscuss', 0.091), ('patented', 0.091), ('developer', 0.088), ('restores', 0.087), ('embodies', 0.087), ('maxim', 0.087), ('boon', 0.087), ('gary', 0.087), ('million', 0.084), ('unconference', 0.084), ('memcached', 0.083), ('shard', 0.083), ('hurdles', 0.081), ('kurt', 0.081), ('deliberately', 0.081), ('san', 0.08), ('traction', 0.079), ('overview', 0.078), ('brewer', 0.077), ('extracting', 0.077), ('exascale', 0.077), ('materials', 0.075), ('fabulous', 0.075)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999976 811 high scalability-2010-04-16-Hot Scalability Links for April 16, 2010
Introduction: Twitter gets a total of 3 billion requests a day via its API ; 105,779,710 registered users; 300,000 new registered users a day; 180 million unique visitors a month; 55 million tweets a day. Who has the most servers? Google 1 million+; Intel 100K; 1&1 Internet 70K; Facebook 30K; Akamai 61K; Rackspace 56k+. Cloud Computing Economies of Scale . James Hamilton gives a fabulous talk breaking down where the costs are in the cloud. It's not where you may think. Higher utilization is the key. More here . Erlang Factory: Andy Gross: Distributed Erlang Systems In Operation: Patterns and Pitfalls by Martin J. Logan. Great overview of architecting distributed systems in Erlang. Covers what you want and don't want in a distributed system and how to compromise those elements, what's common, system design, cluster membership, load balancing, upgrades, debugging, and more. Extreme Scale Computing by Irving Wladawsky-Berger . “An exascale supercomputer capable of a million tr
2 0.34588736 804 high scalability-2010-04-06-Sponsored Post: Event - Social Developer Summit
Introduction: Social Developer Summit - June 29, 2010 - San Franciso, CA A meeting of the technically social - Building, scaling, and profiting in a social age Whether it's social games, social news, social discovery, social search, or other forms of social solutions , developers today are facing new hurdles in building instantly scalable products. As new technologies emerge to address the challenges faced by social application developers, it's increasingly important to come together for knowledge sharing purposes. The first Social Developer Summit will bring together social application developers to discuss the challenges, solutions, and best practices for building applications in the rapidly expanding social web economy . At the Social Developer Summit, industry experts will share tips and case studies for building high performance social web products. For more information please take a look at Social Developer Summit . If you are interested in a sponsored pos
3 0.34588736 814 high scalability-2010-04-20-Sponsored Post: Event - Social Developer Summit
Introduction: Social Developer Summit - June 29, 2010 - San Franciso, CA A meeting of the technically social - Building, scaling, and profiting in a social age Whether it's social games, social news, social discovery, social search, or other forms of social solutions , developers today are facing new hurdles in building instantly scalable products. As new technologies emerge to address the challenges faced by social application developers, it's increasingly important to come together for knowledge sharing purposes. The first Social Developer Summit will bring together social application developers to discuss the challenges, solutions, and best practices for building applications in the rapidly expanding social web economy . At the Social Developer Summit, industry experts will share tips and case studies for building high performance social web products. For more information please take a look at Social Developer Summit . If you are interested in a sponsored pos
4 0.2066372 802 high scalability-2010-04-01-Hot Scalability Links for April 1, 2010
Introduction: Why NoSQL Will Not Die . Stephan Schmidt explains why you may wait a long time for NoSQL to go to that great bit bucket in the sky. DBMS Musings: Distinguishing Two Major Types of Column-Stores by Daniel Abadi. I have noticed that Bigtable, HBase, Hypertable, and Cassandra are being called column-stores with increasing frequency, due to their ability to store and access column families separately. This makes them appear to be in the same category as column-stores such as Sybase IQ, C-Store, Vertica, VectorWise, MonetDB, ParAccel, and Infobright, which also are able to access columns separately. Cloud Economics, By The Square Foot by Rich Miller. But cloud computing offers a middle path, offering cost and usability advantages for customers, as well as an attractive return for providers. PostgreSQL: meet your queue by Theo Schlossnagle . I really think that cueing your database to publish over AMQP is the bees knees and it turns out I wasn't alone! Scali
5 0.15684418 954 high scalability-2010-12-06-What the heck are you actually using NoSQL for?
Introduction: It's a truism that we should choose the right tool for the job . Everyone says that. And who can disagree? The problem is this is not helpful advice without being able to answer more specific questions like: What jobs are the tools good at? Will they work on jobs like mine? Is it worth the risk to try something new when all my people know something else and we have a deadline to meet? How can I make all the tools work together? In the NoSQL space this kind of real-world data is still a bit vague. When asked, vendors tend to give very general answers like NoSQL is good for BigData or key-value access. What does that mean for for the developer in the trenches faced with the task of solving a specific problem and there are a dozen confusing choices and no obvious winner? Not a lot. It's often hard to take that next step and imagine how their specific problems could be solved in a way that's worth taking the trouble and risk. Let's change that. What problems are you using NoSQL to sol
7 0.13920373 96 high scalability-2007-09-18-Amazon Architecture
8 0.13868247 183 high scalability-2007-12-12-Report from OpenSocial Meetup at Google
13 0.12900029 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
topicId topicWeight
[(0, 0.261), (1, 0.049), (2, 0.091), (3, 0.025), (4, 0.108), (5, 0.007), (6, -0.091), (7, -0.041), (8, 0.061), (9, 0.074), (10, 0.068), (11, 0.0), (12, 0.023), (13, -0.03), (14, -0.094), (15, 0.026), (16, -0.002), (17, 0.014), (18, 0.104), (19, 0.051), (20, 0.003), (21, 0.03), (22, 0.072), (23, 0.038), (24, 0.018), (25, -0.026), (26, -0.019), (27, -0.054), (28, -0.053), (29, -0.017), (30, 0.146), (31, -0.069), (32, 0.053), (33, 0.019), (34, 0.079), (35, -0.126), (36, -0.082), (37, 0.094), (38, 0.037), (39, 0.055), (40, 0.059), (41, -0.002), (42, -0.059), (43, -0.001), (44, -0.015), (45, 0.029), (46, -0.043), (47, 0.065), (48, 0.078), (49, -0.022)]
simIndex simValue blogId blogTitle
same-blog 1 0.96576643 811 high scalability-2010-04-16-Hot Scalability Links for April 16, 2010
Introduction: Twitter gets a total of 3 billion requests a day via its API ; 105,779,710 registered users; 300,000 new registered users a day; 180 million unique visitors a month; 55 million tweets a day. Who has the most servers? Google 1 million+; Intel 100K; 1&1 Internet 70K; Facebook 30K; Akamai 61K; Rackspace 56k+. Cloud Computing Economies of Scale . James Hamilton gives a fabulous talk breaking down where the costs are in the cloud. It's not where you may think. Higher utilization is the key. More here . Erlang Factory: Andy Gross: Distributed Erlang Systems In Operation: Patterns and Pitfalls by Martin J. Logan. Great overview of architecting distributed systems in Erlang. Covers what you want and don't want in a distributed system and how to compromise those elements, what's common, system design, cluster membership, load balancing, upgrades, debugging, and more. Extreme Scale Computing by Irving Wladawsky-Berger . “An exascale supercomputer capable of a million tr
2 0.8412534 804 high scalability-2010-04-06-Sponsored Post: Event - Social Developer Summit
Introduction: Social Developer Summit - June 29, 2010 - San Franciso, CA A meeting of the technically social - Building, scaling, and profiting in a social age Whether it's social games, social news, social discovery, social search, or other forms of social solutions , developers today are facing new hurdles in building instantly scalable products. As new technologies emerge to address the challenges faced by social application developers, it's increasingly important to come together for knowledge sharing purposes. The first Social Developer Summit will bring together social application developers to discuss the challenges, solutions, and best practices for building applications in the rapidly expanding social web economy . At the Social Developer Summit, industry experts will share tips and case studies for building high performance social web products. For more information please take a look at Social Developer Summit . If you are interested in a sponsored pos
3 0.8412534 814 high scalability-2010-04-20-Sponsored Post: Event - Social Developer Summit
Introduction: Social Developer Summit - June 29, 2010 - San Franciso, CA A meeting of the technically social - Building, scaling, and profiting in a social age Whether it's social games, social news, social discovery, social search, or other forms of social solutions , developers today are facing new hurdles in building instantly scalable products. As new technologies emerge to address the challenges faced by social application developers, it's increasingly important to come together for knowledge sharing purposes. The first Social Developer Summit will bring together social application developers to discuss the challenges, solutions, and best practices for building applications in the rapidly expanding social web economy . At the Social Developer Summit, industry experts will share tips and case studies for building high performance social web products. For more information please take a look at Social Developer Summit . If you are interested in a sponsored pos
4 0.81261814 802 high scalability-2010-04-01-Hot Scalability Links for April 1, 2010
Introduction: Why NoSQL Will Not Die . Stephan Schmidt explains why you may wait a long time for NoSQL to go to that great bit bucket in the sky. DBMS Musings: Distinguishing Two Major Types of Column-Stores by Daniel Abadi. I have noticed that Bigtable, HBase, Hypertable, and Cassandra are being called column-stores with increasing frequency, due to their ability to store and access column families separately. This makes them appear to be in the same category as column-stores such as Sybase IQ, C-Store, Vertica, VectorWise, MonetDB, ParAccel, and Infobright, which also are able to access columns separately. Cloud Economics, By The Square Foot by Rich Miller. But cloud computing offers a middle path, offering cost and usability advantages for customers, as well as an attractive return for providers. PostgreSQL: meet your queue by Theo Schlossnagle . I really think that cueing your database to publish over AMQP is the bees knees and it turns out I wasn't alone! Scali
5 0.80253065 723 high scalability-2009-10-16-Paper: Scaling Online Social Networks without Pains
Introduction: We saw in Why are Facebook, Digg, and Twitter so hard to scale? scaling social networks is a lot harder than you might think. This paper, Scaling Online Social Networks without Pains , from a team at Telefonica Research in Spain hopes to meet the challenge of status distribution, user generated content distribution, and managing the social graph through a technique they call One-Hop Replication (OHR). OHR abstracts and delegates the complexity of scaling up from the social network application . The abstract: Online Social Networks (OSN) face serious scalability challenges due to their rapid growth and popularity. To address this issue we present a novel approach to scale up OSN called One Hop Replication (OHR). Our system combines partitioning and replication in a middleware to transparently scale up a centralized OSN design, and therefore, avoid the OSN application to undergo the costly transition to a fully distributed system to meet its scalability needs. OHR exploits some
7 0.73278737 183 high scalability-2007-12-12-Report from OpenSocial Meetup at Google
8 0.70399559 846 high scalability-2010-06-22-Sponsored Post: Jobs: Etsy, Digg, Huffington Post Event: Velocity Conference
9 0.70021057 873 high scalability-2010-08-06-Hot Scalability Links for Aug 6, 2010
10 0.63316792 677 high scalability-2009-08-09-NoSQL: If Only It Was That Easy
11 0.62108117 835 high scalability-2010-06-03-Hot Scalability Links for June 3, 2010
12 0.61683965 1094 high scalability-2011-08-08-Tagged Architecture - Scaling to 100 Million Users, 1000 Servers, and 5 Billion Page Views
13 0.6142714 1057 high scalability-2011-06-10-Stuff The Internet Says On Scalability For June 10, 2011
14 0.60777396 519 high scalability-2009-02-23-Database Sharding at Netlog, with MySQL and PHP
15 0.6040197 753 high scalability-2009-12-21-Hot Holiday Scalability Links for 2009
16 0.5993495 755 high scalability-2009-12-28-Zynga Needs a Server-side Systems Engineer
17 0.58978152 707 high scalability-2009-09-17-Hot Links for 2009-9-17
18 0.58744115 883 high scalability-2010-08-20-Hot Scalability Links For Aug 20, 2010
19 0.58609539 1158 high scalability-2011-12-16-Stuff The Internet Says On Scalability For December 16, 2011
20 0.58560276 1115 high scalability-2011-09-14-Big List of Scalabilty Conferences
topicId topicWeight
[(1, 0.165), (2, 0.212), (3, 0.131), (10, 0.035), (30, 0.016), (40, 0.024), (42, 0.018), (56, 0.041), (61, 0.097), (77, 0.018), (79, 0.073), (85, 0.06), (94, 0.048)]
simIndex simValue blogId blogTitle
1 0.95418143 1178 high scalability-2012-01-20-Stuff The Internet Says On Scalability For January 20, 2012
Introduction: If you’ve got the time, we’ve got the HighScalability: Google+: 90 million users ; Internet 2011 : 2.1 billion Internet users, 1 trillion YouTube views, 5.9 billion mobile subscriptions; Fusion-io: One Billion IOPS ; 12 atoms: size of IBM's new memory bit ; 32 Million: Stack monthly visitors ; Gmail: 350 Million Users ; TimTebow: 1.5 million Tweets Quotable Quotes: Similarity : There is no canonical schema anymore. Instead you should ask: What high-volume queries will I need to serve with my data? Then work backwards from there. @kvirjee : Dis/Agree? -- "there is no problem but scalability, and architecture is its solution" @robpegoraro : Eternal vigilance can be crowdsourced. Didn't Bill Gates say once that 48 bits would always be enough for an ID? Well, Oracle ran out of bits: Fundamental Oracle flaw revealed . 64 bits, that's the ticket, ipv6 went 128 bits. The day Kodak died : We developed the world's first consumer digital camera bu
same-blog 2 0.94543898 811 high scalability-2010-04-16-Hot Scalability Links for April 16, 2010
Introduction: Twitter gets a total of 3 billion requests a day via its API ; 105,779,710 registered users; 300,000 new registered users a day; 180 million unique visitors a month; 55 million tweets a day. Who has the most servers? Google 1 million+; Intel 100K; 1&1 Internet 70K; Facebook 30K; Akamai 61K; Rackspace 56k+. Cloud Computing Economies of Scale . James Hamilton gives a fabulous talk breaking down where the costs are in the cloud. It's not where you may think. Higher utilization is the key. More here . Erlang Factory: Andy Gross: Distributed Erlang Systems In Operation: Patterns and Pitfalls by Martin J. Logan. Great overview of architecting distributed systems in Erlang. Covers what you want and don't want in a distributed system and how to compromise those elements, what's common, system design, cluster membership, load balancing, upgrades, debugging, and more. Extreme Scale Computing by Irving Wladawsky-Berger . “An exascale supercomputer capable of a million tr
3 0.94239408 926 high scalability-2010-10-24-Hot Scalability Links For Oct 24, 2010
Introduction: On a cold and rainy Fall day, a day stolen from winter rather than our usual gorgeous Indian Summers , a day not even the SF Giants winning the pennant can help warm, here are some hot links to read by a digital flame: Using MySQL as a NoSQL - A story for exceeding 750,000 qps on a commodity server by Yoshinori Matsunobu. Wonderfully detailed post on how you can lookup a row by ID really fast if you bypass all the typical MySQL query parsing overhead. Minecraftwiki.net and minecraftforum.net now serve more traffic than Slashdot and Stackoverflow! 1 million pageviews and 100k uniques per day, per site; 10TB of bandwidth a month; 4+ machines running Varnish, HAProxy, PHP, MySQL, Nginx. Stuff the Internet Says: @ old_sound : Somebody make me a t-shirt that says "I've read the CAP theorem and I liked it" @dscape : How relevant do I think the CAP theorem is? Not at all. I honestly hate conversations where anyone talks about crap.. cap, sorry. @humidbei
4 0.92865145 1194 high scalability-2012-02-16-A Super Short on the Youporn Stack - 300K QPS and 100 Million Page Views Per Day
Introduction: Eric Pickup from Youporn.com posted on a news group that Youporn is now 100% Redis based and will soon be revealing more about their architecture at the ConFoo conference . Some stunning, but not surprising numbers were revealed: 100 million page views per day A cluster of Redis slaves are handling over 300k queries per second. Some additional nuggets: Additional Redis nodes were added because the network cards couldn't keep up with Redis. Impressed with Redis' performance. All reads come from Redis; we are maintaining MySQL just to allow us to build new sorted sets as our requirement change Most data is found in hashes with ordered sets used to know what data to show. A typical lookup would be an zInterStore on: videos:filters:released, Videos:filters:orientation:straight,Videos:filters:categories:{category_id}, Videos:ordering:rating Then perform a zRange to get the pages we want and get the list of video_ids back. Then start a pipeline and get
5 0.92740899 790 high scalability-2010-03-09-Applications as Virtual States
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. As I was writing an article on the architecture of the Storm Botnet , I couldn't help but notice the deep similarity of how Storm works and changes we're seeing in the evolution of political systems. In particular, the rise of the virtual-state . As crazy as this may sound, I think this is also the direction applications will need follow to survive in a complex world of billions of compute devices. You may have already heard of virtual corporations . Virtual corporations are companies with limited office space, a distributed workforce, and production facilities located wherever it is profitable to locate them. The idea is to stay lean and compete using the rapid development and introduction of new products into high value-added markets . If you spot a market opportunity with a small time window, building your own factories and hiring and engine
6 0.91717726 428 high scalability-2008-10-24-11 Secrets of a Cloud Scale Consultant That They Dont' Want You to Know
8 0.91066623 1231 high scalability-2012-04-20-Stuff The Internet Says On Scalability For April 20, 2012
10 0.90852481 149 high scalability-2007-11-12-Scaling Using Cache Farms and Read Pooling
11 0.90419286 998 high scalability-2011-03-03-Stack Overflow Architecture Update - Now at 95 Million Page Views a Month
12 0.90379912 106 high scalability-2007-10-02-Secrets to Fotolog's Scaling Success
13 0.90162051 1565 high scalability-2013-12-16-22 Recommendations for Building Effective High Traffic Web Software
14 0.90159452 1537 high scalability-2013-10-25-Stuff The Internet Says On Scalability For October 25th, 2013
15 0.90140915 711 high scalability-2009-09-22-How Ravelry Scales to 10 Million Requests Using Rails
17 0.90119791 954 high scalability-2010-12-06-What the heck are you actually using NoSQL for?
18 0.90057403 808 high scalability-2010-04-12-Poppen.de Architecture
20 0.89835876 1322 high scalability-2012-09-14-Stuff The Internet Says On Scalability For September 14, 2012